105 questions
3
votes
1
answer
221
views
Upload a large file to Minio from Minio objects
I have the next case:
Get a certain count of N objects from Minio and create zip archive and upload it zip to Minio as one object.
Problem:
I have many objects, that are up to 40gb in size
I can't ...
- 345
0
votes
0
answers
37
views
How to properly (or at least somehow) use org.apache.hadoop.fs.MultipartUploader?
I have Hadoop in my environment and use it as S3.
My current task is to implement a logic for uploading large file (say, >1Gb) to Hadoop with no buffering, so the data should be streamed into it.
...
- 81
-1
votes
1
answer
59
views
Upload an Excel sheet with huge number of records to a MySql database in the form of a JSON
I have a requirement in Spring Boot project, where I have a huge Excel file with 15-20 sheets, each sheet containing 30,000 rows with an average of 15 columns in each sheet.
My Database is roughly as ...
0
votes
0
answers
129
views
How do I add a large number of files into a Github repository?
I have a folder of code and assets (mostly assets) for a website I'm making that has a lot of files in it. By a lot, I mean literally thousands of files. I want to put the contents of this folder into ...
1
vote
0
answers
103
views
How to upload a big file in chunks using js?
I have to upload multiple files to my flask server for further processing from my webpage.
Html element
<input type="file" class="file-input file-input hidden" multiple>
...
- 46
0
votes
0
answers
101
views
Angular file upload is slower than postman
I have one nodejs API which is taking formdata file as an input and uploads video file into my disk
from postman i am making POST request with 700MB file which is uploading as expected speed
but ...
- 1
0
votes
0
answers
248
views
Files uploaded through s3 multipart upload are not working
I am trying to upload large files to s3 using multipart upload. I am using the aws-sdk v3 for intializing and completing the multipart upload and I am generating presigned urls for every part that can ...
0
votes
0
answers
338
views
How can I setup Django to serve files on a file server?
I am working on a Django website where files are going to be sold. These files can be large in size, up to 5GB. So, I believe that in addition to a VPS for serving the website, I also need to set up a ...
- 63
0
votes
2
answers
1k
views
Efficient Large File Upload(500GB) to Azure Blob Storage from ReactJS UI with FastAPI/Flask Backend
I'm working on a project where I need to upload very large files (approximately 500GB) from a ReactJS front-end to Azure Blob Storage, using a Python-based FastAPI or Flask backend. My goal is to ...
- 31
1
vote
1
answer
67
views
I created a .NET Core 7 application, for pose detection, Not able to load large files
I am getting the following when Trying to upload a video file larger than 15 seconds for a form,
enter image description here
The video model is as follow,
public class VideoUploadViewModel
{
[...
- 13
0
votes
0
answers
2k
views
How to Upload a Large File to MinIO using Python SDK
I'm curious about how to upload large files in chunks using the MinIO Python SDK in a FastAPI backend.
I've implemented chunked uploading using .stream() to the server according to the following
post: ...
0
votes
1
answer
866
views
Import large data in WordPress and show it in form of tables in the frontend
I have around 10 million rows of data, that I am trying to upload in WordPress to show it on a paginated table using Ninja Tables. I have 10 CSV files containing 1 million rows each. Each file is ...
- 31
1
vote
1
answer
2k
views
How to upload large file using Blazor to WebAPI (C#) and store it into Azure Blob storage
I need to upload a large file(up 4GB) using Blazor.
Please in your answers using the new version of Azure Storage SDK (v12 Azure.Storage.Blobs NuGet package.)
In my case, the old version will not work ...
0
votes
1
answer
131
views
Uploading large excel files to Big Query
how can i upload a large excel file and dataset (larger than 10 mb) to big query ?
Can anyone help ?
I tried to research a way to do it, but everything i found was a little bit complicated.
I just ...
2
votes
0
answers
1k
views
Split either csv or xlsx file on file upload into mulitple chunked .csv or .xlsx file using javascript to be received by fastapi
Due to backend filesize limit of 5.5MB of the API, I need to chunk large files (only .csv, .xls,.xlsx) when uploaded into chunks of <= 5MB and send each chunk by calling file upload api. Each chunk ...
- 29