[Feature]: Upload large files in chunks #1674
Replies: 19 comments 22 replies
-
It probably can't hurt to add the chunking, but I think issues like this should generally be solved on the proxy side. As for watching a folder, we're planning to add an option for that to the cli. |
Beta Was this translation helpful? Give feedback.
-
I think this has extra benefits besides just the reverse proxy side of things. If we have this, then uploading large files on slow or unstable connections would mean they could be resumed later rather than the entire upload failing. Temporary files could be kept around for a configurable amount of time and if the file continues to be uploaded, negotiation between client and server could be handled so that the client resumes from where it was before. |
Beta Was this translation helpful? Give feedback.
-
For reliable upload we could implement the tus protocol https://tus.io/ |
Beta Was this translation helpful? Give feedback.
-
Additionally, chunked uploading would solve an issue for Cloudflare users. |
Beta Was this translation helpful? Give feedback.
This comment was marked as off-topic.
This comment was marked as off-topic.
-
Version 1.52.0 has my PR: #2101 This solves the CloudFlare tunnel problem for me. I can upload ~ 200 MB files now. |
Beta Was this translation helpful? Give feedback.
-
Any update if we can get chunking working via web? The current solution for mobile which uses |
Beta Was this translation helpful? Give feedback.
-
Would love to see proper chunked upload since my reverse proxy server is memory/space limited. This means that without chunking, a 400MB file will simply over-utilize the resources of the server, leading to crashes. |
Beta Was this translation helpful? Give feedback.
-
Chunking would also allow the use of cloudflare tunnels |
Beta Was this translation helpful? Give feedback.
-
+1 for chunking. |
Beta Was this translation helpful? Give feedback.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
-
Eventually this could be implemented by integrating tusd. It would also support pausing and resuming uploads. |
Beta Was this translation helpful? Give feedback.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
-
Folks, if you don't have anything new to add please just upvote the original request. |
Beta Was this translation helpful? Give feedback.
-
I gave Bonus: uppy.io natively supports @alextran1502 What's your take on potential future PR here? |
Beta Was this translation helpful? Give feedback.
-
I'm sorry, do I understand correctly that there is still no solution to this problem? And yes, I'm another cloudflare user. |
Beta Was this translation helpful? Give feedback.
-
A work around is to use the cloudflare wrap app on devices and connect directly to the private ips. |
Beta Was this translation helpful? Give feedback.
-
Feature detail
Currently, uploading is done in a very simple way: upload the whole file directly to the server. However, some users may have limits on their reverse proxy preventing uploading such files.
Uploading in chunks (like LibrePhotos does for exemple) would allow bypassing this problem.
With immich not being able to scan local folders, I think this feature might be needed.
Platform
Server
Beta Was this translation helpful? Give feedback.
All reactions