xuang7 commented on issue #5144:
URL: https://github.com/apache/texera/issues/5144#issuecomment-4513603832
Thanks for the report. I tried to follow your steps to reproduce, but in my
local environment, uploading a 100GB file succeeded. Could you provide a bit
more information to help us narrow this down?
1. Does the failure only happen with 100GB+ files, or does it also happen
with smaller files?
Could you try uploading 1GB, 10GB, and 50GB files to the same dataset and
let us know whether each one succeeds?
2. Could you also try a few different upload configurations, such as
different part sizes, and see whether the issue still occurs?
3. For the timeout errors, do all multipart-upload requests eventually time
out, or only some specific parts?
4. Around the time of the failure, could you share the relevant lines from
`file-service/log/file-service.log`, especially anything mentioning
`multipart-upload`, `uploadPart`, exceptions, or `idleTimeout`?
Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
