Yicong-Huang commented on issue #5144: URL: https://github.com/apache/texera/issues/5144#issuecomment-4521215445
I did not know we can support or are supporting 200GB files! that's great. My two cents: 1. does lakefs have this kind of issues reported? if it is a bug from their side, we should not be the first to encounter it. 2. as @xuang7 cannot reproduce it, it might be related to OS/env. For instance, some OS have limited on file IO system calls, and if the 100GB file is cut into small chunks, it may have different threshold depending on the OS. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
