thisisnic commented on issue #50009: URL: https://github.com/apache/arrow/issues/50009#issuecomment-4555014611
Thanks for reporting this @jwijffels! A few questions for you to help us pin this down: 1. How are you authenticating to S3? e.g. instance role, env vars etc. This might be a credential expiry issue (still would need fixing in Arrow but helps us narrow it down) 2. Does the `write_parquet()` actually succeed despite the segfault? 3. Is the bulk of the time before or after the `write_parquet()` in the long jobs that drop out? 4. Is 42 mins a hard cutoff or exact? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
