thisisnic commented on issue #50009: URL: https://github.com/apache/arrow/issues/50009#issuecomment-4562211123
> Not sure where this installSigPipeHandler should be set Me neither! I could get AI to look at it, but it does it for the whole R process and I need to seek some human advice on whether this is potentially problematic or not. > If there is a workaround to avoid this crash by explicitely calling some kind of S3 finalizer It's a tricky one as the S3 finaliser finalises the whole session (the AWS SDK is weird like that) so you could call an Arrow internal function (I think it's like `arrow:::s3_finalise()` or similarly named) after `read_parquet()` but I think `write_parquet()` to S3 wouldn't work later then unless you started a new R session (though that might be a more desirable workaround?) AWS did update their SDK guidance about this since we first implemented this: https://github.com/aws/aws-sdk-cpp/issues/2323 @pitrou - do you have any advice on what might be a good path forward here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
