dwsmith1983 commented on issue #7455: URL: https://github.com/apache/datafusion-comet/issues/7455#issuecomment-6733679712
`fs.s3a.encryption.context` is new in Hadoop 3.5.0; 3.4.1 and 3.4.2 don't declare it, so only the spark-4.2 profile reaches it. The pairing PR will classify it. I plan to exempt it next to the CSE entries: the native Delta scan only reads, native code never reads the key, and Hadoop sends the context only on writes. For the malformed value you found, I'll add a test that it fails in S3A setup on the driver, before the native scan, so Comet fails where Spark does. If it doesn't, the key goes into `AllS3ConfigKeys` instead. The SSE-C and CSE declines stay, and I'll check it against #7026. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
