drexler-sky opened a new pull request, #1992:
URL: https://github.com/apache/datafusion-comet/pull/1992

   
   
   ## Which issue does this PR close?
   
   <!--
   We generally require a GitHub issue to be filed for all bug fixes and 
enhancements and this helps us generate change logs for our releases. You can 
link an issue to this PR using the GitHub syntax. For example `Closes #123` 
indicates that this PR will close issue #123.
   -->
   
   Closes #.
   
   ## Rationale for this change
   
   This PR adds support for Approach 2 (JNI-based Hadoop FileSystem access) to 
enable S3 reads via the native DataFusion Parquet scanner. The original 
discussion of both approaches can be found in [issue 
#1766](https://github.com/apache/datafusion-comet/issues/1766).
   
   ## What changes are included in this PR?
   
   Added JNI-based integration for accessing Hadoop FileSystem in Comet
   
   Introduced a new config flag: `spark.comet.use_jni_object_store` to toggle 
this feature
   
   ## How are these changes tested?
   
   new test
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to