holdenk opened a new pull request #29179: URL: https://github.com/apache/spark/pull/29179
This is a work in progress pull request for the purpose of discussing the best path forward. I believe our options are: - Something like this where we re-implement much of the standard file discovery mechanism - Exposing a trait to do the directory listing as a developer API and allowing folks to mix it in to their file sources when they wish to avoid locality or do parallel discovery - Expose the parallel listing utils class as a developer API but no trait - Do nothing ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
