Re: [PR] GH-1067: Close cached HDFS FileSystem instances [arrow-java]
jbonofre commented on PR #1141: URL: https://github.com/apache/arrow-java/pull/1141#issuecomment-4417952244 @xborder I fixed the CI on main. Can you please rebase? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] GH-1067: Close cached HDFS FileSystem instances [arrow-java]
github-actions[bot] commented on PR #1141: URL: https://github.com/apache/arrow-java/pull/1141#issuecomment-4397547998 Thank you for opening a pull request! Please label the PR with one or more of: - bug-fix - chore - dependencies - documentation - enhancement Also, add the 'breaking-change' label if appropriate. See [CONTRIBUTING.md](https://github.com/apache/arrow-java/blob/main/CONTRIBUTING.md) for details. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
[PR] GH-1067: Close cached HDFS FileSystem instances [arrow-java]
xborder opened a new pull request, #1141: URL: https://github.com/apache/arrow-java/pull/1141 ## What's Changed - This PR fixes JVM shutdown hangs after reading HDFS datasets through Arrow Java. - FileSystemDatasetFactory now tracks hdfs:// URIs used to create the factory. On close(), after releasing the native dataset factory, it best-effort closes the matching Hadoop FileSystem instances. - The Hadoop cleanup is done via reflection so Arrow Java does not add a production dependency on Hadoop. Non-HDFS URIs are ignored. Closes #1067 . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
