pitrou commented on issue #43604: URL: https://github.com/apache/arrow/issues/43604#issuecomment-2296831985
Ok, I looked a bit into this and it's quite complex. The crash happens at shutdown after the CSV streaming reader was destroyed. Since the streaming reader does some readahead by default (`ReadOptions.use_threads = true`), some read tasks are still running on the thread pool. This is driven by the `ReadaheadGenerator` which doesn't appear to be able to way for cleanup when all references to it are lost. @westonpace -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
