hudi-bot opened a new issue, #15581: URL: https://github.com/apache/hudi/issues/15581
Originally reported at [https://github.com/apache/hudi/issues/7234] ------- Root-cause: Basically, the reason it’s failing is following: # GCS uses PipeInputStream/PipeOutputStream comprising reading/writing ends of the “pipe” it’s using for unidirectional comm b/w Threads # PipeInputStream (for whatever reason) remembers the thread that actually wrote into the pipe # In BoundedInMemoryQueue we’re bootstrapping new executors (read, threads) for reading and _writing_ (it’s only used in HoodieMergeHandle, and in bulk-insert) # When we’re done writing in HoodieMergeHelper, we’re shutting down *first* BIMQ, then the HoodieMergeHandle, and that’s exactly the reason why it’s failing Issue has been introduced at [https://github.com/apache/hudi/pull/4264/files] ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-5238 - Type: Bug - Epic: https://issues.apache.org/jira/browse/HUDI-5425 - Affects version(s): - 0.12.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
