DanielMorales9 commented on issue #32746: URL: https://github.com/apache/beam/issues/32746#issuecomment-2407030425
> Hmmm, for streaming mode there should be one RecordWriterManager per bundle so I don't think there should be multiple threads trying to access one instance. Strange, because I can see threads writing multiple files with few rows. <img width="1374" alt="Screenshot 2024-10-11 at 11 29 57" src="https://github.com/user-attachments/assets/dc22e1c6-c7a8-4984-b0e1-950ea2f7a947";> > Can you check if you have any logs for "Encountered an error when closing data writer..." (line 118)? I do not have any errors when closing writers. > P.S. are you running at Beam HEAD? We recently merged a change that adds a static table cache (https://github.com/apache/beam/pull/32686), so it should be loaded only once per RecordWriterManager I am running version 2.59.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
