chamikaramj commented on pull request #13235: URL: https://github.com/apache/beam/pull/13235#issuecomment-721280059
Yeah, the error fix was included in Beam 2.24.0. So newer versions should better resurface errors. I don't think rows > 10MB errors will result in quota errors or rate limit errors so they should be resurfaced as errors logs after Beam 2.24.0. Can you (or user) try a pipeline with latest Beam version ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org