bvolpato opened a new pull request, #40858: URL: https://github.com/apache/beam/pull/40858
The 1 TB BigQuery read takes about 2h22 in the Dataflow V2 integration reports ([example](https://github.com/apache/beam/actions/runs/40570409932)). It currently runs as part of the suite scheduled every eight hours. Run that case unchanged in a dedicated daily V2 scale job. Keep the other BigQuery read cases in the regular suite and retain the existing explicit CI triggers for running both lanes. The tradeoff is daily rather than eight-hour feedback for the 1 TB case. Validated the actual Gradle task graph and test selection with `--test-dry-run`, plus workflow syntax. The two tasks retain the same V2 options, SDK build dependencies, classpath, and cleanup. The test input and row-count assertion are unchanged. No Dataflow jobs or SDK images were published during local validation. <!-- Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). - [x] Replace these instructions with a description of your change and why you have made it. - [ ] Mention the appropriate issue in your description (for example: `addresses #123` or `fixes #456`). - [ ] Update `CHANGES.md` with noteworthy changes. See [CONTRIBUTING.md]() for more details. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
