FYI, we've seen a number of pre-commit and post-commit failures this week
due to Dataflow quota issues. For example [1][2]:

:beam-runners-google-cloud-dataflow-java:validatesRunnerTestorg.apache.beam.sdk.transforms.CombineTest$WindowingTests
ยป testGlobalCombineWithDefaultsAndTriggers

Failed to create a workflow job: (e5d646c7d1a09997): The workflow could not
be created. Causes: (999cdad46bde76aa): Dataflow quota error for
jobs-per-project quota. Project apache-beam-testing is running 50 jobs.
Please check the quota usage via GCP Console. If it exceeds the limit,
please wait for a workflow to finish or contact [email protected]
to request an increase in quota. If it does not, contact
[email protected].

I've opened BEAM-4630 [3] to track. We should disable these tests for now,
and work on either increasing Dataflow quota, or reducing parallelism.

[1] https://builds.apache.org/job/beam_PreCommit_Java_GradleBuild/6785/
[2]
https://scans.gradle.com/s/ouxnqbymallzi/tests/ubfk4psvvdijy-brhdrcaeda7dm
[3] https://issues.apache.org/jira/browse/BEAM-4630

Reply via email to