Scott Wegner created BEAM-4630:
----------------------------------
Summary: Dataflow tests failing due to quota issues
Key: BEAM-4630
URL: https://issues.apache.org/jira/browse/BEAM-4630
Project: Beam
Issue Type: Bug
Components: runner-dataflow, testing
Reporter: Scott Wegner
Assignee: Thomas Groh
In the last few days, we've seen a number to pre-commit and post-commit runs
fail on Dataflow tests due to quota issues. For example
([jenkins|https://builds.apache.org/job/beam_PreCommit_Java_GradleBuild/6785/],
[gradle|https://scans.gradle.com/s/ouxnqbymallzi/tests/ubfk4psvvdijy-brhdrcaeda7dm]):
{{:beam-runners-google-cloud-dataflow-java:validatesRunnerTestorg.apache.beam.sdk.transforms.CombineTest$WindowingTests
» testGlobalCombineWithDefaultsAndTriggers}}
{{Failed to create a workflow job: (e5d646c7d1a09997): The workflow could not
be created. Causes: (999cdad46bde76aa): Dataflow quota error for
jobs-per-project quota. Project apache-beam-testing is running 50 jobs. Please
check the quota usage via GCP Console. If it exceeds the limit, please wait for
a workflow to finish or contact dataflow-feedb...@google.com to request an
increase in quota. If it does not, contact dataflow-feedb...@google.com.}}
We should disable these tests for now, and work on either increasing Dataflow
quota, or reducing parallelism.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
