Alan Myrvold created BEAM-6203:
----------------------------------

             Summary: Load test for dataflow caused other tests to fail due to 
lack of quota
                 Key: BEAM-6203
                 URL: https://issues.apache.org/jira/browse/BEAM-6203
             Project: Beam
          Issue Type: Bug
          Components: build-system
    Affects Versions: 2.10.0
            Reporter: Alan Myrvold
            Assignee: Lukasz Gajowy


On Dec 10, tests of dataflow pipelines were failing. Console logs showed lack 
of quota:
Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) 
to execute this workflow with 1 instances in region us-central1. Quota summary 
(required/available): 1/6987 instances, 1/0 CPUs, 250/69951 disk GB, 0/4046 SSD 
disk GB, 1/293 instance groups, 1/293 managed instance groups, 1/268 instance 
templates, 1/241 in-use IP addresses.

At the same time, the loadtestoptions-jenkins-1210161627-d0e49a84 job was 
running, and requested 1000 workers, and got 498 max. It ran for 1hr 21min.

Could this job be reduced in scope or limited in the number of dataflow workers?

https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-10_08_16_32-12840883456333022524?project=apache-beam-testing



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to