[
https://issues.apache.org/jira/browse/BEAM-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16715506#comment-16715506
]
Lukasz Gajowy commented on BEAM-6203:
-------------------------------------
It definitely should be (that was an oversight). Delegating this to a person
that is working on this. Could you suggest how many workers at most can we use
for such job (not to starve the other jobs)?
> Load test for dataflow caused other tests to fail due to lack of quota
> ----------------------------------------------------------------------
>
> Key: BEAM-6203
> URL: https://issues.apache.org/jira/browse/BEAM-6203
> Project: Beam
> Issue Type: Bug
> Components: build-system
> Affects Versions: 2.10.0
> Reporter: Alan Myrvold
> Assignee: Lukasz Gajowy
> Priority: Major
>
> On Dec 10, tests of dataflow pipelines were failing. Console logs showed lack
> of quota:
> Workflow failed. Causes: Project apache-beam-testing has insufficient
> quota(s) to execute this workflow with 1 instances in region us-central1.
> Quota summary (required/available): 1/6987 instances, 1/0 CPUs, 250/69951
> disk GB, 0/4046 SSD disk GB, 1/293 instance groups, 1/293 managed instance
> groups, 1/268 instance templates, 1/241 in-use IP addresses.
> At the same time, the loadtestoptions-jenkins-1210161627-d0e49a84 job was
> running, and requested 1000 workers, and got 498 max. It ran for 1hr 21min.
> Could this job be reduced in scope or limited in the number of dataflow
> workers?
> https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-10_08_16_32-12840883456333022524?project=apache-beam-testing
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
