[
https://issues.apache.org/jira/browse/BEAM-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801223#comment-16801223
]
Robert Burke commented on BEAM-6903:
------------------------------------
The error:
2019/03/25 06:04:12 Test flatten:flatten failed: googleapi: Error 429: Quota
exceeded for quota metric 'dataflow.googleapis.com/create_requests' and limit
'CreateRequestsPerMinutePerUser' of service 'dataflow.googleapis.com' for
consumer 'project_number:************'., rateLimitExceeded
This means that we're hitting our quota with the dataflow service. Anything
also running against dataflow would be running into this issue.
The Go SDK doesn't run that many jobs (granted it's ~7 simultaneously), and
runs on the periodic post-commit unless manually. The only options are to
somehow get our quota with dataflow increased, or changing the Go SDK
integration test driver code to add a pause between sending job requests, to
reduce the rate. This would naturally increase test run time.
Assigning to Jason for triage, and possibly increasing our simultaneous job
quota. Let me know if adding the wait is desired.
> Go IT fails on quota issues frequently
> --------------------------------------
>
> Key: BEAM-6903
> URL: https://issues.apache.org/jira/browse/BEAM-6903
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Boyuan Zhang
> Assignee: Jason Kuster
> Priority: Major
>
> https://builds.apache.org/job/beam_PostCommit_Go/3002/
> https://builds.apache.org/job/beam_PostCommit_Go/3000/
> https://builds.apache.org/job/beam_PostCommit_Go/2997/
> https://builds.apache.org/job/beam_PostCommit_Go/2993/
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
