[ 
https://issues.apache.org/jira/browse/BEAM-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801223#comment-16801223
 ] 

Robert Burke commented on BEAM-6903:
------------------------------------

The error:

2019/03/25 06:04:12 Test flatten:flatten failed: googleapi: Error 429: Quota 
exceeded for quota metric 'dataflow.googleapis.com/create_requests' and limit 
'CreateRequestsPerMinutePerUser' of service 'dataflow.googleapis.com' for 
consumer 'project_number:************'., rateLimitExceeded


This means that we're hitting our quota with the dataflow service. Anything 
also running against dataflow would be running into this issue. 

The Go SDK doesn't run that many jobs (granted it's ~7 simultaneously), and 
runs on the periodic post-commit unless manually. The only options are to 
somehow get our quota with dataflow increased, or changing the Go SDK 
integration test driver code to add a pause between sending job requests, to 
reduce the rate. This would naturally increase test run time.

Assigning to Jason for triage, and possibly increasing our simultaneous job 
quota. Let me know if adding the wait is desired.

> Go IT fails on quota issues frequently
> --------------------------------------
>
>                 Key: BEAM-6903
>                 URL: https://issues.apache.org/jira/browse/BEAM-6903
>             Project: Beam
>          Issue Type: Bug
>          Components: test-failures
>            Reporter: Boyuan Zhang
>            Assignee: Jason Kuster
>            Priority: Major
>
> https://builds.apache.org/job/beam_PostCommit_Go/3002/
> https://builds.apache.org/job/beam_PostCommit_Go/3000/
> https://builds.apache.org/job/beam_PostCommit_Go/2997/
> https://builds.apache.org/job/beam_PostCommit_Go/2993/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to