[ https://issues.apache.org/jira/browse/BEAM-4761?focusedWorklogId=124242&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124242 ]
ASF GitHub Bot logged work on BEAM-4761: ---------------------------------------- Author: ASF GitHub Bot Created on: 17/Jul/18 22:43 Start Date: 17/Jul/18 22:43 Worklog Time Spent: 10m Work Description: ThatRfernand commented on issue #5966: [BEAM-4761] Run Nexmark on Dataflow URL: https://github.com/apache/beam/pull/5966#issuecomment-405751879 We can concurrently run up to 100 Dataflow jobs. I've seen a peak of 70 under heavy ValidatesRunner pressure (three of those running concurrently). I think you're safe running < 10 or so. On Tue, Jul 17, 2018 at 3:00 PM Andrew Pilloud <notificati...@github.com> wrote: > @ThatRfernand <https://github.com/ThatRfernand> I've been told you are > the quota expert. This runs one pipeline at a time on Dataflow. How many > concurrent jobs should I cap it at? > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/beam/pull/5966#issuecomment-405742423>, or mute > the thread > <https://github.com/notifications/unsubscribe-auth/ADoySKLE-kAZoISEQXRtryk_bAYf65KHks5uHl6WgaJpZM4VTCm9> > . > ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 124242) Time Spent: 40m (was: 0.5h) > Add postCommit scripts and perfkit dashboards for nexmark on Dataflow runner > ---------------------------------------------------------------------------- > > Key: BEAM-4761 > URL: https://issues.apache.org/jira/browse/BEAM-4761 > Project: Beam > Issue Type: Test > Components: examples-nexmark > Reporter: Etienne Chauchot > Assignee: Andrew Pilloud > Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)