[ https://issues.apache.org/jira/browse/BEAM-5355?focusedWorklogId=167736&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-167736 ]
ASF GitHub Bot logged work on BEAM-5355: ---------------------------------------- Author: ASF GitHub Bot Created on: 20/Nov/18 12:21 Start Date: 20/Nov/18 12:21 Worklog Time Spent: 10m Work Description: lgajowy closed pull request #6987: [BEAM-5355] Prevent creating metrics of the same name multiple times URL: https://github.com/apache/beam/pull/6987 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/sdks/java/testing/load-tests/src/main/java/org/apache/beam/sdk/loadtests/GroupByKeyLoadTest.java b/sdks/java/testing/load-tests/src/main/java/org/apache/beam/sdk/loadtests/GroupByKeyLoadTest.java index fb0bf841107..abd4170f967 100644 --- a/sdks/java/testing/load-tests/src/main/java/org/apache/beam/sdk/loadtests/GroupByKeyLoadTest.java +++ b/sdks/java/testing/load-tests/src/main/java/org/apache/beam/sdk/loadtests/GroupByKeyLoadTest.java @@ -84,11 +84,12 @@ void loadTest() throws IOException { Optional<SyntheticStep> syntheticStep = createStep(options.getStepOptions()); PCollection<KV<byte[], byte[]>> input = - pipeline.apply(SyntheticBoundedIO.readFrom(sourceOptions)); + pipeline + .apply(SyntheticBoundedIO.readFrom(sourceOptions)) + .apply(ParDo.of(new MetricsMonitor(METRICS_NAMESPACE))); for (int branch = 0; branch < options.getFanout(); branch++) { applyStepIfPresent(input, format("Synthetic step (%s)", branch), syntheticStep) - .apply(ParDo.of(new MetricsMonitor(METRICS_NAMESPACE))) .apply(format("Group by key (%s)", branch), GroupByKey.create()) .apply( format("Ungroup and reiterate (%s)", branch), ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 167736) Time Spent: 4h 10m (was: 4h) > Create GroupByKey load test for Java SDK > ---------------------------------------- > > Key: BEAM-5355 > URL: https://issues.apache.org/jira/browse/BEAM-5355 > Project: Beam > Issue Type: Sub-task > Components: testing > Reporter: Lukasz Gajowy > Assignee: Lukasz Gajowy > Priority: Minor > Fix For: Not applicable > > Time Spent: 4h 10m > Remaining Estimate: 0h > > This is more thoroughly described in this proposal: > [https://docs.google.com/document/d/1PuIQv4v06eosKKwT76u7S6IP88AnXhTf870Rcj1AHt4/edit?usp=sharing] > > In short: this ticket is about implementing the GroupByKeyLoadIT that uses > SyntheticStep and Synthetic source to create load on the pipeline. -- This message was sent by Atlassian JIRA (v7.6.3#76005)