[
https://issues.apache.org/jira/browse/BEAM-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17122787#comment-17122787
]
Beam JIRA Bot commented on BEAM-7497:
-------------------------------------
This issue is P2 but has been unassigned without any comment for 60 days so it
has been labeled "stale-P2". If this issue is still affecting you, we care!
Please comment and remove the label. Otherwise, in 14 days the issue will be
moved to P3.
Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed
explanation of what these priorities mean.
> SyntheticSource option forceNumInitialBundles is not optional in all cases
> --------------------------------------------------------------------------
>
> Key: BEAM-7497
> URL: https://issues.apache.org/jira/browse/BEAM-7497
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Kasia Kucharczyk
> Priority: P2
> Labels: stale-P2
>
> It fails when numRecords is between 1 and 3.
> I noticed it by running SyntheticDataPublisher:
> {code:java}
> ./gradlew :beam-sdks-java-load-tests:run
> -PloadTest.args='--pubSubTopic=projects/apache-beam-io-testing/topics/loadtests
> --sourceOptions={"numRecords":2}'
> -PloadTest.mainClass="org.apache.beam.sdk.loadtests.SyntheticDataPublisher"{code}
>
> The exception:
>
> {code:java}
> Exception in thread "main" java.lang.OutOfMemoryError: Requested array size
> exceeds VM limit
> at
> org.apache.beam.sdk.io.synthetic.BundleSplitter.getRelativeBundleSizes(BundleSplitter.java:60)
> at
> org.apache.beam.sdk.io.synthetic.BundleSplitter.getBundleSizes(BundleSplitter.java:39)
> at
> org.apache.beam.sdk.io.synthetic.SyntheticBoundedSource.split(SyntheticBoundedSource.java:146)
> at
> org.apache.beam.runners.direct.BoundedReadEvaluatorFactory$InputProvider.getInitialInputs(BoundedReadEvaluatorFactory.java:214)
> at
> org.apache.beam.runners.direct.ReadEvaluatorFactory$InputProvider.getInitialInputs(ReadEvaluatorFactory.java:89)
> at
> org.apache.beam.runners.direct.RootProviderRegistry.getInitialInputs(RootProviderRegistry.java:76)
> at
> org.apache.beam.runners.direct.ExecutorServiceParallelExecutor.start(ExecutorServiceParallelExecutor.java:155)
> at
> org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:208)
> at
> org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:67)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)
> at
> org.apache.beam.sdk.loadtests.SyntheticDataPublisher.main(SyntheticDataPublisher.java:150)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
