[
https://issues.apache.org/jira/browse/BEAM-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Goenka updated BEAM-5041:
-------------------------------
Description:
Java Sdk Harness used pCollections to keep track of computed consumers
[here|[https://github.com/apache/beam/blob/ff95a82e461bd8319d9733be60e75992ba90cd7c/sdks/java/harness/src/main/java/org/apache/beam/fn/harness/control/ProcessBundleHandler.java#L158]
] . This is incorrect as consumers are based on pTransforms so pTransforms
should be used to keep track of computed processors.
In case of Flatten, this creates an issue where pTransforms having same input
as that to flatten are not executed. This causes
[https://github.com/apache/beam/blob/ff95a82e461bd8319d9733be60e75992ba90cd7c/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java#L316]
to fail.
was:
Java Sdk Harness used pCollections to keep track of computed consumers [here|
https://github.com/apache/beam/blob/ff95a82e461bd8319d9733be60e75992ba90cd7c/sdks/java/harness/src/main/java/org/apache/beam/fn/harness/control/ProcessBundleHandler.java#L158
] . This is incorrect as consumers are based on pTransforms so pTransforms
should be used to keep track of computed processors.
In case of Flatten, this creates an issue where pTransforms having same input
as that to flatten are not executed. This causes
[https://github.com/apache/beam/blob/ff95a82e461bd8319d9733be60e75992ba90cd7c/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java#L316]
to fail.
> Java Fn SDK Harness skips unprocessed pCollections
> --------------------------------------------------
>
> Key: BEAM-5041
> URL: https://issues.apache.org/jira/browse/BEAM-5041
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-harness
> Reporter: Ankur Goenka
> Assignee: Ankur Goenka
> Priority: Major
>
> Java Sdk Harness used pCollections to keep track of computed consumers
> [here|[https://github.com/apache/beam/blob/ff95a82e461bd8319d9733be60e75992ba90cd7c/sdks/java/harness/src/main/java/org/apache/beam/fn/harness/control/ProcessBundleHandler.java#L158]
> ] . This is incorrect as consumers are based on pTransforms so pTransforms
> should be used to keep track of computed processors.
> In case of Flatten, this creates an issue where pTransforms having same input
> as that to flatten are not executed. This causes
> [https://github.com/apache/beam/blob/ff95a82e461bd8319d9733be60e75992ba90cd7c/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java#L316]
> to fail.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
