Yichi Zhang created BEAM-11066:
----------------------------------
Summary: Java wordcount example throw exception on dataflow runner
with streaming beam_fn_api
Key: BEAM-11066
URL: https://issues.apache.org/jira/browse/BEAM-11066
Project: Beam
Issue Type: New Feature
Components: examples-java
Reporter: Yichi Zhang
Looks like the TextIO.write() is not properly writing windowed output in
streaming mode.
{{Exception in thread "main" java.lang.IllegalStateException: Found nodes that
matched overrides. Matches:
\{Node{fullName=WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values}=[PTransformOverride\{matcher=EqualClassPTransformMatcher{class=class
org.apache.beam.sdk.transforms.Create$Values},
overrideFactory=org.apache.beam.runners.dataflow.DataflowRunner$StreamingFnApiCreateOverrideFactory@62923ee6}]}
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkState(Preconditions.java:588)
at
org.apache.beam.sdk.Pipeline$1.leaveCompositeTransform(Pipeline.java:237)
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:661)
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:317)
at
org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:251)
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:463)
at org.apache.beam.sdk.Pipeline.checkNoMoreMatches(Pipeline.java:218)
at org.apache.beam.sdk.Pipeline.replaceAll(Pipeline.java:214)
at
org.apache.beam.runners.dataflow.DataflowRunner.replaceTransforms(DataflowRunner.java:1180)
at
org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:871)
at
org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:192)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:317)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:303)
at org.apache.beam.examples.WordCount.runWordCount(WordCount.java:185)
at org.apache.beam.examples.WordCount.main(WordCount.java:192)}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
