Ismaël Mejía created BEAM-3589:
----------------------------------
Summary: Flink runner breaks with ClassCastException on
UnboundedSource
Key: BEAM-3589
URL: https://issues.apache.org/jira/browse/BEAM-3589
Project: Beam
Issue Type: Bug
Components: runner-flink
Affects Versions: 2.3.0
Reporter: Ismaël Mejía
When you execute a pipeline tha uses an unbounded source and an empty transform
it produces a ClassCastException:
{quote}[WARNING]
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:294)
at java.lang.Thread.run (Thread.java:748)
Caused by: java.lang.ClassCastException:
org.apache.beam.runners.core.construction.AutoValue_PTransformTranslation_UnknownRawPTransform
cannot be cast to org.apache.beam.sdk.io.Read$Unbounded
at
org.apache.beam.runners.flink.FlinkStreamingTransformTranslators$ReadSourceTranslator.translateNode
(FlinkStreamingTransformTranslators.java:256)
at
org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.applyStreamingTransform
(FlinkStreamingPipelineTranslator.java:139)
at
org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.visitPrimitiveTransform
(FlinkStreamingPipelineTranslator.java:118)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
(TransformHierarchy.java:670)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
(TransformHierarchy.java:647)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
(TransformHierarchy.java:623)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
(TransformHierarchy.java:623)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
(TransformHierarchy.java:647)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
(TransformHierarchy.java:662)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600
(TransformHierarchy.java:311)
at org.apache.beam.sdk.runners.TransformHierarchy.visit
(TransformHierarchy.java:245)
at org.apache.beam.sdk.Pipeline.traverseTopologically (Pipeline.java:458)
at org.apache.beam.runners.flink.FlinkPipelineTranslator.translate
(FlinkPipelineTranslator.java:38)
at org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.translate
(FlinkStreamingPipelineTranslator.java:70)
at
org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.translate
(FlinkPipelineExecutionEnvironment.java:113)
at org.apache.beam.runners.flink.FlinkRunner.run (FlinkRunner.java:110)
at org.apache.beam.sdk.Pipeline.run (Pipeline.java:311)
at org.apache.beam.sdk.Pipeline.run (Pipeline.java:297)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run
(NexmarkLauncher.java:1139)
at org.apache.beam.sdk.nexmark.Main.runAll (Main.java:69)
at org.apache.beam.sdk.nexmark.Main.main (Main.java:301)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:294)
at java.lang.Thread.run (Thread.java:748)
{quote}
You can reproduce it quickly by running this command from the nexmark directory:
{quote}mvn exec:java -Dexec.mainClass=org.apache.beam.sdk.nexmark.Main
-Pflink-runner "-Dexec.args=--runner=FlinkRunner --query=2 --streaming=true
--manageResources=false --monitorJobs=true"
{quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
