[
https://issues.apache.org/jira/browse/BEAM-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348400#comment-16348400
]
Grzegorz Kołakowski commented on BEAM-3589:
-------------------------------------------
I believe the issue is fixed in https://issues.apache.org/jira/browse/BEAM-2806
. Here is the corresponding pull request
[https://github.com/apache/beam/pull/4558] .
> Flink runner breaks with ClassCastException on UnboundedSource
> --------------------------------------------------------------
>
> Key: BEAM-3589
> URL: https://issues.apache.org/jira/browse/BEAM-3589
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Affects Versions: 2.3.0
> Reporter: Ismaël Mejía
> Priority: Blocker
>
> When you execute a pipeline tha uses an unbounded source and an empty
> transform it produces a ClassCastException:
> {quote}[WARNING]
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke
> (NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke (Method.java:498)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:294)
> at java.lang.Thread.run (Thread.java:748)
> Caused by: java.lang.ClassCastException:
> org.apache.beam.runners.core.construction.AutoValue_PTransformTranslation_UnknownRawPTransform
> cannot be cast to org.apache.beam.sdk.io.Read$Unbounded
> at
> org.apache.beam.runners.flink.FlinkStreamingTransformTranslators$ReadSourceTranslator.translateNode
> (FlinkStreamingTransformTranslators.java:256)
> at
> org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.applyStreamingTransform
> (FlinkStreamingPipelineTranslator.java:139)
> at
> org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.visitPrimitiveTransform
> (FlinkStreamingPipelineTranslator.java:118)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:670)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:647)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:623)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:623)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:647)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:662)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600
> (TransformHierarchy.java:311)
> at org.apache.beam.sdk.runners.TransformHierarchy.visit
> (TransformHierarchy.java:245)
> at org.apache.beam.sdk.Pipeline.traverseTopologically (Pipeline.java:458)
> at org.apache.beam.runners.flink.FlinkPipelineTranslator.translate
> (FlinkPipelineTranslator.java:38)
> at
> org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.translate
> (FlinkStreamingPipelineTranslator.java:70)
> at
> org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.translate
> (FlinkPipelineExecutionEnvironment.java:113)
> at org.apache.beam.runners.flink.FlinkRunner.run (FlinkRunner.java:110)
> at org.apache.beam.sdk.Pipeline.run (Pipeline.java:311)
> at org.apache.beam.sdk.Pipeline.run (Pipeline.java:297)
> at org.apache.beam.sdk.nexmark.NexmarkLauncher.run
> (NexmarkLauncher.java:1139)
> at org.apache.beam.sdk.nexmark.Main.runAll (Main.java:69)
> at org.apache.beam.sdk.nexmark.Main.main (Main.java:301)
> at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke
> (NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke (Method.java:498)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:294)
> at java.lang.Thread.run (Thread.java:748)
> {quote}
> You can reproduce it quickly by running this command from the nexmark
> directory:
> {quote}mvn exec:java -Dexec.mainClass=org.apache.beam.sdk.nexmark.Main
> -Pflink-runner "-Dexec.args=--runner=FlinkRunner --query=2 --streaming=true
> --manageResources=false --monitorJobs=true"
> {quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
