Abacn commented on PR #37036: URL: https://github.com/apache/beam/pull/37036#issuecomment-4283741929
Sorry for the delay. It's surprising if Flink runner (classic) doesn't support Bounded or Unbounded read. Took a look again, it's more likely due to environment setup or dependency issues. The PrimitiveUnboundedRead and PrimitiveBoundedRead should have translator registered here https://github.com/apache/beam/blob/25370f50b39f2703ee1a15780b76fa52464fc581/sdks/java/core/src/main/java/org/apache/beam/sdk/util/construction/ReadTranslation.java#L208 I'm able to reproduce the error ``` Exception in thread "main" java.lang.IllegalStateException: No translator known for org.apache.beam.sdk.util.construction.SplittableParDo$PrimitiveUnboundedRead at org.apache.beam.sdk.util.construction.PTransformTranslation.urnForTransform(PTransformTranslation.java:315) at org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.visitPrimitiveTransform(FlinkStreamingPipelineTranslator.java:135) at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:593) ``` if I comment out the "AutoService" annotation. However, with that annotation and compiled SDK core, my pipeline worked. Are you building a "fat" jar for your submission. If so, please make sure service files are assembled correctly. For example, in Gradle shadow plugin one needs to declare ``` shadowJar { ... mergeServiceFiles() } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
