Hi Colleagues,I have been trying to build and run a Beam FlinkPipelineRunner app in a Flink Cluster for sometime.I followed the bottom procedure at the bottom of this link where it says how to run it in a Flink Cluster.dataArtisans/flink-dataflow
| | | | | | | | | | | dataArtisans/flink-dataflow flink-dataflow - Google Dataflow Runner for Apache Flink | | | | My app gets builds ok, at least it seems like that.But, when I run it in the Flink Cluster, I have been getting zillions of different types of exceptions and its non ending.Is there a custom pom.xml, or a guideline to develop this app so it just builds and runs like the example in the above link? This is how I run it in Flink Cluster: ./flink run /opt/analytics/apache/beamproject/incubator-beam-master/examples/java/src/main/java/org/apache/beam/examples/beamflink-bench/target/beamflink-bench-1.0-SNAPSHOT.jar --topic lrdata --bootstrap.servers myhost:9092 --zookeeper.connect kirk:2181 --group.id myGroup. These are the dependencies I currently have in my pom.xml.Thanks so much for your help. Appreciate your kind attention. <dependencies><dependency> <groupId>com.google.oauth-client</groupId> <artifactId>google-oauth-client</artifactId> <version>1.22.0</version></dependency><dependency> <groupId>org.apache.beam</groupId> <artifactId>flink-runner_2.10</artifactId> <version>0.1.0-incubating-SNAPSHOT</version> </dependency><dependency> <groupId>com.apache.kafka</groupId> <artifactId>kafka-0.1.0</artifactId> <version>0.1.0-incubating-SNAPSHOT</version></dependency><dependency> <groupId>com.apache.beam</groupId> <artifactId>direct-runner-0.1.0</artifactId> <version>0.1.0-incubating-SNAPSHOT</version></dependency><dependency> <groupId>com.google.collections</groupId> <artifactId>google-collections</artifactId> <version>1.0-rc2</version></dependency> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>3.8.1</version> <scope>test</scope> </dependency> </dependencies>
