just figured out that it might not detect the right environment (local execution) - passing
--flinkMaster=\[local\] like java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount --runner=FlinkRunner --output=/tmp/out --flinkMaster=\[local\] when running does the trick too :) On Wed, Aug 7, 2019 at 6:59 PM Lukasz Cwik <lc...@google.com> wrote: > The uber jar your using looks like it is incorrectly merging dependencies > which is causing the issue you reported. > > Please try using mvn to run the example directly: > mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ > -Dexec.args="--runner=FlinkRunner --inputFile=pom.xml > --output=counts" -Pflink-runner > > Here are more details about running the quickstart on various runners: > https://beam.apache.org/get-started/quickstart-java/ > > Is there some quickstart guide or documentation which told you to use mvn > package and then java -jar beam.jar that we should be updating? > > On Wed, Aug 7, 2019 at 9:27 AM Kaymak, Tobias <tobias.kay...@ricardo.ch> > wrote: > >> Hello, >> >> after generating the examples in 2.14.0 via: >> >> mvn archetype:generate \ >> -DarchetypeGroupId=org.apache.beam \ >> -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \ >> -DarchetypeVersion=2.14.0 \ >> -DgroupId=org.example \ >> -DartifactId=word-count-beam \ >> -Dversion="0.1" \ >> -Dpackage=org.apache.beam.examples \ >> -DinteractiveMode=false >> >> compiling it via: >> >> mvn clean package -Pflink-runner >> >> and running it via the FlinkRunner (local): >> >> java -cp target/word-count-beam-bundled-0.1.jar >> org.apache.beam.examples.WordCount --runner=FlinkRunner --output=/tmp/out >> >> I get the following error: >> >> Exception in thread "main" java.lang.RuntimeException: Pipeline execution >> failed >> at >> org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:116) >> >> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313) >> >> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299) >> >> at >> org.apache.beam.examples.WordCount.runWordCount(WordCount.java:185) >> >> at org.apache.beam.examples.WordCount.main(WordCount.java:192) >> >> Caused by: com.typesafe.config.ConfigException$UnresolvedSubstitution: >> reference.conf @ >> jar:file:/private/tmp/word-count-beam/target/word-count-beam-bundled-0.1.jar!/reference.conf: >> 804: Could not resolve >> substitution to a value: ${akka.stream.materializer} >> >> at >> com.typesafe.config.impl.ConfigReference.resolveSubstitutions(ConfigReference.java:108) >> >> >> Should I file an issue in Jira or am I doing something wrong? >> >
