Hi Amit Thanks, it ran but got stuck at:
[INFO] --- exec-maven-plugin:1.4.0:exec (default-cli) @ spark --- log4j:WARN No appenders could be found for logger (org.apache.beam.sdk.options.PipelineOptionsFactory). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. On Wed, May 25, 2016 at 1:17 PM, Amit Sela <[email protected]> wrote: > I'm not near a computer but are you running from the parent project dir or > the runner ? You need to run from the runner dir. > > On Wed, May 25, 2016, 10:44 Punit Naik <[email protected]> wrote: > >> Hi Amit >> >> Just tried that and still got an error: >> >> [ERROR] Failed to execute goal >> org.codehaus.mojo:exec-maven-plugin:1.4.0:exec (default-cli) on project >> parent: The parameters 'executable' for goal >> org.codehaus.mojo:exec-maven-plugin:1.4.0:exec are missing or invalid -> >> [Help 1] >> >> On Wed, May 25, 2016 at 1:01 PM, Amit Sela <[email protected]> wrote: >> >>> Would you try running with mvn exec:exec ? >>> See here: >>> https://github.com/apache/incubator-beam/blob/master/runners/spark/README.md >>> >>> On Wed, May 25, 2016, 10:14 Punit Naik <[email protected]> wrote: >>> >>>> Hi Everyone >>>> >>>> I compiled beam project with the command "mvn clean install >>>> -DskipTests" and then ran the WordCount example with the following command: >>>> >>>> mvn compile exec:java -pl examples/java >>>> -Dexec.mainClass=org.apache.beam.examples.WordCount >>>> -Dexec.args="--runner=SparkPipelineRunner --sparkMaster=local >>>> --inputFile=/in --output=/beam-out" >>>> >>>> But it gave me an error saying: >>>> >>>> [ERROR] Failed to execute goal >>>> org.codehaus.mojo:exec-maven-plugin:1.4.0:java (default-cli) on project >>>> java-examples-all: An exception occured while executing the Java class. >>>> null: InvocationTargetException: Unknown 'runner' specified >>>> 'SparkPipelineRunner', supported pipeline runners >>>> [BlockingDataflowPipelineRunner, DataflowPipelineRunner, >>>> DirectPipelineRunner] -> [Help 1] >>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to >>>> execute goal org.codehaus.mojo:exec-maven-plugin:1.4.0:java (default-cli) >>>> on project java-examples-all: An exception occured while executing the Java >>>> class. null >>>> at >>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) >>>> at >>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >>>> at >>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >>>> at >>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) >>>> at >>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) >>>> at >>>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) >>>> at >>>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) >>>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) >>>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) >>>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) >>>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) >>>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) >>>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) >>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>> at >>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >>>> at >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> at java.lang.reflect.Method.invoke(Method.java:498) >>>> at >>>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) >>>> at >>>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) >>>> at >>>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) >>>> at >>>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) >>>> Caused by: org.apache.maven.plugin.MojoExecutionException: An exception >>>> occured while executing the Java class. null >>>> at >>>> org.codehaus.mojo.exec.ExecJavaMojo.execute(ExecJavaMojo.java:345) >>>> at >>>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) >>>> at >>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) >>>> ... 20 more >>>> Caused by: java.lang.reflect.InvocationTargetException >>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>> at >>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >>>> at >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> at java.lang.reflect.Method.invoke(Method.java:498) >>>> at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293) >>>> at java.lang.Thread.run(Thread.java:745) >>>> Caused by: java.lang.IllegalArgumentException: Unknown 'runner' >>>> specified 'SparkPipelineRunner', supported pipeline runners >>>> [BlockingDataflowPipelineRunner, DataflowPipelineRunner, >>>> DirectPipelineRunner] >>>> at >>>> org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1434) >>>> at >>>> org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:107) >>>> at >>>> org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:292) >>>> at org.apache.beam.examples.WordCount.main(WordCount.java:192) >>>> ... 6 more >>>> Caused by: java.lang.ClassNotFoundException: SparkPipelineRunner >>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381) >>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >>>> at java.lang.Class.forName0(Native Method) >>>> at java.lang.Class.forName(Class.java:264) >>>> at >>>> org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1421) >>>> ... 9 more >>>> >>>> What is the problem? >>>> >>>> >>>> -- >>>> Thank You >>>> >>>> Regards >>>> >>>> Punit Naik >>>> >>> >> >> >> -- >> Thank You >> >> Regards >> >> Punit Naik >> > -- Thank You Regards Punit Naik
