Hi, Thanks so much for helping so far! I did want you guys said about
setting the embedded execution to be false and remove the input arguments. Here
is what I got:
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:java
(default-cli) on project beam-examples-java: An exception occured while
executing the Java class. null: InvocationTargetException: Failed to run:
hadoop org.apache.beam.runners.apex.ApexYarnLauncher
/tmp/beam-runner-apex1438316137710606714params (exit code 127)
[ERROR] bash: hadoop: command not
found [ERROR] -> [Help 1] If any
of you would have further solution for this :(
Claire
On Monday, June 5, 2017 8:12 AM, Vlad Rozov <[email protected]> wrote:
I guess that TfIdf example and/or apex runner can't handle local file system.
Try using default input.
java.lang.RuntimeException: java.io.FileNotFoundException:
/Users/vrozov/Projects/Apache/beam/examples (Is a directory)
at
org.apache.beam.runners.apex.translation.operators.ApexReadUnboundedInputOperator.setup(ApexReadUnboundedInputOperator.java:127)
at
org.apache.beam.runners.apex.translation.operators.ApexReadUnboundedInputOperator.setup(ApexReadUnboundedInputOperator.java:47)
at com.datatorrent.stram.engine.Node.setup(Node.java:188)
at
com.datatorrent.stram.engine.StreamingContainer.setupNode(StreamingContainer.java:1337)
at
com.datatorrent.stram.engine.StreamingContainer.access$100(StreamingContainer.java:129)
at
com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1413)
Caused by: java.io.FileNotFoundException:
/Users/vrozov/Projects/Apache/beam/examples (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:90)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:55)
at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:221)
at
org.apache.beam.sdk.io.FileBasedSource$FileBasedReader.startImpl(FileBasedSource.java:457)
at
org.apache.beam.sdk.io.OffsetBasedSource$OffsetBasedReader.start(OffsetBasedSource.java:271)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$ResidualSource.advance(UnboundedReadFromBoundedSource.java:466)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$ResidualSource.access$300(UnboundedReadFromBoundedSource.java:444)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$Reader.advance(UnboundedReadFromBoundedSource.java:295)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$Reader.start(UnboundedReadFromBoundedSource.java:288)
at
org.apache.beam.runners.apex.translation.operators.ApexReadUnboundedInputOperator.setup(ApexReadUnboundedInputOperator.java:125)
... 5 more
Thank you,
Vlad
On 6/2/17 18:21, Thomas Weise wrote:
It may also be helpful to enable logging to see if there are any exceptions in
the execution. The console log only contains output from Maven. Is logging
turned off (or a suitable slf4j backend missing)?
On Fri, Jun 2, 2017 at 5:00 PM, Thomas Weise <[email protected]> wrote:
Hi Claire,
The stack traces suggest that the application was launched and the Apex DAG
is deployed and might be running (it runs in embedded mode).
Do you see any output? In case it writes to files, anything in output or
output staging directories?
Thanks, Thomas
On Thu, Jun 1, 2017 at 3:18 PM, Claire Yuan <[email protected]> wrote:
Hi Vlad, Thanks for replying! Here attached my log and stack trace
On Thursday, June 1, 2017 1:31 PM, Vlad Rozov <[email protected]>
wrote:
Hi Claire,
Can you provide maven logs? It may also help to obtain stack trace. In a
separate terminal window, run "jps -lv" and look for the jvm process id that
executes org.apache.beam.examples.TfIdf . Use jstack <process id> to get the
stack trace.
Thank you,
Vlad
On 6/1/17 13:00, Claire Yuan wrote:
Hi, I am using the Apex runner to execute Apache Beam example pipeline.
However my terminal always get frozen when running the command: mvn compile
exec:java -Dexec.mainClass=org.apache.be am.examples.TfIdf \
-Dexec.args="--inputFile=pom.x ml --output=counts --runner=ApexRunner"
-Papex-runner Would anyone have solution for this?
Claire
