I guess that TfIdf example and/or apex runner can't handle local file
system. Try using default input.
java.lang.RuntimeException: java.io.FileNotFoundException:
/Users/vrozov/Projects/Apache/beam/examples (Is a directory)
at
org.apache.beam.runners.apex.translation.operators.ApexReadUnboundedInputOperator.setup(ApexReadUnboundedInputOperator.java:127)
at
org.apache.beam.runners.apex.translation.operators.ApexReadUnboundedInputOperator.setup(ApexReadUnboundedInputOperator.java:47)
at com.datatorrent.stram.engine.Node.setup(Node.java:188)
at
com.datatorrent.stram.engine.StreamingContainer.setupNode(StreamingContainer.java:1337)
at
com.datatorrent.stram.engine.StreamingContainer.access$100(StreamingContainer.java:129)
at
com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1413)
Caused by: java.io.FileNotFoundException:
/Users/vrozov/Projects/Apache/beam/examples (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:90)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:55)
at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:221)
at
org.apache.beam.sdk.io.FileBasedSource$FileBasedReader.startImpl(FileBasedSource.java:457)
at
org.apache.beam.sdk.io.OffsetBasedSource$OffsetBasedReader.start(OffsetBasedSource.java:271)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$ResidualSource.advance(UnboundedReadFromBoundedSource.java:466)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$ResidualSource.access$300(UnboundedReadFromBoundedSource.java:444)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$Reader.advance(UnboundedReadFromBoundedSource.java:295)
at
org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter$Reader.start(UnboundedReadFromBoundedSource.java:288)
at
org.apache.beam.runners.apex.translation.operators.ApexReadUnboundedInputOperator.setup(ApexReadUnboundedInputOperator.java:125)
... 5 more
Thank you,
Vlad
On 6/2/17 18:21, Thomas Weise wrote:
It may also be helpful to enable logging to see if there are any
exceptions in the execution. The console log only contains output from
Maven. Is logging turned off (or a suitable slf4j backend missing)?
On Fri, Jun 2, 2017 at 5:00 PM, Thomas Weise <t...@apache.org
<mailto:t...@apache.org>> wrote:
Hi Claire,
The stack traces suggest that the application was launched and the
Apex DAG is deployed and might be running (it runs in embedded mode).
Do you see any output? In case it writes to files, anything in
output or output staging directories?
Thanks,
Thomas
On Thu, Jun 1, 2017 at 3:18 PM, Claire Yuan
<clairey...@yahoo-inc.com <mailto:clairey...@yahoo-inc.com>> wrote:
Hi Vlad,
Thanks for replying! Here attached my log and stack trace
On Thursday, June 1, 2017 1:31 PM, Vlad Rozov
<v.ro...@datatorrent.com <mailto:v.ro...@datatorrent.com>> wrote:
Hi Claire,
Can you provide maven logs? It may also help to obtain stack
trace. In a separate terminal window, run "jps -lv" and look
for the jvm process id that executes
org.apache.beam.examples.TfIdf. Use jstack <process id> to get
the stack trace.
Thank you,
Vlad
On 6/1/17 13:00, Claire Yuan wrote:
Hi,
I am using the Apex runner to execute Apache Beam example
pipeline. However my terminal always get frozen when running
the command:
|mvn compile exec:java -Dexec.mainClass=org.apache.be
<http://org.apache.be>am.examples.TfIdf \
-Dexec.args="--inputFile=pom.xml --output=counts
--runner=ApexRunner" -Papex-runner|
Would anyone have solution for this?
Claire
