On 2016-09-25 23:10, Chinmay Kolhatkar wrote:
Hi,
I can see RollingTopWordsDemo running fine in my local setup.
What variables did you set to configure your twitter credentials?
What xml file did you write them to?
Can you please share complete exception?
All I see is:
2016-09-26 13:27:15,173 INFO
com.datatorrent.gateway.resources.ws.v2.WSResource: Caught exception in
processing web service: java.lang.IllegalArgumentException: Wrong FS:
hdfs://namenode:9000/user/dtadmin/datatorrent/appPackages, expected:
file:///
Also, Do you see TwitterSampleInput class mentioned in exception
anywhere?
I grep'd everything in /var/log/datatorrent and the only place it shows
up is in
dtgateway.access.log:
<IPADDR> - - [22/Sep/2016:22:12:37 +0000] "GET
/ws/v2/applications/application_1474394828255_0012/operatorClasses/com.datatorrent.contrib.twitter.TwitterSampleInput
HTTP/1.1" 200 1495 "http://namenode:9090/static/"; "Mozilla/5.0
<CONFIG_INFO>
I do get the following exception in dtgateway.log when shutting down the
gateway.
I don't know if it's significant.
2016-09-26 13:40:44,366 INFO com.datatorrent.gateway.DTGateway: Shutting
down
2016-09-26 13:40:44,427 ERROR com.datatorrent.gateway.I: DFS Directory
cannot be written to with exception:
java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:808)
at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2041)
at
org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:707)
at
org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:703)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:714)
at com.datatorrent.stram.client.FSAgent.deleteFile(FSAgent.java:94)
at com.datatorrent.gateway.I.h(gc:30)
at com.datatorrent.gateway.l.K(pc:158)
at com.datatorrent.gateway.l.h(pc:65)
at com.datatorrent.gateway.K.run(yc:156)
at java.lang.Thread.run(Thread.java:745)
2016-09-26 13:40:44,444 INFO com.datatorrent.gateway.DTGateway: Shutdown
complete
-Chinmay.
Thanks much,
-david
On Wed, Sep 21, 2016 at 1:06 AM, <[email protected]> wrote:
I'm trying to run the RollingTopWordsDemo option (#1) in the malhar
version 3.4 twitter demo,
and the TweetSampler operator gets the exception:
java.lang.RuntimeException: java.lang.InterruptedException: sleep
interrupted
at
com.google.common.base.Throwables.propagate(Throwables.java:156)
at
com.datatorrent.stram.engine.InputNode.run(InputNode.java:209)
at
com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1407)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at
com.datatorrent.stram.engine.InputNode.run(InputNode.java:101)
... 1 more
I'm new to Apex, so I'm not sure how to debug this.
Any suggestions or ideas?
Thanks in advance,
-david
