Re: Error in submitting Topology

2013-12-30 Thread Aniket Alhat
Don't forget to rename file m2-pom.xml to pom.xml and also post your directory "tree" structure. I want to check whether your source WordCountTopology.java exists or not. On Mon, Dec 30, 2013 at 10:52 AM, Aniket Alhat wrote: > cd Storm > cd storm > mvn clean install > bin/storm jar /home/user/st

SnapshottableMap vs. MapState

2013-12-30 Thread Alon Peer
In Trident's MemcachedState implementation ( https://github.com/nathanmarz/trident-memcached/blob/master/src/jvm/trident/memcached/MemcachedState.java#L139), the makeState() method returns an instance of SnapshottableMap, while the MysqlState implementation ( https://github.com/wilbinsc/storm-mysql

Re: SnapshottableMap vs. MapState

2013-12-30 Thread Svend Vanderveken
(my humble interpretation as I understand by reading the code) NonTransactionalMap, TransactionMap and OpaqueMap are all implementations of MapState, which represent a thing able to keep a state formatted of a key-value table (=> "map"-"state") A Snapshottable represents a state which is able to

txid reset in Trident

2013-12-30 Thread Alon Peer
I've created a Trident topology with persistentAggregate, where I save aggregated data to a DB. I've created a fake BatchSpout for my tests. I noticed that when running in local mode, every time I start my topology, the txid values are reset, which in practice resets the counters that I stored in m

Re: Guaranteeing message processing on strom fails

2013-12-30 Thread Nathan Leung
You are using the sentence as the message ID? The word count example repeats sentences, and your message IDs need to be unique. On Mon, Dec 30, 2013 at 2:05 AM, Michal Singer wrote: > In my test I am using the word counter that was in the code samples of > storm starter. > > The first spout is

Re: txid reset in Trident

2013-12-30 Thread Viral Bajaria
When you use the kafka spout in product it will store the txId in zookeeper and on restart it will start from the last txId that was stored in zookeeper. -Viral On Mon, Dec 30, 2013 at 8:18 AM, Alon Peer wrote: > I've created a Trident topology with persistentAggregate, where I save > aggregat

Lots of .tmp files under /tmp

2013-12-30 Thread Patricio Echagüe
Has any of you ran into this issue where there are a lot of .tmp files under /tmp owned by storm process? -rw-rw-r-- 1 stormstorm 2877 Dec 27 00:36 hsoRefX3Fu0OMf89gmlTwVIw9G6zlf4801471426122403897.tmp -rw-rw-r-- 1 stormstorm 3239 Dec 23 12:18 hsoUiDr1FFboRONPue1rDqva4oWOmm593908

Re: Error in submitting Topology

2013-12-30 Thread researcher cs
Thanks Aniket error in this command mvn clean install [ERROR] BUILD ERROR [INFO] [INFO] Cannot execute mojo: clean. It requires a project with an existing pom.xml, but the build is not using one. although i renamed pom.xml

Re: Error in submitting Topology

2013-12-30 Thread researcher cs
problem still persist after mvn clean install for your question do you mean that /home/usr/Storm/storm/storm-starter/src/jvm/storm/starter /WordCountTopology.java On Mon, Dec 30, 2013 at 10:25 AM, Aniket Alhat wrote: > Don't forget to rename file m2-pom.xml to pom.xml and also post your > dire

Re: Error in submitting Topology

2013-12-30 Thread researcher cs
Thanks Aniket problem still persist after mvn clean install for your question do you mean that /home/usr/Storm/storm/storm-starter/src/jvm/storm/starter/ WordCountTopology.java On Mon, Dec 30, 2013 at 10:25 AM, Aniket Alhat wrote: > Don't forget to rename file m2-pom.xml to pom.xml and also po

Re: Error in submitting Topology

2013-12-30 Thread Abhishek Bhattacharjee
What are you doing exactly could you send the steps you are following ? If you are having problems with mvn use lein. Send the logs of what you are doing that will help us understand why exactly you are getting the error. On Tue, Dec 31, 2013 at 4:15 AM, researcher cs wrote: > Thanks Aniket > >

Re: Error in submitting Topology

2013-12-30 Thread researcher cs
Steps 1- After installing storm .. i downloaded storm-starter to run it on storm 2- running WordCountTopology using maven "build successfully" 3- trying to submit a topology on storm ui . using storm jar 4- i used storm jar SNAPSHOT with dependencies and worked well .. 5- trying to use storm jar u

Re: Error in submitting Topology

2013-12-30 Thread researcher cs
Thanks Abhishek for replying Steps 1- After installed storm .. i downloaded storm-starter to run it on storm 2- running WordCountTopology using maven "build successfully" 3- trying to submit a topology on storm ui . using storm jar 4- i used storm jar SNAPSHOT with dependencies and worked well .. 5

Re: Error in submitting Topology

2013-12-30 Thread researcher cs
Thanks Abhishek for replying Steps 1- After installed storm .. i downloaded storm-starter to run it on storm 2- running WordCountTopology using maven "build successfully" 3- trying to submit a topology on storm ui . using storm jar 4- i used storm jar SNAPSHOT with dependencies and worked well .. 5

Re: How to verify the statue of running topology / Storm+Graphite not working / Logs attached

2013-12-30 Thread 程训焘
Thanks all! The problem is indeed caused by ZeroMq and JZMQ. From my log, I saw the ZeroMQ crashed. I now fixed my network configurations, and it works fine now! Thanks very much for your help! Happy new year! Xuntao Regards, Cheng Xuntao On Mon, Dec 30, 2013 at 12:13 PM, Bishnu Patro wrote:

RE: Guaranteeing message processing on strom fails

2013-12-30 Thread Michal Singer
thanks, I am checking this out. This might be a problem. But there is still this issue: Ui – some streams are missing in UI as a result of the worker being killed or rebalance *From:* Nathan Leung [mailto:ncle...@gmail.com] *Sent:* Monday, December 30, 2013 6:35 PM *To:* user *Subject:* Re:

Re: A couple of Trident issues

2013-12-30 Thread Svend Vanderveken
1. This mysql state https://github.com/wilbinsc/storm-mysql/blob/master/src/main/java/storm/trident/state/mysql/MysqlState.java seems to send one request to DB per primary key it wants to query, that's the reason you see so many request to the DB. I believe it could be refactored using a "Select