Re: Trident topology: sliding window aggregation?

2014-08-18 Thread Krzysztof Zarzycki
I bump the thread as I'm also looking for the answer to this question. If anyone has any ideas to share, that would be great! Thanks, - Zarzyk 2014-07-23 19:30 GMT+02:00 A.M. costco.s...@yahoo.com: While looking into storm Trident, how could we achieve sliding window functions with Trident

RE: Kafka + Storm

2014-08-18 Thread Georgy Abraham
For all these reasons Kafka is one of the most used data ingestion into storm and in the latest version the most used Kafka spout is integrated onto storm code base. -Original Message- From: Corey Nolet Sent: 15-08-2014 AM 09:25 To: user@storm.incubator.apache.org Subject: Re: Kafka +

Value of nimbus.host for Storm running on Mesos via Marathon

2014-08-18 Thread Yaron Rosenbaum
Hi I'm running nimbus on Mesos via Marathon: Tasks Configuration Command /storm-mesos-0.9/bin/storm-mesos nimbus Constraints Unspecified Container Unspecified CPUs 1 Environment Unspecified Executor Unspecified Instances 1 Memory (MB) 1024 Disk Space (MB) 10 Ports 6627,3773,3772 URIs

Re: Cleanup method not called for the BaseBasicBolt when the topology is killed

2014-08-18 Thread Spico Florin
Hello! I've followed the suggestion of adding a shutdown hook inside the Bolt as it was suggested by this post http://grokbase.com/t/gg/storm-user/136ks2tgmn/how-do-you-perform-cleanup-when-killing-a-topology (see Derek's). The hook is initialized, but the run method is not called when the

Re: How do i unregister from the group? Too many emails...:)

2014-08-18 Thread Bobby Evans
Send an e-mail to user-unsubscr...@storm.incubator.apache.org from the e-mail address you want to unsubscribe from. - Bobby On 8/17/14, 12:58 PM, Joe Roberts carl.roberts.zap...@gmail.com wrote: user@storm.incubator.apache.org Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Sent

Re: Storm PROD Server log folder configuration issue

2014-08-18 Thread Harsha
Hi Yiming, Looks like we only have tag for the last release. you can checkout a tag git checkout tags/[1]v0.9.2-incubating. Thanks, -Harsha On Sun, Aug 17, 2014, at 08:15 PM, Fang, Yiming wrote: Hi Harsha, Thanks a lot for the help. As long as we are working on 0.9.2. I

kafka high level consumer - threads guaranteed to read a single partition?

2014-08-18 Thread Josh J
Hi, For the kafka high level consumer, if I create exactly the number of threads as the number of partitions, is there a guarantee that each thread will be the only thread that reads from a particular partition? I'm following this example

Re: How to stress test storm?

2014-08-18 Thread Amila Suriarachchi
Thanks for your information. I'll go through your links and see. Amila. On Mon, Aug 18, 2014 at 11:52 AM, Spico Florin spicoflo...@gmail.com wrote: Hello! The spout or bolt are running as instances (tasks) inside in an executor threa. You can run more tasks per executor thread by they

Supervisor keeps crashing

2014-08-18 Thread Kushan Maskey
I have two servers in which supervisor is running. Once of the runs fine as far as I know until now. But the other one keep shuts it down and tries to restart it again unsuccessfully with the following error message. Can anyone please help me? Thanks. 2014-08-18 20:56:22 b.s.d.supervisor [INFO]

Maven error

2014-08-18 Thread researcher cs
when i executed this command mvn compile exec:java -Dexec.classpathScope=compile -Dexec.mainClass=trident.Myclass i got this [ERROR] BUILD FAILURE[INFO] Compilation failure error: error reading /home/usrs/.m2/repository/com/google/guava/guava/13.0/guava-13.0.jar; error in opening zip file

Re: Maven error

2014-08-18 Thread Anand Nalya
Hi, It seems that the maven dependencies are not properly downloaded. Can you try deleting these jar file and compile again? -Anand On 19 August 2014 05:00, researcher cs prog.researc...@gmail.com wrote: when i executed this command mvn compile exec:java -Dexec.classpathScope=compile

RE: Maven error

2014-08-18 Thread Georgy Abraham
Yes .. The jars may be corrupted or not fully downloaded one one try . Delete the folders of all jars causing the problem and build or compile again , maven seeing the dependencies are not there, will download it again. If you have manually installed the jars , please do it again with non

RE: java.lang.ArrayIndexOutOfBoundsException: 3 atbacktype.storm.utils.DisruptorQueue.consumeBatchToCursor

2014-08-18 Thread Georgy Abraham
From the error messaage the Array index out of bounds is coming from your code . Maybe you missed something ?? You are using StormSubmitter class to run it on cluster right ?? I haven't tried with a different curator version , so don't know that. -Original Message- From: Kushan Maskey