Re: KafkaSpout forceFromStart Issue

Francois, I've used the same pattern you've described and didn't have any problems. Your approach is valid. There must be something else going on. On Mon, Mar 23, 2015 at 2:28 PM Harsha wrote: > It looks like your approach is right. Once you turn off forceFromStart and > set the offset time to e

Re: Suggestion for topology with high latency bolt

lusively execute multiple >>> threads of a high latency bolt. >>> For example, we could have one worker, which executes a high latency >>> bolt and another worker, which executes the rest of the topology. >>> So the default behavior would be evenly distribute the bo

Re: Suggestion for topology with high latency bolt

Idan, Use the Config class https://github.com/apache/storm/blob/master/storm-core/src/jvm/backtype/storm/Config.java#L1295 On Tue, Mar 10, 2015 at 9:49 AM Idan Fridman wrote: > curtis, how do you set the storm.message.timeout.secs? > > 2015-03-10 17:07 GMT+02:00 Curtis Allen : >

Re: Suggestion for topology with high latency bolt

Tuning an topology that contains bolts that have a unpredictable execute latency is extremely difficult. I've had to slow down the entire topology by increasing the storm.max.spout.pending and storm.message.timeout.secs otherwise you'll have tuples queue up and timeout. On Tue, Mar 10, 2015 at 8:5

Re: what version of kryo storm currently use?

Says right in your stack trace. Kryo - 2.21 On Fri, Jan 23, 2015 at 11:28 AM, hjh wrote: > Hi Dose anyone know what version of kryo storm currently use? Because I > got exception when use kryo to serialize class. > > 18736 [Thread-30-pose_array_receiver] ERROR > backtype.storm.daemon.executor -

Re: storm.kafka.KafkaConfig; local class incompatible: stream classdesc serialVersionUID

into it. > So downloaded fresh storm 0.9.3 and used it to upload topology the problem > was gone. > > So many thanks to pointing it out and one virtual beer to Curtis :) > > Margus (margusja) Roohttp://margus.roo.ee > skype: margusja > +372 51 480 > > On 23/01/15 00:59, Cu

Re: storm.kafka.KafkaConfig; local class incompatible: stream classdesc serialVersionUID

Looks like you have 2 versions of the kafka spout in your classpath. What output do you get when you run the following command from your project directory? mvn dependency:tree| grep kafka ​ On Thu, Jan 22, 2015 at 2:55 PM, Margus Roo wrote: > I made my code more simple and still the same probl

Re: Question about kafka-spout

These failed message would not be lost because updated kafka offsets are never committed to zookeeper in a failure scenario. If a spout dies the failed messages are still in kafka so the next spout instance will attempt to process those failed messages again. On Tue, Dec 2, 2014 at 2:19 PM, Sergey

Re: [storm-kafka] Acking a tuple twice

Looks like you got bit by the same bug I did. Are you using storm 0.9.2? That error has nothing to do with acking. You get it because the offset requested is to old. See https://github.com/apache/storm/pull/183 Set spoutConf.maxOffsetBehind = Long.MAX_VALUE To fix this error. On Thursday, Novemb

Re: How to set up STORM_TEST_TIMEOUT_MS programatically in 0.9.3?

According this this pull request you can only set the time out via environment variable. Looks like you want functionality that is in this pull request it hasn't been merged in yet, I'm guessing you'll have to wa

Re: any pointers for storm metrics

This blog post is an excellent resource http://www.endgame.com/blog/storm-metrics-how-to.html On Mon, Nov 24, 2014 at 1:49 PM, Rohit Kelkar wrote: > The storm site http://storm.apache.org/documentation/Metrics.html lists > out the metrics but does not give any example usage. > Given that my onl

Re: What appears to be a Kryo Conflict

Nope, everything is working fine for us. On Thu, Oct 9, 2014 at 2:58 PM, Nick Beenham wrote: > I saw that on SO and wondered how folks had solved the issue, did you run > into any issues with 2.22 on the classpath? > > Nick > > On Thu, Oct 9, 2014 at 4:10 PM, Curtis Allen

Re: What appears to be a Kryo Conflict

Your problem was answered in Stack Overflow http://stackoverflow.com/questions/24244689/kryo-compatibility-in-storm-0-9-1and-titan-graph-database-0-4-2-with-apache-cass/24246845#24246845 Titan 0.4.2 + Storm 0.9.2 are compatible. Storm 0.9.2 is *not* compatible with Titan 0.5.0 To fix this problem

Re: Kryo

You might find this interesting http://stackoverflow.com/questions/24244689/kryo-compatibility-in-storm-0-9-1and-titan-graph-database-0-4-2-with-apache-cass/24246845#24246845 On Wed, Oct 8, 2014 at 10:16 AM, Nathan Leung wrote: > 0.9.2 release upgrades to kryo 2.21. > > On Wed, Oct 8, 2014 at 12