Kafka trident getting stuck

Hi all, I'm pretty new to storm and kafka/zookeeper, and I hope that my question is not to dumb. Here it goes: I'm using latest stable storm and storm-kafka = 0.9.2-incubating I've setup test cluster using wirbelsturm tool with unchanged yaml (just uncommented kafka machine) here is config snip

Re: Kafka trident getting stuck

Tuesday, July 8, 2014, Miloš Solujić wrote: > >> Hi all, >> >> I'm pretty new to storm and kafka/zookeeper, and I hope that my question >> is not to dumb. Here it goes: >> >> I'm using latest stable storm and storm-kafka = 0.9.2-incubating >>

Re: Kafka trident getting stuck

, Danijel Schiavuzzi wrote: > Are you sure you are producing new messages into the same Kafka > topic? What number did you set maxSpoutPending to? > > On Tuesday, July 8, 2014, Miloš Solujić wrote: > >> Thanks Danijel for your quick proposition. >> >> I tri

Re: Kafka trident getting stuck

fka topic. Also, >> try enabling Config.setDebug(true) and monitoring the Kafka spout's >> activity in the logs. setMaxSpoutPending should always be set, as by >> default it is unset, so you risk internal queue explosion. >> >> On Tuesday, July 8, 2014, Miloš Solujić wrote: >

Re: [0.9.2-incubating] Kafka Spout setting to latest offset

One more +1 On 9 Jul 2014 23:49, "Curtis Allen" wrote: > Thanks for the +1's I've went ahead and created a JIRA issue > https://issues.apache.org/jira/browse/STORM-399 and pull request > https://github.com/apache/incubator-storm/pull/183 > > Danijel and P. Taylor please +1 in JIRA > > Thanks agai

Re: Kafka trident getting stuck

e the LoggingMetricsConsumer in storm.yaml, and then > check the Kafka spout's kafka.latestOffset metric in metrics.log, and > compare this offset with the one Kafka's own utility script outputs > (search under kafka/bin/ for the script). > > On Wednesday, July 9, 2014, Miloš So

Re: Kafka trident getting stuck

Yes On 10 Jul 2014 14:03, "Danijel Schiavuzzi" wrote: > Did you kill your topology before clearing the Zookeeper data? > > On Jul 10, 2014 1:24 PM, "Miloš Solujić" wrote: > > > > Thanks Danijel for taking interest in my problem. > > > >

Re: Storm Training/VM

Hi Ted, when I started playing with storm, this project helped a lot https://github.com/miguno/wirbelsturm/ now it is more general tool, but it started as automation around management of storm cluster take a look at its simple yaml config

Re: working with external timestamps

Hi Laeeq, Storm supports external timestamps Cheers Miloš On 22 Aug 2014 01:05, "laeeq ahmed" wrote: > Hi, > > I have been using Apache spark, but spark does not support external > timestamps and gives timestamsp to data as soon as it enters spark > system. Does storm support external timestamp

Re: distinct counting

Alec, For this one, I'd recommend redis hll like Gna explained earlier. On 21 Aug 2014 23:31, "Sa Li" wrote: > Thanks all the reply > > I have considered to integrate the java-hll package ( > https://github.com/aggregateknowledge/java-hll), which uses hash-function > murmur_23 from google, I am