Re: [Announcement] SF / East Bay Storm User Meetup

This sounds super interesting. If you could later upload the talk (in any form) for the international audience that would be awesome. From: Siva Jagadeesan Sent: Tuesday, January 6, 2015 2:56 AM To: user@storm.apache.org Subject: [Announcement] SF / East Bay Sto

Re: Hooks into Shell bolt

Thanks for your inputs, Itai. On Tue, Jan 6, 2015 at 1:09 AM, Itai Frenkel wrote: > You should use a downstream bolt since it is easier to maintain. If you > have to, you can inject a wrapper to the collector that the shellbolt uses > and manipulate the emitted list before actually forwarding i

[Announcement] SF / East Bay Storm User Meetup

Hi Everyone, SF / East Bay Area Storm Monthly Meetup is going to be on* Jan 8th (Thursday) at 6:45pm* at *TubeMogul* *1250 53rd* *St #1* *Emeryville, CA* *Speaker* : Eric Allen (from AdRoll) *Topic*: You're Doing It Wrong! How we used Storm wrong, then right, for a distributed HTTP client at Ad

Re: hdfs bolt with Mapr hadoop cluster

Hi, Please share if you have any comments. Thanks, Shivendra On 12/30/14, 4:33 PM, "Shivendra Singh" wrote: >Hi, > >To use hdfs bolt with Mapr hadoop cluster, >what shall I use for the : >".withFsUrl("hdfs://localhost:54310²);² > >given that mapr has no name node architecture. > >Thanks, >Shiv

Re: Storm on Virtual Hardware

Hi Justin. Thanks for the feedback. There are folks here where I work who want to move Storm (along with Kafka and Zookeeper) to a VMWare cluster. This seems like not the way to go, but since I haven't tried it myself I was soliciting opinion to get a broader perspective. I'm wondering how you

Re: Hooks into Shell bolt

You should use a downstream bolt since it is easier to maintain. If you have to, you can inject a wrapper to the collector that the shellbolt uses and manipulate the emitted list before actually forwarding it to the real collector. From: Hemanth Yamijala Sent: M

Re: null pointer exception

I am using the latest, 0.9.3 and I don't use the shell bolts. I don't have any explicit multi-threading in my bolts, either. The issue seems like some kind of memory leak and storm is running out of memory. When I monitor the processes, I don't see any memory reclaimed even after the tuples have re

Hooks into Shell bolt

Hi, We are planning to integrate some Python modules with Storm. I have been able to get the integration going quite easily using the ShellBolt and python Storm module, following the example in storm-starter. For productionizing, after basic processing in Python, there are some steps that we woul

Re: kafka spout emit in batch issue

Sorry for post again, really need someone point me the right way, : ), thanks On Dec 31, 2014 10:34 AM, "Sa Li" wrote: > Hi, All > > Happy new year! > > I am using TridentKafkaSpout to collect data from kafka, and having a > trident state as well, here is the code > > > static class EventUpdater

Re: Cannot fetch messages when multiple topologies by Storm-Kafka

Are you passing different zkroot for each of those topologies in SpoutConfig. On Mon, Jan 5, 2015, at 01:59 AM, Miroslav Holubec wrote: > Hi James, I have same issue, have u solved it somehow? > > Regards, Miroslav > > On 2 July 2014 at 09:46, jamesw...@yahoo.com.tw > wrote: >> __ >> Hi all, >>

Re: null pointer exception

What version of storm are you using?  Are any of the bolts shell bolts?  There is a known issue where this can happen if two shell bolts share an executor, because they are multi-threaded. - Bobby On Sunday, January 4, 2015 10:19 PM, clay teahouse wrote: Hi All,I have the followin

Re: about storm tuple

Thank you very much!! I will try that!! On 01/05/2015 01:01 AM, Nathan Leung wrote: Out of the box storm does not allow you to determine which machine a bolt or spout runs on. However, it's possible to write a custom scheduler to do this (see http://xumingming.sinaapp.com/885/twitter-storm-h

fieldsGrouping() for multiple input streams

Hi *, I have a bolt C (running with multiple instances) which receives two input streams, from bolt A and B. Both input streams have the same key fields in their tuples, plus additional, distinct fields. Does Storm support fieldsGrouping() so that tuples from both bolt A and B are distr

tasks reassigning when a worker node downs and recover

Hi, i am new to storm and i met a problem with tasks reassigning when a worker node downs and recover. worker node 1-5 running my cluster. i submit a topology to my cluster, and nimbus assign some task to node 1. when node 1 is down (whole machine level), supervisor and all worker processes down t

Re: Cannot fetch messages when multiple topologies by Storm-Kafka

Hi James, I have same issue, have u solved it somehow? Regards, Miroslav On 2 July 2014 at 09:46, jamesw...@yahoo.com.tw wrote: > Hi all, > > I use storm 0.9.2 to build my topology and use kafka to fetch data. But > when I have more topologies to fetch the data from the same topics, some of >