Can KafkaSpout emit tuple to specified stream on 0.9.5?

2016-06-22 Thread Chen Junfeng
I want to emit tuples to a specified stream instead of default stream. Then I found this one https://github.com/apache/storm/pull/601/files#r53569108. It seems I only need to modify spoutConfig.emitStreamId when constructing the KafkaSpout. But my dev and production environment is 0.9.5, and

Re: Setup Apache Storm for single machine

2016-06-22 Thread Joaquin Menchaca
I made a sample storm repo on 0.10.0: https://github.com/darkn3rd/storm-vagrant There's some docs in there that might be useful. For writing code, don't know. On Wed, Jun 22, 2016 at 3:05 AM, Walid Aljoby wrote: > Hi all, > > I have installed single node Apache storm

topology stops processing without failures or errors

2016-06-22 Thread William Cox
Hello all, We're investigating using Storm for some work. We have a topology using the KafkaSpout followed by two bolts - one is a processing step, followed by a kafka producer. Each is using the BaseRichBolt and anchoring and acknowledging each tuple. We run our topology using 1 worker, 10

Question about Fields grouping

2016-06-22 Thread Evgeniy Khyst
Hi, I can't find information how fields grouping works in case of worker fail. With fields grouping tuples are partitioned by some key and are sent to different tasks. Tuples with the same key goes to the same task. When a worker dies, the supervisor will restart it. If it continuously fails on

Re: Setup Apache Storm for single machine

2016-06-22 Thread Walid Aljoby
Hi all, I have installed single node Apache storm cluster, version 1.0.1.I want to run sample topology, so I find that following command is the one used for that:  storm jar all-my-code.jar org.apache.storm.MyTopology arg1 arg2 The question is: how can I creat all-my-code.jar and

java.lang.NoSuchMethodError: org.apache.thrift.protocol.TProtocol.getScheme()Ljava/lang/Class

2016-06-22 Thread Venkatesh Bodapati
I am working on storm with hive,sql,kafka. i will read data from kafkatopic and hive table, and send data to mysql and another kafkatopic.i willn't able to connect with hive from storm. i got error like this java.lang.NoSuchMethodError:

How to use storm Trident for batching tuples?

2016-06-22 Thread Ye Minkg
I was using storm previously and I need to more batching capabilities so I searched for batching in storm. And I found out Trident which do micro-batching in real-time. But somehow, I cannot figure out how Trident handle micro-batching (flow, batch size, batch interval) to know it really has what

How to get storm metrics for Trident topology?

2016-06-22 Thread Ye Minkg
I am trying to get storm metrics from Trident topology. And when I try to set up metrics for Trident topology and execute it, the following error occurs. "TopologyContext.registerMetric can only be called from within overridden IBolt::prepare() or ISpout::open() method." Seems like current storm