config trident to emit no batch when no data found in kafka

2015-04-08 Thread 王天驹
hi, i am using trident, and found that when no data found in kafka, spout still emit empty batch can this be turned off? thx!

Opening connection to Random IPs

2015-04-08 Thread Anil Kumar
Hi Guys, We have problem while submitting topology where it is trying to open up client connection to random IPs like 70.127.0.0, 90.127.0.0 etc. Could you please help us in finding out why it is trying to do this ? Extract from our logs are: 6845 [main-SendThread(90.127.0.0:2000)] INFO

Re: Opening connection to Random IPs

2015-04-08 Thread Jens-U. Mozdzen
Hi Anil, Zitat von Anil Kumar anilkumar.om...@gmail.com: Hi Guys, We have problem while submitting topology where it is trying to open up client connection to random IPs like 70.127.0.0, 90.127.0.0 etc. are you running your Storm supervisors within Docker / LXC containers? Regards, Jens

Field Grouping question on optimization

2015-04-08 Thread Kashyap Mhaisekar
Hi, My topology is like the following - *Spout - Bolt A - Bolt B - Bolt C - Bolt D* the groupings between* Bolt C - Bolt D* is a field grouping as Bolt D is doing an aggregation while everything else is a shuffleGrouping. Use Case: If the spout emits 100K tuples such that the emits all are

Re: Field Grouping question on optimization

2015-04-08 Thread Rajiv Onat
You may want to look at partial key grouping feature to reduce hotspots, cases where key cardinality makes a bolt instance straggle. This feature is in 0.9.4 -Rajiv On Apr 8, 2015, at 11:52 AM, Kashyap Mhaisekar kashya...@gmail.com wrote: Hi, My topology is like the following - Spout -