Thanks Rex…

Thanks,
Pradeep V.B.

From: Rex Ma [mailto:[email protected]]
Sent: Friday, October 30, 2015 11:31 PM
To: [email protected]
Subject: Re: impact to "field grouping" binding to task after restart

Hi Pradeep,

I find the code related to field grouping in 
storm/storm-core/src/clj/backtype/storm/daemon/executor.clj<https://github.com/apache/storm/blob/master/storm-core%2Fsrc%2Fclj%2Fbacktype%2Fstorm%2Fdaemon%2Fexecutor.clj#L43>.

The target task id is calculated by hashcode of all grouping fields' values mod 
total number of  target tasks.

and the num of tasks is calculated when executor started based on the topology 
config.

so I think the messages will goto the same task as before.




On Fri, Oct 30, 2015 at 10:09 PM, Pradeep Badiger 
<[email protected]<mailto:[email protected]>> wrote:
Hi All,

I am doing a small POC using storm. I am using field grouping to send tuples to 
a bolt that writes to a topic. The bolt task writes to a particular partition 
of a topic. Question that I have is, if the bolt tasks restart, does the field 
grouping shuffle and start to send messages to a different task compared to 
before restart?

Thanks,
Pradeep V.B.


This email and any files transmitted with it are confidential, proprietary and 
intended solely for the individual or entity to whom they are addressed. If you 
have received this email in error please delete it immediately.


This email and any files transmitted with it are confidential, proprietary and 
intended solely for the individual or entity to whom they are addressed. If you 
have received this email in error please delete it immediately.

Reply via email to