Dell - Internal Use - Confidential If you learn better by reading a book try http://www.manning.com/sallen/.
It starts with basics and ramps up to reliable message processing and beyond. From: Jeffery Maass [mailto:maas...@gmail.com] Sent: Friday, May 15, 2015 10:18 AM To: user@storm.apache.org Subject: Re: Need help Totally my bad. I did not actually go look at the spouts to see if they were implemented as reliable spouts or not. If you haven't already read these, I would read them now: https://storm.apache.org/documentation/Concepts.html https://storm.apache.org/documentation/Guaranteeing-message-processing.html I learned about reliable spouts by dissecting the Kafka spout: https://github.com/apache/storm/blob/v0.9.4/external/storm-kafka/src/jvm/storm/kafka/KafkaSpout.java Sorry, I don't have a simpler example on hand. The essentials are this: * Your spout handles : ** Gathering records from its datasource ** Sending records to the rest of the topology ( emit ) ** what to do when a tuple successfully completes the topology ( ack ) ** what to do when a tuple fails "somewhere" in the topology ( fail ) * Storm handles : ** delivery to all bolts in a topology of an individual tuple ** guaranteed reporting of an individual tuple's success or failure back to the originating spout * To make use of guaranteed message processing: ** When your spout emits a tuple, it must emit a unique message id. This message id is returned to the spout whenever a report is made on the tuple ( ack or fail ) ** When your bolt is finished with a tuple, it must notify Storm using either ack(tuple) or fail(tuple) Thank you for your time! +++++++++++++++++++++ Jeff Maass<mailto:maas...@gmail.com> linkedin.com/in/jeffmaass<http://linkedin.com/in/jeffmaass> stackoverflow.com/users/373418/maassql<http://stackoverflow.com/users/373418/maassql> +++++++++++++++++++++ On Fri, May 15, 2015 at 9:51 AM, Asif Ihsan <asifihsan.ih...@gmail.com<mailto:asifihsan.ih...@gmail.com>> wrote: That project doesn't do anything about message delivery. I have to make sure guaranteed processing of the message sent by the spout to bolt. On Fri, May 15, 2015 at 5:33 PM, Jeffery Maass <maas...@gmail.com<mailto:maas...@gmail.com>> wrote: See the 0.9.4 release codebase @ https://github.com/apache/storm/tree/v0.9.4 There is a project called "Storm Starter" @ https://github.com/apache/storm/tree/v0.9.4/examples/storm-starter Thank you for your time! +++++++++++++++++++++ Jeff Maass<mailto:maas...@gmail.com> linkedin.com/in/jeffmaass<http://linkedin.com/in/jeffmaass> stackoverflow.com/users/373418/maassql<http://stackoverflow.com/users/373418/maassql> +++++++++++++++++++++ On Fri, May 15, 2015 at 2:43 AM, Asif Ihsan <asifihsan.ih...@gmail.com<mailto:asifihsan.ih...@gmail.com>> wrote: I am new to Storm. I studied that Storm is reliable and gives message delivery guaranty. I tried to see how it works, but I couldn't do it. can anyone help me with the single spout and single bolt. Every message sent by the spout to bolt should be acknowledged by the bolt to the spout. And display message that stream acknowledged. Thank you. -- Regards Muhammad Asif Ihsan -- Regards Muhammad Asif Ihsan
