Re: Reading state of a streaming topology via DRPC?
Thanks for the pointer. I''ll have a close look at this. Is there also an example in 'plain' storm api? Niels On Feb 16, 2014 11:14 AM, Enno Shioji eshi...@gmail.com wrote: This uses Trident but I think it covers what you need: https://github.com/eshioji/trident-tutorial/blob/master/src/main/java/tutorial/storm/trident/Part04_BasicStateAndDRPC.java On Sat, Feb 15, 2014 at 8:17 PM, Niels Basjes ni...@basjes.nl wrote: Hi, I want to create a bolt that keeps some kind of state (aggregate) about the messages it has seen so far (i.e. web click stream). Once such a bolt has gathered information I would like to get to that information for an application I designing. So far I've come up with two way of getting at this data: 1) Persist it into something like HBase (i.e push from the bolt). 2) Use DRPC to query the bolt state directly. Regarding this last idea (using DRPC): Is this possible? If it is then where can I find an example on how to create a single topology that is essentially both streaming and drpc. Thanks. -- Best regards, Niels Basjes
Re: Reading state of a streaming topology via DRPC?
This uses Trident but I think it covers what you need: https://github.com/eshioji/trident-tutorial/blob/master/src/main/java/tutorial/storm/trident/Part04_BasicStateAndDRPC.java On Sat, Feb 15, 2014 at 8:17 PM, Niels Basjes ni...@basjes.nl wrote: Hi, I want to create a bolt that keeps some kind of state (aggregate) about the messages it has seen so far (i.e. web click stream). Once such a bolt has gathered information I would like to get to that information for an application I designing. So far I've come up with two way of getting at this data: 1) Persist it into something like HBase (i.e push from the bolt). 2) Use DRPC to query the bolt state directly. Regarding this last idea (using DRPC): Is this possible? If it is then where can I find an example on how to create a single topology that is essentially both streaming and drpc. Thanks. -- Best regards, Niels Basjes
Reading state of a streaming topology via DRPC?
Hi, I want to create a bolt that keeps some kind of state (aggregate) about the messages it has seen so far (i.e. web click stream). Once such a bolt has gathered information I would like to get to that information for an application I designing. So far I've come up with two way of getting at this data: 1) Persist it into something like HBase (i.e push from the bolt). 2) Use DRPC to query the bolt state directly. Regarding this last idea (using DRPC): Is this possible? If it is then where can I find an example on how to create a single topology that is essentially both streaming and drpc. Thanks. -- Best regards, Niels Basjes
