Hey Shekar, Hmm. Could you post your logs, so we can have a look? The logs will post both the config, and the offsets used. If there's an issue, we should be able to figure it out.
Cheers, Chris On 1/16/15 5:41 PM, "Shekar Tippur" <[email protected]> wrote: >Interesting .. > > >I have added > >systems.system-name.streams.stream-name.samza.reset.offset = true > >systems.system-name.streams.stream-name.samza.offset.default = oldest > >to the config. I see that it is still looking only the latest events. > > >- Shekar > >On Fri, Jan 16, 2015 at 3:26 PM, Chinmay Soman <[email protected]> >wrote: > >> Aah that's right. Thanks for confirming. >> >> On Fri, Jan 16, 2015 at 3:22 PM, Chris Riccomini < >> [email protected]> wrote: >> >> > Hey Chinmay, >> > >> > We do have checkpoint-tool.sh, which allows you to set input offsets >>to >> > arbitrary locations. One caveat here is that your job has to be >>offline >> > when this is done. When coordinator stream is done, it should be >>possible >> > to dynamically change the offsets (by bouncing the containers) when >>the >> > offsets change. >> > >> > Cheers, >> > Chris >> > >> > On 1/16/15 2:13 PM, "Chinmay Soman" <[email protected]> wrote: >> > >> > >We don't have a way to start from a known offset right ? Do you guys >> > >think >> > >that might be useful ? >> > > >> > >On Fri, Jan 16, 2015 at 11:55 AM, Shekar Tippur <[email protected]> >> > wrote: >> > > >> > >> Yan, >> > >> Thanks. This really helps. >> > >> >> > >> - Shekar >> > >> >> > >> On Fri, Jan 16, 2015 at 11:52 AM, Yan Fang <[email protected]> >> > wrote: >> > >> >> > >> > Hi Shekar, >> > >> > >> > >> > Assuming you are using 0.8, there are configurations that you can >> set >> > >>to >> > >> > read messages from oldest. >> > >> > >> > >> > systems.system-name.streams.stream-name.samza.reset.offset = true >> > >> > systems.system-name.streams.stream-name.samza.offset.default = >> oldest >> > >> > >> > >> > See >> > >> > >> > >> > >> > >> >> > >> >> > >> >>http://samza.incubator.apache.org/learn/documentation/0.8/jobs/configurat >> > >>ion-table.html >> > >> > >> > >> > Hope this helps. >> > >> > >> > >> > Thanks, >> > >> > >> > >> > Fang, Yan >> > >> > [email protected] >> > >> > +1 (206) 849-4108 >> > >> > >> > >> > On Fri, Jan 16, 2015 at 11:02 AM, Shekar Tippur >><[email protected]> >> > >> wrote: >> > >> > >> > >> > > Hello, >> > >> > > >> > >> > > I was wondering what would be the recommended way to point >>Samza >> to >> > >> > consume >> > >> > > older messages? >> > >> > > >> > >> > > I have made some code changes that I want to apply to all the >> > >>messages >> > >> > that >> > >> > > have been read so far. >> > >> > > >> > >> > > - Shekar >> > >> > > >> > >> > >> > >> >> > > >> > > >> > > >> > >-- >> > >Thanks and regards >> > > >> > >Chinmay Soman >> > >> > >> >> >> -- >> Thanks and regards >> >> Chinmay Soman >>
