Interesting ..
I have added systems.system-name.streams.stream-name.samza.reset.offset = true systems.system-name.streams.stream-name.samza.offset.default = oldest to the config. I see that it is still looking only the latest events. - Shekar On Fri, Jan 16, 2015 at 3:26 PM, Chinmay Soman <[email protected]> wrote: > Aah that's right. Thanks for confirming. > > On Fri, Jan 16, 2015 at 3:22 PM, Chris Riccomini < > [email protected]> wrote: > > > Hey Chinmay, > > > > We do have checkpoint-tool.sh, which allows you to set input offsets to > > arbitrary locations. One caveat here is that your job has to be offline > > when this is done. When coordinator stream is done, it should be possible > > to dynamically change the offsets (by bouncing the containers) when the > > offsets change. > > > > Cheers, > > Chris > > > > On 1/16/15 2:13 PM, "Chinmay Soman" <[email protected]> wrote: > > > > >We don't have a way to start from a known offset right ? Do you guys > > >think > > >that might be useful ? > > > > > >On Fri, Jan 16, 2015 at 11:55 AM, Shekar Tippur <[email protected]> > > wrote: > > > > > >> Yan, > > >> Thanks. This really helps. > > >> > > >> - Shekar > > >> > > >> On Fri, Jan 16, 2015 at 11:52 AM, Yan Fang <[email protected]> > > wrote: > > >> > > >> > Hi Shekar, > > >> > > > >> > Assuming you are using 0.8, there are configurations that you can > set > > >>to > > >> > read messages from oldest. > > >> > > > >> > systems.system-name.streams.stream-name.samza.reset.offset = true > > >> > systems.system-name.streams.stream-name.samza.offset.default = > oldest > > >> > > > >> > See > > >> > > > >> > > > >> > > >> > > > http://samza.incubator.apache.org/learn/documentation/0.8/jobs/configurat > > >>ion-table.html > > >> > > > >> > Hope this helps. > > >> > > > >> > Thanks, > > >> > > > >> > Fang, Yan > > >> > [email protected] > > >> > +1 (206) 849-4108 > > >> > > > >> > On Fri, Jan 16, 2015 at 11:02 AM, Shekar Tippur <[email protected]> > > >> wrote: > > >> > > > >> > > Hello, > > >> > > > > >> > > I was wondering what would be the recommended way to point Samza > to > > >> > consume > > >> > > older messages? > > >> > > > > >> > > I have made some code changes that I want to apply to all the > > >>messages > > >> > that > > >> > > have been read so far. > > >> > > > > >> > > - Shekar > > >> > > > > >> > > > >> > > > > > > > > > > > >-- > > >Thanks and regards > > > > > >Chinmay Soman > > > > > > > -- > Thanks and regards > > Chinmay Soman >
