Hey Chinmay, We do have checkpoint-tool.sh, which allows you to set input offsets to arbitrary locations. One caveat here is that your job has to be offline when this is done. When coordinator stream is done, it should be possible to dynamically change the offsets (by bouncing the containers) when the offsets change.
Cheers, Chris On 1/16/15 2:13 PM, "Chinmay Soman" <[email protected]> wrote: >We don't have a way to start from a known offset right ? Do you guys >think >that might be useful ? > >On Fri, Jan 16, 2015 at 11:55 AM, Shekar Tippur <[email protected]> wrote: > >> Yan, >> Thanks. This really helps. >> >> - Shekar >> >> On Fri, Jan 16, 2015 at 11:52 AM, Yan Fang <[email protected]> wrote: >> >> > Hi Shekar, >> > >> > Assuming you are using 0.8, there are configurations that you can set >>to >> > read messages from oldest. >> > >> > systems.system-name.streams.stream-name.samza.reset.offset = true >> > systems.system-name.streams.stream-name.samza.offset.default = oldest >> > >> > See >> > >> > >> >>http://samza.incubator.apache.org/learn/documentation/0.8/jobs/configurat >>ion-table.html >> > >> > Hope this helps. >> > >> > Thanks, >> > >> > Fang, Yan >> > [email protected] >> > +1 (206) 849-4108 >> > >> > On Fri, Jan 16, 2015 at 11:02 AM, Shekar Tippur <[email protected]> >> wrote: >> > >> > > Hello, >> > > >> > > I was wondering what would be the recommended way to point Samza to >> > consume >> > > older messages? >> > > >> > > I have made some code changes that I want to apply to all the >>messages >> > that >> > > have been read so far. >> > > >> > > - Shekar >> > > >> > >> > > > >-- >Thanks and regards > >Chinmay Soman
