RE: is it possible to commit offsets on a per stream basis?

2013-10-04 Thread Yu, Libo
users@kafka.apache.org Subject: Re: is it possible to commit offsets on a per stream basis? I added a comment/suggestion to: https://issues.apache.org/jira/browse/KAFKA-966 Basically to expose an api for marking an offset for commit, such that the auto-commit would only commit offsets up to the last me

Re: is it possible to commit offsets on a per stream basis?

2013-10-03 Thread Jason Rosenberg
ry helpful. > > Regards, > > Libo > > > -Original Message- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Monday, September 09, 2013 12:17 PM > To: users@kafka.apache.org > Subject: Re: is it possible to commit offsets on a per stream basis? > >

RE: is it possible to commit offsets on a per stream basis?

2013-09-09 Thread Yu, Libo
o > > > -Original Message- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Sunday, September 08, 2013 12:46 PM > To: users@kafka.apache.org > Subject: Re: is it possible to commit offsets on a per stream basis? > > That should be fine too. > >

Re: is it possible to commit offsets on a per stream basis?

2013-09-09 Thread Neha Narkhede
> > > -Original Message- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Sunday, September 08, 2013 12:46 PM > To: users@kafka.apache.org > Subject: Re: is it possible to commit offsets on a per stream basis? > > That should be fine too. > >

RE: is it possible to commit offsets on a per stream basis?

2013-09-09 Thread Yu, Libo
, September 08, 2013 12:46 PM To: users@kafka.apache.org Subject: Re: is it possible to commit offsets on a per stream basis? That should be fine too. On Sat, Sep 7, 2013 at 8:33 PM, Jason Rosenberg wrote: > To be clear, it looks like I forgot to add to my question, that I am > asking

Re: is it possible to commit offsets on a per stream basis?

2013-09-08 Thread Neha Narkhede
mit > > > background thread wakes up each time. > > > > > > Jason > > > > > > > > > On Thu, Aug 29, 2013 at 11:58 AM, Yu, Libo wrote: > > > > > > > Thanks, Neha. That is a great answer. > > > > > > > > R

Re: is it possible to commit offsets on a per stream basis?

2013-09-07 Thread Jason Rosenberg
. > > > > Jason > > > > > > On Thu, Aug 29, 2013 at 11:58 AM, Yu, Libo wrote: > > > > > Thanks, Neha. That is a great answer. > > > > > > Regards, > > > > > > Libo > > > > > > > > > -Ori

Re: is it possible to commit offsets on a per stream basis?

2013-09-07 Thread Neha Narkhede
-Original Message----- > > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > > Sent: Thursday, August 29, 2013 1:55 PM > > To: users@kafka.apache.org > > Subject: Re: is it possible to commit offsets on a per stream basis? > > > > 1 We can create multiple conn

Re: is it possible to commit offsets on a per stream basis?

2013-09-02 Thread Jason Rosenberg
ent: Thursday, August 29, 2013 1:55 PM > To: users@kafka.apache.org > Subject: Re: is it possible to commit offsets on a per stream basis? > > 1 We can create multiple connectors. From each connector create only one > stream. > 2 Use a single thread for a stream. In this case, the connector in

RE: is it possible to commit offsets on a per stream basis?

2013-08-29 Thread Yu, Libo
Thanks, Neha. That is a great answer. Regards, Libo -Original Message- From: Neha Narkhede [mailto:neha.narkh...@gmail.com] Sent: Thursday, August 29, 2013 1:55 PM To: users@kafka.apache.org Subject: Re: is it possible to commit offsets on a per stream basis? 1 We can create multiple

Re: is it possible to commit offsets on a per stream basis?

2013-08-29 Thread Neha Narkhede
1 We can create multiple connectors. From each connector create only one stream. 2 Use a single thread for a stream. In this case, the connector in each thread can commit freely without any dependence on the other threads. Is this the right way to go? Will it introduce any dead lock when multiple