Re: Setting the consumer's offset

2015-11-18 Thread Yonghui Zhao
Hi, How about this feature? thanks *We do plan to allow the high level consumer to specify a starting offset inthe future when we revisit the consumer design. Some of the details aredescribed inhttps://cwiki.apache.org/confluence/display/KAFKA/Consumer+Client+Re-Design

Re: Setting the consumer's offset

2013-04-02 Thread James Englert
I wrote some code herehttp://mail-archives.apache.org/mod_mbox/kafka-users/201303.mbox/%3CCAPD5FitPZkn7Uu+hRY70p8NP=spTEm8zaBOEqKcTiVFB=oo...@mail.gmail.com%3Ethat resets the offset. You just need to be sure to set this as the consumer(s) is starting up. I'm not certain if it is the right way

Re: Setting the consumer's offset

2013-04-02 Thread Jun Rao
Currently, we have tools like ImportOffset that can update the starting offset of a consumer in ZK. However, one has to stop all consumers first. We do plan to allow the high level consumer to specify a starting offset in the future when we revisit the consumer design. Some of the details are

Re: Setting the consumer's offset

2013-04-01 Thread Jun Rao
Sean, A broker can have multiple topics, each with multiple partitions. Each partition can be consumed by multiple consumers. Our high level consumer API doesn't allow you to specify a starting offset. SimpleConsumer does. If you use SimpleConsumer, you are responsible for managing the