Re: auto.offset.reset for Kafka streams 0.10.2.0
Thanks for the clarification Matthais / Michael! +1 to clear documentation around this because as far as I remember, default for normal consumers is "latest" and since Streams internally use normal consumers, the first intuition is that it will be "latest" for Streams as well. Best, Mahendra On Tue, Apr 11, 2017 at 12:31 PM, Michael Nollwrote: > It's also documented at > http://docs.confluent.io/current/streams/developer-guide.html#non-streams- > configuration-parameters > . > > FYI: We have already begun syncing the Confluent docs for Streams into the > Apache Kafka docs for Streams, but there's still quite some work left > (volunteers are welcome :-P). > > -Michael > > > On Tue, Apr 11, 2017 at 8:37 AM, Matthias J. Sax > wrote: > > > Default for Streams is "earliest" > > > > cf. > > https://github.com/apache/kafka/blob/0.10.2.0/streams/ > > src/main/java/org/apache/kafka/streams/StreamsConfig.java#L405 > > > > > > -Matthias > > > > On 4/10/17 9:41 PM, Mahendra Kariya wrote: > > > This was even my assumption. But I had to explicitly specify > > > auto.offset.reset=latest. Without this config, it started from > > "earliest"! > > > > > > On Tue, Apr 11, 2017 at 10:07 AM, Sachin Mittal > > wrote: > > > > > >> As far as I know default is latest, if no offsets are found. Otherwise > > it > > >> starts from the offset. > > >> > > >> > > >> On Tue, Apr 11, 2017 at 8:51 AM, Mahendra Kariya < > > >> mahendra.kar...@go-jek.com > > >>> wrote: > > >> > > >>> Hey All, > > >>> > > >>> Is the auto offset reset set to "earliest" by default in Kafka > streams > > >>> 0.10.2.0? I thought default was "latest". > > >>> > > >>> I started a new Kafka streams application with a fresh application id > > and > > >>> it started consuming messages from the beginning. > > >>> > > >> > > > > > > > >
Re: auto.offset.reset for Kafka streams 0.10.2.0
It's also documented at http://docs.confluent.io/current/streams/developer-guide.html#non-streams-configuration-parameters . FYI: We have already begun syncing the Confluent docs for Streams into the Apache Kafka docs for Streams, but there's still quite some work left (volunteers are welcome :-P). -Michael On Tue, Apr 11, 2017 at 8:37 AM, Matthias J. Saxwrote: > Default for Streams is "earliest" > > cf. > https://github.com/apache/kafka/blob/0.10.2.0/streams/ > src/main/java/org/apache/kafka/streams/StreamsConfig.java#L405 > > > -Matthias > > On 4/10/17 9:41 PM, Mahendra Kariya wrote: > > This was even my assumption. But I had to explicitly specify > > auto.offset.reset=latest. Without this config, it started from > "earliest"! > > > > On Tue, Apr 11, 2017 at 10:07 AM, Sachin Mittal > wrote: > > > >> As far as I know default is latest, if no offsets are found. Otherwise > it > >> starts from the offset. > >> > >> > >> On Tue, Apr 11, 2017 at 8:51 AM, Mahendra Kariya < > >> mahendra.kar...@go-jek.com > >>> wrote: > >> > >>> Hey All, > >>> > >>> Is the auto offset reset set to "earliest" by default in Kafka streams > >>> 0.10.2.0? I thought default was "latest". > >>> > >>> I started a new Kafka streams application with a fresh application id > and > >>> it started consuming messages from the beginning. > >>> > >> > > > >
Re: auto.offset.reset for Kafka streams 0.10.2.0
Default for Streams is "earliest" cf. https://github.com/apache/kafka/blob/0.10.2.0/streams/src/main/java/org/apache/kafka/streams/StreamsConfig.java#L405 -Matthias On 4/10/17 9:41 PM, Mahendra Kariya wrote: > This was even my assumption. But I had to explicitly specify > auto.offset.reset=latest. Without this config, it started from "earliest"! > > On Tue, Apr 11, 2017 at 10:07 AM, Sachin Mittalwrote: > >> As far as I know default is latest, if no offsets are found. Otherwise it >> starts from the offset. >> >> >> On Tue, Apr 11, 2017 at 8:51 AM, Mahendra Kariya < >> mahendra.kar...@go-jek.com >>> wrote: >> >>> Hey All, >>> >>> Is the auto offset reset set to "earliest" by default in Kafka streams >>> 0.10.2.0? I thought default was "latest". >>> >>> I started a new Kafka streams application with a fresh application id and >>> it started consuming messages from the beginning. >>> >> > signature.asc Description: OpenPGP digital signature
Re: auto.offset.reset for Kafka streams 0.10.2.0
This was even my assumption. But I had to explicitly specify auto.offset.reset=latest. Without this config, it started from "earliest"! On Tue, Apr 11, 2017 at 10:07 AM, Sachin Mittalwrote: > As far as I know default is latest, if no offsets are found. Otherwise it > starts from the offset. > > > On Tue, Apr 11, 2017 at 8:51 AM, Mahendra Kariya < > mahendra.kar...@go-jek.com > > wrote: > > > Hey All, > > > > Is the auto offset reset set to "earliest" by default in Kafka streams > > 0.10.2.0? I thought default was "latest". > > > > I started a new Kafka streams application with a fresh application id and > > it started consuming messages from the beginning. > > >
Re: auto.offset.reset for Kafka streams 0.10.2.0
As far as I know default is latest, if no offsets are found. Otherwise it starts from the offset. On Tue, Apr 11, 2017 at 8:51 AM, Mahendra Kariyawrote: > Hey All, > > Is the auto offset reset set to "earliest" by default in Kafka streams > 0.10.2.0? I thought default was "latest". > > I started a new Kafka streams application with a fresh application id and > it started consuming messages from the beginning. >
auto.offset.reset for Kafka streams 0.10.2.0
Hey All, Is the auto offset reset set to "earliest" by default in Kafka streams 0.10.2.0? I thought default was "latest". I started a new Kafka streams application with a fresh application id and it started consuming messages from the beginning.