Re: How auto.offset.reset = latest works

2019-10-06 Thread Matthias J. Sax
You can get the assigned partitions via `Consumer#assignment()`. And yes, if `auto.offset.reset` triggers and it set to "latest" the consumer will get the end-offset for each assigned partition and start reading from there. -Matthias On 10/3/19 12:29 PM, Hrishikesh Mishra wrote: > Hi, > > I wa

Re: How auto.offset.reset = latest works

2019-10-03 Thread M. Manna
If I get your question right, your concern isn't about auto.offset.reset - it's the partition assignment. consumer group represents parallelism. It's well-documented in Kafka official docs. Each consumer (in a consumer group) gets fare share of job (i.e. # partitions for a topic subscription). Due

How auto.offset.reset = latest works

2019-10-03 Thread Hrishikesh Mishra
Hi, I want to understand how does *auto.offset.reset = latest *work. When consumer first call poll() method, will it assign the current offsets to consumer for all partition (when single consumer is up in a consumer group)? How do I know all partitions are assigned to a consumer? Regards Hrishik