Re: Kafka Connect Source questions

2017-10-13 Thread Randall Hauch
On Thu, Oct 12, 2017 at 1:59 AM, Stephane Maarek < steph...@simplemachines.com.au> wrote: > Hi, > > > > I had a look at the Connect Source Worker code and have two questions: > When a Source Task commits offsets, does it perform compaction / > optimisation before sending off? E.g. I read from 1 s

Kafka Connect Source questions

2017-10-11 Thread Stephane Maarek
Hi, I had a look at the Connect Source Worker code and have two questions: When a Source Task commits offsets, does it perform compaction / optimisation before sending off? E.g.  I read from 1 source partition, and I read 1000 messages. Will the offset flush send 1000 messages to the offset s