RE: KafkaConnect SinkTask::put

2017-01-09 Thread david.franklin
Hi Shikhar - many thanks - that works a treat :) -Original Message- From: Shikhar Bhushan [mailto:shik...@confluent.io] Sent: 06 January 2017 17:39 To: dev@kafka.apache.org Subject: Re: KafkaConnect SinkTask::put Sorry I forgot to specify, this needs to go into your Connect worker

Re: KafkaConnect SinkTask::put

2017-01-06 Thread Shikhar Bhushan
put it in the > wrong place? > > Thanks again, > David > > -Original Message- > From: Shikhar Bhushan [mailto:shik...@confluent.io] > Sent: 05 January 2017 18:12 > To: dev@kafka.apache.org > Subject: Re: KafkaConnect SinkTask::put > > Hi David, > &

RE: KafkaConnect SinkTask::put

2017-01-06 Thread david.franklin
ry 2017 18:12 To: dev@kafka.apache.org Subject: Re: KafkaConnect SinkTask::put Hi David, You can override the underlying consumer's `max.poll.records` setting for this. E.g. consumer.max.poll.records=500 Best, Shikhar On Thu, Jan 5, 2017 at 3:59 AM wrote: > Is there any way of l

RE: KafkaConnect SinkTask::put

2017-01-06 Thread david.franklin
Hi Shikhar - thankyou very much for that :) Best wishes, David -Original Message- From: Shikhar Bhushan [mailto:shik...@confluent.io] Sent: 05 January 2017 18:12 To: dev@kafka.apache.org Subject: Re: KafkaConnect SinkTask::put Hi David, You can override the underlying consumer&#

Re: KafkaConnect SinkTask::put

2017-01-05 Thread Shikhar Bhushan
Hi David, You can override the underlying consumer's `max.poll.records` setting for this. E.g. consumer.max.poll.records=500 Best, Shikhar On Thu, Jan 5, 2017 at 3:59 AM wrote: > Is there any way of limiting the number of events that are passed into the > call to the put(Collection) metho

KafkaConnect SinkTask::put

2017-01-05 Thread david.franklin
Is there any way of limiting the number of events that are passed into the call to the put(Collection) method? I'm writing a set of events to Kafka via a source Connector/Task and reading these from a sink Connector/Task. If I generate of the order of 10k events the number of SinkRecords passed