Stephane Maarek created KAFKA-4942: -------------------------------------- Summary: Kafka Connect: Offset committing times out before expected Key: KAFKA-4942 URL: https://issues.apache.org/jira/browse/KAFKA-4942 Project: Kafka Issue Type: Bug Reporter: Stephane Maarek Priority: Critical
I run a connector that deals with a lot of data, in a kafka connect cluster When the offsets are getting committed, I get the following: [2017-03-23 03:56:25,134] INFO WorkerSinkTask{id=MyConnector-1} Committing offsets (org.apache.kafka.connect.runtime.WorkerSinkTask) [2017-03-23 03:56:25,135] WARN Commit of WorkerSinkTask{id=MyConnector-1} offsets timed out (org.apache.kafka.connect.runtime.WorkerSinkTask) If you look at the timestamps, they're 1 ms apart. My settings are the following: offset.flush.interval.ms = 120000 offset.flush.timeout.ms = 60000 offset.storage.topic = _connect_offsets It seems the offset flush timeout setting is completely ignored for the look of the logs. I would expect the timeout message to happen 60 seconds after the commit offset INFO message, not 1 millisecond later. -- This message was sent by Atlassian JIRA (v6.3.15#6346)