Liquan Pei created KAFKA-3462:
---------------------------------
Summary: Allow SinkTasks to disable consumer offset commit
Key: KAFKA-3462
URL: https://issues.apache.org/jira/browse/KAFKA-3462
Project: Kafka
Issue Type: Bug
Components: copycat
Affects Versions: 0.10.1.0
Reporter: Liquan Pei
Assignee: Liquan Pei
Priority: Minor
Fix For: 0.10.1.0
SinkTasks should be able to disable consumer offset commit if they manage
offsets in the sink data store rather than using Kafka consumer offsets. For
example, an HDFS connector might record offsets in HDFS to provide exactly once
delivery. When the SinkTask is started or a rebalance occurs, the task
would reload offsets from HDFS. In this case, disabling consumer offset commit
will save some CPU cycles and network IOs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)