Liquan Pei created KAFKA-3462:
---------------------------------

             Summary: Allow SinkTasks to disable consumer offset commit 
                 Key: KAFKA-3462
                 URL: https://issues.apache.org/jira/browse/KAFKA-3462
             Project: Kafka
          Issue Type: Bug
          Components: copycat
    Affects Versions: 0.10.1.0
            Reporter: Liquan Pei
            Assignee: Liquan Pei
            Priority: Minor
             Fix For: 0.10.1.0


 SinkTasks should be able to disable consumer offset commit if they manage 
offsets in the sink data store rather than using Kafka consumer offsets.  For 
example, an HDFS connector might record offsets in HDFS to provide exactly once 
delivery. When the SinkTask is started or a rebalance occurs, the task
would reload offsets from HDFS. In this case, disabling consumer offset commit 
will save some CPU cycles and network IOs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to