Randall Hauch created KAFKA-3821:
------------------------------------
Summary: Allow Kafka Connect source tasks to produce offset
without writing to topics
Key: KAFKA-3821
URL: https://issues.apache.org/jira/browse/KAFKA-3821
Project: Kafka
Issue Type: Improvement
Components: KafkaConnect
Affects Versions: 0.9.0.1
Reporter: Randall Hauch
Assignee: Ewen Cheslack-Postava
Provide a way for a {{SourceTask}} implementation to record a new offset for a
given partition without necessarily writing a source record to a topic.
Consider a connector task that uses the same offset when producing an unknown
number of {{SourceRecord}} objects (e.g., it is taking a snapshot of a
database). Once the task completes those records, the connector wants to update
the offsets (e.g., the snapshot is complete) but has no more records to be
written to a topic. With this change, the task could simply supply an updated
offset.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
