[ 
https://issues.apache.org/jira/browse/KAFKA-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Konstantine Karantasis updated KAFKA-5827:
------------------------------------------
    Comment: was deleted

(was: Now that https://issues.apache.org/jira/browse/KAFKA-5505 maybe some 
motivation behind this ticket has been addressed. Besides that, allowing a task 
to delay shutting down after stop has been signaled might interfere with 
rebalancing. 

If there's no objection I'd suggest to close this ticket as "won't fix")

> Allow configuring Kafka sink connectors to start processing records from the 
> end of topics
> ------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5827
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5827
>             Project: Kafka
>          Issue Type: Improvement
>          Components: KafkaConnect
>            Reporter: Behrang Saeedzadeh
>            Priority: Major
>
> As far as I can see, Kafka connectors start exporting data of a topic from 
> the beginning of its partitions. We have a topic that contains a few million 
> old records that we don't need but we would like to start exporting new 
> records that are added to the topic.
> Basically:
> * When the connector is started for the first time and it does not have a 
> current offset stored, it should start consuming data from the end of topic 
> partitions
> * When the connector is restarted and has a current offset for partitions 
> stored somewhere, it should start from those offsets



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to