[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770488#comment-16770488 ] Matthias J. Sax commented on KAFKA-7815: Moving all major/minor/trivial tickets that are not merged yet out of 2.2 release. > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748916#comment-16748916 ] Ryanne Dolan commented on KAFKA-7815: - Pull Request > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745471#comment-16745471 ] Ryanne Dolan commented on KAFKA-7815: - [~cricket007] given the KIP freeze for 2.2.0 in the near future, I'd rather not expand the scope of this KIP, but I agree that something like that KIP worthy :) > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745281#comment-16745281 ] Jordan Moore commented on KAFKA-7815: - So, I was thinking about putting something like "recordLogged" as well into a SinkTasks - a callback that the record reached the sink. I understand that might need a new KIP, but I feel like the scope might be able to be expanded to include that? One use case - HDFS / S3 Connector, when a file is written, I want a callback to register a Hive Metastore partition. > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742721#comment-16742721 ] Matthias J. Sax commented on KAFKA-7815: Thanks a lot :) > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742500#comment-16742500 ] Ryanne Dolan commented on KAFKA-7815: - thanks [~mjsax], changed to 416. Concurrency is hard :) > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-7815) SourceTask should expose ACK'd offsets, metadata
[ https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16741444#comment-16741444 ] Matthias J. Sax commented on KAFKA-7815: [~ryannedolan] It seems that KIP number 414 is already used – can you please update the KIP number to avoid a conflict. Thanks a lot! > SourceTask should expose ACK'd offsets, metadata > > > Key: KAFKA-7815 > URL: https://issues.apache.org/jira/browse/KAFKA-7815 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect >Reporter: Ryanne Dolan >Assignee: Ryanne Dolan >Priority: Minor > Fix For: 2.2.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > Add a new callback method, recordLogged(), to notify SourceTasks when a > record is ACK'd by the downstream broker. Include offsets and metadata of > ACK'd record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
