[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-10-19 Thread Dima Koroliuk (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1280#comment-1280 ] Dima Koroliuk commented on KAFKA-10339: --- [~gharris1727] thank you for the explanation! >

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-10-18 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776850#comment-17776850 ] Greg Harris commented on KAFKA-10339: - [~funkerman] Hello! In your example, no, because auto-synced

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-10-17 Thread Dima Koroliyk (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776196#comment-17776196 ] Dima Koroliyk commented on KAFKA-10339: --- [~yangguo1220] Hello! Can you please clarify whether EOS

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-09-20 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767334#comment-17767334 ] Greg Harris commented on KAFKA-10339: - Please note that this KAFKA ticket only applies to data

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-09-19 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766887#comment-17766887 ] Chris Egerton commented on KAFKA-10339: --- There is no MirrorSinkConnector; we never implemented

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-09-18 Thread Angelos Kaltsikis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766260#comment-17766260 ] Angelos Kaltsikis commented on KAFKA-10339: --- [~ChrisEgerton] Does that mean that the end to

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2023-08-02 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750338#comment-17750338 ] Chris Egerton commented on KAFKA-10339: --- Now that KAFKA-6080 has been resolved with

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-09-21 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199546#comment-17199546 ] Ning Zhang commented on KAFKA-10339: Thanks [~mimaison], once the above PR 8730 is merged, I will

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-09-21 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199492#comment-17199492 ] Mickael Maison commented on KAFKA-10339: Thanks [~yangguo1220]. I've seen your review requests,

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-09-21 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199443#comment-17199443 ] Ning Zhang commented on KAFKA-10339: [~mimaison] When possible, very appreciated if KAFKA-10483 and 

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171670#comment-17171670 ] Ning Zhang commented on KAFKA-10339: it is true that SinkTaskContext.offsets() has been taken

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171642#comment-17171642 ] Ryanne Dolan commented on KAFKA-10339: -- I believe your proposed task.loadOffsets() is taken care of

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171612#comment-17171612 ] Ning Zhang commented on KAFKA-10339: thanks for the input. I think that sounds a working plan. Here

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171519#comment-17171519 ] Ryanne Dolan commented on KAFKA-10339: -- I think what you mean is that a read-process-write loop

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-04 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171249#comment-17171249 ] Ning Zhang commented on KAFKA-10339: Technically, transaction can not be done across clusters, so

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-03 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170425#comment-17170425 ] Ryanne Dolan commented on KAFKA-10339: -- Yeah, I guess it would be possible to switch from

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-03 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170377#comment-17170377 ] Ryanne Dolan commented on KAFKA-10339: -- [~yangguo1220] this is awesome, thanks! My team has looked

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-03 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170231#comment-17170231 ] Ning Zhang commented on KAFKA-10339: [~ryannedolan] [~mimaison] Here is the KIP I would like to get