[ 
https://issues.apache.org/jira/browse/KAFKA-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009365#comment-17009365
 ] 

Nitish Goyal commented on KAFKA-9351:
-------------------------------------

[~ryannedolan] These are event counts

At times, I only see a small difference in events count (which is well 
explained by retries in producer). But few times, I see a huge difference in 
events counts (which I am worried about)

Eg : A partition with few million events would have difference of few hundred 
thousands records

 

Is this an expected behavior? Can producer retries can cause difference of few 
hundred thousands records in destination cluster?

> Higher count in destination cluster using Kafka MM2
> ---------------------------------------------------
>
>                 Key: KAFKA-9351
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9351
>             Project: Kafka
>          Issue Type: Bug
>          Components: mirrormaker
>    Affects Versions: 2.4.0
>            Reporter: Nitish Goyal
>            Priority: Minor
>
> I have setup replication between cluster across different data centres. After 
> setting up replication, at times, I am observing higher event count in 
> destination cluster
> Below are counts in source and destination cluster
>  
> *Source Cluster*
> ```
>  
> events_4:0:51048
> events_4:1:52250
> events_4:2:51526
> ```
>  
> *Destination Cluster*
> ```
> nm5.events_4:0:53289
> nm5.events_4:1:54569
> nm5.events_4:2:53733
> ```
>  
> This is a blocker for us to start using MM2 replicatior



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to