Re: Inter Mirror maker processes offset sync

2015-01-21 Thread Guozhang Wang
Hi Tao, You may want to take a look at the current progress we are making at MM: https://issues.apache.org/jira/browse/KAFKA-1650 which makes a zero data-loss MM, and: https://issues.apache.org/jira/browse/KAFKA-1839 attempts to remove possible duplicates at MM. Guozhang On Wed, Jan 21,

Inter Mirror maker processes offset sync

2015-01-21 Thread tao xiao
Hi all, I have two mirror maker processes running on two different machines fetching messages from same topic from one data center to another data center. These two processes are assigned to the same consumer group. If I want no data loss or data duplication even when one of the mirror maker