Re: Kafka MirrorMaker - not replicating messages after being brought up

2017-06-21 Thread karan alang
Hi Richard, thanks for the response .. i was able to get this to work, by adding auto.offset.reset=earliest in consumer.properties. Atleast the count matched, i'll check on the contents to ensure there are no duplicates. However, when i set auto.offset.reset=latest, i did not see any effect. Whe

RE: Kafka MirrorMaker - not replicating messages after being brought up

2017-06-21 Thread ext-gfenol...@eramet-sln.nc
brokers... so maybe it’s related. -Message d'origine- De : Richard Shaw [mailto:rich...@aggress.net] Envoyé : jeudi 22 juin 2017 15:06 À : users@kafka.apache.org Objet : Re: Kafka MirrorMaker - not replicating messages after being brought up Karan, have you got auto.offset.reset in

Re: Kafka MirrorMaker - not replicating messages after being brought up

2017-06-21 Thread Richard Shaw
Karan, have you got auto.offset.reset in your consumer.properties? https://kafka.apache.org/documentation/#newconsumerconfigs On Thu, Jun 22, 2017 at 2:00 AM, karan alang wrote: > Hi All, > > I've 2 Kafka clusters (Kafka 10) & I'm trying to test the MirrorMaker > functionality. > > Here is what

Kafka MirrorMaker - not replicating messages after being brought up

2017-06-21 Thread karan alang
Hi All, I've 2 Kafka clusters (Kafka 10) & I'm trying to test the MirrorMaker functionality. Here is what i did : 1) I have identical topics Topic1 on 2 Kafka clusters - Cluster1 & Cluster2 2) On Cluster1, I publish 100 messages on Topic1 3) I've 2 consumers reading messages from the 2 topics o