Default MirrorMaker not copying over from source to target

2015-02-15 Thread Alex Melville
Hi Kafka'ers, I am trying to get the Mirrormaker working with two separate clusters, one as the source and the other as the target. The topic I'm trying to copy over exists on both the source and target clusters. Here are the relevant entries in my consumer and producer properties files, which

Number of Events Mismatch from source to destination

2015-02-15 Thread Vineet Mishra
Hi All, I am having a Kafka Storm Topology which is ingesting events published to Kafka and processing on top of that data. Although apart from some latency I found that everything was going good. But recently I came across a issue which I couldn't get any solution yet. I publishing some events

Re: API to get the partition number

2015-02-15 Thread tao xiao
You can get the partition number and offset of the message by MessageAndMetadata.partition() and MessageAndMetadata.offset(). To your scenario you can turn off auto commit auto.commit.enable=false and then commit by yourself after finishing message consumption. On Mon, Feb 16, 2015 at 1:40 PM,