Re: Duplicate Messages on the Consumer

2013-07-21 Thread Jun Rao
misconfigured, so we're thinking that may be the issue. Casey -Original Message- From: Philip O'Toole [mailto:phi...@loggly.com] Sent: Thursday, July 18, 2013 3:29 PM To: users@kafka.apache.org Cc: kafka-us...@incubator.apache.org Subject: Re: Duplicate Messages on the Consumer

RE: Duplicate Messages on the Consumer

2013-07-19 Thread Sybrandy, Casey
...@incubator.apache.org Subject: Re: Duplicate Messages on the Consumer Have you actually examined the Kafka files on disk, to make sure those dupes are really there? Or is this a case of reading the same message more than once? Philip On Thu, Jul 18, 2013 at 8:55 AM, Sybrandy, Casey casey.sybra...@six3systems.com

Duplicate Messages on the Consumer

2013-07-18 Thread Sybrandy, Casey
Hello, We recently started seeing duplicate messages appearing at our consumers. Thankfully, the database is set up so that we don't store the dupes, but it is annoying. It's not every message, only about 1% of them. We are running 0.7.0 for the broker with Zookeeper 3.3.4 from Cloudera and

Re: Duplicate Messages on the Consumer

2013-07-18 Thread Philip O'Toole
Have you actually examined the Kafka files on disk, to make sure those dupes are really there? Or is this a case of reading the same message more than once? Philip On Thu, Jul 18, 2013 at 8:55 AM, Sybrandy, Casey casey.sybra...@six3systems.com wrote: Hello, We recently started seeing