Issue with Kafka Broker

2016-04-10 Thread Mudit Agarwal
Hi Guys, I have 3 node kafka setup.Version is 0.9.0.1.I bounced the kafka-server and zookeeper services on broker 3 node.Post that i am seeing below messages in logs continuosly.Any help will be highly appreciated. [2016-04-11 05:24:56,074] WARN [Replica Manager on Broker 3]: While recording

Apache kafka listener listens less messages than produced

2016-04-10 Thread Ratha v
I use old kafka consumer and producer(v 0.8x) When i produce 10 messages i get only 6 messages..Is there anything wrong in my listener .properties? I start listener first then producing .. *Listener properties* enable.auto.commit=true auto.commit.interval.ms=101

Re: Log Retention: What gets deleted

2016-04-10 Thread Gwen Shapira
Agree! Thats a serious problem. We are trying to fix this in the upcoming release. Gwen On Fri, Apr 8, 2016 at 2:56 PM, Anandha L Ranganathan wrote: > Thanks. > > I have seen this in our system would like to understand the behavior of the > log segment. > > How the log

Re: Kafka Newbie question

2016-04-10 Thread Liquan Pei
Hi Predeep, I think I misinterpreted your question. Are you trying to consume a topic multiple times for each consumer instance or consume one topic with multiple consumer instances? In case that you want to consume a topic multiple times with one consumer instance, `seekToBeginning`` will reset

Re: Kafka Newbie question

2016-04-10 Thread Harsha
Pradeep, How about https://kafka.apache.org/090/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html#seekToBeginning%28org.apache.kafka.common.TopicPartition...%29 -Harsha On Sat, Apr 9, 2016, at 09:48 PM, Pradeep Bhattiprolu wrote: > Liquan , thanks for the