RE: Looks like consumer fetchers get stopped we are not getting any data

2014-01-11 Thread Seshadri, Balaji
Currently its set to default,whats the timeout should we increase to. From: Guozhang Wang [wangg...@gmail.com] Sent: Saturday, January 11, 2014 3:53 PM To: users@kafka.apache.org Subject: Re: Looks like consumer fetchers get stopped we are not getting any d

restoring broker node / zookeeper question

2014-01-11 Thread Ran RanUser
I have two questions: 1. We plan to initially run Kafka without partitioning or replication, simply having two single node Kafka (broker) servers in two geographically diverse locations. Using periodic backups/snapshots across locations for disaster recovery. Our producer / consumer application

RE: Looks like consumer fetchers get stopped we are not getting any data

2014-01-11 Thread Nanjegowda, Mithunraj
We have attached more logs where the fetchers are stopped. https://issues.apache.org/jira/browse/KAFKA-693 issue mentions about this issue, and do we need to upgrade to 0.8.0 release for this fix? Regards, RJ -Original Message- From: Seshadri, Balaji Sent: Saturday, January 11, 2014 3:

Re: Looks like consumer fetchers get stopped we are not getting any data

2014-01-11 Thread Guozhang Wang
>From the logs it seems the consumer's ZK registry log has lost, while KAFKA-693 is mainly due to server side issue. Could you check if there is a session timeout from the consumer on ZK log. Guozhang On Sat, Jan 11, 2014 at 2:33 PM, Seshadri, Balaji wrote: > We found the below bug in Kafka JIR

RE: Looks like consumer fetchers get stopped we are not getting any data

2014-01-11 Thread Seshadri, Balaji
We found the below bug in Kafka JIRA. https://issues.apache.org/jira/browse/KAFKA-693 Could you guys please let us know if this bug is causing the fetchers getting stooped because of rebalance failure,we are using 0.8-beta and this fix seems to be in 0.8 version. The issue happens only when we

Re: custom kafka consumer - strangeness

2014-01-11 Thread Gerrit Jansen van Vuuren
I'm also seeing the following. I consume the data in the queue. Then after 10 seconds send another fetch request (with the incremented offset), and never receives a response from the broker, my code eventually times out (after 30seconds). The broker writes Expiring fetch request Name: FetchReques

Re: custom kafka consumer - strangeness

2014-01-11 Thread Gerrit Jansen van Vuuren
Hi, No the offsets are not the same. I've printed out the values to see this, and its not the case. On Fri, Jan 10, 2014 at 5:02 PM, Jun Rao wrote: > Are the offset used in the 2 fetch requests the same? If so, you will get > the same messages twice. You consumer is responsible for advancing

Re: Kafka with Docker - producer disconnecting

2014-01-11 Thread Thomas
Hi, you can have a look at https://github.com/wurstmeister/kafka-docker maybe that helps On 10/01/2014 19:30, Alex Artigues wrote: Hi everyone, I am attempting to run Zookeeper and Kafka in dockers. Both startup normally and Kafka connects ok. I think my containers are linked fine because I a