Re: zookeeper version issue

2013-05-31 Thread Neha Narkhede
Actually, the version of zookeeper that Kafka 08 and 07 depend on is 3.3.4. Zookeeper 3.3.3 has known serious bugs with lost watchers. Thanks, Neha On Fri, May 31, 2013 at 10:22 AM, Dennis Haller dhal...@talemetry.comwrote: The version of zookeeper embedded with Kafka 0.8 is still v. 3.3.3.

High level zookeeper consumer life

2013-05-31 Thread arathi maddula
Hi, I use a high level consumer inside a servlet which reads from Kafka stream. Every time I send an HTTP request, I use a different group ID. This results in lots of consumers on zookeeper node( ls /consumers on zookeeper client shows list of all consumers). Please help me clarify these: 1)Is

Custom partitioner

2013-05-31 Thread Timothy Chen
Hi, I'm trying to add my own custom partitioner and saw the example in the 0.8 producer example in the wiki. However, when I set a broker list and set the custom partitioner class name I did in the client, I see this error: Partitioner cannot be used when broker list is set Does this means

Re: High level zookeeper consumer life

2013-05-31 Thread Jun Rao
Consumers are not auto deleted from ZK. So, you will need to reuse the group ID and existing consumer instances on the group. For the relationship btw partitions and consumers, see #4 in http://kafka.apache.org/faq.html. Rebalance failures are typically transient, but are more likely with more

Re: Maximum no. of connections to kafka from a single machine

2013-05-31 Thread Jun Rao
There is no hard limit. There may be soft limits such as open file handlers. Thanks, Jun On Fri, May 31, 2013 at 3:13 PM, arathi maddula arathimadd...@gmail.comwrote: Hi, Is there a limit to the maximum no. of connections a high level consumer, running on a single machine, can create to

Re: Custom partitioner

2013-05-31 Thread Tim Chen (343)
I am using 0.8 Kafka with c# client. Tim Sent from my iPhone On May 31, 2013, at 8:50 PM, Jun Rao jun...@gmail.com wrote: Are you using the 0.8 branch code? That error is for the 0.7 release. Thanks, Jun On Fri, May 31, 2013 at 1:42 PM, Timothy Chen tnac...@gmail.com wrote: Hi,