Increasing number of partitions in kafka-0.8.0-beta1

2013-11-25 Thread Vaibhav Puranik
Hi all, We have kafka-0.8.0-beta1 version installed in our production. Here is what the comment for num.partitions in config file says: # The number of logical partitions *per topic per server.* More partitions allow greater parallelism # for consumption, but also mean more files. We found out

Re: ConsumerRebalanceFailedException

2013-07-16 Thread Vaibhav Puranik
by session expirations in zookeeper - typically caused by client-side GC or flaky connections to zookeeper. On Mon, Jul 15, 2013 at 10:15 AM, Vaibhav Puranik vpura...@gmail.com wrote: Hi all, We have a small Kafka cluster (0.7.1 - 3 nodes) in EC2. The load is about 200 million events per day

ConsumerRebalanceFailedException

2013-07-15 Thread Vaibhav Puranik
Zookeeper? On a separate note, are there any JMX parameters I need to be monitoring to make sure that my kafka cluster is healthy? How can I keep watch on my kafka cluster? Regards, Vaibhav Puranik GumGum

Re: About Kafka Users Group around Hadoop Summit

2013-05-28 Thread Vaibhav Puranik
On Tue, May 21, 2013 at 10:54 AM, Vaibhav Puranik vpura...@gmail.com wrote: Any day will work for me. I am waiting for you to decide on time so that I can book my ticket accordingly! Regards, Vaibhav On Tue, May 21, 2013 at 4:47 AM, Jonathan Hodges hodg...@gmail.com wrote

Re: About Kafka Users Group around Hadoop Summit

2013-05-28 Thread Vaibhav Puranik
on Thursday evening. If not, we plan to host it at LinkedIn. Thanks, Neha On Tue, May 28, 2013 at 11:47 AM, Vaibhav Puranik vpura...@gmail.com wrote: Sorry to bug you guys, but is the date fixed? So that I can book my flight accordingly. Regards, Vaibhav GumGum On Tue, May 21, 2013

Re: About Kafka Users Group around Hadoop Summit

2013-05-21 Thread Vaibhav Puranik
, Jun On Mon, May 20, 2013 at 1:35 PM, Vaibhav Puranik vpura...@gmail.com wrote: Jun and Neha, Is there any plan for Kafka Users group meeting around Hadoop Summit? It was done last year. It really works well for people like me who don't live in SF Bay Area

About Kafka Users Group around Hadoop Summit

2013-05-20 Thread Vaibhav Puranik
Jun and Neha, Is there any plan for Kafka Users group meeting around Hadoop Summit? It was done last year. It really works well for people like me who don't live in SF Bay Area. A session on 0.8 would be great. Regards, Vaibhav Puranik GumGum

Re: Kafka at ApacheCon this week

2013-02-25 Thread Vaibhav Puranik
Hi Jun, This meetup is in Portland if I understand it correctly. Is there a plan to have a meet up in the bay area soon? We are a LA based company. I would like to attend if there is any meetup coming up soon in San Francisco bay area. Replication/Upgrading the existing cluster to 0.8 is what I