Re: offset-management-in-kafka

2015-04-08 Thread Yosi Botzer
- the default is still zookeeper, so the consumers should set it to 'kafka'. The documentation also explain how to migrate from zookeeper offsets to kafka offsets. Gwen On Wed, Apr 8, 2015 at 8:13 AM, Yosi Botzer yosi.bot...@gmail.com wrote: Hi, I have seen this presentation: http

Re: only one ProducerSendThread thread when running with multiple brokers (kafka 0.8)

2014-01-02 Thread yosi botzer
the batch size 3 times larger with 3 partitions. Thanks, Jun On Wed, Jan 1, 2014 at 12:43 PM, yosi botzer yosi.bot...@gmail.com wrote: Yes I am specifying a key for each message. The same producer code works much slower when sending messages to a topic with multiple partitions comparing

only one ProducerSendThread thread when running with multiple brokers (kafka 0.8)

2014-01-01 Thread yosi botzer
Hi, I am using kafka 0.8. I have 3 machines each running kafka broker. I am using async mode of my Producer. I expected to see 3 different threads with names starting with ProducerSendThread- (according to this article: http://engineering.gnip.com/kafka-async-producer/) However I can see only

Re: only one ProducerSendThread thread when running with multiple brokers (kafka 0.8)

2014-01-01 Thread yosi botzer
producer for kafka, but its nothing near complete yet. https://github.com/gerritjvv/kafka-fast Regards, Gerrit On Wed, Jan 1, 2014 at 1:17 PM, yosi botzer yosi.bot...@gmail.com wrote: Hi, I am using kafka 0.8. I have 3 machines each running kafka broker. I am using async mode of my

Re: only one ProducerSendThread thread when running with multiple brokers (kafka 0.8)

2014-01-01 Thread yosi botzer
on. On Wed, Jan 1, 2014 at 1:27 PM, yosi botzer yosi.bot...@gmail.com wrote: But shouldn't I see a separate thread per broker (I am using the async mode)? Why do I get a better performance sending a message that has fewer partitions? On Wed, Jan 1, 2014 at 2:22 PM, Gerrit

Re: only one ProducerSendThread thread when running with multiple brokers (kafka 0.8)

2014-01-01 Thread yosi botzer
for each message? Thanks, Jun On Wed, Jan 1, 2014 at 4:17 AM, yosi botzer yosi.bot...@gmail.com wrote: Hi, I am using kafka 0.8. I have 3 machines each running kafka broker. I am using async mode of my Producer. I expected to see 3 different threads with names starting