RE: producer creating multiple log files after message sending

Thanks Neha, -Original Message- From: Neha Narkhede [mailto:neha.narkh...@gmail.com] Sent: Wednesday, April 17, 2013 9:08 PM To: users@kafka.apache.org Subject: Re: producer creating multiple log files after message sending Hi Snehalata, Would you grep through the log4j files for the to

Re: How to create the initial zookeeper chroot path for zk.connect?

Hi, Yes, I can see the new path exists by using the command "ls /" On Thu, Apr 18, 2013 at 1:29 AM, Neha Narkhede wrote: > After creating the path, did you get a chance to confirm that it got > created correctly ? > > Thanks, > Neha > > On Wed, Apr 17, 2013 at 9:30 AM, Ryan Chan wrote: > > So

Re: How to create the initial zookeeper chroot path for zk.connect?

After creating the path, did you get a chance to confirm that it got created correctly ? Thanks, Neha On Wed, Apr 17, 2013 at 9:30 AM, Ryan Chan wrote: > Sorry as I am new to Kafka/ZK, but the instruction seems not clear.. > > In the config, it was said that we can use a chroot-ed ZK ( > http://

Re: no logs received when a broker restart after clearing its logs

This issue doesn't exist in 0.8 since we got rid of the zookeeper based producer altogether. Thanks Neha On Wed, Apr 17, 2013 at 10:12 AM, Jason Rosenberg wrote: > Will this issue be fixed in 0.8? > > > On Wed, Apr 17, 2013 at 7:40 AM, 王国栋 wrote: > >> Thanks Neha. >> >> Yes, I believe we run in

Re: no logs received when a broker restart after clearing its logs

Will this issue be fixed in 0.8? On Wed, Apr 17, 2013 at 7:40 AM, 王国栋 wrote: > Thanks Neha. > > Yes, I believe we run into this issue. > > We will try this patch. Currently, make topic-partition directory manually > is OK for us. > > > Guodong > > > On Wed, Apr 17, 2013 at 9:24 PM, Neha Narkhe

How to create the initial zookeeper chroot path for zk.connect?

Sorry as I am new to Kafka/ZK, but the instruction seems not clear.. In the config, it was said that we can use a chroot-ed ZK ( http://kafka.apache.org/configuration.html), e.g. localhost:2181/kafka But when I start the Kafka using the setting, it was showing.. java.lang.IllegalArgumentExceptio

Re: producer creating multiple log files after message sending

Hi Snehalata, Would you grep through the log4j files for the topic under consideration and look for "Rolling.*due to". This will tell us why the log is getting rolled over. Thanks, Neha On Wed, Apr 17, 2013 at 12:05 AM, Snehalata Nagaje wrote: > Hi, > > > > I am using kafak 0.8 version and send

Re: Question about Partitions not receive equal number messages

Hi Neha, We can not understand why the partitions will be unbalanced if each thread gets different number of messages. We go through the code of producer, and the partition number is generated by "random.nextInt(numOfPartitions)", so we think even if different thread gets different number of mess

Re: no logs received when a broker restart after clearing its logs

Thanks Neha. Yes, I believe we run into this issue. We will try this patch. Currently, make topic-partition directory manually is OK for us. Guodong On Wed, Apr 17, 2013 at 9:24 PM, Neha Narkhede wrote: > Can you check if you are hitting this > https://issues.apache.org/jira/browse/KAFKA-27

Re: Question about Partitions not receive equal number messages

I suspect each of the threads are not assigned equal number of messages to send. I don't think it matter whether you use one producer or more as long as you distribute work amongst those threads equally. Thanks, Neha On Wednesday, April 17, 2013, Helin Xiang wrote: > Hi， > We are using kafka 0.7

Re: no logs received when a broker restart after clearing its logs

Can you check if you are hitting this https://issues.apache.org/jira/browse/KAFKA-278 ? Thanks, Neha On Wednesday, April 17, 2013, Helin Xiang wrote: > Hi, we are using kafka 0.7.2 > > We start 2 brokers, and running for a while. After that, we shut 1 broker > down, remove its data directory, an

no logs received when a broker restart after clearing its logs

Hi, we are using kafka 0.7.2 We start 2 brokers, and running for a while. After that, we shut 1 broker down, remove its data directory, and restart it. But the broker won't receive any logs. We checked the zookeeper, finding that old topic contain only 1 broker id. After that, we manually make som

Question about Partitions not receive equal number messages

Hi， We are using kafka 0.7.2. The situation is a little complicated: 1. We use Java API and multi-thread to send logs to kafka. (like 16 threads). Each thread contain its own kafka.javaapi.producer.Producer object. 2. There is one topic which the partition of is set to 4. we use random partitio

producer creating multiple log files after message sending

Hi, I am using kafak 0.8 version and sending messages to kafka server using below code, Producer producer = new Producer(new ProducerConfig(props)); producer.send(new KeyedMessage(topicName,partitionKey,jsonString)); producer.close(); I am able to post messages with, but after certain