Re: Kafka server occure java.nio.BufferUnderflowException

I use c library (librdkafka) Best Regards Jerry -Original Message- From: Jun Raolt;jun...@gmail.comgt; To: users@kafka.apache.orglt;users@kafka.apache.orggt;; 陈小军lt;chenxiao...@nhn.comgt;; Cc: Sent: 2014-01-22 (星期三) 00:44:59 Subject: Re: Kafka server occure

Kafka rebalancing causes Zookeeper to fail

I have a basic Zookeeper/Kafka setup. I am still on Kafka 0.8 beta 1, and Zookeeper 3.4.5. The activity on this machine isn't massive...I would say the Kafka queues get a consistent 1 message every 2-3 seconds, as well as occasional spikes, but still nothing large enough to push the limits. Both

Re: Kafka server occure java.nio.BufferUnderflowException

Hey Jerry, this issue was fixed on dec 14 in commit 16915a2. If the problem persists in the latest version of librdkafka (0.8.2), please file a github issue here: https://github.com/edenhill/librdkafka/issues/ Thanks, Magnus 2014/1/22 陈小军 chenxiao...@nhn.com I use c library (librdkafka)

Re: Kafka rebalancing causes Zookeeper to fail

Not sure how stable ZK 3.4.5 is. Could you try 3.3.4? Also, see if https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whyaretheremanyrebalancesinmyconsumerlog? is applicable. Thanks, Jun On Wed, Jan 22, 2014 at 6:24 AM, Ahmed H. ahmed.ham...@gmail.com wrote: I have a basic

Re: Kafka rebalancing causes Zookeeper to fail

Hello, I looked at that, not sure if it is applicable or not at this point. We used to have frequent rebalances, but that issue was mitigated by increasing the zktimeout on the consumer side. With that said, it may still be a problem. I have't collected any metrics concerning rebalances in a

Re: Problem on re-adding a breakdown broker back

Is this issue re-producible? Can you try start up a new cluster, then kill one broker and check list-topics before and afterwards to see if this issue still exist? On Tue, Jan 21, 2014 at 10:07 PM, Xiao Bo xiaob...@gmail.com wrote: I also tried changing the broker id to a new id: 5 and still

Java major.minor version error

Hi, I have kafka_2.10 version 0.8.0 in my maven dependency. I am trying to run a consumer. It is throwing major.minor version error. *java.lang.UnsupportedClassVersionError: kafka/javaapi/consumer/ConsumerConnector : Unsupported major.minor version 51.0* Is the Kafka repo built against jdk 1.7?

Re: Java major.minor version error

I am using jre 1.6. All the release candidates were built against 1.7. was the final release also built against 1.7 ? On Thu, Jan 23, 2014 at 3:25 AM, Abhinav Anand ab.rv...@gmail.com wrote: Hi, I have kafka_2.10 version 0.8.0 in my maven dependency. I am trying to run a consumer. It is

Re: Java major.minor version error

0.8.0 final release was built with JDK 6 (which was RC5) /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop

Error in Kafka Producer

Hi all, I am a new user of Kafka. I tried Java example of it and it worked great. Now when I tried to write to a Producer (Java) and send ByteArray to it as a data, I get ClassCastException as below java.lang.ClassCastException: java.lang.String cannot be cast to [B at

Re: How to force producer and high level consumer to use different Ethernet cards on the kafka broker node

Sorry for the confusion. We implemented this by re-mapping the hostname to the ip on eth1 on our consumers; zookeeper can keep publishing the same hostname while different clients (producers / brokers / consumers) can map that hostname to different physical interfaces. This allows us to have

Re: Error in Kafka Producer

Hello, In your case the key's type is String, not byte array, so you need to override the following property: key.serializer.class - kafka.serializer.StringEncoder Details of the producer configs can be found: http://kafka.apache.org/documentation.html#producerconfigs On Wed, Jan 22, 2014 at

Re: Kafka rebalancing causes Zookeeper to fail

You can find some of the GC settings in https://cwiki.apache.org/confluence/display/KAFKA/Operations There were some ZK bugs exposed during session expiration, which were fixed in 3.3.4. Not sure if 3.4.5 exposes any new issues. The easiest thing is probably to avoid GC-induced ZK session timeout

Re: Kafka metrics. Issue with unclean leader election rate

Are you using the 0.8.0 release? Thanks, Jun On Wed, Jan 22, 2014 at 10:11 AM, Arathi Maddula amadd...@boardreader.comwrote: Hi, I have a 3 node Kafka cluster. Iam monitoring the JMX metrics of these 3 nodes. All topics and partitions are distributed across all 3 nodes. But node1 is

Re: Java major.minor version error

Hi Joe, I am using jre 1.6 and I don't see any reason for the error. But I am still getting the exception while running the consumer with jre 6. It runs fine with jre 7 Regards, Abhinav On Thu, Jan 23, 2014 at 3:57 AM, Joe Stein joe.st...@stealth.ly wrote: 0.8.0 final release was built with

Re: Java major.minor version error

Can you share your reference? /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop / On Jan 22, 2014, at 10:36 PM, Abhinav Anand

Re: Java major.minor version error

It would be helpful if you can reproduce the issue. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop / On Jan 22, 2014, at 11:22

Re: Java major.minor version error

Hi Joe, I am trying to setup a Kafka Simple Consumer in java. I am using the kafka.consumer.Consumer.createJavaConsumerConnector to create a consumer connector. The connector is used for get message streams. I am using kafka.javaapi.consumer.ConsumerConnector *Code: * import kafka.consumer.*;