Re: Kafka DefaultPartitioner is not behaved as expected.

The reason you need to use a.getBytes is because the default serializer.class is kafka.serializer.DefaultEncoder which takes byte[] as input. The way the array returns hash code is not based on equality of the elements hence every time a new byte array is created which is the case in your sample

Re: Kafka DefaultPartitioner is not behaved as expected.

Thanks a lot, really appreciate you guys help!!! On Thursday, March 5, 2015 9:17 PM, tao xiao xiaotao...@gmail.com wrote: The reason you need to use a.getBytes is because the default serializer.class is kafka.serializer.DefaultEncoder which takes byte[] as input. The way the array

Kafka DefaultPartitioner is not behaved as expected.

Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broker instance running and I'm experimenting kafka producer in a cluster environment. So I create a topic foo with 2 partitions and replication 1.I create a async Producer without defining partition.class (so the partitioner

Re: Kafka DefaultPartitioner is not behaved as expected.

And I'm using kafka version 0.8.2.0 On Thursday, March 5, 2015 11:51 AM, Zijing Guo alter...@yahoo.com.INVALID wrote: Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broker instance running and I'm experimenting kafka producer in a cluster environment. So I

Re: Kafka DefaultPartitioner is not behaved as expected.

I suppose the keyedMessage constructor is KeyedMessage(topic, key, message), so in your case key is test message + e. Thanks, Mayuresh On Thu, Mar 5, 2015 at 9:25 AM, Zijing Guo alter...@yahoo.com.invalid wrote: And I'm using kafka version 0.8.2.0 On Thursday, March 5, 2015 11:51 AM,

Re: Kafka DefaultPartitioner is not behaved as expected.

Hi, Thanks for your response. That's just my typo, I was meant to say  KeyedMessage(foo,a, test message + e). On Thursday, March 5, 2015 12:49 PM, Mayuresh Gharat gharatmayures...@gmail.com wrote: I suppose the keyedMessage constructor is KeyedMessage(topic, key, message), so in your

Re: Kafka DefaultPartitioner is not behaved as expected.

Zijing, Which version of Kafka client are you using? On Thu, Mar 5, 2015 at 8:50 AM, Zijing Guo alter...@yahoo.com.invalid wrote: Hi community,I have a 2 nodes test cluster with 2 zk instance and 2 broker instance running and I'm experimenting kafka producer in a cluster environment. So I

Re: Kafka DefaultPartitioner is not behaved as expected.

Hi Guozhang,I'm using kafka 0.8.2.0  Thanks On Thursday, March 5, 2015 12:57 PM, Guozhang Wang wangg...@gmail.com wrote: Zijing, Which version of Kafka client are you using? On Thu, Mar 5, 2015 at 8:50 AM, Zijing Guo alter...@yahoo.com.invalid wrote: Hi community,I have a 2 nodes

Re: Kafka DefaultPartitioner is not behaved as expected.

And also there something that I think worth mentioning,when I call  prod.send(KeyedMessage(foo, a, test message)), the data can't be delivered to the brokers, the only way to make it work is through:prod.send(KeyedMessage(foo, a.getBytes, test message.getBytes)). When I convert the data and key