Re: Kafka ingestion data not equally distribute among brokers

2018-11-08 Thread Shiuh Rong Yong
.html> > > ProducerRecord> > > regards> > > > > On Tue, Nov 6, 2018 at 5:46 PM Shiuh Rong Yong <> > shiuhrongy...@cirosolution.com> wrote:> > > > Hi Manoj,> > >> > > I am new on Kafka, is it something mentioned on th

Re: Kafka ingestion data not equally distribute among brokers

2018-11-06 Thread Shiuh Rong Yong
Hi Manoj, I am new on Kafka, is it something mentioned on this site? https://kafka.apache.org/0100/javadoc/org/apache/kafka/streams/state/KeyValueStore.html Where can we set the key and value in Kafka? Thanks! - Original Message - From: "Manoj Khangaonkar" To: "users" Sent:

one of the Kafka node slow

2018-11-02 Thread Shiuh Rong Yong
Hi there, We have a dev cluster with 3 nodes Hadoop and we have installed Kafka on them. However during ingestion from Mysql binlog, we notice that 2 of the nodes are a slower, between the 2 nodes, one node has the lowest byte out to consumer. We can see that in the grafana graph in our