how many instances of the broker is suggested in one server.

2014-05-26 Thread Zhujie (zhujie, Smartcare)
Hi all, I have one question, how many instances of the broker is suggested in one server? We start three instances, the performance will be three times faster than one instance. So how many instances should I start? Most appreciated zhujie

答复: how many instances of the broker is suggested in one server.

2014-05-26 Thread Zhujie (zhujie, Smartcare)
instances on a server will compete for memory (e.g., for pagecache, jvm heap, etc), storage (log space) and CPU. Thanks, Jun On Sun, May 25, 2014 at 11:10 PM, Zhujie (zhujie, Smartcare) first.zhu...@huawei.com wrote: Hi all, I have one question, how many instances of the broker is suggested

答复: kafka performance question

2014-05-25 Thread Zhujie (zhujie, Smartcare)
increasing batch.num.messages. Thanks, Jun On Tue, May 13, 2014 at 5:56 PM, Zhujie (zhujie, Smartcare) first.zhu...@huawei.com wrote: Dear all, We want to use kafka to collect and dispatch data file, but the performance is maybe lower than we want. In our cluster

kafka performance question

2014-05-13 Thread Zhujie (zhujie, Smartcare)
Dear all, We want to use kafka to collect and dispatch data file, but the performance is maybe lower than we want. In our cluster,there is a provider and a broker. We use a one thread read file from local disk of provider and send it to broker. The average throughput is only 3 MB/S~4MB/S. But