Re: How many partition can one single machine handle in Kafka?

2014-10-24 Thread Xiaobin She
the frequency of flushing to disk. -Todd On Wed, Oct 22, 2014 at 10:09 PM, Xiaobin She xiaobin...@gmail.com wrote: Todd, Thank you for the information. With 28,000+ files and 14 disks, that makes there are averagely about 4000 open files on two disk ( which is treated as one single

Re: How many partition can one single machine handle in Kafka?

2014-10-22 Thread Xiaobin She
files (regular file handles, not network connections). In our case, we're beefing up the disk performance as much as we can by running in a RAID-10 configuration with 14 disks. -Todd On Tue, Oct 21, 2014 at 7:58 PM, Xiaobin She xiaobin...@gmail.com wrote: Todd, Actually I'm wondering how

How many partition can one single machine handle in Kafka?

2014-10-21 Thread Xiaobin She
hello, everyone I'm new to kafka, I'm wondering what's the max num of partition can one siggle machine handle in Kafka? Is there an sugeest num? Thanks. xiaobinshe

Re: How many partition can one single machine handle in Kafka?

2014-10-21 Thread Xiaobin She
(including replicas). Above that we've seen some performance and stability issues. -Todd On Tue, Oct 21, 2014 at 12:15 AM, Xiaobin She xiaobin...@gmail.com wrote: hello, everyone I'm new to kafka, I'm wondering what's the max num of partition can one siggle machine handle in Kafka