Re: [Dev] Issue in Kafka producer load testing

2014-12-23 Thread Kathees Rajendram
Hi Kasun, Now we can send more messages to Kafka single server. I have shared the comparison results[1] for JMS producer Vs Kafka producer transport in ESB. [1] - https://docs.google.com/a/wso2.com/spreadsheets/d/1LrzxDh98V8PBfXctQ6v6MWZitCKg9Bm41ju5gHZTNWE/edit#gid=0 Thanks, Kathees On Thu, O

Re: [Dev] Issue in Kafka producer load testing

2014-10-15 Thread Kathees Rajendram
Hi Kasun, I have tested Kafka producer side of Kafka ESB connector and shared the document[1]. Kafka inbound throughput average is around 1/s.Current Kafka inbound implementation has a limitation that we cannot reduce the time interval less than 1000 ms. [1] - https://docs.google.com/a/wso2.com/s

Re: [Dev] Issue in Kafka producer load testing

2014-10-15 Thread Kasun Indrasiri
Hi Kathees, Can you please share the performance stats for consumer and producer side of the Kafka inbound and connector please. On Mon, Oct 6, 2014 at 10:29 AM, Kathees Rajendram wrote: > Hi Dushan, > > Yes I set it. Reason for this issue is that producer connection was not > closed properly.

Re: [Dev] Issue in Kafka producer load testing

2014-10-05 Thread Kathees Rajendram
Hi Dushan, Yes I set it. Reason for this issue is that producer connection was not closed properly. Now number of open file limit is enough. Thanks, Kathees On Sun, Oct 5, 2014 at 7:43 PM, Dushan Abeyruwan wrote: > ulimit ? > > have you set them in your OS > > On Sat, Oct 4, 2014 at 8:48 PM, K

Re: [Dev] Issue in Kafka producer load testing

2014-10-05 Thread Dushan Abeyruwan
ulimit ? have you set them in your OS On Sat, Oct 4, 2014 at 8:48 PM, Kathees Rajendram wrote: > > Hi, > > I tried to send 5000 messages to Kafka broker using Jmeter ( 10 thread and > 500 messages per a thread,one message size is 105 byes). After 2000 > messages I am getting the following excep

[Dev] Issue in Kafka producer load testing

2014-10-04 Thread Kathees Rajendram
Hi, I tried to send 5000 messages to Kafka broker using Jmeter ( 10 thread and 500 messages per a thread,one message size is 105 byes). After 2000 messages I am getting the following exception. Exception shows "Too many open files" error.So I changed to increase no. of open files limit on my machi