Claus, I have built the latest 2.6 trunk and run some performance tests through it. I'm getting little change from 2.5 in terms of through-put.
Can you recommend anything else to eek out some more performance? Thanks, Damian. -----Original Message----- From: Damian Harvey Sent: Tuesday, 11 January 2011 8:08 AM To: users@camel.apache.org Subject: RE: Performance Claus, I'm using 2.5. I'll pull down the latest and try that. Is my understanding correct in that these settings should allow for this number of concurrent users? Thanks, Damian. -----Original Message----- From: Claus Ibsen [mailto:claus.ib...@gmail.com] Sent: Tuesday, 11 January 2011 1:16 AM To: users@camel.apache.org Subject: Re: Performance What version of Camel do you use? I found an issue in Camel 2.5 with the seda component. There is some special logic if you use the option multipleConsumers which is used to multicast messages to multiple consumers. And this requires thread pool in the work doing that, as its parallel processing that work. Unfortunately the issue in Camel 2.5 is that it creates those thread pool, even if its not needed. I have fixed it on trunk https://issues.apache.org/jira/browse/CAMEL-3523 So this may impact a system if you use a lot of seda endpoints. In your case you can try using a profiler to see if it can help identify bottlenecks. For example YourKit is a good profiler. On Mon, Jan 10, 2011 at 1:09 AM, Damian Harvey <damian.har...@aon.com.au> wrote: > I'm running performance tests and noticing that under load I am getting > increasingly large amounts of time spent in the SEDA queues. > > For example below are some lines from my log when the app is under load (20 > concurrent threads). The first is from one Route (Get360List) that then call > the calls the 3 routes via multicast in parallel (GetPolicyList, GetFeeList, > GetClaimList). > > There is a ~600ms delay between the multicast being called and the Consumers > on those SEDA queues picking up the messages. I have 30 concurrent consumers > set for each SEDA endpoint, so I would have thought that there would be no > shortage of consumers to pull messages from these queues. > > Are there any other settings that I should be looking at to reduce this delay? > > 2011-01-10 10:57:02,249 [a://get360Start] INFO Aon_360Request > -(ID-aon43098-1487-1294617268515-0-3526) Started Single Client > AONZBAD2571 for Get360List > 2011-01-10 10:57:02,827 [PolicyListStart] INFO Aon_GetPolicyListRoute > -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for > GetPolicyList > 2011-01-10 10:57:02,827 [PolicyListStart] INFO ExecProducer > -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand > [args=[cbslocal, AONZBAD2571PDTrue], > executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat, > timeout=9223372036854775807, outFile=null, workingDir=null, > useStderrOnEmptyStdout=true] > 2011-01-10 10:57:02,827 [PolicyListStart] INFO GetOsCmdRouteBuilder$1 > -(ID-aon43098-1487-1294617268515-0-3526) Calling command: > C:/workspaces/CRMS/MockCBS/GetPolicyList.bat cbslocal > AONZBAD2571PDTrue > 2011-01-10 10:57:02,827 [getFeeListStart] INFO Aon_GetFeeListRoute > -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for > GetFeeList > 2011-01-10 10:57:02,827 [tClaimListStart] INFO Aon_GetClaimListRoute > -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for > GetClaimList > 2011-01-10 10:57:02,827 [tClaimListStart] INFO GetOsCmdRouteBuilder$1 > -(ID-aon43098-1487-1294617268515-0-3526) Calling command: > C:/workspaces/CRMS/MockCBS/GetClaimList.bat cbslocal AONZBAD2571TrueD > 2011-01-10 10:57:03,015 [PolicyListStart] INFO ExecProducer > -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand > [args=[cbslocal, AONZBAD2571PDTrue], > executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat, > timeout=9223372036854775807, outFile=null, workingDir=null, > useStderrOnEmptyStdout=true] had exit value 0 > 2011-01-10 10:57:03,499 [PolicyListStart] INFO Aon_GetPolicyListRoute > -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single > Client for GetPolicyList > 2011-01-10 10:57:03,593 [getFeeListStart] INFO GetOsCmdRouteBuilder$1 > -(ID-aon43098-1487-1294617268515-0-3526) Calling command: > C:/workspaces/CRMS/MockCBS/GetFeeList.bat cbslocal AONZBAD2571TrueD > 2011-01-10 10:57:03,593 [tClaimListStart] INFO ExecProducer > -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand > [args=[cbslocal, AONZBAD2571TrueD], > executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat, > timeout=9223372036854775807, outFile=null, workingDir=null, > useStderrOnEmptyStdout=true] > 2011-01-10 10:57:03,718 [getFeeListStart] INFO ExecProducer > -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand > [args=[cbslocal, AONZBAD2571TrueD], > executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat, > timeout=9223372036854775807, outFile=null, workingDir=null, > useStderrOnEmptyStdout=true] > 2011-01-10 10:57:03,796 [tClaimListStart] INFO ExecProducer > -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand > [args=[cbslocal, AONZBAD2571TrueD], > executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat, > timeout=9223372036854775807, outFile=null, workingDir=null, > useStderrOnEmptyStdout=true] had exit value 0 > 2011-01-10 10:57:03,874 [getFeeListStart] INFO ExecProducer > -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand > [args=[cbslocal, AONZBAD2571TrueD], > executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat, > timeout=9223372036854775807, outFile=null, workingDir=null, > useStderrOnEmptyStdout=true] had exit value 0 > 2011-01-10 10:57:04,608 [getFeeListStart] INFO Aon_GetFeeListRoute > -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single > Client for GetFeeList > 2011-01-10 10:57:04,655 [tClaimListStart] INFO Aon_GetClaimListRoute > -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single > Client for GetClaimList > 2011-01-10 10:57:05,155 [a://get360Start] INFO Aon_360Request > -(ID-aon43098-1487-1294617268515-0-3526) Finished processing Single > Client AONZBAD2571 for Get360List > > Thanks, > > Damian. > > > Damian Harvey | Aon Australia/Pacific > > Level 31, 201 Kent Street Sydney NSW 2000 > t: +61292537000 | f: +61292537952 > e: damian.har...@aon.com.au<mailto:damian.har...@aon.com.au> > > Please consider the environment before printing this email. > > ________________________________ > > This communication (and any attachments) is directed in confidence to the > addressee(s) listed above, and may not otherwise be distributed, copied or > used. The contents of this communication may also be subject to privilege, > and all rights to that privilege are expressly claimed and not waived. If you > have received this communication in error, please notify us by reply e-mail > or by telephone and delete this communication (and any attachments) without > making a copy. > > Before opening or using attachments, you should check them for viruses and > defects. We do not accept liability in connection with computer virus, data > corruption, delay, interruption, unauthorised access or unauthorised > amendment. > -- Claus Ibsen ----------------- FuseSource Email: cib...@fusesource.com Web: http://fusesource.com Twitter: davsclaus Blog: http://davsclaus.blogspot.com/ Author of Camel in Action: http://www.manning.com/ibsen/ This communication (and any attachments) is directed in confidence to the addressee(s) listed above, and may not otherwise be distributed, copied or used. The contents of this communication may also be subject to privilege, and all rights to that privilege are expressly claimed and not waived. If you have received this communication in error, please notify us by reply e-mail or by telephone and delete this communication (and any attachments) without making a copy. Before opening or using attachments, you should check them for viruses and defects. We do not accept liability in connection with computer virus, data corruption, delay, interruption, unauthorised access or unauthorised amendment. ****** IMPORTANT NOTICE ****** This email and any attachments transmitted with it are confidential. If you are not the intended recipient, you must not use, reproduce, disclose or distribute the information contained in this email. If you are not the intended recipient or if you believe this is an unsolicited email, please immediately notify the sender by replying to this email or contact Aon representatives on +61 2 9253 7000 then promptly destroy this email and any copies of this email. Before opening or using attachments, you should check them for viruses and defects. Aon does not accept liability in connection with computer virus, data corruption, delay, interruption, unauthorised access or unauthorised amendment. This communication (and any attachments) is directed in confidence to the addressee(s) listed above, and may not otherwise be distributed, copied or used. The contents of this communication may also be subject to privilege, and all rights to that privilege are expressly claimed and not waived. If you have received this communication in error, please notify us by reply e-mail or by telephone and delete this communication (and any attachments) without making a copy. Before opening or using attachments, you should check them for viruses and defects. We do not accept liability in connection with computer virus, data corruption, delay, interruption, unauthorised access or unauthorised amendment.
