On Wed, Jan 12, 2011 at 10:39 PM, Damian Harvey <damian.har...@aon.com.au> wrote: > Claus, > > I have built the latest 2.6 trunk and run some performance tests through it. > I'm getting little change from 2.5 in terms of through-put. > > Can you recommend anything else to eek out some more performance? >
Use general performance advice. Adjust the seda concurrent consumers to a reasonable size. It depends on what your tasks do. Are they crunching numbers (heavy CPU) then lower the numbers, if they do mostly remote IO-work (waiting for data to arrive back from remote servers) then a reasonable / high number works better. Use a profiler. Disable JMX if you dont need it. Adjust JVM and memory. Use a profiler to figure out where your bottlenecks are. Don't guess. > Thanks, > > Damian. > > > -----Original Message----- > From: Damian Harvey > Sent: Tuesday, 11 January 2011 8:08 AM > To: users@camel.apache.org > Subject: RE: Performance > > Claus, > > I'm using 2.5. I'll pull down the latest and try that. > > Is my understanding correct in that these settings should allow for this > number of concurrent users? > > Thanks, > > Damian. > > -----Original Message----- > From: Claus Ibsen [mailto:claus.ib...@gmail.com] > Sent: Tuesday, 11 January 2011 1:16 AM > To: users@camel.apache.org > Subject: Re: Performance > > What version of Camel do you use? > > I found an issue in Camel 2.5 with the seda component. There is some special > logic if you use the option multipleConsumers which is used to multicast > messages to multiple consumers. And this requires thread pool in the work > doing that, as its parallel processing that work. > Unfortunately the issue in Camel 2.5 is that it creates those thread pool, > even if its not needed. > > I have fixed it on trunk > https://issues.apache.org/jira/browse/CAMEL-3523 > > So this may impact a system if you use a lot of seda endpoints. > > In your case you can try using a profiler to see if it can help identify > bottlenecks. > For example YourKit is a good profiler. > > > On Mon, Jan 10, 2011 at 1:09 AM, Damian Harvey <damian.har...@aon.com.au> > wrote: >> I'm running performance tests and noticing that under load I am getting >> increasingly large amounts of time spent in the SEDA queues. >> >> For example below are some lines from my log when the app is under load (20 >> concurrent threads). The first is from one Route (Get360List) that then call >> the calls the 3 routes via multicast in parallel (GetPolicyList, GetFeeList, >> GetClaimList). >> >> There is a ~600ms delay between the multicast being called and the Consumers >> on those SEDA queues picking up the messages. I have 30 concurrent consumers >> set for each SEDA endpoint, so I would have thought that there would be no >> shortage of consumers to pull messages from these queues. >> >> Are there any other settings that I should be looking at to reduce this >> delay? >> >> 2011-01-10 10:57:02,249 [a://get360Start] INFO Aon_360Request >> -(ID-aon43098-1487-1294617268515-0-3526) Started Single Client >> AONZBAD2571 for Get360List >> 2011-01-10 10:57:02,827 [PolicyListStart] INFO Aon_GetPolicyListRoute >> -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for >> GetPolicyList >> 2011-01-10 10:57:02,827 [PolicyListStart] INFO ExecProducer >> -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand >> [args=[cbslocal, AONZBAD2571PDTrue], >> executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat, >> timeout=9223372036854775807, outFile=null, workingDir=null, >> useStderrOnEmptyStdout=true] >> 2011-01-10 10:57:02,827 [PolicyListStart] INFO GetOsCmdRouteBuilder$1 >> -(ID-aon43098-1487-1294617268515-0-3526) Calling command: >> C:/workspaces/CRMS/MockCBS/GetPolicyList.bat cbslocal >> AONZBAD2571PDTrue >> 2011-01-10 10:57:02,827 [getFeeListStart] INFO Aon_GetFeeListRoute >> -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for >> GetFeeList >> 2011-01-10 10:57:02,827 [tClaimListStart] INFO Aon_GetClaimListRoute >> -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for >> GetClaimList >> 2011-01-10 10:57:02,827 [tClaimListStart] INFO GetOsCmdRouteBuilder$1 >> -(ID-aon43098-1487-1294617268515-0-3526) Calling command: >> C:/workspaces/CRMS/MockCBS/GetClaimList.bat cbslocal AONZBAD2571TrueD >> 2011-01-10 10:57:03,015 [PolicyListStart] INFO ExecProducer >> -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand >> [args=[cbslocal, AONZBAD2571PDTrue], >> executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat, >> timeout=9223372036854775807, outFile=null, workingDir=null, >> useStderrOnEmptyStdout=true] had exit value 0 >> 2011-01-10 10:57:03,499 [PolicyListStart] INFO Aon_GetPolicyListRoute >> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single >> Client for GetPolicyList >> 2011-01-10 10:57:03,593 [getFeeListStart] INFO GetOsCmdRouteBuilder$1 >> -(ID-aon43098-1487-1294617268515-0-3526) Calling command: >> C:/workspaces/CRMS/MockCBS/GetFeeList.bat cbslocal AONZBAD2571TrueD >> 2011-01-10 10:57:03,593 [tClaimListStart] INFO ExecProducer >> -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand >> [args=[cbslocal, AONZBAD2571TrueD], >> executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat, >> timeout=9223372036854775807, outFile=null, workingDir=null, >> useStderrOnEmptyStdout=true] >> 2011-01-10 10:57:03,718 [getFeeListStart] INFO ExecProducer >> -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand >> [args=[cbslocal, AONZBAD2571TrueD], >> executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat, >> timeout=9223372036854775807, outFile=null, workingDir=null, >> useStderrOnEmptyStdout=true] >> 2011-01-10 10:57:03,796 [tClaimListStart] INFO ExecProducer >> -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand >> [args=[cbslocal, AONZBAD2571TrueD], >> executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat, >> timeout=9223372036854775807, outFile=null, workingDir=null, >> useStderrOnEmptyStdout=true] had exit value 0 >> 2011-01-10 10:57:03,874 [getFeeListStart] INFO ExecProducer >> -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand >> [args=[cbslocal, AONZBAD2571TrueD], >> executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat, >> timeout=9223372036854775807, outFile=null, workingDir=null, >> useStderrOnEmptyStdout=true] had exit value 0 >> 2011-01-10 10:57:04,608 [getFeeListStart] INFO Aon_GetFeeListRoute >> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single >> Client for GetFeeList >> 2011-01-10 10:57:04,655 [tClaimListStart] INFO Aon_GetClaimListRoute >> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single >> Client for GetClaimList >> 2011-01-10 10:57:05,155 [a://get360Start] INFO Aon_360Request >> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing Single >> Client AONZBAD2571 for Get360List >> >> Thanks, >> >> Damian. >> >> >> Damian Harvey | Aon Australia/Pacific >> >> Level 31, 201 Kent Street Sydney NSW 2000 >> t: +61292537000 | f: +61292537952 >> e: damian.har...@aon.com.au<mailto:damian.har...@aon.com.au> >> >> Please consider the environment before printing this email. >> >> ________________________________ >> >> This communication (and any attachments) is directed in confidence to the >> addressee(s) listed above, and may not otherwise be distributed, copied or >> used. The contents of this communication may also be subject to privilege, >> and all rights to that privilege are expressly claimed and not waived. If >> you have received this communication in error, please notify us by reply >> e-mail or by telephone and delete this communication (and any attachments) >> without making a copy. >> >> Before opening or using attachments, you should check them for viruses and >> defects. We do not accept liability in connection with computer virus, data >> corruption, delay, interruption, unauthorised access or unauthorised >> amendment. >> > > > > -- > Claus Ibsen > ----------------- > FuseSource > Email: cib...@fusesource.com > Web: http://fusesource.com > Twitter: davsclaus > Blog: http://davsclaus.blogspot.com/ > Author of Camel in Action: http://www.manning.com/ibsen/ > > > This communication (and any attachments) is directed in confidence to the > addressee(s) listed above, and may not otherwise be distributed, copied or > used. The contents of this communication may also be subject to privilege, > and all rights to that privilege are expressly claimed and not waived. If you > have received this communication in error, please notify us by reply e-mail > or by telephone and delete this communication (and any attachments) without > making a copy. > > Before opening or using attachments, you should check them for viruses and > defects. We do not accept liability in connection with computer virus, data > corruption, delay, interruption, unauthorised access or unauthorised > amendment. > > > > ****** IMPORTANT NOTICE ****** > This email and any attachments transmitted with it are confidential. If you > are not the intended recipient, you must not use, reproduce, disclose or > distribute the information contained in this email. If you are not the > intended recipient or if you believe this is an unsolicited email, please > immediately notify the sender by replying to this email or contact Aon > representatives on +61 2 9253 7000 then promptly destroy this email and any > copies of this email. > > Before opening or using attachments, you should check them for viruses and > defects. Aon does not accept liability in connection with computer virus, > data corruption, delay, interruption, unauthorised access or unauthorised > amendment. > > > This communication (and any attachments) is directed in confidence to the > addressee(s) listed above, and may not otherwise be distributed, copied or > used. The contents of this communication may also be subject to privilege, > and all rights to that privilege are expressly claimed and not waived. If you > have received this communication in error, please notify us by reply e-mail > or by telephone and delete this communication (and any attachments) without > making a copy. > > Before opening or using attachments, you should check them for viruses and > defects. We do not accept liability in connection with computer virus, data > corruption, delay, interruption, unauthorised access or unauthorised > amendment. > > -- Claus Ibsen ----------------- FuseSource Email: cib...@fusesource.com Web: http://fusesource.com Twitter: davsclaus Blog: http://davsclaus.blogspot.com/ Author of Camel in Action: http://www.manning.com/ibsen/
