The test performs a 'POST' to a cgi script that returns ~60K worth of data. All the cgi script does is sleep for 2 seconds, and write output. The cgi script looks like this:
#!/bin/bash sleep 2 cat <<! Content-type: text/html <html> <head> [about 20K bytes of useless stuff goes here] </head> <body> [about 40K bytes of useless stuff goes here] </body> </html> ! The cgi script doesn't attempt to process the POST at all, it just returns useless data. The purpose of the test was to figure out why JMeter was giving me such 'different' results between JM2.4 and JM2.6. I think I've done that now - JM2.4 (on WinXP) wasn't reporting the correct numbers in the Summary Report. Sadly this means that all my prior benchmarks are nearly useless - since the numbers there can't be trusted. But I can start a fresh set using JM2.6 now and feel pretty comfortable that the numbers are at least accurate now. -- Robin D. Wilson Sr. Director of Web Development KingsIsle Entertainment, Inc. VOICE: 512-777-1861 www.KingsIsle.com -----Original Message----- From: Deepak Goel [mailto:deic...@gmail.com] Sent: Thursday, February 16, 2012 1:08 AM To: JMeter Users List Subject: Re: Average times are confusing me... Hey Is it the test considering the "CGI Script" as an addon which it includes in a different hit to the server. And the average is the "Average of two request, one to the original page and one to the CGI Script" Your answer is 2.5 seconds. 2 second for the CGI script and 0.5 second for the overall transaction. It just treats the CGI script like an add on file. :) Deepak On 2/16/12, Philippe Mouawad <philippe.moua...@gmail.com> wrote: > These settings were introduced in 2.6. To face cpu impact on Time computing. > > In 2.4 thé settings i made you set are hère by défault afaik as nano > computing was not yet available . > > Regards > Philippe > > On Wednesday, February 15, 2012, Robin D. Wilson <rwils...@gmail.com> wrote: >> On JMeter 2.6, setting the settings you recommended fixed the problem: >> >> - sampleresult.useNanoTime=false >> - sampleresult.nanoThreadSleep=0 >> >> But it doesn't do anything for JMeter 2.4. Needless to say, I have a > bunch of re-benchmarking to do... >> >> I can file a ticket - but I am not sure that it will provide much value, > since it is clear that the above settings fix the problem. >> >> -- >> Robin D. Wilson >> Sr. Director of Web Development >> KingsIsle Entertainment, Inc. >> VOICE: 512-777-1861 >> www.KingsIsle.com >> >> >> -----Original Message----- >> From: Philippe Mouawad [mailto:philippe.moua...@gmail.com] >> Sent: Wednesday, February 15, 2012 3:52 PM >> To: JMeter Users List >> Subject: Re: Average times are confusing me... >> >> Hello, >> I think you should submit your Test as a bug just for us to check what >> could explain this. >> I made many tests on WinXP and never faced this issue so I am not > convinced >> it's the real explanation although you reproduced it. >> >> Can you also make a test by setting this in jmeter.properties: >> >> >> - sampleresult.useNanoTime=false >> - sampleresult.nanoThreadSleep=0 >> >> >> Thanks >> Regards >> Philippe >> >> >> On Wed, Feb 15, 2012 at 6:39 PM, Robin D. Wilson <rwils...@gmail.com> > wrote: >> >>> FYI, I have confirmed that my test case only fails on 'WinXP'. When I run >>> the exact same test on Win7 (x64), it works fine. >>> >>> The sad thing is, I've been benchmarking my systems using WinXP for over > a >>> year ... sigh. >>> >>> So now I find out that all my benchmark numbers are essentially bogus. >>> >>> -- >>> Robin D. Wilson >>> Sr. Director of Web Development >>> KingsIsle Entertainment, Inc. >>> VOICE: 512-777-1861 >>> www.KingsIsle.com >>> >>> >>> -----Original Message----- >>> From: Philippe Mouawad [mailto:philippe.moua...@gmail.com] >>> Sent: Monday, February 13, 2012 2:13 PM >>> To: JMeter Users List >>> Subject: Re: Average times are confusing me... >>> >>> Mac OSX 10.6.8. >>> >>> I suggest you open an issue with your attached test plan (exactly the one >>> that has the issue). >>> >>> Regards >>> Philippe >>> On Mon, Feb 13, 2012 at 8:28 PM, Robin D. Wilson <rwils...@gmail.com> >>> wrote: >>> >>> > Just out of curiosity - what type of OS was your JMeter GUI running on? >>> > I've been running my tests on Windows XP. >>> > >>> > -- >>> > Robin D. Wilson >>> > Sr. Director of Web Development >>> > KingsIsle Entertainment, Inc. >>> > VOICE: 512-777-1861 >>> > www.KingsIsle.com >>> > >>> > >>> > -----Original Message----- >>> > From: Philippe Mouawad [mailto:philippe.moua...@gmail.com] >>> > Sent: Friday, February 10, 2012 7:41 AM >>> > To: JMeter Users List >>> > Subject: Re: Average times are confusing me... >>> > >>> > Hello, >>> > I have just made the same test with a JSP (doing a Thread.sleep(2000) > => >>> > 2s) behind a Tomcat 6 with JMeter 2.6 >>> > >>> > I put 100 threads that loop 100 times in GUI mode (one JMETER): >>> > All results shown in Aggregate report are around 2s . >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> >>> >> > sampler_label,aggregate_report_count,average,aggregate_report_median,aggregate_report_90%_line,aggregate_report_min,aggregate_report >>> > >>> > >>> > _max,aggregate_report_error%,aggregate_report_rate,aggregate_report_bandwidth >>> > HTTP >>> > >>> > >>> > Request,10000,2006,2004,2012,2001,2195,0.0,49.5793194742609,1224.082013722936 >>> > >>> > TOTAL,10000,2006,2004,2012,2001,2195,0.0,49.5793194742609,1224.082013722936 >>> > >>> > >>> > Summary listener shows this: >>> > 2012/02/10 14:36:00 INFO - jmeter.reporters.Summariser: Generate > Summary >>> > Results + 2655 in 54,8s = 48,4/s Avg: 2010 Min: 2001 Max: 2195 >>> > Err: 0 (0,00%) >>> > 2012/02/10 14:38:26 INFO - jmeter.reporters.Summariser: Generate > Summary >>> > Results + 7345 in 148,9s = 49,3/s Avg: 2005 Min: 2001 Max: 2088 >>> > Err: 0 (0,00%) >>> > 2012/02/10 14:38:26 INFO - jmeter.reporters.Summariser: Generate > Summary >>> > Results = 10000 in 201,7s = 49,6/s Avg: 2006 Min: 2001 Max: 2195 >>> > Err: 0 (0,00%) >>> > >>> > So as you can see, nothing abnormal . >>> > >>> > JSP Code: >>> > >>> > <%@ page contentType="text/html; charset=UTF-8" %> >>> > <html> >>> > <body> >>> > <% >>> > Thread.sleep(2000); >>> > %> >>> > <!-- GENERATE around 25Ko page --> >>> > <%=org.apache.commons.lang.RandomStringUtils.random(25000, >>> > "abcdefghijklmnopqrstuvwxyz01234567890")%> >>> > <p>Test</p> >>> > </body> >>> > </html> > > -- > Cordialement. > Philippe Mouawad. > -- Namaskara~Nalama~Guten Tag~Bonjour -- Keigu Deepak +91-9765089593 deic...@gmail.com http://www.simtree.net Skype: thumsupdeicool Google talk: deicool Blog: http://loveandfearless.wordpress.com Facebook: http://www.facebook.com/deicool "Contribute to the world, environment and more : http://www.gridrepublic.org " --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org For additional commands, e-mail: user-h...@jmeter.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org For additional commands, e-mail: user-h...@jmeter.apache.org