On 16 February 2012 16:17, Robin D. Wilson <rwils...@gmail.com> wrote: > The test performs a 'POST' to a cgi script that returns ~60K worth of data. > All the cgi script does is sleep for 2 seconds, and > write output. The cgi script looks like this: > > #!/bin/bash > sleep 2 > cat <<! > Content-type: text/html > > <html> > <head> > [about 20K bytes of useless stuff goes here] > </head> > <body> > [about 40K bytes of useless stuff goes here] > </body> > </html> > ! > > The cgi script doesn't attempt to process the POST at all, it just returns > useless data. The purpose of the test was to figure out > why JMeter was giving me such 'different' results between JM2.4 and JM2.6. I > think I've done that now - JM2.4 (on WinXP) wasn't > reporting the correct numbers in the Summary Report.
Are you saying that it is only the Summary report that was wrong? If you have the raw figures for the test, you can use 2.6 to re-analyse - or use some other means to recalculate the summary. Note that the changes to JMeter relating to nanoTime were mainly done to eliminate the effect of nanoTime drift with respect to systemTimeMillis As far as I know, nanoTime on WinXP is more accurate than systemTimeMillis, at least for elapsed times of the order of a few seconds. > Sadly this means that all my prior benchmarks are nearly useless - since the > numbers there can't be trusted. But I can start a fresh set using JM2.6 now > and feel pretty comfortable that the numbers are at > least accurate now. > > -- > Robin D. Wilson > Sr. Director of Web Development > KingsIsle Entertainment, Inc. > VOICE: 512-777-1861 > www.KingsIsle.com > > > -----Original Message----- > From: Deepak Goel [mailto:deic...@gmail.com] > Sent: Thursday, February 16, 2012 1:08 AM > To: JMeter Users List > Subject: Re: Average times are confusing me... > > Hey > > Is it the test considering the "CGI Script" as an addon which it > includes in a different hit to the server. And the average is the > "Average of two request, one to the original page and one to the CGI > Script" > > Your answer is 2.5 seconds. 2 second for the CGI script and 0.5 second > for the overall transaction. It just treats the CGI script like an add > on file. > > :) > Deepak > > On 2/16/12, Philippe Mouawad <philippe.moua...@gmail.com> wrote: >> These settings were introduced in 2.6. To face cpu impact on Time computing. >> >> In 2.4 thé settings i made you set are hère by défault afaik as nano >> computing was not yet available . >> >> Regards >> Philippe >> >> On Wednesday, February 15, 2012, Robin D. Wilson <rwils...@gmail.com> wrote: >>> On JMeter 2.6, setting the settings you recommended fixed the problem: >>> >>> - sampleresult.useNanoTime=false >>> - sampleresult.nanoThreadSleep=0 >>> >>> But it doesn't do anything for JMeter 2.4. Needless to say, I have a >> bunch of re-benchmarking to do... >>> >>> I can file a ticket - but I am not sure that it will provide much value, >> since it is clear that the above settings fix the problem. >>> >>> -- >>> Robin D. Wilson >>> Sr. Director of Web Development >>> KingsIsle Entertainment, Inc. >>> VOICE: 512-777-1861 >>> www.KingsIsle.com >>> >>> >>> -----Original Message----- >>> From: Philippe Mouawad [mailto:philippe.moua...@gmail.com] >>> Sent: Wednesday, February 15, 2012 3:52 PM >>> To: JMeter Users List >>> Subject: Re: Average times are confusing me... >>> >>> Hello, >>> I think you should submit your Test as a bug just for us to check what >>> could explain this. >>> I made many tests on WinXP and never faced this issue so I am not >> convinced >>> it's the real explanation although you reproduced it. >>> >>> Can you also make a test by setting this in jmeter.properties: >>> >>> >>> - sampleresult.useNanoTime=false >>> - sampleresult.nanoThreadSleep=0 >>> >>> >>> Thanks >>> Regards >>> Philippe >>> >>> >>> On Wed, Feb 15, 2012 at 6:39 PM, Robin D. Wilson <rwils...@gmail.com> >> wrote: >>> >>>> FYI, I have confirmed that my test case only fails on 'WinXP'. When I run >>>> the exact same test on Win7 (x64), it works fine. >>>> >>>> The sad thing is, I've been benchmarking my systems using WinXP for over >> a >>>> year ... sigh. >>>> >>>> So now I find out that all my benchmark numbers are essentially bogus. >>>> >>>> -- >>>> Robin D. Wilson >>>> Sr. Director of Web Development >>>> KingsIsle Entertainment, Inc. >>>> VOICE: 512-777-1861 >>>> www.KingsIsle.com >>>> >>>> >>>> -----Original Message----- >>>> From: Philippe Mouawad [mailto:philippe.moua...@gmail.com] >>>> Sent: Monday, February 13, 2012 2:13 PM >>>> To: JMeter Users List >>>> Subject: Re: Average times are confusing me... >>>> >>>> Mac OSX 10.6.8. >>>> >>>> I suggest you open an issue with your attached test plan (exactly the one >>>> that has the issue). >>>> >>>> Regards >>>> Philippe >>>> On Mon, Feb 13, 2012 at 8:28 PM, Robin D. Wilson <rwils...@gmail.com> >>>> wrote: >>>> >>>> > Just out of curiosity - what type of OS was your JMeter GUI running on? >>>> > I've been running my tests on Windows XP. >>>> > >>>> > -- >>>> > Robin D. Wilson >>>> > Sr. Director of Web Development >>>> > KingsIsle Entertainment, Inc. >>>> > VOICE: 512-777-1861 >>>> > www.KingsIsle.com >>>> > >>>> > >>>> > -----Original Message----- >>>> > From: Philippe Mouawad [mailto:philippe.moua...@gmail.com] >>>> > Sent: Friday, February 10, 2012 7:41 AM >>>> > To: JMeter Users List >>>> > Subject: Re: Average times are confusing me... >>>> > >>>> > Hello, >>>> > I have just made the same test with a JSP (doing a Thread.sleep(2000) >> => >>>> > 2s) behind a Tomcat 6 with JMeter 2.6 >>>> > >>>> > I put 100 threads that loop 100 times in GUI mode (one JMETER): >>>> > All results shown in Aggregate report are around 2s . >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> >>>> >>> >> > sampler_label,aggregate_report_count,average,aggregate_report_median,aggregate_report_90%_line,aggregate_report_min,aggregate_report >>>> > >>>> > >>>> >> _max,aggregate_report_error%,aggregate_report_rate,aggregate_report_bandwidth >>>> > HTTP >>>> > >>>> > >>>> >> Request,10000,2006,2004,2012,2001,2195,0.0,49.5793194742609,1224.082013722936 >>>> > >>>> >> TOTAL,10000,2006,2004,2012,2001,2195,0.0,49.5793194742609,1224.082013722936 >>>> > >>>> > >>>> > Summary listener shows this: >>>> > 2012/02/10 14:36:00 INFO - jmeter.reporters.Summariser: Generate >> Summary >>>> > Results + 2655 in 54,8s = 48,4/s Avg: 2010 Min: 2001 Max: 2195 >>>> > Err: 0 (0,00%) >>>> > 2012/02/10 14:38:26 INFO - jmeter.reporters.Summariser: Generate >> Summary >>>> > Results + 7345 in 148,9s = 49,3/s Avg: 2005 Min: 2001 Max: 2088 >>>> > Err: 0 (0,00%) >>>> > 2012/02/10 14:38:26 INFO - jmeter.reporters.Summariser: Generate >> Summary >>>> > Results = 10000 in 201,7s = 49,6/s Avg: 2006 Min: 2001 Max: 2195 >>>> > Err: 0 (0,00%) >>>> > >>>> > So as you can see, nothing abnormal . >>>> > >>>> > JSP Code: >>>> > >>>> > <%@ page contentType="text/html; charset=UTF-8" %> >>>> > <html> >>>> > <body> >>>> > <% >>>> > Thread.sleep(2000); >>>> > %> >>>> > <!-- GENERATE around 25Ko page --> >>>> > <%=org.apache.commons.lang.RandomStringUtils.random(25000, >>>> > "abcdefghijklmnopqrstuvwxyz01234567890")%> >>>> > <p>Test</p> >>>> > </body> >>>> > </html> >> >> -- >> Cordialement. >> Philippe Mouawad. >> > > > -- > Namaskara~Nalama~Guten Tag~Bonjour > > > -- > Keigu > > Deepak > +91-9765089593 > deic...@gmail.com > http://www.simtree.net > > Skype: thumsupdeicool > Google talk: deicool > Blog: http://loveandfearless.wordpress.com > Facebook: http://www.facebook.com/deicool > > "Contribute to the world, environment and more : http://www.gridrepublic.org > " > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org > For additional commands, e-mail: user-h...@jmeter.apache.org > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org > For additional commands, e-mail: user-h...@jmeter.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org For additional commands, e-mail: user-h...@jmeter.apache.org
