Re: Percentile values in JMeter Summarizer output

[Bhadauria, Tarun Kumar]

@Sebb @Ubik

Having percentile on summary report is not something critical but a nice to
have feature. And if it is going to be performance costly then probably is
not worth it.

@Ubik

About the back end listener. I used it with JMeter distributed mode and it
resulted in lower throughput. I had posted it on a different thread herein

and one of the reasoning given was that any run time listener would have
perf impact.

Any way I also observed that I receive better throughput when running
JMeter test independently on 10 machines than using distributed mode.
Reduced throughput in distributed mode is described here


Hence I ended up using JMeter-ec2
 project (my own forked
 version though) and there is
no out of box support for backend listener in this setup. I guess I need to
extract data from each individual jtl file and push it to influx db and
consolidate the result (???).

This approach would get benefit of higher throughput by avoiding to use
distributed mode and backend listener entirely. And at the same time one
can also plot 99 etc percentiles which are available with backend listener.



Thanks
Tarun K

On 30 March 2016 at 18:59, sebb  wrote:

> On 30 March 2016 at 17:06, UBIK LOAD PACK Support
>  wrote:
> > Hello,
> > Our answers below.
> > Regards
> >
> >
> > On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
> > tarun.kumar.bhadau...@zalando.de> wrote:
> >
> >> thanks but I am hesitant to use listener (even back end listener) as I
> have
> >> experienced drop in throughput when using these listener.
> >>
> >
> > Are you sure about that ?
> > The BackendListener sends asynchronously the results to Graphite, if you
> > experience a drop in throughput it can have many causes:
> >
> >- Network saturation on the machine
> >- Issue on the Graphite side
> >- Network issue between controller and graphite server
> >- Wrong tuning of BackendListener, OOTB config might not suit your
> test
> >case
> >
> >
> >
> >
> >> Hence I was looking for percentile value in summarizer output when
> >> executing the test.
> >>
> >
> > It's not currently possible.
>
> Also note that the calculation of percentile values is somewhat more
> expensive than calculating average, min or max, which should normally
> be sufficient for monitoring a test run.
>
> Do you _really_ need live percentiles?
>
> >
> >
> >>
> >> Thanks
> >> Tarun K
> >>
> >> On 9 March 2016 at 13:06, Philippe Mouawad 
> >> wrote:
> >>
> >> > Hello,
> >> >
> >> >
> >> >
> >>
> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
> >> > http://jmeter.apache.org/usermanual/realtime-results.html
> >> >
> >> > Regards
> >> >
> >> > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
> >> > tarun.kumar.bhadau...@zalando.de> wrote:
> >> >
> >> > > Hello All,
> >> > >
> >> > > When running test on non gui mode summarizer output list avg/min and
> >> max
> >> > > times.
> >> > > Is it possible to list percentile (90, 95 and 99) as well?
> >> > >
> >> > > Thanks
> >> > > Tarun K
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Cordialement.
> >> > Philippe Mouawad.
> >> >
> >>
> >
> >
> >
> > --
> >
> > Regards
> > Ubik Load Pack  Team
> > Follow us on Twitter 
> >
> >
> > Cordialement
> > L'équipe Ubik Load Pack 
> > Suivez-nous sur Twitter 
>
> -
> To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org
> For additional commands, e-mail: user-h...@jmeter.apache.org
>
>

Re: Percentile values in JMeter Summarizer output

[sebb]

On 30 March 2016 at 17:06, UBIK LOAD PACK Support
 wrote:
> Hello,
> Our answers below.
> Regards
>
>
> On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
> tarun.kumar.bhadau...@zalando.de> wrote:
>
>> thanks but I am hesitant to use listener (even back end listener) as I have
>> experienced drop in throughput when using these listener.
>>
>
> Are you sure about that ?
> The BackendListener sends asynchronously the results to Graphite, if you
> experience a drop in throughput it can have many causes:
>
>- Network saturation on the machine
>- Issue on the Graphite side
>- Network issue between controller and graphite server
>- Wrong tuning of BackendListener, OOTB config might not suit your test
>case
>
>
>
>
>> Hence I was looking for percentile value in summarizer output when
>> executing the test.
>>
>
> It's not currently possible.

Also note that the calculation of percentile values is somewhat more
expensive than calculating average, min or max, which should normally
be sufficient for monitoring a test run.

Do you _really_ need live percentiles?

>
>
>>
>> Thanks
>> Tarun K
>>
>> On 9 March 2016 at 13:06, Philippe Mouawad 
>> wrote:
>>
>> > Hello,
>> >
>> >
>> >
>> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
>> > http://jmeter.apache.org/usermanual/realtime-results.html
>> >
>> > Regards
>> >
>> > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
>> > tarun.kumar.bhadau...@zalando.de> wrote:
>> >
>> > > Hello All,
>> > >
>> > > When running test on non gui mode summarizer output list avg/min and
>> max
>> > > times.
>> > > Is it possible to list percentile (90, 95 and 99) as well?
>> > >
>> > > Thanks
>> > > Tarun K
>> > >
>> >
>> >
>> >
>> > --
>> > Cordialement.
>> > Philippe Mouawad.
>> >
>>
>
>
>
> --
>
> Regards
> Ubik Load Pack  Team
> Follow us on Twitter 
>
>
> Cordialement
> L'équipe Ubik Load Pack 
> Suivez-nous sur Twitter 

-
To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org
For additional commands, e-mail: user-h...@jmeter.apache.org

Re: Percentile values in JMeter Summarizer output

[UBIK LOAD PACK Support]

Hello,
Our answers below.
Regards


On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
tarun.kumar.bhadau...@zalando.de> wrote:

> thanks but I am hesitant to use listener (even back end listener) as I have
> experienced drop in throughput when using these listener.
>

Are you sure about that ?
The BackendListener sends asynchronously the results to Graphite, if you
experience a drop in throughput it can have many causes:

   - Network saturation on the machine
   - Issue on the Graphite side
   - Network issue between controller and graphite server
   - Wrong tuning of BackendListener, OOTB config might not suit your test
   case




> Hence I was looking for percentile value in summarizer output when
> executing the test.
>

It's not currently possible.



>
> Thanks
> Tarun K
>
> On 9 March 2016 at 13:06, Philippe Mouawad 
> wrote:
>
> > Hello,
> >
> >
> >
> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
> > http://jmeter.apache.org/usermanual/realtime-results.html
> >
> > Regards
> >
> > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
> > tarun.kumar.bhadau...@zalando.de> wrote:
> >
> > > Hello All,
> > >
> > > When running test on non gui mode summarizer output list avg/min and
> max
> > > times.
> > > Is it possible to list percentile (90, 95 and 99) as well?
> > >
> > > Thanks
> > > Tarun K
> > >
> >
> >
> >
> > --
> > Cordialement.
> > Philippe Mouawad.
> >
>



-- 

Regards
Ubik Load Pack  Team
Follow us on Twitter 


Cordialement
L'équipe Ubik Load Pack 
Suivez-nous sur Twitter 

Re: Percentile values in JMeter Summarizer output

[sebb]

On 30 March 2016 at 11:30, Bhadauria, Tarun Kumar
 wrote:
> Hi Philipp
>
> JMeter dashboard is very promising but I want to print 90, 95 and 99
> percentile value on jmeter-summarizer during test run

The Dashboard only creates the report at the *end* of a test run.

> summary +  1 in 4s =0.3/s Avg:   795 Min:   795 Max:   795 Err:
> 0 (0.00%) Active: 2 Started: 2 Finished: 0
>
> JMeter Dashboard does not answer this question, or am I wrong?

See above

> Thanks
> Tarun K
>
> On 9 March 2016 at 14:59, Bhadauria, Tarun Kumar <
> tarun.kumar.bhadau...@zalando.de> wrote:
>
>> thanks Philipp, will try it out
>>
>> Thanks
>> Tarun K
>>
>> On 9 March 2016 at 13:21, Philippe Mouawad 
>> wrote:
>>
>>> In upcoming 3.0 version, these values will be computed by an HTML report
>>> generated on demand from jtl file or at the end of test.
>>>
>>> You can give it a try by downloading a nightly build, feedback welcome.
>>>
>>> Regards
>>>
>>> On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
>>> tarun.kumar.bhadau...@zalando.de> wrote:
>>>
>>> > thanks but I am hesitant to use listener (even back end listener) as I
>>> have
>>> > experienced drop in throughput when using these listener.
>>> > Hence I was looking for percentile value in summarizer output when
>>> > executing the test.
>>> >
>>> > Thanks
>>> > Tarun K
>>> >
>>> > On 9 March 2016 at 13:06, Philippe Mouawad 
>>> > wrote:
>>> >
>>> > > Hello,
>>> > >
>>> > >
>>> > >
>>> >
>>> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
>>> > > http://jmeter.apache.org/usermanual/realtime-results.html
>>> > >
>>> > > Regards
>>> > >
>>> > > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
>>> > > tarun.kumar.bhadau...@zalando.de> wrote:
>>> > >
>>> > > > Hello All,
>>> > > >
>>> > > > When running test on non gui mode summarizer output list avg/min and
>>> > max
>>> > > > times.
>>> > > > Is it possible to list percentile (90, 95 and 99) as well?
>>> > > >
>>> > > > Thanks
>>> > > > Tarun K
>>> > > >
>>> > >
>>> > >
>>> > >
>>> > > --
>>> > > Cordialement.
>>> > > Philippe Mouawad.
>>> > >
>>> >
>>>
>>>
>>>
>>> --
>>> Cordialement.
>>> Philippe Mouawad.
>>>
>>
>>

-
To unsubscribe, e-mail: user-unsubscr...@jmeter.apache.org
For additional commands, e-mail: user-h...@jmeter.apache.org

Re: Percentile values in JMeter Summarizer output

[Bhadauria, Tarun Kumar]

Hi Philipp

JMeter dashboard is very promising but I want to print 90, 95 and 99
percentile value on jmeter-summarizer during test run

summary +  1 in 4s =0.3/s Avg:   795 Min:   795 Max:   795 Err:
0 (0.00%) Active: 2 Started: 2 Finished: 0

JMeter Dashboard does not answer this question, or am I wrong?

Thanks
Tarun K

On 9 March 2016 at 14:59, Bhadauria, Tarun Kumar <
tarun.kumar.bhadau...@zalando.de> wrote:

> thanks Philipp, will try it out
>
> Thanks
> Tarun K
>
> On 9 March 2016 at 13:21, Philippe Mouawad 
> wrote:
>
>> In upcoming 3.0 version, these values will be computed by an HTML report
>> generated on demand from jtl file or at the end of test.
>>
>> You can give it a try by downloading a nightly build, feedback welcome.
>>
>> Regards
>>
>> On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
>> tarun.kumar.bhadau...@zalando.de> wrote:
>>
>> > thanks but I am hesitant to use listener (even back end listener) as I
>> have
>> > experienced drop in throughput when using these listener.
>> > Hence I was looking for percentile value in summarizer output when
>> > executing the test.
>> >
>> > Thanks
>> > Tarun K
>> >
>> > On 9 March 2016 at 13:06, Philippe Mouawad 
>> > wrote:
>> >
>> > > Hello,
>> > >
>> > >
>> > >
>> >
>> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
>> > > http://jmeter.apache.org/usermanual/realtime-results.html
>> > >
>> > > Regards
>> > >
>> > > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
>> > > tarun.kumar.bhadau...@zalando.de> wrote:
>> > >
>> > > > Hello All,
>> > > >
>> > > > When running test on non gui mode summarizer output list avg/min and
>> > max
>> > > > times.
>> > > > Is it possible to list percentile (90, 95 and 99) as well?
>> > > >
>> > > > Thanks
>> > > > Tarun K
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Cordialement.
>> > > Philippe Mouawad.
>> > >
>> >
>>
>>
>>
>> --
>> Cordialement.
>> Philippe Mouawad.
>>
>
>

Re: Percentile values in JMeter Summarizer output

[Bhadauria, Tarun Kumar]

thanks Philipp, will try it out

Thanks
Tarun K

On 9 March 2016 at 13:21, Philippe Mouawad 
wrote:

> In upcoming 3.0 version, these values will be computed by an HTML report
> generated on demand from jtl file or at the end of test.
>
> You can give it a try by downloading a nightly build, feedback welcome.
>
> Regards
>
> On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
> tarun.kumar.bhadau...@zalando.de> wrote:
>
> > thanks but I am hesitant to use listener (even back end listener) as I
> have
> > experienced drop in throughput when using these listener.
> > Hence I was looking for percentile value in summarizer output when
> > executing the test.
> >
> > Thanks
> > Tarun K
> >
> > On 9 March 2016 at 13:06, Philippe Mouawad 
> > wrote:
> >
> > > Hello,
> > >
> > >
> > >
> >
> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
> > > http://jmeter.apache.org/usermanual/realtime-results.html
> > >
> > > Regards
> > >
> > > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
> > > tarun.kumar.bhadau...@zalando.de> wrote:
> > >
> > > > Hello All,
> > > >
> > > > When running test on non gui mode summarizer output list avg/min and
> > max
> > > > times.
> > > > Is it possible to list percentile (90, 95 and 99) as well?
> > > >
> > > > Thanks
> > > > Tarun K
> > > >
> > >
> > >
> > >
> > > --
> > > Cordialement.
> > > Philippe Mouawad.
> > >
> >
>
>
>
> --
> Cordialement.
> Philippe Mouawad.
>

Re: Percentile values in JMeter Summarizer output

[Philippe Mouawad]

In upcoming 3.0 version, these values will be computed by an HTML report
generated on demand from jtl file or at the end of test.

You can give it a try by downloading a nightly build, feedback welcome.

Regards

On Wed, Mar 9, 2016 at 1:18 PM, Bhadauria, Tarun Kumar <
tarun.kumar.bhadau...@zalando.de> wrote:

> thanks but I am hesitant to use listener (even back end listener) as I have
> experienced drop in throughput when using these listener.
> Hence I was looking for percentile value in summarizer output when
> executing the test.
>
> Thanks
> Tarun K
>
> On 9 March 2016 at 13:06, Philippe Mouawad 
> wrote:
>
> > Hello,
> >
> >
> >
> http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
> > http://jmeter.apache.org/usermanual/realtime-results.html
> >
> > Regards
> >
> > On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
> > tarun.kumar.bhadau...@zalando.de> wrote:
> >
> > > Hello All,
> > >
> > > When running test on non gui mode summarizer output list avg/min and
> max
> > > times.
> > > Is it possible to list percentile (90, 95 and 99) as well?
> > >
> > > Thanks
> > > Tarun K
> > >
> >
> >
> >
> > --
> > Cordialement.
> > Philippe Mouawad.
> >
>



-- 
Cordialement.
Philippe Mouawad.

Re: Percentile values in JMeter Summarizer output

[Philippe Mouawad]

Hello,

http://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report
http://jmeter.apache.org/usermanual/realtime-results.html

Regards

On Wed, Mar 9, 2016 at 1:03 PM, Bhadauria, Tarun Kumar <
tarun.kumar.bhadau...@zalando.de> wrote:

> Hello All,
>
> When running test on non gui mode summarizer output list avg/min and max
> times.
> Is it possible to list percentile (90, 95 and 99) as well?
>
> Thanks
> Tarun K
>



-- 
Cordialement.
Philippe Mouawad.

Percentile values in JMeter Summarizer output

[Bhadauria, Tarun Kumar]

Hello All,

When running test on non gui mode summarizer output list avg/min and max
times.
Is it possible to list percentile (90, 95 and 99) as well?

Thanks
Tarun K