Produced using: - Jenkins 1.121.2 - Performance Plugin 3.15 - Plot 2.1.0 - Jmeter 5.1
I have googled, searched this group and search the jenkins issue log and cannot find an example of this being recorded but cannot imagine I am the only one having this issue. I may be missing something but looking at the Jenkins Performance Plugin "comparison with previous build" graph appears to show the difference between the current report and the previous report, however both reports are just an accumulation of all runs up until that point which pretty much makes any of the reporting provided by the plugin useless. Say your jmeter script is 10 samplers.Run 1 has 0 failures and run 2 has 100% failure rate, the report looks like this: *URI | Samples | Errors* Login | 20 (+10) | 50% (+50%) As a comparison to the previous run I would expect it to look like *URI | Samples | Errors* Login | 10 (10) | 100% (0%) Say run 3 was again a clean run the report looks like *URI | Samples | Errors* Login | 30 (+10) | 33.33% (-16.66%) Once again as a comparison to the previous run I would expect it to look like this as we do not care about the first run in a comparison again the previous build: *URI | Samples | Errors* Login | 10 (10) | 0% (100%) Note I also did not expect a + or - in the adjusted figure as surely this should just contain the last results. It also appears all the graphs are based on the cumulative figures so the never actually represent the run the seem to represent. Take this graph for example, we were having downstream issues which resulted in each run hitting a 98% error rate, the last 2 runs were around 25% error rate but rather than the percentage of errors dropping to around 25% to reflect that run, it once again just provides the cumulative error rate of all run before it. Surely it should look like this: This also breaks things like threshold checking for build failures which also uses the cumulative figure. Deleting runs from jenkins also has unesired effects such as reducing the number of samplers in the next report but not previous statistics. Is there any way to fix this reporting? Thanks -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/2329c2e2-f3d4-47e5-ab0d-90eebc304f56%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
