Re: JMeter Performance plugin having XXE vulnerability
Thanks for the feedback and suggestions. On Monday, April 4, 2022 at 6:09:05 PM UTC+2 Mark Waite wrote: > On Monday, April 4, 2022 at 9:32:56 AM UTC-6 Arun Suresh wrote: > >> JMeter performance plugin is listed with vulnerability: >> https://plugins.jenkins.io/performance/ >> So currently its not safe to use this plugin( >> https://www.jenkins.io/security/advisory/2021-11-12/#SECURITY-2394). >> >> Can you please help us to fix this issue. Currently I'm facing issue that >> I don't find any other alternative plugin also to use since this plugin >> currently have this vulnerability. >> Due to this vulnerability, currently security guidelines is not allowing >> us to use this plugin. Will be extremely helpful if you can support us >> here. >> >> The current maintainers were informed of the vulnerability before it was > published without a fix. They did not have the capacity to fix it. I > assume they still do not have the capacity to fix it. > > You are welcome to adopt the plugin and fix the issue. It would be a good > way for your employer to get the fix they need and a good way for them to > contribute to the Jenkins community. The "Contributing to Open Source" > <https://docs.google.com/document/d/1PKYIpPlRVGsBqrz0Ob1Cv3cefOZ5j2xtGZdWs27kLuw/edit?usp=sharing> > > workshop from DevOps World 2021 provides a series of steps that you could > take to prepare to adopt the performance plugin. There is a five part > video series <https://www.youtube.com/watch?v=Fev8KfFsPZE> linked in that > document that introduces the concepts and illustrates the tasks to consider > as you adopt a plugin. > > As another alternative, you could push the JMeter results to a different > location (a web server somewhere inside your company) and guide people to > read the results from that web server. > > Mark Waite > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/aded6d82-4e16-4718-b7b9-5a8fcb29b499n%40googlegroups.com.
Re: JMeter Performance plugin having XXE vulnerability
On Monday, April 4, 2022 at 9:32:56 AM UTC-6 Arun Suresh wrote: > JMeter performance plugin is listed with vulnerability: > https://plugins.jenkins.io/performance/ > So currently its not safe to use this plugin( > https://www.jenkins.io/security/advisory/2021-11-12/#SECURITY-2394). > > Can you please help us to fix this issue. Currently I'm facing issue that > I don't find any other alternative plugin also to use since this plugin > currently have this vulnerability. > Due to this vulnerability, currently security guidelines is not allowing > us to use this plugin. Will be extremely helpful if you can support us > here. > > The current maintainers were informed of the vulnerability before it was published without a fix. They did not have the capacity to fix it. I assume they still do not have the capacity to fix it. You are welcome to adopt the plugin and fix the issue. It would be a good way for your employer to get the fix they need and a good way for them to contribute to the Jenkins community. The "Contributing to Open Source" <https://docs.google.com/document/d/1PKYIpPlRVGsBqrz0Ob1Cv3cefOZ5j2xtGZdWs27kLuw/edit?usp=sharing> workshop from DevOps World 2021 provides a series of steps that you could take to prepare to adopt the performance plugin. There is a five part video series <https://www.youtube.com/watch?v=Fev8KfFsPZE> linked in that document that introduces the concepts and illustrates the tasks to consider as you adopt a plugin. As another alternative, you could push the JMeter results to a different location (a web server somewhere inside your company) and guide people to read the results from that web server. Mark Waite -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/8806fe7d-850f-4ac0-9a2f-fb3901acef21n%40googlegroups.com.
JMeter Performance plugin having XXE vulnerability
JMeter performance plugin is listed with vulnerability: https://plugins.jenkins.io/performance/ So currently its not safe to use this plugin( https://www.jenkins.io/security/advisory/2021-11-12/#SECURITY-2394). Can you please help us to fix this issue. Currently I'm facing issue that I don't find any other alternative plugin also to use since this plugin currently have this vulnerability. Due to this vulnerability, currently security guidelines is not allowing us to use this plugin. Will be extremely helpful if you can support us here. Thank you -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/e81641cf-cbe0-40da-a43c-b5c1a0888b49n%40googlegroups.com.
Performance Plugin result jtl file size
Hi All, I am using Performance Plugin to for trend analysis. I am observing that "result.jtl" file is keep growing after every build, since the results are appending. So my question is, upto what size "result.jtl" file will grow? Is there any way I can restrict the "result.jtl" to store only "n" number of builds? Thanks, Ansu -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/ff1d073e-1f01-4083-a5dd-65d10cb26431n%40googlegroups.com.
Re: Performance plugin how use Absolute constraints ?
Hi any resolution on this ? please share. On Wednesday, January 4, 2017 at 6:54:15 PM UTC+5:30 vdab...@gmail.com wrote: > Hi, > > Some requests have response time very short (6ms) and relative comparison > give difference to high (6ms compare to 7ms => 16% diff). > > For example : > > === > > Performance: Recording JMeter reports 'resultat/res_filtred.jtl' > Performance: Parsing JMeter report file > '/home/jenkins/.jenkins/jobs/PERF_publish_compare_loadtesting/builds/41/performance-reports/JMeter/res_filtred.jtl'. > Performance: Percentage of relative difference outside -11.0 to +100.0 % sets > the build as failure > Performance: Percentage of relative difference outside -0.0 to +10.0 % sets > the build as unstable > > > > Performance: Recording JMeter reports 'resultat/res_filtred.jtl' > > Comparison build no. - 37 and 41 using Average response time > > > > PrevBuildURI CurrentBuildURI PrevBuildURIAvg > CurrentBuildURIAvg RelativeDiffRelativeDiffPercentage > > P1_01_ACCUEIL P1_01_ACCUEIL 6 6 > 0.0 0.0 > P1_02_DMD_FORM_LOGIN P1_02_DMD_FORM_LOGIN6 > 7 1.0 16.67 > P1_03_LOGIN P1_03_LOGIN 10 13 > 3.0 30.0 > P1_04_STATS P1_04_STATS 53 78 > 25.047.17 > P1_05_RETOUR_MENU P1_05_RETOUR_MENU 2 > 2 0.0 0.0*P1_06_LOGOUTP1_06_LOGOUT > 6 7 1.0 * > *16.67* > > > The label "P1_06_LOGOUT" made the build *unstable* > Build step 'Publish Performance test result report' changed build result to > UNSTABLE > === > > How can i configure the Performance Plugin with absolute response time > constraints like : > > P1_01_ACCUEIL must be less than 20 ms > P1_02_DMD_FORM_LOGIN must be less than 20 ms > P1_03_LOGIN must be less than 100 ms > P1_04_STATS must be less than 200 ms > P1_05_RETOUR_MENU must be less than 20ms > *P1_06_LOGOUT must be less than 20 ms* > > > With the "Expert Mode" i can see Constraints but i don't understand how > it's work and how configure the SLA values (likes P1_06_LOGOUT:20 ? => must > be less than 20 ms) > > Regards. > Vincent D. > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/3a97eaca-cbfe-42d0-b997-828094c1b8f2n%40googlegroups.com.
Performance plugin - how to use both relative and error threshold?
Hi! Using the post-build action "Publish Performance test result report" from the performance plugin [1], is it possible to have both relative and error threshold to detect/make build failures? This is under the evaluation mode / Standard Mode. If not, where to post RFEs? I don't see an Issues tab on its github page [2]. [1] https://plugins.jenkins.io/performance/ [2] https://github.com/jenkinsci/performance-plugin Regards, David -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/d0cac7d3-d4f5-4b1c-9a23-caaf74aca113%40googlegroups.com.
Using Jenkins Pipeline Stage Result Visualization Improvements with reporting plugins like Blazemeter or Performance Plugin
Good morning, A few months ago Jenkins Pipeline released some very interesting improvements https://jenkins.io/blog/2019/07/05/jenkins-pipeline-stage-result-visualization-improvements/ with Groovy commands to declare unstable or failed stages. My problem is to use this along with Performance plugin <http://jenkinsci.github.io/performance-plugin/Reporting.html>. Even if the report says it is a failure, the jenkins pipeline sees it as a Success [image: perfpluginstatus.PNG] [image: status.PNG] How can I use the output of this status to set the status of the stage ? Best regards, Robin -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/697fb3cb-a6aa-4bbc-a049-4dc931a48702%40googlegroups.com.
Re: Jenkins Performance Plugin provides all reporting as a cumulation of all runs, not just the relevant run for the report.
After a bit more of a play around I have identified a workaround, but
ultimately it was down to unexpected behaviour by both Jenkins and JMeter.
Firstly, Jenkins was not creating a new workspace for every build and was
not clearing down the workspace after each build. This meant that all
existing artefacts were still present from previous builds when new builds
were being started.
Secondly, when starting up, JMeter simply apends to any existing log file
instead of creating it from scratch.
The combination of the 2 meant that the results.csv file on the Jenkins
runner was what contained all previous run data, not the perfReport plugin.
The perfReport plugin appeared to be doing everything correctly.
I have now added a cleardown section to my jenkins file and everything
looks good.
However I did notice that in failed or unstable builds, the graphs were not
being populated. This appears to be caused by these conditions causing the
plugin to fail before generating the reports. A quick fix for this was to
have 2 perfReport entries in your stage. 1 that creates the reports then 1
that processes the pass criteria.
stage('Publish report') {
perfReport 'result.csv'
perfReport sourceDataFiles: 'result.csv',
filterRegex: '',
failBuildIfNoResultFile: true,
errorFailedThreshold: 5,
errorUnstableThreshold: 1
}
If anyone has a better solution to this final issue, I am all ears but
happy with the way it is running now.
On Tuesday, June 18, 2019 at 2:12:03 PM UTC+1, Stuart Kenworthy wrote:
>
> Produced using:
> - Jenkins 1.121.2
> - Performance Plugin 3.15
> - Plot 2.1.0
> - Jmeter 5.1
>
> I have googled, searched this group and search the jenkins issue log and
> cannot find an example of this being recorded but cannot imagine I am the
> only one having this issue.
>
> I may be missing something but looking at the Jenkins Performance Plugin
> "comparison with previous build" graph appears to show the difference
> between the current report and the previous report, however both reports
> are just an accumulation of all runs up until that point which pretty much
> makes any of the reporting provided by the plugin useless.
>
> Say your jmeter script is 10 samplers.Run 1 has 0 failures and run 2 has
> 100% failure rate, the report looks like this:
>
> *URI | Samples | Errors*
> Login | 20 (+10) | 50% (+50%)
>
> As a comparison to the previous run I would expect it to look like
>
> *URI | Samples | Errors*
> Login | 10 (10)| 100% (0%)
>
> Say run 3 was again a clean run the report looks like
>
> *URI | Samples | Errors*
> Login | 30 (+10) | 33.33% (-16.66%)
>
> Once again as a comparison to the previous run I would expect it to look
> like this as we do not care about the first run in a comparison again the
> previous build:
>
> *URI | Samples | Errors*
> Login | 10 (10)| 0% (100%)
>
> Note I also did not expect a + or - in the adjusted figure as surely this
> should just contain the last results.
>
> It also appears all the graphs are based on the cumulative figures so the
> never actually represent the run the seem to represent.
>
> Take this graph for example, we were having downstream issues which
> resulted in each run hitting a 98% error rate, the last 2 runs were around
> 25% error rate but rather than the percentage of errors dropping to around
> 25% to reflect that run, it once again just provides the cumulative error
> rate of all run before it.
>
>
> Surely it should look like this:
> This also breaks things like threshold checking for build failures which
> also uses the cumulative figure.
>
> Deleting runs from jenkins also has unesired effects such as reducing the
> number of samplers in the next report but not previous statistics.
>
> Is there any way to fix this reporting?
>
> Thanks
>
--
You received this message because you are subscribed to the Google Groups
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/jenkinsci-users/94f4e5cb-e4c3-4026-bb13-91f5b89b%40googlegroups.com.
Jenkins Performance Plugin provides all reporting as a cumulation of all runs, not just the relevant run for the report.
Produced using: - Jenkins 1.121.2 - Performance Plugin 3.15 - Plot 2.1.0 - Jmeter 5.1 I have googled, searched this group and search the jenkins issue log and cannot find an example of this being recorded but cannot imagine I am the only one having this issue. I may be missing something but looking at the Jenkins Performance Plugin "comparison with previous build" graph appears to show the difference between the current report and the previous report, however both reports are just an accumulation of all runs up until that point which pretty much makes any of the reporting provided by the plugin useless. Say your jmeter script is 10 samplers.Run 1 has 0 failures and run 2 has 100% failure rate, the report looks like this: *URI | Samples | Errors* Login | 20 (+10) | 50% (+50%) As a comparison to the previous run I would expect it to look like *URI | Samples | Errors* Login | 10 (10)| 100% (0%) Say run 3 was again a clean run the report looks like *URI | Samples | Errors* Login | 30 (+10) | 33.33% (-16.66%) Once again as a comparison to the previous run I would expect it to look like this as we do not care about the first run in a comparison again the previous build: *URI | Samples | Errors* Login | 10 (10)| 0% (100%) Note I also did not expect a + or - in the adjusted figure as surely this should just contain the last results. It also appears all the graphs are based on the cumulative figures so the never actually represent the run the seem to represent. Take this graph for example, we were having downstream issues which resulted in each run hitting a 98% error rate, the last 2 runs were around 25% error rate but rather than the percentage of errors dropping to around 25% to reflect that run, it once again just provides the cumulative error rate of all run before it. Surely it should look like this: This also breaks things like threshold checking for build failures which also uses the cumulative figure. Deleting runs from jenkins also has unesired effects such as reducing the number of samplers in the next report but not previous statistics. Is there any way to fix this reporting? Thanks -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/2329c2e2-f3d4-47e5-ab0d-90eebc304f56%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Viewing Performance Plugin Result Graphs slows down jenkins
Hello everyone, I'm using latest jenkins LTS as well as up to date plugins. Plugins installed are nothing fancy: Pipeline, Github PR, Git and additional tools like timestamper etc. Problem: When viewing performance test result graphs, created by performance plugin, we sometimes get very high cpu usage for jenkins, even after the actual graphs are rendered. CPU usage keeps going for some minutes then and speeds up. This does not always happen. I have narrowed down our reports to only contain a few hundred, max 1-2k entries. csv-files are +200kByte, so nothing really huge. Today I have noticed something very odd: When viewing the results for a specific build the text was loaded but NO graphs at all were shown and Chrome kept saying "waiting for available socket". When opening any other jenkins page, e.g. main page, other's jobs page, configs or even monitoring, It didn't load an the same socket-message was shown at the bottom of Chrome. Using another browser or an incognito windows the other pages loaded (though that specific build's perf-page had the same issues there). When loading the page in question I get this 12x on jenkins log: March 28th 2019, 13:52:09.498 com.squareup.okhttp.internal.Platform$JdkWithJettyBootPlatform getSelectedProtocol INFO ALPN callback dropped: SPDY and HTTP/2 are disabled. Is alpn-boot on the boot class path? Does anyone know how to fix this or what may cause this? I have search this group and via google and whatsoever, but didn't find anything. Thanks and kind regards, Kay -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/e558e1e8-b659-4b12-898b-3dd47988d429%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Performance Plugin Help
I need some help configuring the Jenkins performance plugin (https://plugins.jenkins.io/performance). When I click on the job's top level "Performance Trend", I only see two links: "Last Report" and "Filter Trend Data". As far as I can tell, "Filter Trend Data" does not do anything to the reports. Have I configured something wrong? It seems like there should be a graph on the "Performance Trend" page, but there is nothing. The biggest issue I am having is being able to filter the data to show the last 5 builds, but it always shows all builds despite my "Filter Trend Data" settings. Any help is greatly appreciated! Jenkins ver. 2.150.2 Performance Plugin ver. 3.15 -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/73c006b3-1353-472c-8729-dd5ebb54ed04%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Performance Plugin: Could't find a report specified in the performance constraints!
Hi - Even after mentioning filename in the Related Report section of 'Expert Mode' in Performance Plugin, I am seeing an error saying - Couldn't find file. Can anyone please advice? Please find attachment for configuration and error message Thanks Ganesh.N -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/a06da9c8-8d87-4054-9c96-30420eed6c38%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Performance Plugin - NPE - Expert Mode
Hi,
I am trying to use ${BUILD_NUMBER} in the results file name and specifying
the file name under 'Related report' section of 'Expert mode' in
Performance Plugin.
My results are in a JTL file (CSV format inside). I am getting a
NullPointerException when executing the build.
To my surprise, when I use a filename directly, like results_112.jtl, it
parses the file properly and gives me results as per the thresholds i
defined. But when I use ${BUILD_NUMBER}, i get a NPE.
Error message below.
C:\Program Files (x86)\Jenkins\workspace\First_Project>exit 0
Performance: Recording JMeterCsv reports 'results_115.jtl'
Performance: Parsing JMeter report file 'C:\Program Files
(x86)\Jenkins\jobs\First_Project\builds\115\performance-reports\JMeterCSV\results_115.jtl'.
java.lang.NullPointerException
at
hudson.plugins.performance.constraints.ConstraintFactory.createConstraintClones(ConstraintFactory.java:39)
at
hudson.plugins.performance.PerformancePublisher.evaluateInExpertMode(PerformancePublisher.java:982)
at
hudson.plugins.performance.PerformancePublisher.perform(PerformancePublisher.java:375)
at
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:736)
at
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:682)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:627)
at hudson.model.Run.execute(Run.java:1764)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:419)
Please don't as me to switch to XMl format, as I am doing a lot of other
parsing and reporting based on this data in CSV format :)
--
You received this message because you are subscribed to the Google Groups
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/jenkinsci-users/84528fbe-6898-4f30-92c2-533584eaba37%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
performance-plugin not interpreting % for relative constraint failure on average response time
HI, Jenkins 2.7.3 Performance Plugin 3.0 When I create a Relative Constraint in expert mode, using Average REsponse time, the %'s I enter into the 'Tolerance' field do not get interpreted correctly. If I enter 5, the average response time threshold gets calculated as 50% If I enter 1, the average response time threshold gets calculated as 10% If I enter 0.1, the average response time gets interpreted, correctly, as 0.1% Therefore, it is impossible to get the relative constraint to fail for anything between 0.9& and 10% Has anyone seen this behaviour before? Regards Euan -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/5df8fcef-86e6-4852-b0c7-6e2fab209aed%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Blue Ocean and Performance Plugin: How to make logs and test results visible?
Hi, Performance Plugin ( https://wiki.jenkins-ci.org/display/JENKINS/Performance+Plugin ) recently received pipeline support. I tried it and it works great in a pipeline. In the old Jenkins UI, after the job completes, there is an icon visible which is labelled "Performance Report". Clicking on this takes you to the performance report. It looks like this: https://wiki.jenkins-ci.org/download/attachments/42468533/perf-report.png However, if I look at the same job in the new Blue Ocean UI, there is no link to the "Performance Report". What does the Performance Plugin need to do in order to make the "Performance Report" visible in the Blue Ocean UI? Thanks. -- Craig -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CAG%3DrPVcQXtf4xHm5jb0NYQGSfyB6aiCPTrHgWH9tcaLO1Jg%2B%2BQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Performance Plugin - Exceeded the threshold but the Jenkins job Finished: SUCCESS
Hi,
I have set up a pipeline with a 'Jenkinsfile'.
The 'Jenkinsfile' triggers performance test with JMeter and then plugin
'performanceReport'.
The output from 'performanceReport' show that the threshold has exceeded,
but the Jenkins job Finished: SUCCESS.
Do anyone know what I have missed or how to get the Jenkis job to FAILURE?
*Part of the 'Jenkinsfile':*
stage("Performance Tests"){
bat pscmd('.\\performance-tests.ps1')
performanceReport compareBuildPrevious: true, configType: 'ART',
errorFailedThreshold: 0, errorUnstableResponseTimeThreshold:
'sws-backend-maintenance.jtl:10', errorUnstableThreshold: 0,
failBuildIfNoResultFile: false, modeOfThreshold: false,
modePerformancePerTestCase: true, modeThroughput: true, nthBuildNumber: 0,
parsers: [[$class: 'JMeterParser', glob:
'testresults/sws-backend-maintenance.jtl']],
relativeFailedThresholdNegative: 0.0, relativeFailedThresholdPositive: 0.0,
relativeUnstableThresholdNegative: 0.0, relativeUnstableThresholdPositive:
0.0
step([$class: 'ArtifactArchiver', artifacts: 'testresults/**/*'])
}
*Part of the Jenkins Console output log*:
Performance: Recording JMeter reports
'testresults/sws-backend-maintenance.jtl'
Performance: Parsing JMeter report file
'D:\Jenkins\jobs\sws-backend-maintenance\jmeter\builds\83\performance-reports\JMeter\sws-backend-maintenance.jtl'.
Setting threshold: sws-backend-maintenance.jtl:10
Performance: Percentage of errors greater or equal than 0% sets the build
as unstable
Performance: Percentage of errors greater or equal than 0% sets the build
as failure
sws-backend-maintenance.jtl has an average of: 272
UNSTABLE: sws-backend-maintenance.jtl has exceeded the threshold of [10]
with the time of [272]
:
[Pipeline] End of Pipeline
Finished: SUCCESS
Component: performance-plugin
Environment: Jenkins ver. 2.32.2
Performance plugin ver. 2.0
Best Regards,
Jeanette
--
You received this message because you are subscribed to the Google Groups
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/jenkinsci-users/CAHN924r7KCXEPXVFT3hyb7qyfYL9tz%3DTqWw4tmaEvEJkRf89Cw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Performance plugin how use Absolute constraints ?
Hi, Some requests have response time very short (6ms) and relative comparison give difference to high (6ms compare to 7ms => 16% diff). For example : === Performance: Recording JMeter reports 'resultat/res_filtred.jtl' Performance: Parsing JMeter report file '/home/jenkins/.jenkins/jobs/PERF_publish_compare_loadtesting/builds/41/performance-reports/JMeter/res_filtred.jtl'. Performance: Percentage of relative difference outside -11.0 to +100.0 % sets the build as failure Performance: Percentage of relative difference outside -0.0 to +10.0 % sets the build as unstable Performance: Recording JMeter reports 'resultat/res_filtred.jtl' Comparison build no. - 37 and 41 using Average response time PrevBuildURICurrentBuildURI PrevBuildURIAvg CurrentBuildURIAvg RelativeDiffRelativeDiffPercentage P1_01_ACCUEIL P1_01_ACCUEIL 6 6 0.0 0.0 P1_02_DMD_FORM_LOGINP1_02_DMD_FORM_LOGIN6 7 1.0 16.67 P1_03_LOGIN P1_03_LOGIN 10 13 3.0 30.0 P1_04_STATS P1_04_STATS 53 78 25.047.17 P1_05_RETOUR_MENU P1_05_RETOUR_MENU 2 2 0.0 0.0*P1_06_LOGOUTP1_06_LOGOUT 6 7 1.0 * *16.67* The label "P1_06_LOGOUT" made the build *unstable* Build step 'Publish Performance test result report' changed build result to UNSTABLE ======= How can i configure the Performance Plugin with absolute response time constraints like : P1_01_ACCUEIL must be less than 20 ms P1_02_DMD_FORM_LOGIN must be less than 20 ms P1_03_LOGIN must be less than 100 ms P1_04_STATS must be less than 200 ms P1_05_RETOUR_MENU must be less than 20ms *P1_06_LOGOUT must be less than 20 ms* With the "Expert Mode" i can see Constraints but i don't understand how it's work and how configure the SLA values (likes P1_06_LOGOUT:20 ? => must be less than 20 ms) Regards. Vincent D. -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/18b036b3-69b8-4bd4-89da-6bce5c4dc1e3%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
View report with Performance Plugin
Hi all, I start to use jenkins+jmeter+performance plugin. Plugin is installed and available in Post-build steps. Jmeter is installed on remote server. Jenkins has access to this remote server and can start test in non-gui mode. Shell script looks so: jmeter -n -t some.jmx -l some.jtl Problem appear when I try to view test results. Started by user test <http://jenkins.imantics.net/user/test> [EnvInject] - Loading node environment variables. Building in workspace /var/lib/jenkins/workspace/_run_api_testing executing script: cd /usr/local/jmeter jmeter -n -t some.jmx -l some.jtl Creating summariser Created the tree successfully using some.jmx Starting the test @ Wed Dec 09 15:16:33 UTC 2015 (1449674193495) Waiting for possible shutdown message on port 4445 summary + 1 in 0.3s =3.2/s Avg: 316 Min: 316 Max: 316 Err: 0 (0.00%) Active: 1 Started: 1 Finished: 0 summary + 9 in 0.2s = 58.8/s Avg:15 Min: 4 Max:91 Err: 0 (0.00%) Active: 0 Started: 1 Finished: 1 summary = 10 in 0.5s = 20.3/s Avg:45 Min: 4 Max: 316 Err: 0 (0.00%) Tidying up ...@ Wed Dec 09 15:16:34 UTC 2015 (1449674194524) ... end of run [SSH] exit-status: 0 Performance: Percentage of relative difference outside -0.0 to +0.0 % sets the build as failure Performance: Percentage of relative difference outside -0.0 to +0.0 % sets the build as unstable Performance: no JMeter files matching '**/*.jtl' have been found. Has the report generated?. Setting Build to FAILURE Build step 'Publish Performance test result report' changed build result to FAILURE Finished: FAILURE Report is available on remote host in cd /usr/local/jmeter Could anyone please help me with it? Thanks a lot for any given information, Anna -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/d032cdbc-fba6-4455-9eea-281b81802388%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Performance Plugin error
Hi,
We are running Jenkins V: 1.611 and Performance plugin v: 1.13,
Everything was fine when we set this plugin and it is running fine in few
jobs, now when I open job for any modification, it is giving error like
bellow and when I delete
*publish perfomance test result report Junit report file *
section , it is working fine.
A problem occurred while processing the request. Please check our bug
tracker <https://issues.jenkins-ci.org/> to see if a similar problem has
already been reported. If it is already reported, please vote and put a
comment on it to let us gauge the impact of the problem. If you think this
is a new issue, please file a new issue. When you file an issue, make sure
to add the entire stack trace, along with the version of Jenkins and
relevant plugins. The users list
<http://jenkins-ci.org/content/mailing-lists> might be also useful in
understanding what has happened.
Stack trace
javax.servlet.ServletException: java.lang.RuntimeException: Failed to
instantiate class hudson.plugins.performance.PerformancePublisher from
{"parsers":{"glob":"","kind":"hudson.plugins.performance.JUnitParser$DescriptorImpl"},"modeOfThreshold":"false","errorUnstableThreshold":"-1","errorFailedThreshold":"-1","errorUnstableResponseTimeThreshold":"","relativeUnstableThresholdNegative":"0.0","relativeUnstableThresholdPositive":"0.0","relativeFailedThresholdNegative":"0.0","relativeFailedThresholdPositive":"0.0","compareBuildPrevious":"false","nthBuildNumber":"0","comparisonType":"ART","modePerformancePerTestCase":true,"modeThroughput":false,"stapler-class":"hudson.plugins.performance.PerformancePublisher","$class":"hudson.plugins.performance.PerformancePublisher"}
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:796)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
at org.kohsuke.stapler.MetaClass$6.doDispatch(MetaClass.java:249)
at
org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
at org.kohsuke.stapler.MetaClass$6.doDispatch(MetaClass.java:249)
at
org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
at org.kohsuke.stapler.MetaClass$6.doDispatch(MetaClass.java:249)
at
org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53)
at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
at org.kohsuke.stapler.Stapler.invoke(Stapler.java:649)
at org.kohsuke.stapler.Stapler.service(Stapler.java:238)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:686)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1494)
at
hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:123)
at
net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:198)
at
net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:176)
at
net.bull.javamelody.PluginMonitoringFilter.doFilter(PluginMonitoringFilter.java:85)
at
org.jvnet.hudson.plugins.monitoring.HudsonMonitoringFilter.doFilter(HudsonMonitoringFilter.java:99)
at
hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:120)
at
hudson.plugins.greenballs.GreenBallFilter.doFilter(GreenBallFilter.java:58)
at
hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:120)
at
hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:114)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:48)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
at
hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
at
hudson.security.UnwrapSecurityExceptionFilter.doFilter(UnwrapSecurityExceptionFilter.java:51)
at
hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
at
jenkins.security.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:117)
at
hudson.security.ChainedServletFilter$1.doFilter(ChainedServlet
RE: Performance-plugin
I have been trying to install this plugin for test ran in Robot Framework but have not been able to have even on performance reported. On what file is this plugin looking into? I have converted my robotframework xml test in Xunit test results. But still no luck. thanks From: jenkinsci-users@googlegroups.com [mailto:jenkinsci-users@googlegroups.com] On Behalf Of jes Struck Sent: June-02-15 9:40 AM To: jenkinsci-users@googlegroups.com Subject: Performance-plugin Hello Jenkins Users, We are in the process of implementing performance test in Jenkins, and has therefor installed the Performance plugin. but we are struggeling with two major isseus. 1.) All test is reported as an error even doe all of them is sgiving html status, 200 OK. - Please see the attached screen shot. 2.) Alot of the graphs is not working, for some reason they are not generated properly - Please see the attached screen shot. [Inline images 1] As bonus info I can tell that we are running on a Red Hat Enterprise Linux Server release 6.6 (Santiago) as Jenkins master and slaves, we are using Jenkins 1.568 and the lastest version of the Perfomance plugin(1.13). Please, if anybody has seen this, and has a solution or workaround that will be very much helpfull. /Jes -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com<mailto:jenkinsci-users+unsubscr...@googlegroups.com>. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CABCrcLpXaTujLbZcoMcMatYoY%2B0bd%2BNoSouxQ6EjKpq%2BT-Y5%3DQ%40mail.gmail.com<https://groups.google.com/d/msgid/jenkinsci-users/CABCrcLpXaTujLbZcoMcMatYoY%2B0bd%2BNoSouxQ6EjKpq%2BT-Y5%3DQ%40mail.gmail.com?utm_medium=email&utm_source=footer>. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/BD334F856BC119489D8D5CD99DFB9F766FFFC602%40GATCAS01.CMLnet.peinet.peinc.com. For more options, visit https://groups.google.com/d/optout.
Performance-plugin
Hello Jenkins Users, We are in the process of implementing performance test in Jenkins, and has therefor installed the Performance plugin. but we are struggeling with two major isseus. 1.) All test is reported as an error even doe all of them is sgiving html status, 200 OK. - Please see the attached screen shot. 2.) Alot of the graphs is not working, for some reason they are not generated properly - Please see the attached screen shot. [image: Inline images 1] As bonus info I can tell that we are running on a Red Hat Enterprise Linux Server release 6.6 (Santiago) as Jenkins master and slaves, we are using Jenkins 1.568 and the lastest version of the Perfomance plugin(1.13). Please, if anybody has seen this, and has a solution or workaround that will be very much helpfull. /Jes -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CABCrcLpXaTujLbZcoMcMatYoY%2B0bd%2BNoSouxQ6EjKpq%2BT-Y5%3DQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Performance-plugin
Hello Jenkins Users We are in the process of implementing Performance test in Jenkins, using JMeter,and have therfor installed the Performance-plugin for Jenkins. we have at the moment two major issues with this plugin, 1.) All test are reported as errors, even though all of our test is return with html status, 200 OK 2.) the second also can been seen on the attached screenshot, alot of the graph does not work. [image: Inline images 1] Some bonus information is that we are running on a Red Hat Enterprise Linux Server release 6.6 (Santiago) with Jenkins 1.568 and the lastest version of the plugin (1.13) does any body else have the same issues, or a solution to this??. /Jes -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CABCrcLqM2F8cpmER7-8mHGnDxxsVXV104mWwrVGtOnM%3D2BiX5g%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: Performance Plugin
Replying to self here. Weeks ago, I wrote: >> my .jtl has data concatenated from multiple builds, That was my problem and I fixed it by using the Jenkins options to delete my Jenkins "workspace" before each build. Otherwise, JMeter's default behavior is to append new data to an existing .jtl file, no matter how old that .jtl file is. Say that I had run builds from the 10 previous evenings, each with a 2-minute load test. I was left with a single .jtl file that had a two minute load test followed by 23 hours and 58 minutes of inactivity...and then repeat that 9 more times. All that inactivity graphed as near-zero throughput. --Erik On Monday, January 26, 2015 at 4:09:11 PM UTC-6, Ostermueller, Erik wrote: > > Hello, > > > > I have two questions about the performance plugin. I’ve got 1.11, Jenkins > 1.590 on linux, openjdk 1.7x. > > > > First, how do you delete/expire the cache that was added in V1.10 ? > > > > Second, my most recent build’s .jtl file is a concatenation of the current > build and multiple .jtl files from prior builds. Is this intentional? The > concatenation doesn’t seem to happen consistently. Without it, my > throughput graphs look great. But when my .jtl has data concatenated from > multiple builds, the throughput numbers are like 0 or 1 and completely > disagree with the verbose JMeter output (that looks correct to me), which > is seen in the build log. > > > > Thanks for Jenkins. > > > > --Erik > > > _ > The information contained in this message is proprietary and/or > confidential. If you are not the intended recipient, please: (i) delete the > message and all copies; (ii) do not disclose, distribute or use the message > in any manner; and (iii) notify the sender immediately. In addition, please > be aware that any message addressed to our domain is subject to archiving > and review by persons other than the intended recipient. Thank you. > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/67a7fd3d-3752-4632-aac3-695f2aa75a9e%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Performance Plugin
Hello, I have two questions about the performance plugin. I've got 1.11, Jenkins 1.590 on linux, openjdk 1.7x. First, how do you delete/expire the cache that was added in V1.10 ? Second, my most recent build's .jtl file is a concatenation of the current build and multiple .jtl files from prior builds. Is this intentional? The concatenation doesn't seem to happen consistently. Without it, my throughput graphs look great. But when my .jtl has data concatenated from multiple builds, the throughput numbers are like 0 or 1 and completely disagree with the verbose JMeter output (that looks correct to me), which is seen in the build log. Thanks for Jenkins. --Erik _ The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you. -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/A94B468263DDE2448A14367F590EB97332FFF350%40LTCFISWMSGMB15.FNFIS.com. For more options, visit https://groups.google.com/d/optout.
Jenkins Performance Plugin - How to configure the tests to fail if response time goes below a specific value ?
Hi Team, I have configured the Jmeter Performance Plugin in Jenkins and getting all the performance results.But I wanted to configure the job such that if the average response time goes below a specific threshold then the job should fail.I have 2 jmeter tests in one job .So how can I specify threshold for both the files -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Performance plugin: configure report file's path
Hi, I'm using the performance plugin to read some junit report files. But I have an issue with the path of this report. I have many jobs who can trigger the job who generate the report. And I want to work in different directory for each job. My workspace look like this: WORKSPACE/ JOBA/report.xml JOBA/something.txt JOBA/somethingelse.txt ... JOBB/report.xml ... JOBC/report.xml ... In jenkins I can choose a path like **/report.xml for the report's path. But it'll take all the reports and I just want one of them. Sometimes it will be JOBA/report.xml. Some other times, JOBB/report.xml. I have an env var to know which one I want. Is it possible to use this env var to specify where the performance plugin should search the report file? Thanks L. -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Performance Plugin, no charts
Hello all, I'm using the performance plugin, and I'm generating jmeter results, but I'm not getting any charts. The charts are there, just empty. I can click through and get to the table and the results: URIsamplesAverage (ms)Median (ms)Line90 (ms)Minimun (ms)Maximun (ms)Errors (%)XXX200153102231938550.0 % which looks good (though I'd prefer lower numbers ;) ) Anyway, where can I look to see why I'm not getting any charts? If it matters, I'm running JMeter through a script as a post-build step. Thanks,
Performance Plugin constantly parsing jmx files
I have two Jmeter tests that run in two distinct jenkins jobs on tomcat, using Jenkins 1.452, ubuntu , 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux, Tom cat 7.0.25 My catalina.out file is full of the following. There are many entries than there are individual runs of jmeter. The system becomes unusable over time. Both jobs are disabled and I am still seeing the messages below. Can someone suggest additional debugging options? Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl Performance: Parsing JMeter report file Production-AppletPrint.jtl
