[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter updated JENKINS-61198 Jenkins / JENKINS-61198 Thresholds not reliable Change By: Simon Richter Status: Fixed but Unreleased Closed Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5413.1582556880198%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter updated JENKINS-61198 Jenkins / JENKINS-61198 Thresholds not reliable Change By: Simon Richter Status: Open Fixed but Unreleased Resolution: Not A Defect Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5411.1582556820283%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter commented on JENKINS-61198 Re: Thresholds not reliable Okay, that was me being stupid and interpreting "greater than" as "greater or equal". Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5409.1582556820252%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter commented on JENKINS-61198 Re: Thresholds not reliable Wait, am I being stupid? Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5391.1582556040107%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter edited a comment on JENKINS-61198 Re: Thresholds not reliable Thresholds are "1", "1", empty, empty: !warn.png|thumbnail!With 1 failing test, I'd expect this to give me "unstable" Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5382.1582554780201%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter commented on JENKINS-61198 Re: Thresholds not reliable Thresholds are "1", "1", empty, empty: Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5379.1582554660520%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter updated an issue Jenkins / JENKINS-61198 Thresholds not reliable Change By: Simon Richter Attachment: warn.png Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204746.1582552124000.5377.1582554660397%40Atlassian.JIRA.
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Nikolas Falco commented on JENKINS-61198 Re: Thresholds not reliable As you can see from the logs the threadshold check is performed at the end. INFO: Starting to record. INFO: Processing BoostTest-1.x (default) INFO: [BoostTest-1.x (default)] - 7 test report file(s) were found with the pattern 'build/qa/**/*.boost-results.xml' relative to '/var/lib/jenkins-agent/workspace/linux-kicad-head' for the testing framework 'BoostTest-1.x (default)'. INFO: Processing JUnit INFO: [JUnit] - 6 test report file(s) were found with the pattern 'build/qa/*.xunit-results/*.xml' relative to '/var/lib/jenkins-agent/workspace/linux-kicad-head' for the testing framework 'JUnit'. INFO: Processing CTest-Version 3.x (default) INFO: [CTest-Version 3.x (default)] - 2 test report file(s) were found with the pattern 'build/Testing/**/*.xml' relative to '/var/lib/jenkins-agent/workspace/linux-kicad-head' for the testing framework 'CTest-Version 3.x (default)'. INFO: Check 'Failed Tests' threshold. INFO: Setting the build status to SUCCESS INFO: Stopping recording. How did you configure the threshold? Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter updated an issue Jenkins / JENKINS-61198 Thresholds not reliable Change By: Simon Richter We have a few jobs that use the xUnit plugin with multiple sources to collect results from multiple test frameworks. The build should be marked as unstable if there is a single test failure.In several builds, the build is marked as successful with multiple test failures. My suspicion is that thresholds are checked only for one of the sources, not all of them cumulatively.[Example build| [ https://jenkins.simonrichter.eu/job/linux-kicad-head/4211/] Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter updated an issue Jenkins / JENKINS-61198 Thresholds not reliable Change By: Simon Richter We have a few jobs that use the xUnit plugin with multiple sources to collect results from multiple test frameworks. The build should be marked as unstable if there is a single test failure.In several builds, the build is marked as successful with multiple test failures. My suspicion is that thresholds are checked only for one of the sources, not all of them cumulatively.[ [ Example build ] |[https://jenkins.simonrichter.eu/job/linux-kicad-head/4211/] |https://jenkins.simonrichter.eu/job/linux-kicad-head/4211/] Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter updated an issue Jenkins / JENKINS-61198 Thresholds not reliable Change By: Simon Richter We have a few jobs that use the xUnit plugin with multiple sources to collect results from multiple test frameworks. The build should be marked as unstable if there is a single test failure.In several builds, the build is marked as successful with multiple test failures. My suspicion is that thresholds are checked only for one of the sources, not all of them cumulatively.[ [ Example build] ( |[ https://jenkins.simonrichter.eu/job/linux-kicad-head/4211/ ) ]|https://jenkins.simonrichter.eu/job/linux-kicad-head/4211/] Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit
[JIRA] (JENKINS-61198) Thresholds not reliable
Title: Message Title Simon Richter created an issue Jenkins / JENKINS-61198 Thresholds not reliable Issue Type: Bug Assignee: Nikolas Falco Components: xunit-plugin Created: 2020-02-24 13:48 Priority: Minor Reporter: Simon Richter We have a few jobs that use the xUnit plugin with multiple sources to collect results from multiple test frameworks. The build should be marked as unstable if there is a single test failure. In several builds, the build is marked as successful with multiple test failures. My suspicion is that thresholds are checked only for one of the sources, not all of them cumulatively. [Example build](https://jenkins.simonrichter.eu/job/linux-kicad-head/4211/) Add Comment
