Okay in this case it was actually a failing test. Saucelabs was unfortunately masking it. Fix has been merged and Firefox search in pages is now working again. Thanks guys!
On Mon, Aug 3, 2015 at 2:48 PM, Dan Duvall <[email protected]> wrote: > This appears to be an issue solely with the annotation to the SauceLabs > job that is supposed to occur after each failed scenario. In other words, > trust the Jenkins build status over the SauceLabs status for now. > > I'm able to reproduce the failure pretty consistently against Beta Cluster > with both a local FF WebDriver connection and via SauceLabs, so I would > consider it a true failure, possibly a need to refactor the test—I see a > `sleep 5` in the step so perhaps it's a timing issue. > > On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <[email protected]> wrote: > >> QA peeps, this test keeps failing but when I click the sauce labs url >> https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85 it tells me >> it passed so we're having a lot of difficulty trying to debug this. >> >> Is it possible to grab some help from someone to work out why this keeps >> happening? It's responsible for most of our red builds now. >> >> Context: >> https://phabricator.wikimedia.org/T105589 >> https://phabricator.wikimedia.org/T98476 >> >> On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <[email protected]> >> wrote: >> >>> * FAILURE: >>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce >>> Build #771 >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/> >>> (Mon, 03 Aug 2015 02:42:00 +0000)* >>> *Test Result* >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/> >>> 1 failed, 3 skipped >>> Failed Tests *Test Name**Duration**Age* Search.Search with search in >>> pages button >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button>40 >>> sec1 >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/> >>> All >>> Tests *Package**Duration**Fail**Skip**Total* (root) >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)>26 >>> min1368 >>> >>> _______________________________________________ >>> reading-wmf mailing list >>> [email protected] >>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf >>> >>> >> >> _______________________________________________ >> QA mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/qa >> >> > > > -- > Dan Duvall > Automation Engineer > Wikimedia Foundation <http://wikimediafoundation.org> > > _______________________________________________ > reading-wmf mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/reading-wmf > >
_______________________________________________ QA mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/qa
