This appears to be an issue solely with the annotation to the SauceLabs job that is supposed to occur after each failed scenario. In other words, trust the Jenkins build status over the SauceLabs status for now.
I'm able to reproduce the failure pretty consistently against Beta Cluster with both a local FF WebDriver connection and via SauceLabs, so I would consider it a true failure, possibly a need to refactor the test—I see a `sleep 5` in the step so perhaps it's a timing issue. On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <[email protected]> wrote: > QA peeps, this test keeps failing but when I click the sauce labs url > https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85 it tells me > it passed so we're having a lot of difficulty trying to debug this. > > Is it possible to grab some help from someone to work out why this keeps > happening? It's responsible for most of our red builds now. > > Context: > https://phabricator.wikimedia.org/T105589 > https://phabricator.wikimedia.org/T98476 > > On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <[email protected]> > wrote: > >> * FAILURE: >> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce >> Build #771 >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/> >> (Mon, 03 Aug 2015 02:42:00 +0000)* >> *Test Result* >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/> >> 1 failed, 3 skipped >> Failed Tests *Test Name**Duration**Age* Search.Search with search in >> pages button >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button>40 >> sec1 >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/> >> All >> Tests *Package**Duration**Fail**Skip**Total* (root) >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)>26 >> min1368 >> >> _______________________________________________ >> reading-wmf mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/reading-wmf >> >> > > _______________________________________________ > QA mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/qa > > -- Dan Duvall Automation Engineer Wikimedia Foundation <http://wikimediafoundation.org>
_______________________________________________ QA mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/qa
