Both of these failures are legit, actually. The first one fails every time because there's no "Settings" menu item for the mobile view on beta ATM. The second one is intermittent but fails because clicking "search within pages" fails to do anything ~ 20% of the time—I was able to reproduce this through repeated executions of the tests and by pausing at the "click search" step to initiate it manually.
Is there someone on your team that can own verification of such failures before escalating them to QA/RelEng? We're here to help troubleshoot/refactor the trickier stuff but that first one seemed pretty trivial to repro. On Tue, Jun 16, 2015 at 11:03 AM, Jon Robson <[email protected]> wrote: > More flaky weirdness. cc'ing QA > > On Tue, Jun 16, 2015 at 10:05 AM, jenkins-bot <[email protected]> > wrote: > >> * FAILURE: >> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce >> Build #685 >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/> >> (Tue, 16 Jun 2015 16:31:43 +0000)* >> *Test Result* >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/> >> 2 failed, 3 skipped >> Failed Tests *Test Name**Duration**Age* Menus open correct page for >> anonymous users.Check links in menu >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu>23 >> sec2 >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/683/> >> Search.Search >> with search in pages button >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Search/Search_with_search_in_pages_button>34 >> sec1 >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/684/> >> All >> Tests *Package**Duration**Fail**Skip**Total* (root) >> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)>24 >> min2356 >> >> _______________________________________________ >> reading-wmf mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/reading-wmf >> >> > > _______________________________________________ > QA mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/qa > > -- Dan Duvall Automation Engineer Wikimedia Foundation <http://wikimediafoundation.org>
_______________________________________________ QA mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/qa
