https://phabricator.wikimedia.org/T102901 < I've raised a bug. Looks like something funky is happening.
On Wed, Jun 17, 2015 at 4:03 PM, Dan Duvall <[email protected]> wrote: > On Wed, Jun 17, 2015 at 3:44 PM, Dan Duvall <[email protected]> wrote: > >> Both of these failures are legit, actually. The first one fails every >> time because there's no "Settings" menu item for the mobile view on beta >> ATM. The second one is intermittent but fails because clicking "search >> within pages" fails to do anything ~ 20% of the time—I was able to >> reproduce this through repeated executions of the tests and by pausing at >> the "click search" step to initiate it manually. >> >> Is there someone on your team that can own verification of such failures >> before escalating them to QA/RelEng? We're here to help >> troubleshoot/refactor the trickier stuff but that first one seemed pretty >> trivial to repro. >> > > My mistake. Looking at the SauceLabs replay of the first one does indeed > show "Settings" in the menu, although it doesn't show when I run the test > locally (still running against beta). Still, it would be nice to establish > a practice of verifying internally before escalating to other teams. (Where > are those illusive QA analysts we saw in the new org chart ... ?) > > >> >> On Tue, Jun 16, 2015 at 11:03 AM, Jon Robson <[email protected]> >> wrote: >> >>> More flaky weirdness. cc'ing QA >>> >>> On Tue, Jun 16, 2015 at 10:05 AM, jenkins-bot <[email protected] >>> > wrote: >>> >>>> * FAILURE: >>>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce >>>> Build #685 >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/> >>>> (Tue, 16 Jun 2015 16:31:43 +0000)* >>>> *Test Result* >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/> >>>> 2 failed, 3 skipped >>>> Failed Tests *Test Name**Duration**Age* Menus open correct page >>>> for anonymous users.Check links in menu >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu>23 >>>> sec2 >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/683/> >>>> Search.Search >>>> with search in pages button >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Search/Search_with_search_in_pages_button>34 >>>> sec1 >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/684/> >>>> All >>>> Tests *Package**Duration**Fail**Skip**Total* (root) >>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)>24 >>>> min2356 >>>> >>>> _______________________________________________ >>>> reading-wmf mailing list >>>> [email protected] >>>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf >>>> >>>> >>> >>> _______________________________________________ >>> QA mailing list >>> [email protected] >>> https://lists.wikimedia.org/mailman/listinfo/qa >>> >>> >> >> >> -- >> Dan Duvall >> Automation Engineer >> Wikimedia Foundation <http://wikimediafoundation.org> >> > > > > -- > Dan Duvall > Automation Engineer > Wikimedia Foundation <http://wikimediafoundation.org> > > _______________________________________________ > QA mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/qa > >
_______________________________________________ QA mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/qa
