On Wed, Jun 17, 2015 at 3:44 PM, Dan Duvall <[email protected]> wrote:
> Both of these failures are legit, actually. The first one fails every time > because there's no "Settings" menu item for the mobile view on beta ATM. > The second one is intermittent but fails because clicking "search within > pages" fails to do anything ~ 20% of the time—I was able to reproduce this > through repeated executions of the tests and by pausing at the "click > search" step to initiate it manually. > > Is there someone on your team that can own verification of such failures > before escalating them to QA/RelEng? We're here to help > troubleshoot/refactor the trickier stuff but that first one seemed pretty > trivial to repro. > My mistake. Looking at the SauceLabs replay of the first one does indeed show "Settings" in the menu, although it doesn't show when I run the test locally (still running against beta). Still, it would be nice to establish a practice of verifying internally before escalating to other teams. (Where are those illusive QA analysts we saw in the new org chart ... ?) > > On Tue, Jun 16, 2015 at 11:03 AM, Jon Robson <[email protected]> > wrote: > >> More flaky weirdness. cc'ing QA >> >> On Tue, Jun 16, 2015 at 10:05 AM, jenkins-bot <[email protected]> >> wrote: >> >>> * FAILURE: >>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce >>> Build #685 >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/> >>> (Tue, 16 Jun 2015 16:31:43 +0000)* >>> *Test Result* >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/> >>> 2 failed, 3 skipped >>> Failed Tests *Test Name**Duration**Age* Menus open correct page for >>> anonymous users.Check links in menu >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu>23 >>> sec2 >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/683/> >>> Search.Search >>> with search in pages button >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Search/Search_with_search_in_pages_button>34 >>> sec1 >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/684/> >>> All >>> Tests *Package**Duration**Fail**Skip**Total* (root) >>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)>24 >>> min2356 >>> >>> _______________________________________________ >>> reading-wmf mailing list >>> [email protected] >>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf >>> >>> >> >> _______________________________________________ >> QA mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/qa >> >> > > > -- > Dan Duvall > Automation Engineer > Wikimedia Foundation <http://wikimediafoundation.org> > -- Dan Duvall Automation Engineer Wikimedia Foundation <http://wikimediafoundation.org>
_______________________________________________ QA mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/qa
