It's on/off. It's been failing since day 1 see: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/ 43-47 and 49-51 all fail.
I'm pretty sure it's race conditions based on the fact adding a sleep in https://gerrit.wikimedia.org/r/246801 fixes it - but I'd really like to understand better rather than hacking around it. On Thu, Oct 29, 2015 at 7:50 AM, Antoine Musso <[email protected]> wrote: > Le 28/10/2015 22:27, Jon Robson a écrit : > > QA team > > We're struggling to identify why this is happening and it's spamming our > > inboxes > > https://gerrit.wikimedia.org/r/246801 seems to fix the issue for unknown > > reasons. > > Any help you can provide on the patch would be much appreciated. > > Hello, > > For build #50, it shows a 503: > > 21:19:18 Scenario: Internal survey is visible when bucketed > # features/internal_survey.feature:22 > > 21:19:29 Given the quick survey test pages are installed > # features/support/step_definitions/common_steps.rb:1 > > 21:19:29 unexpected HTTP response (503) (MediawikiApi::HttpError) > > The mediawiki_api gem should give more details really :-/ I have > looked at logstash-beta.wmflabs.org but haven't found any error around > that time. > One off error?.. > > > Build #49 and #51 have a different one: > > > 14:32:10 Scenario: External survey is not present when dismissed > # features/external_survey.feature:23 > 14:32:29 And the page has fully loaded > # features/support/step_definitions/common_steps.rb:72 > 14:32:29 Then I should not see the survey > # features/support/step_definitions/common_steps.rb:83 > 14:32:29 expected visible? to return false, got true > (RSpec::Expectations::ExpectationNotMetError) > > > I ran the job again (build #52) and it passes now :-( > > -- > Antoine "hashar" Musso > > > _______________________________________________ > QA mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/qa >
_______________________________________________ QA mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/qa
