[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[gerritbot]

gerritbot added a comment.

Change 247901 merged by jenkins-bot:
Additionally run Wikidata browsertests without saucelabs

https://gerrit.wikimedia.org/r/247901


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, Mbch331, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

raita.wmflabs.org shows the correct link.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

If you can figure that out, then what does go wrong with the last few failures 
on sauce labs?


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[Tobi_WMDE_SW]

Tobi_WMDE_SW added a comment.

That's the nice thing about saucelabs: you can have a look at the test-run in a 
video to figure out what went wrong.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tobi_WMDE_SW
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

For now lets run the jobs both with and without saucelabs until we figure out 
how to make one of them not flaky.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

A timeout will be also be reported when a link can not be found when the 
instruction was wait for that link to appear. So it is not that simple. Most of 
them seem not to be "A script on this page may be busy, or it may have stopped 
responding.".


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[Jonas]

Jonas added a comment.

Is this the right link 

 to see the results?
So it's mostly timeouts?

This sadly made me laugh:

  Scenario: Edit sitelink
  Unexpected modal dialog (text: A script on this page may be busy, or it may 
have stopped responding. You can stop the script now, open the script in the 
debugger, or let the script continue.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jonas
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

Yes that seems to work.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[zeljkofilipin]

zeljkofilipin added a comment.

I think the only thing left is to tell the machine you want to run the browser 
headless.

  export HEADLESS=true

https://github.com/wikimedia/mediawiki-selenium#headless-mode


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: zeljkofilipin
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

Yes that seems to disable saucelabs. But now I get "unable to obtain stable 
firefox connection in 60 seconds" as a failure for the second scenario:
http://raita.wmflabs.org/#projects/https%3A%2F%2Fgithub.com%2Fwmde%2FWikidataBrowserTests.git/builds/FLBroL2mRIOCJAGEQ3QFvw
https://gerrit.wikimedia.org/r/#/c/247901/2/


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[Tobi_WMDE_SW]

Tobi_WMDE_SW added a comment.

@JanZerebecki
AFAIK it uses Saucelabs whenever SAUCE_ONDEMAND_USERNAME and 
SAUCE_ONDEMAND_ACCESS_KEY are set. Unsetting these should make it use the local 
browser.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tobi_WMDE_SW
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, 01tonythomas, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[JanZerebecki]

JanZerebecki added a comment.

It seems not setting --format Cucumber::Formatter::Sauce as in the patch does 
not cause it to not use saucelabs. How do I instruct the framework to use a 
local browser instead?


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, 01tonythomas, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[gerritbot]

gerritbot added a subscriber: gerritbot.
gerritbot added a comment.

Change 247901 had a related patch set uploaded (by JanZerebecki):
[WIP] Run Wikidata browsertests without saucelabs

https://gerrit.wikimedia.org/r/247901


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, 
Aklapper, Wikidata-bugs, aude, 01tonythomas, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

[zeljkofilipin]

zeljkofilipin added a comment.

This should be really easy to do. Our framework supports running tests on a 
local browser or Sauce Labs. Let me know if you need help with this, or if you 
would like to pair on it.


TASK DETAIL
  https://phabricator.wikimedia.org/T116166

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: zeljkofilipin
Cc: Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, Aklapper, 
Wikidata-bugs, aude, greg



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs