Re: [Wikitech-l] [Wikipedia-l] Data centre switchover to Eqiad

[Riccardo Coccioli]

Those variables are in the process to be moved to Etcd to make the
configuration dynamic, see [1] and related tasks, hence (re)moving the
problem in the first place. Even in the case that this will not go to
production in time, the hardcoded part in Switchdc can be easily removed,
please find my detailed reply directly in the task in [2].

Riccardo

[1] https://phabricator.wikimedia.org/T156924
[2] https://phabricator.wikimedia.org/T164177#3224771

On Mon, May 1, 2017 at 1:37 AM, Eddie Greiner-Petter <
wikimedia@eddie-sh.de> wrote:

> Hey,
> I had a quick chat with Zppix about how to solve this and we ended up
> creating this task instead of just sending in a patch:
>
> https://phabricator.wikimedia.org/T164177
>
> While it looks quite trivial to change the strings in the config files
> on the first glance, I noticed that the switchdc script actually
> hardcodes this message in the scripts used to set mediawiki ro and back
> rw (maybe also somewhere else, haven't checked), which needs us to pay
> attention to not break switchdc by exchanging that message. Details are
> described on the task, let's continue there.
>
> - Eddie
>
> On 01.05.2017 00:18, Jaime Crespo wrote:
> > On Sun, Apr 30, 2017 at 9:24 PM, Eddie Greiner-Petter <
> > wikimedia@eddie-sh.de> wrote:
> >
> >> That reminds me that we noticed during switch to codfw that the message
> >> shown when trying to really edit a page (the mediawiki read-only
> >> message) contains:
> >>
> >> The system administrator who locked it offered this explanation:
> >> MediaWiki is in read-only mode for maintenance. Please try again in a
> >> few minutes
> >>
> >> which isn't quite informative. Is there a task for changing the "offered
> >> explanation" part? Some hint about the DC switch (and maybe a link to
> >> the meta page) would be better.
> >
> >
> > The read-only messages are controlled by these strings:
> >
> > https://phabricator.wikimedia.org/source/mediawiki-config/
> browse/master/wmf-config/db-codfw.php;a65f35adbc9d2c8c9a85e956a64661
> 783d2c973d$645
> > https://phabricator.wikimedia.org/source/mediawiki-config/
> browse/master/wmf-config/db-eqiad.php;a65f35adbc9d2c8c9a85e956a64661
> 783d2c973d$664
> >
> > I think with the pressure of keeping everything up, plus discussing
> > internally if we should declare a specific amount of time (given it
> doesn't
> > auto-update) we ended up a very generic message. We are, however, looking
> > at showing better error messages like on the ticket I reported at
> > https://phabricator.wikimedia.org/T163455#3199813
> >
> > Please send a pull request or file a new ticket on Phabricator with the
> > #operations and #codfw-rollout tags with a proposal and we can definitely
> > change it by Wednesday.
> >
> > Thanks,
> >
>
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wikipedia-l] Data centre switchover to Eqiad

[Eddie Greiner-Petter]

Hey,
I had a quick chat with Zppix about how to solve this and we ended up
creating this task instead of just sending in a patch:

https://phabricator.wikimedia.org/T164177

While it looks quite trivial to change the strings in the config files
on the first glance, I noticed that the switchdc script actually
hardcodes this message in the scripts used to set mediawiki ro and back
rw (maybe also somewhere else, haven't checked), which needs us to pay
attention to not break switchdc by exchanging that message. Details are
described on the task, let's continue there.

- Eddie

On 01.05.2017 00:18, Jaime Crespo wrote:
> On Sun, Apr 30, 2017 at 9:24 PM, Eddie Greiner-Petter <
> wikimedia@eddie-sh.de> wrote:
> 
>> That reminds me that we noticed during switch to codfw that the message
>> shown when trying to really edit a page (the mediawiki read-only
>> message) contains:
>>
>> The system administrator who locked it offered this explanation:
>> MediaWiki is in read-only mode for maintenance. Please try again in a
>> few minutes
>>
>> which isn't quite informative. Is there a task for changing the "offered
>> explanation" part? Some hint about the DC switch (and maybe a link to
>> the meta page) would be better.
> 
> 
> The read-only messages are controlled by these strings:
> 
> https://phabricator.wikimedia.org/source/mediawiki-config/browse/master/wmf-config/db-codfw.php;a65f35adbc9d2c8c9a85e956a64661783d2c973d$645
> https://phabricator.wikimedia.org/source/mediawiki-config/browse/master/wmf-config/db-eqiad.php;a65f35adbc9d2c8c9a85e956a64661783d2c973d$664
> 
> I think with the pressure of keeping everything up, plus discussing
> internally if we should declare a specific amount of time (given it doesn't
> auto-update) we ended up a very generic message. We are, however, looking
> at showing better error messages like on the ticket I reported at
> https://phabricator.wikimedia.org/T163455#3199813
> 
> Please send a pull request or file a new ticket on Phabricator with the
> #operations and #codfw-rollout tags with a proposal and we can definitely
> change it by Wednesday.
> 
> Thanks,
> 



signature.asc
Description: OpenPGP digital signature
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wikipedia-l] Data centre switchover to Eqiad

[Jaime Crespo]

On Sun, Apr 30, 2017 at 9:24 PM, Eddie Greiner-Petter <
wikimedia@eddie-sh.de> wrote:

> That reminds me that we noticed during switch to codfw that the message
> shown when trying to really edit a page (the mediawiki read-only
> message) contains:
>
> The system administrator who locked it offered this explanation:
> MediaWiki is in read-only mode for maintenance. Please try again in a
> few minutes
>
> which isn't quite informative. Is there a task for changing the "offered
> explanation" part? Some hint about the DC switch (and maybe a link to
> the meta page) would be better.


The read-only messages are controlled by these strings:

https://phabricator.wikimedia.org/source/mediawiki-config/browse/master/wmf-config/db-codfw.php;a65f35adbc9d2c8c9a85e956a64661783d2c973d$645
https://phabricator.wikimedia.org/source/mediawiki-config/browse/master/wmf-config/db-eqiad.php;a65f35adbc9d2c8c9a85e956a64661783d2c973d$664

I think with the pressure of keeping everything up, plus discussing
internally if we should declare a specific amount of time (given it doesn't
auto-update) we ended up a very generic message. We are, however, looking
at showing better error messages like on the ticket I reported at
https://phabricator.wikimedia.org/T163455#3199813

Please send a pull request or file a new ticket on Phabricator with the
#operations and #codfw-rollout tags with a proposal and we can definitely
change it by Wednesday.

Thanks,

-- 
Jaime Crespo

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wikipedia-l] Data centre switchover to Eqiad

[Eddie Greiner-Petter]

As there was a globalnotice the other week when we switched to codfw,
I'm sure there'll be one this week for the switch back too.

That reminds me that we noticed during switch to codfw that the message
shown when trying to really edit a page (the mediawiki read-only
message) contains:

The system administrator who locked it offered this explanation:
MediaWiki is in read-only mode for maintenance. Please try again in a
few minutes

which isn't quite informative. Is there a task for changing the "offered
explanation" part? Some hint about the DC switch (and maybe a link to
the meta page) would be better.

- Eddie

On 30.04.2017 21:15, David Gerard wrote:
> Would a sitenotice for logged-in users, or at least a watchlist
> notice, be a good idea?
> 
> 
> - d.
> 
> 
> 
> On 30 April 2017 at 19:08, zppix e  wrote:
>> Hello,  as you may or may not already know there will be a datacentre
>> switch back to Eqiad, WMF's main data centre, on May 3rd at approximately
>> 14:00 UTC. For approximately 20-30 minutes you will NOT be able to save
>> edits to any WMF project. If you have any questions feel free to reply back
>> to this email, or ask on IRC on freenode channel #wikimedia-tech. If there
>> any major issues that occur during this time please report them to
>> #wikimedia-tech on freenode!
>>
>> Thanks,
>> Zppix
>> Volunteer Developer for WMF
>> www.enwp.org/User:Zppix
>> ___
>> Wikipedia-l mailing list
>> wikipedi...@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikipedia-l
> 
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> 



signature.asc
Description: OpenPGP digital signature
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wikipedia-l] Data centre switchover to Eqiad

[David Gerard]

Would a sitenotice for logged-in users, or at least a watchlist
notice, be a good idea?


- d.



On 30 April 2017 at 19:08, zppix e  wrote:
> Hello,  as you may or may not already know there will be a datacentre
> switch back to Eqiad, WMF's main data centre, on May 3rd at approximately
> 14:00 UTC. For approximately 20-30 minutes you will NOT be able to save
> edits to any WMF project. If you have any questions feel free to reply back
> to this email, or ask on IRC on freenode channel #wikimedia-tech. If there
> any major issues that occur during this time please report them to
> #wikimedia-tech on freenode!
>
> Thanks,
> Zppix
> Volunteer Developer for WMF
> www.enwp.org/User:Zppix
> ___
> Wikipedia-l mailing list
> wikipedi...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikipedia-l

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l