Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-25 Thread Manuel Arostegui
Hello,

s4 (commonswiki) was done:

Read-only start: 05:00:51
Read-only stop: 05:01:42
Total read-only time: 51 seconds

Thanks,
Manuel.

On Thu, Sep 26, 2019 at 6:00 AM Manuel Arostegui 
wrote:

> Hello,
>
> The last switchover, from this batch, s4 (commonswiki), will start in 1h
> https://phabricator.wikimedia.org/T230784
>
> Thanks
> Manuel.
>
>
> On Tue, Aug 20, 2019 at 12:49 PM Manuel Arostegui <
> maroste...@wikimedia.org> wrote:
>
>> Hello,
>>
>> The following primary database masters will be switched over during the
>> next few weeks (more details at https://phabricator.wikimedia.org/T230788
>> ):
>>
>> Impact:
>> *Writes will be blocked*
>> *Reads will remain unaffected*
>>
>> These are the concrete days, hours and affected wikis:
>>
>> * s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki
>> - tracking task: T230762
>>
>> * s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
>> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>>  - tracking task: T230785
>>
>> * s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
>> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
>> - tracking task: T230783
>>
>> * s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
>> tracking task: T230784
>>
>> If everything goes well, we do not expect to use those 30 minutes of
>> read-only and rather just a few minutes.
>>
>> We will email send an email the day of each failover before and after it
>> is done.
>>
>> Sorry for any inconvenience this might cause.
>>
>>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-25 Thread Manuel Arostegui
Hello,

The last switchover, from this batch, s4 (commonswiki), will start in 1h
https://phabricator.wikimedia.org/T230784

Thanks
Manuel.


On Tue, Aug 20, 2019 at 12:49 PM Manuel Arostegui 
wrote:

> Hello,
>
> The following primary database masters will be switched over during the
> next few weeks (more details at https://phabricator.wikimedia.org/T230788
> ):
>
> Impact:
> *Writes will be blocked*
> *Reads will remain unaffected*
>
> These are the concrete days, hours and affected wikis:
>
> * s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki -
> tracking task: T230762
>
> * s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>  - tracking task: T230785
>
> * s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
> - tracking task: T230783
>
> * s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
> tracking task: T230784
>
> If everything goes well, we do not expect to use those 30 minutes of
> read-only and rather just a few minutes.
>
> We will email send an email the day of each failover before and after it
> is done.
>
> Sorry for any inconvenience this might cause.
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-23 Thread Manuel Arostegui
On Tue, Sep 24, 2019 at 6:00 AM Manuel Arostegui 
wrote:

> Hello,
>
> s3 master switchover will start in 1h:
> https://phabricator.wikimedia.org/T230783
> List of affected wikis:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
>
> Further, the host that will be replaced is db1075, which crashed yesterday
> evening due to HW malfunction: https://phabricator.wikimedia.org/T233534
>
> Thanks,
> Manuel.
>


s3 was done successfully.

read only start: 05:10:14 UTC AM
read only stop: 05:13:08 UTC AM
total read only time: 2 minutes 54 seconds.

We had a slightly longer read only time compared to the all the previous
ones due to some issues with the way we set read-only, those will be
followed up at T233679

Thanks everyone who helped out
Manuel.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-23 Thread Manuel Arostegui
Hello,

s3 master switchover will start in 1h:
https://phabricator.wikimedia.org/T230783
List of affected wikis:
https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist

Further, the host that will be replaced is db1075, which crashed yesterday
evening due to HW malfunction: https://phabricator.wikimedia.org/T233534

Thanks,
Manuel.

On Tue, Aug 20, 2019 at 12:49 PM Manuel Arostegui 
wrote:

> Hello,
>
> The following primary database masters will be switched over during the
> next few weeks (more details at https://phabricator.wikimedia.org/T230788
> ):
>
> Impact:
> *Writes will be blocked*
> *Reads will remain unaffected*
>
> These are the concrete days, hours and affected wikis:
>
> * s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki -
> tracking task: T230762
>
> * s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>  - tracking task: T230785
>
> * s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
> - tracking task: T230783
>
> * s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
> tracking task: T230784
>
> If everything goes well, we do not expect to use those 30 minutes of
> read-only and rather just a few minutes.
>
> We will email send an email the day of each failover before and after it
> is done.
>
> Sorry for any inconvenience this might cause.
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-16 Thread Manuel Arostegui
On Tue, Sep 17, 2019 at 6:00 AM Manuel Arostegui 
wrote:

> Hello,
>
> s2 primary master switchover will start in 1h:
> https://phabricator.wikimedia.org/T230785
> List of affected wikis:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>
>

s2 switchover was done
read-only start: 05:00:44
read-only stop: 05:01:34

Total read-only time: 50 seconds.

Manuel.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-16 Thread Manuel Arostegui
Hello,

s2 primary master switchover will start in 1h:
https://phabricator.wikimedia.org/T230785
List of affected wikis:
https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist


Thanks,
Manuel.

On Tue, Aug 20, 2019 at 12:49 PM Manuel Arostegui 
wrote:

> Hello,
>
> The following primary database masters will be switched over during the
> next few weeks (more details at https://phabricator.wikimedia.org/T230788
> ):
>
> Impact:
> *Writes will be blocked*
> *Reads will remain unaffected*
>
> These are the concrete days, hours and affected wikis:
>
> * s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki -
> tracking task: T230762
>
> * s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>  - tracking task: T230785
>
> * s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
> - tracking task: T230783
>
> * s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
> tracking task: T230784
>
> If everything goes well, we do not expect to use those 30 minutes of
> read-only and rather just a few minutes.
>
> We will email send an email the day of each failover before and after it
> is done.
>
> Sorry for any inconvenience this might cause.
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-09 Thread Manuel Arostegui
s8 (wikidata) master was switched over successfully.

read-only start: Tue Sep 10 05:00:47 UTC 2019
read-only stop: Tue Sep 10 05:02:14 UTC 2019

Total read-only time: 1 minute 27 seconds.

Cheers,
Manuel.

On Tue, Sep 10, 2019 at 6:18 AM Manuel Arostegui 
wrote:

> Hello,
>
> s8 (wikidata) master will be switched over in 40 minutes.
>
> Manuel.
>
> On Tue, Aug 20, 2019 at 12:49 PM Manuel Arostegui <
> maroste...@wikimedia.org> wrote:
>
>> Hello,
>>
>> The following primary database masters will be switched over during the
>> next few weeks (more details at https://phabricator.wikimedia.org/T230788
>> ):
>>
>> Impact:
>> *Writes will be blocked*
>> *Reads will remain unaffected*
>>
>> These are the concrete days, hours and affected wikis:
>>
>> * s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki
>> - tracking task: T230762
>>
>> * s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
>> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>>  - tracking task: T230785
>>
>> * s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
>> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
>> - tracking task: T230783
>>
>> * s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
>> tracking task: T230784
>>
>> If everything goes well, we do not expect to use those 30 minutes of
>> read-only and rather just a few minutes.
>>
>> We will email send an email the day of each failover before and after it
>> is done.
>>
>> Sorry for any inconvenience this might cause.
>>
>>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-09-09 Thread Manuel Arostegui
Hello,

s8 (wikidata) master will be switched over in 40 minutes.

Manuel.

On Tue, Aug 20, 2019 at 12:49 PM Manuel Arostegui 
wrote:

> Hello,
>
> The following primary database masters will be switched over during the
> next few weeks (more details at https://phabricator.wikimedia.org/T230788
> ):
>
> Impact:
> *Writes will be blocked*
> *Reads will remain unaffected*
>
> These are the concrete days, hours and affected wikis:
>
> * s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki -
> tracking task: T230762
>
> * s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
>  - tracking task: T230785
>
> * s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
> https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
> - tracking task: T230783
>
> * s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
> tracking task: T230784
>
> If everything goes well, we do not expect to use those 30 minutes of
> read-only and rather just a few minutes.
>
> We will email send an email the day of each failover before and after it
> is done.
>
> Sorry for any inconvenience this might cause.
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata] Several primary database masters switchovers scheduled (read-only required)

2019-08-20 Thread Manuel Arostegui
Hello,

The following primary database masters will be switched over during the
next few weeks (more details at https://phabricator.wikimedia.org/T230788):

Impact:
*Writes will be blocked*
*Reads will remain unaffected*

These are the concrete days, hours and affected wikis:

* s8: 10th Sept from 05:00-05:30 UTC. The affected wiki is: wikidatawiki -
tracking task: T230762

* s2: 17th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s2.dblist
 - tracking task: T230785

* s3: 24th Sept from 05:00-05:30 UTC. The list of affected wikis is at:
https://raw.githubusercontent.com/wikimedia/operations-mediawiki-config/master/dblists/s3.dblist
- tracking task: T230783

* s4: 26th Sept from 05:00-05:30 UTC. The affected wiki is: commonswiki -
tracking task: T230784

If everything goes well, we do not expect to use those 30 minutes of
read-only and rather just a few minutes.

We will email send an email the day of each failover before and after it is
done.

Sorry for any inconvenience this might cause.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Wikidata db primary master switchover (read-only required) 30th July 05:00 AM UTC

2019-07-29 Thread Manuel Arostegui
Hello,

The failover was done successfully.
read-only start: 05:00:50
read-only stop: 05:02:21

Total read-only time: 01:31 minutes

Manuel.

On Tue, Jul 30, 2019 at 6:30 AM Manuel Arostegui 
wrote:

> Hello,
>
> This will start in 30 minutes.
>
> Manuel.
>
> On Wed, Jul 10, 2019 at 9:05 AM Manuel Arostegui 
> wrote:
>
>> Hello,
>> We have requested a 30 minutes read-only window for s8 (wikidata) for the
>> 30th July from 05:00-05:30 UTC to switchover our primary wikidata database
>> master (T227063)
>>
>> db1071 is an old host and out of warranty that will be decommissioned
>> (T217396).
>> This will also unblock some migration stages of the new redesign for the
>> wb_terms table (T221764)
>>
>> We are going to do this on Tuesday 30th July from 05:00 to 05:30 AM UTC
>> (we do not expect to use the 30 minutes window, if everything goes as
>> expected).
>>
>> Impact: Writes will be blocked, reads will remain unaffected.
>>
>> Communication will happen at #wikimedia-operations
>> If you are around at that time and want to help with the monitoring,
>> please join us!
>>
>> Thanks
>>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Wikidata db primary master switchover (read-only required) 30th July 05:00 AM UTC

2019-07-29 Thread Manuel Arostegui
Hello,

This will start in 30 minutes.

Manuel.

On Wed, Jul 10, 2019 at 9:05 AM Manuel Arostegui 
wrote:

> Hello,
> We have requested a 30 minutes read-only window for s8 (wikidata) for the
> 30th July from 05:00-05:30 UTC to switchover our primary wikidata database
> master (T227063)
>
> db1071 is an old host and out of warranty that will be decommissioned
> (T217396).
> This will also unblock some migration stages of the new redesign for the
> wb_terms table (T221764)
>
> We are going to do this on Tuesday 30th July from 05:00 to 05:30 AM UTC
> (we do not expect to use the 30 minutes window, if everything goes as
> expected).
>
> Impact: Writes will be blocked, reads will remain unaffected.
>
> Communication will happen at #wikimedia-operations
> If you are around at that time and want to help with the monitoring,
> please join us!
>
> Thanks
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata] Wikidata db primary master switchover (read-only required) 30th July 05:00 AM UTC

2019-07-10 Thread Manuel Arostegui
Hello,
We have requested a 30 minutes read-only window for s8 (wikidata) for the
30th July from 05:00-05:30 UTC to switchover our primary wikidata database
master (T227063)

db1071 is an old host and out of warranty that will be decommissioned
(T217396).
This will also unblock some migration stages of the new redesign for the
wb_terms table (T221764)

We are going to do this on Tuesday 30th July from 05:00 to 05:30 AM UTC (we
do not expect to use the 30 minutes window, if everything goes as expected).

Impact: Writes will be blocked, reads will remain unaffected.

Communication will happen at #wikimedia-operations
If you are around at that time and want to help with the monitoring, please
join us!

Thanks
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] [Cloud] [Wikidata-tech] wb_terms redesign

2019-04-25 Thread Manuel Arostegui
On Thu, Apr 25, 2019 at 6:03 PM Federico Leva (Nemo) 
wrote:

> Alaa Sarhan, 25/04/19 17:38:
> > Full migration is not possible unfortunately due to the current capacity
> > of database master node.
>
> Can you clarify whether it would also be too much load to write both to
> the new table and the old wb_terms table for a transition period
> (controlled by a configuration setting)?
>
>
>
The problem isn't that much because of load but because of disk space
constraints on the master. Right now we do not have enough space to handle
the duplication of data that it will be needed until wb_terms can be killed
and that space will be reclaimed back.
The migration is on hold mostly because of that.
We do have the hardware already at the DC (T211613), we are racking,
installing and setting it up, once done we will work on a master failover
to promote a new host to master (which will have more disk space, more RAM,
and faster disks).

Manuel.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] whitepaper on the Belgian museums' Wikidata project

2015-11-14 Thread Manuel Palomo Duarte
Nice work, I'll reference it in my lectures.

Thank you!

2015-11-14 8:40 GMT+01:00 Gerard Meijssen :

> Hoi,
> A wonderful piece of work. It was a joy to read. Well presented and
> complete :)
> Thank you!
> GerardM
>
> On 13 November 2015 at 19:45, Sandra Fauconnier <
> sandra.fauconn...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> Romaine just mentioned the project of Flemish museums donating metadata
>> to Wikidata
>> <https://www.wikidata.org/wiki/Wikidata:Flemish_art_collections,_Wikidata_and_Linked_Open_Data>
>> .
>>
>> A first outcome of this project is a whitepaper
>> <https://www.wikidata.org/wiki/Wikidata:Flemish_art_collections,_Wikidata_and_Linked_Open_Data/Whitepaper>.
>> In the first place, it is intended for the project partners, to introduce
>> Wikidata, to explain what the project is about, what the costs and benefits
>> are for them, and how the upload will work (i.e. generally - later in the
>> project we will also produce a more detailed handbook).
>> However, we think the whitepaper might be interesting to a much broader
>> audience as well - especially other (cultural) organisations who also
>> consider donating data to Wikidata.
>>
>> I just finished translating it from Dutch to English and transferring it
>> to Wikidata. If anyone wants to read it, comment, add corrections… I’d be
>> very grateful! All feedback is welcome.
>> Also, feel free to share it if relevant.
>>
>> https://www.wikidata.org/wiki/Wikidata:Flemish_art_collections,_Wikidata_and_Linked_Open_Data/Whitepaper
>>
>> Greetings, Sandra (User:Spinster)
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>


-- 
Prof. Manuel Palomo Duarte, PhD
Software Process Improvement and Formal Methods group (SPI&FM).
Department of Computer Science
Escuela Superior de Ingeniería, room 136
Avenida de la Universidad de Cádiz nº 10
11519 - Puerto Real (Spain)
University of Cadiz
Tlf: (+34) 956 483436
Mobile phone: (+34) 649 280080
Mobile phone from University network: 15483
Fax: (+34) 956 015139
http://neptuno.uca.es/~mpalomo

Aviso legal: Este mensaje (incluyendo los ficheros adjuntos) puede contener
información confidencial, dirigida a un destinatario y objetivo específico.
Si usted no es el destinatario del mismo le pido disculpas, y le pido que
elimine este correo, evitando cualquier divulgación, copia o distribución
de su contenido, así como desarrollar o ejecutar cualquier acción basada en
el mismo.
--
Legal Notice: This message (including the attached files) contains
confidential information, directed to a specific addressee and objective.
In case you are not the addressee of the same, I apologize. And I ask you
to delete this mail, and not to resend, copy or distribute its content, as
well as develop or execute any action based on the same.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata