Re: [Toolserver-l] enwiki_p corruption

[Hazard-SJ]

Yes, I checked and the correct value was returned:

mysql> select count(*) from imagelinks where il_to = 'Flag_of_Seattle.svg';
+--+
| count(*) |
+--+
|    2 |
+--+
1 row in set (0.01 sec)


 
Hazard-SJ




 From: DaB. 
To: Wikimedia Toolserver  
Sent: Monday, April 29, 2013 2:42 PM
Subject: Re: [Toolserver-l] enwiki_p corruption
 

Hello,
At Monday 29 April 2013 21:32:43 DaB. wrote:
> enwiki_p needs dumped and re-imported.

yes and no. We have 2 servers for enwiki and only 1 of it is re-setuped yet 
(this one returns the correct value – I checked). There are 3 problems: 
* 1 server can not carry the load so during the downtime our enwp-replag would 
increase.
* The replag of wikidata and commons on the "good" server is very high and 
does not really decrease at the moment
* The discs of the "good" server are (most likely) too small to store enwp, 
commons, wikidata and the user-databases – so no user-databases would be 
available during the re-setup.

Another problem was that I had less time in the last weeks than before because 
my university started again. We will find a solution for all problems but it 
will take a while. So if you need accurate data for enwp, please query sql-s1-
rr (you should always do this BTW).

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corruption

[DaB.]

Hello,
At Monday 29 April 2013 21:32:43 DaB. wrote:
> enwiki_p needs dumped and re-imported.

yes and no. We have 2 servers for enwiki and only 1 of it is re-setuped yet 
(this one returns the correct value – I checked). There are 3 problems: 
* 1 server can not carry the load so during the downtime our enwp-replag would 
increase.
* The replag of wikidata and commons on the "good" server is very high and 
does not really decrease at the moment
* The discs of the "good" server are (most likely) too small to store enwp, 
commons, wikidata and the user-databases – so no user-databases would be 
available during the re-setup.
 
Another problem was that I had less time in the last weeks than before because 
my university started again. We will find a solution for all problems but it 
will take a while. So if you need accurate data for enwp, please query sql-s1-
rr (you should always do this BTW).

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p

[Russell Blau]

On Sat, Mar 23, 2013, at 01:31 PM, DaB. wrote:
> 
> While we speak of enwiki: The import of commons on the new server is
> done. By 
> Sunday or Monday evening we should have a complete and up2date sql-s1-rr 
> again.

Is there any update on this?  AFAICT, sql-s1-rr is still pointing to
rosemary (same as sql-s1-user).

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p

[DaB.]

Hello,
At Saturday 23 March 2013 18:24:48 DaB. wrote:
> I was just doing some investigating and discovered that we still have
> the cur table (it was removed in mediawiki v1.5) and that the jobs
> table isnt visible.

the cur-table was never removed it was just replaced. While it may not updated 
anymore it could still be that for some very old "revision" it is still read. 
The dropping of tables is BTW the job of the WMF-techs and while they not drop 
it I see no harm in having a view.
The job-table is not replicated for performance-reasons.

While we speak of enwiki: The import of commons on the new server is done. By 
Sunday or Monday evening we should have a complete and up2date sql-s1-rr 
again.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p

[DaB.]

Hello,
At Friday 22 February 2013 22:24:13 DaB. wrote:
> There have been multiple reports of corruption and at least 4 open
> tickets in JIRA about issues with enwiki's database issues going back
> about a year.

s1 is the next cluster for a re-import.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

[MZMcBride]

DaB. wrote:
> At Thursday 08 March 2012 19:40:16 DaB. wrote:
>> To me, this indicates that either the master has some very serious problem
>> (unlikely) or that the Toolserver's copy of the database has become corrupt
>> (much more likely). Can anyone verify my findings?
> 
> the enwiki-copy on thyme is corrupt, like status.toolserver.org tells since a
> few days. If the copy of rosemary is corrupt too is unknown at the moment. I
> will request a fresh dump at the wmf, but this can take some time.

Thanks. I forgot to check there. :-)

MZMcBride



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

[DaB.]

Hello,
At Thursday 08 March 2012 19:40:16 DaB. wrote:
> To me, this indicates that either the master has some very serious problem
> (unlikely) or that the Toolserver's copy of the database has become corrupt
> (much more likely). Can anyone verify my findings?

the enwiki-copy on thyme is corrupt, like status.toolserver.org tells since a 
few days. If the copy of rosemary is corrupt too is unknown at the moment. I 
will request a fresh dump at the wmf, but this can take some time.

Sincerly,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

[Aaron Halfaker]

The missing image for Hubble_Space_Telescope_picture_of_Betelgeuse.jpg
exists on commons and is pulled into enwiki.

I was able to find the Hexen page:
grphack@willow:~$ mysql -h enwiki-p.rrdb.toolserver.org enwiki_p -e "SELECT
* FROM page WHERE page_namespace = 0 and page_title =
'Hexen:_Beyond_Heretic'"
+-++---+---+--+--+-+---++-+--+
| page_id | page_namespace | page_title| page_restrictions |
page_counter | page_is_redirect | page_is_new | page_random   |
page_touched   | page_latest | page_len |
+-++---+---+--+--+-+---++-+--+
|   13612 |  0 | Hexen:_Beyond_Heretic |   |
   120 |0 |   0 | 0.821679617112204 |
20120308123616 |   480826930 |12016 |
+-++---+---+--+--+-+---++-+--+

-Aaron

On Thu, Mar 8, 2012 at 12:15 AM, MZMcBride  wrote:

> MZMcBride wrote:
> > Can someone verify the integrity of the page table for me, please?
> >
> > ---
> > mzmcbride@willow:~$ sql enwiki_p;
> >
> > mysql> select * from page where page_namespace = 6 and page_title =
> > 'Hubble_Space_Telescope_picture_of_Betelgeuse.jpg';
> > Empty set (0.00 sec)
> >
> > mysql> select * from page where page_namespace = 0 and page_title =
> > 'Hexen:_Beyond_Heretic';
> > Empty set (0.00 sec)
> > ---
> >
> > Compare:
> >
> > * http://enwp.org/File:Hubble_Space_Tele 
> > scope_picture_of_Betelgeuse.jpg
> > * https://en.wikipedia.org/wiki/Hexen:_Beyond_Heretic
> >
> > To me, this indicates that either the master has some very serious
> problem
> > (unlikely) or that the Toolserver's copy of the database has become
> corrupt
> > (much more likely). Can anyone verify my findings?
>
> Re: the missing image ("Hubble Space ..."), I filed
> .
>
> The "Hexen" case needs further investigation.
>
> MZMcBride
>
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

[MZMcBride]

MZMcBride wrote:
> Can someone verify the integrity of the page table for me, please?
> 
> ---
> mzmcbride@willow:~$ sql enwiki_p;
> 
> mysql> select * from page where page_namespace = 6 and page_title =
> 'Hubble_Space_Telescope_picture_of_Betelgeuse.jpg';
> Empty set (0.00 sec)
> 
> mysql> select * from page where page_namespace = 0 and page_title =
> 'Hexen:_Beyond_Heretic';
> Empty set (0.00 sec)
> ---
> 
> Compare:
> 
> * http://enwp.org/File:Hubble_Space_Telescope_picture_of_Betelgeuse.jpg
> * https://en.wikipedia.org/wiki/Hexen:_Beyond_Heretic
> 
> To me, this indicates that either the master has some very serious problem
> (unlikely) or that the Toolserver's copy of the database has become corrupt
> (much more likely). Can anyone verify my findings?

Re: the missing image ("Hubble Space ..."), I filed
.

The "Hexen" case needs further investigation.

MZMcBride



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette