Marostegui added a subscriber: ayounsi.
Marostegui added a comment.
If we are going to leave eqiad fully depooled for a week...can we do the
switches operation during that time or leave eqiad depooled for longer and fit
them there? @ayounsi thoughts?
TASK DETAIL
https
Marostegui added a comment.
From the DB point of view, we don't really need this anymore.
TASK DETAIL
https://phabricator.wikimedia.org/T290989
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Clement_Goubert, RLazarus
Marostegui closed this task as "Resolved".
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bo
Marostegui added a comment.
This is done
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui added a parent task: Restricted Task.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T327861
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Aklapper, Maintenance_bot, Adamm71, Jersione, Hellket777,
LisafBia6531
Marostegui added projects: User-notice, Cognate, Growth-Team, Language-Team,
MediaWiki-extensions-UrlShortener, StructuredDiscussions,
MediaWiki-extensions-BounceHandler, ContentTranslation, Reading List Service,
WikimediaEditorTasks, Wikidata, wdwb-tech.
Restricted Application added a project
Marostegui added a comment.
I think even if they grow a lot, with the new set of servers, we still have
6.6TB free (76% free disk space)...I'd be surprised if we grow that much in 3
years.
TASK DETAIL
https://phabricator.wikimedia.org/T226093
EMAIL PREFERENCES
https
Marostegui closed this task as "Resolved".
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione,
Marostegui added a comment.
All done
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531, Wangombe,
Astuthiodit_1, 786
Marostegui added a comment.
db1120 rebooted with the latest kernel
TASK DETAIL
https://phabricator.wikimedia.org/T316745
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Maintenance_bot, Aklapper, Jersione, Hellket777, LisafBia6531
Marostegui added projects: User-notice-archive, Cognate, Growth-Team,
Language-Team, MediaWiki-extensions-UrlShortener, StructuredDiscussions,
MediaWiki-extensions-BounceHandler, ContentTranslation, Reading List Service,
WikimediaEditorTasks, Product-Infrastructure-Team-Backlog, Wikidata, wdwb
Marostegui added a comment.
In T313398#8095909 <https://phabricator.wikimedia.org/T313398#8095909>,
@Quiddity wrote:
> From an editor perspective, would this task have resulted in any //lost//
actions (e.g. If I saved an edit with an Echo `@ping` during that ti
Marostegui closed this task as "Resolved".
Marostegui added a comment.
This was done
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper,
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper, Marostegui, Hellket777, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper, Marostegui, Hellket777, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper, Marostegui, Hellket777, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper, Marostegui, Hellket777, Wangombe,
Astuthiodit_1, 786
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper, Marostegui, Wangombe, Astuthiodit_1,
karapayneWMDE
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Trizek-WMF, RhinosF1, Aklapper, Marostegui, Wangombe, Astuthiodit_1,
karapayneWMDE
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313398
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: RhinosF1, Aklapper, Marostegui, Wangombe, Astuthiodit_1, karapayneWMDE,
Invadibot
Marostegui added projects: Cognate, Growth-Team, Language-Team,
MediaWiki-extensions-UrlShortener, StructuredDiscussions,
MediaWiki-extensions-BounceHandler, ContentTranslation, Reading List Service,
WikimediaEditorTasks, Product-Infrastructure-Team-Backlog, Wikidata, wdwb-tech.
Marostegui
Marostegui closed this task as "Resolved".
Marostegui added a comment.
This was all done
RO start: 06:04:57
RO stop: 06:06:02
Total RO time: 83 seconds
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/sett
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T300472
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Legoktm, Addshore, Ladsgroup, Dbrant, JoeWalsh, Tgr, Trizek-WMF, Kormat,
LSobanski, AMP616
Marostegui added a comment.
In T300472#8019812 <https://phabricator.wikimedia.org/T300472#8019812>,
@Trizek-WMF wrote:
> In T300472#8018815 <https://phabricator.wikimedia.org/T300472#8018815>,
@Marostegui wrote:
>
>> This will be done Thursday 30th at 06:00 A
Marostegui closed this task as "Resolved".
Marostegui claimed this task.
Marostegui added a comment.
I am going to consider this fixed as it never happened again.
TASK DETAIL
https://phabricator.wikimedia.org/T284981
EMAIL PREFERENCES
https://phabricator.wikimedia.org/sett
Marostegui edited projects, added DBA; removed SRE.
TASK DETAIL
https://phabricator.wikimedia.org/T284981
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: BBlack, ArielGlenn, Ladsgroup, Addshore, Aklapper, Marostegui,
Astuthiodit_1
Marostegui added a comment.
Next time I will try a different approach to capture them, which I think it
will give us the exact queries
TASK DETAIL
https://phabricator.wikimedia.org/T138208
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences
Marostegui added a comment.
I tried but I wasn't able to capture any :(
TASK DETAIL
https://phabricator.wikimedia.org/T138208
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: LSobanski, Ladsgroup, Marostegui, Addshore
Marostegui added a comment.
So I am still seeing a wikiadmin connection from snapshot1011.eqiad.wmnet. to
a s8 API host (db1172)
TASK DETAIL
https://phabricator.wikimedia.org/T138208
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc
Marostegui added a comment.
In T138208#7571559 <https://phabricator.wikimedia.org/T138208#7571559>,
@gerritbot wrote:
> Change 747455 had a related patch set uploaded (by ArielGlenn; author:
ArielGlenn):
>
> [mediawiki/core@master] try to use 'dump' group for
Marostegui added a comment.
I just ran that query manually and it took 71 seconds. (this can change
depending on the server load too).
Keep in mind that we have a query killer that kills queries after 60 seconds,
so even without the work around done at T297708
<ht
Marostegui removed a project: SRE.
TASK DETAIL
https://phabricator.wikimedia.org/T296384
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Lydia_Pintscher, hoo, Michael, Marostegui,
Lucas_Werkmeister_WMDE, Invadibot
Marostegui removed a project: SRE.
TASK DETAIL
https://phabricator.wikimedia.org/T296382
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Lydia_Pintscher, hoo, Michael, Marostegui,
Lucas_Werkmeister_WMDE, Invadibot
Marostegui removed a project: SRE.
TASK DETAIL
https://phabricator.wikimedia.org/T296383
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Lydia_Pintscher, hoo, Michael, Marostegui, alaa,
Lucas_Werkmeister_WMDE
Marostegui added a comment.
Thanks for looking into this issue :-)
TASK DETAIL
https://phabricator.wikimedia.org/T138208
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: LSobanski, Ladsgroup, Marostegui, Addshore, Lydia_Pintscher
Marostegui added a comment.
Following my chat with @ArielGlenn on IRC, I got this query coming from
snapshot1011
2690453130wikiadmin10.64.0.156:38912wikidatawikiQuery0
StatisticsSELECT /* MediaWiki\\Storage\\SqlBlobStore::fetchBlobs
dumpsgen@snapsh
Marostegui added a comment.
Now that I look into it, the `wikiadmin` user is connected to all the pooled
hosts, regardless of their config group. Connections are from snapshost1008 and
snapshost1011
This would make impossible to run an automated schema change on any of those
wikidata
Marostegui added a subscriber: Ladsgroup.
Marostegui added a comment.
This keeps handling and it is painful if we want to run automated schema
changes (T288235 <https://phabricator.wikimedia.org/T288235>). I have tried to
deploy a change on s8 without manual intervention but it got
Marostegui edited projects, added Data-Persistence (Consultation); removed DBA.
TASK DETAIL
https://phabricator.wikimedia.org/T188730
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, RP88, Michael, Lucas_Werkmeister_WMDE
Marostegui edited projects, added Data-Persistence (Consultation); removed DBA.
TASK DETAIL
https://phabricator.wikimedia.org/T296382
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Lydia_Pintscher, hoo, Michael
Marostegui edited projects, added Data-Persistence (Consultation); removed DBA.
TASK DETAIL
https://phabricator.wikimedia.org/T296383
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Lydia_Pintscher, hoo, Michael
Marostegui edited projects, added Data-Persistence (Consultation); removed DBA.
TASK DETAIL
https://phabricator.wikimedia.org/T296384
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Lydia_Pintscher, hoo, Michael
Marostegui added a comment.
Nowadays with ROW based replication on clouddb* hosts it is very unlikely
that we have unknown data drifts (of course this can still happen!) on big and
very accessed tables. If we had any, replication would break because of data
mismatch.
TASK DETAIL
https
Marostegui added a comment.
I will talk to @Ladsgroup about this, as I am missing lots of context here
and the implications this could have.
TASK DETAIL
https://phabricator.wikimedia.org/T188730
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences
Marostegui closed this task as "Resolved".
Marostegui added a comment.
We have no 10.1 replicas serving traffic, only masters which are not supposed
to receive these queries so I am going to close this as resolved.
TASK DETAIL
https://phabricator.wikimedia.org/T254688
EMAIL P
Marostegui added a comment.
We normally don't track the restarts, but db1171 was restarted 21 days ago,
db1104 is way older (around 80 days) and db1126 two days ago, so that's the one
we can double check whether the query arrives or not in a few weeks.
db1116 is a backup host so we
Marostegui added a comment.
In T292548#7450949 <https://phabricator.wikimedia.org/T292548#7450949>,
@Lucas_Werkmeister_WMDE wrote:
> Hm, but if I understand the comment at T291086#7364424
<https://phabricator.wikimedia.org/T291086#7364424> correctly, the index was
Marostegui added parent tasks: T290868: Upgrade s8 to Buster + MariaDB 10.4,
T290865: Upgrade s1 to Buster + MariaDB 10.4.
TASK DETAIL
https://phabricator.wikimedia.org/T254688
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: RhinosF1
Marostegui added a comment.
I am restarting quite a bunch of s8 (wikidata) hosts as I am upgrading them.
Restarted db1101:3318, db1178 today so we can check by the end of the week if
you want. (please ping me to do so)
TASK DETAIL
https://phabricator.wikimedia.org/T292548
EMAIL
Marostegui added a comment.
It gets cleaned up after each restart.
TASK DETAIL
https://phabricator.wikimedia.org/T292548
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, Lucas_Werkmeister_WMDE, Aklapper, Michael
Marostegui added a comment.
In order to close this, we just need to finish these two tasks: T290868
<https://phabricator.wikimedia.org/T290868> T290865
<https://phabricator.wikimedia.org/T290865>
TASK DETAIL
https://phabricator.wikimedia.org/T254688
EMAIL PREFERE
Marostegui triaged this task as "High" priority.
Marostegui added subscribers: ema, BBlack, EBernhardson, RKemper.
TASK DETAIL
https://phabricator.wikimedia.org/T291542
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
C
Marostegui triaged this task as "Medium" priority.
Marostegui moved this task from Triage to Blocked on the DBA board.
Marostegui added a comment.
Just to mention that this is a nice-to-have indeed but not something that
brought us down or anything close to that - it just required
Marostegui added a comment.
All the hosts have been recovered.
TASK DETAIL
https://phabricator.wikimedia.org/T284981
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Addshore, Aklapper, Marostegui, joanna_borun, the0001
Marostegui added a comment.
My guess is that as the schema change isn't made on the same transaction, the
query arrives in between the drop+create and gets stuck with that huge full
scan.
I have depooled the hosts that are giving too many connections (as they
others have the schema change
Marostegui created this task.
Marostegui added projects: Wikidata, Pybal, Traffic.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: wdwb-tech.
TASK DESCRIPTION
While deploying a schema change (T284375
<https://phabricator.wikimedia.org/T284
Marostegui removed a project: SRE.
Marostegui added a comment.
Is this still happening?
TASK DETAIL
https://phabricator.wikimedia.org/T140879
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Marostegui, WMDE-Fisch, Epidosis
Marostegui reopened subtask T276246: Create Wikipedia Kari Seediq as
Open.
TASK DETAIL
https://phabricator.wikimedia.org/T276251
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Ladsgroup, Marostegui
Cc: Aklapper, Maintenance_bot, Invadibot
Marostegui added a comment.
In T274091#6809810 <https://phabricator.wikimedia.org/T274091#6809810>,
@Lucas_Werkmeister_WMDE wrote:
> As a quick fix, we could probably change the query to use `CAST(chd_seen AS
SIGNED)`; apparently that casts to a signed //64-bit// integ
Marostegui added a comment.
Not sure if entirely related to the scope of this task but, please see:
T138208#6809748 <https://phabricator.wikimedia.org/T138208#6809748>
TASK DETAIL
https://phabricator.wikimedia.org/T147169
EMAIL PREFERENCES
https://phabricator.wikimedia.org/se
Marostegui added a comment.
I depooled today db (https://phabricator.wikimedia.org/P14229) which is
not on the vslow,dump group and I still see two things:
- The host is being accessed by `wikiadmin` from `snapshot1006`:
- The host keeps being accessed even though it's been
Marostegui created this task.
Marostegui added projects: Wikidata, Technical-Debt, wdwb-tech-focus (backlog),
Wikidata-Campsite (Wikidata-Campsite-Iteration-∞).
TASK DESCRIPTION
Probably related to the schema change requested at T273874: Make
wb_changes_dispatch.chd_seen unsigned
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Addshore, Lucas_Werkmeister_WMDE, Devnull, LSobanski,
Akuckartz
Marostegui added a comment.
`testcommonswiki` and `commonswiki`
# ./section s4 | while read host port; do echo "$host:$port" ; mysql.py
-h$host:$port testcommonswiki -e "show create table wb_changes_dispatch\G" |
grep -i chd_seen | grep -v KEY;done
labsdb1
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Addshore, Lucas_Werkmeister_WMDE, Devnull, LSobanski,
Akuckartz
Marostegui closed this task as "Resolved".
Marostegui added a comment.
All done
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper
Marostegui closed subtask T273874: Make wb_changes_dispatch.chd_seen unsigned
in production as Resolved.
TASK DETAIL
https://phabricator.wikimedia.org/T263644
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Lucas_Werkmeister_WMDE, Marostegui
Cc
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Addshore, Lucas_Werkmeister_WMDE, Devnull, LSobanski,
Akuckartz
Marostegui added a comment.
`wikidatawiki`
# ./section s8 | while read host port; do echo "$host:$port" ; mysql.py
-h$host:$port wikidatawiki -e "show create table wb_changes_dispatch\G" | grep
-i chd_seen | grep -v KEY;done
labsdb1012.eqiad.wmnet:3306
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Addshore, Lucas_Werkmeister_WMDE, Devnull, LSobanski,
Akuckartz
Marostegui added a comment.
I have altered `testwikidatawiki` (the connection errors are hosts that are
down for maintenance and will get the schema change once mysql is started again)
# ./section s3 | while read host port; do echo "$host:$port" ; mysql.py
-h$
Marostegui updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Addshore, Lucas_Werkmeister_WMDE, Devnull, LSobanski,
Akuckartz
Marostegui added a comment.
Wikis:
#cat dblists/wikibaserepo.dblist | grep -v "#"
commonswiki
testcommonswiki
testwikidatawiki
wikidatawiki
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/sett
Marostegui claimed this task.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Marostegui
Cc: Ladsgroup, Aklapper, Addshore, Lucas_Werkmeister_WMDE, Devnull, LSobanski,
Akuckartz, Iflorez
Marostegui triaged this task as "Medium" priority.
Marostegui moved this task from Triage to Ready on the DBA board.
TASK DETAIL
https://phabricator.wikimedia.org/T273874
WORKBOARD
https://phabricator.wikimedia.org/project/board/1060/
EMAIL PREFERENCES
https://phabricator.wik
Marostegui added a comment.
The only common query I have found that executes on all hosts is:
SELECT /*
Wikibase\Lib\Store\Sql\Terms\DatabaseTermInLangIdsResolver::selectTermsViaJoin
141.136.76.164 */ wbtl_id, wbtl_type_id, wbxl_language, wbx_text,
wbpt_property_id FROM
Marostegui added a comment.
I forgot to paste:
root@mwmaint2001:~# crontab -l -uwww-data | grep -w wikidatawiki
*/3 * * * * echo "$$: Starting dispatcher" >>
/var/log/wikidata/dispatchChanges-wikidatawiki.log; /usr/local/bin/mwscript
extensions/Wikibase/
Marostegui added a comment.
Sorry @Ladsgroup - totally missed this!
So far I haven't seen any other query or cronjob that would consistently make
us going and kill it.
Thank you!
TASK DETAIL
https://phabricator.wikimedia.org/T245818
EMAIL PREFERENCES
https
Marostegui added a project: Wikidata.
Marostegui added subscribers: Ladsgroup, Addshore.
Marostegui moved this task from Triage to In progress on the DBA board.
Marostegui added a comment.
Adding @Addshore and @Ladsgroup as they have lots of cool dashboards (that I
am unable to find) where
1 - 100 of 712 matches
Mail list logo