[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-06-10 Thread daniel 
daniel added a comment.
In T136598#2369366, @hoo wrote:
The fix for this triggered T116404: EntityUsageTable::getUsedEntityIdStrings query on wbc_entity_usage table is sometimes fast, sometimes slow, not sure how to continue from here. We could potentially work around that, but all ideas I have have strong disadvantages.


I suggest to try T137539: Use inidividual select queries to determin which Entities are in the wbc_entity_usage tableTASK DETAILhttps://phabricator.wikimedia.org/T136598EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, danielCc: Stashbot, ArielGlenn, daniel, gerritbot, JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Lewizho99, Minhnv-2809, Volans, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-06-10 Thread daniel 
daniel added a blocking task: T137539: Use inidividual select queries to determin which Entities are in the wbc_entity_usage table.TASK DETAILhttps://phabricator.wikimedia.org/T136598EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, danielCc: Stashbot, ArielGlenn, daniel, gerritbot, JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Lewizho99, Minhnv-2809, Volans, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-06-09 Thread hoo 
hoo added a blocking task: T116404: EntityUsageTable::getUsedEntityIdStrings query on wbc_entity_usage table is sometimes fast, sometimes slow.TASK DETAILhttps://phabricator.wikimedia.org/T136598EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: ArielGlenn, daniel, gerritbot, JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Lewizho99, Minhnv-2809, Volans, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-06-09 Thread hoo 
hoo added a comment.The fix for this triggered T116404: EntityUsageTable::getUsedEntityIdStrings query on wbc_entity_usage table is sometimes fast, sometimes slow, not sure how to continue from here. We could potentially work around that, but all ideas I have have strong disadvantages.TASK DETAILhttps://phabricator.wikimedia.org/T136598EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: ArielGlenn, daniel, gerritbot, JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Lewizho99, Minhnv-2809, Volans, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-06-09 Thread gerritbot 
gerritbot added a project: Patch-For-Review.TASK DETAILhttps://phabricator.wikimedia.org/T136598EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: ArielGlenn, daniel, gerritbot, JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Lewizho99, Minhnv-2809, Volans, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-06-01 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T136598

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Lewizho99, 
Minhnv-2809, Volans, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, 
Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-05-31 Thread JanZerebecki 
JanZerebecki added a comment.


  At about 2016-05-30 1400 addUsagesForPage job pop failed starts to show about 
50/min and ok starts to have higher fluctuation than before.
  The database that is being connected to is wikidatawiki, most of the 
connection attempts are from the job running for client wikis 
https://phabricator.wikimedia.org/T136598#2340744.
  
  Maybe unrelated: Server admin log:
  2016-05-30
  15:10 logmsgbot: dcausse@tin Synchronized wmf-config: Send wmf.4 search and 
ttmserver traffic to codfw (duration: 00m 33s)
  12:59 gehel: disabling warmers elasticsearch codfw cluster 
(https://phabricator.wikimedia.org/T133125)
  12:35 gehel: re-enabling puppet on elasticsearch codfw cluster 
(https://phabricator.wikimedia.org/T133125)

TASK DETAIL
  https://phabricator.wikimedia.org/T136598

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Minhnv-2809, Volans, 
D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T136598: Wikidata master database connection issue

2016-05-31 Thread hoo 
hoo added a comment.


  In https://phabricator.wikimedia.org/T136598#2340507, @jcrespo wrote:
  
  > There are a couple of long-running tasks on the master, from snapshot1003- 
that is strange, but not sure it is an issue.
  
  
  That's https://phabricator.wikimedia.org/T108929. We should only see 4 
concurrent master connections from the snapshot host, thus this is probably not 
relevant (and will also be fixed soon).
  
  For the actual problem here: I can't see any obvious change in either editing 
patterns (or count) on any project, also not in entity usages (which that job 
adds). There seems to be a coincidental change in job rates: 
https://grafana.wikimedia.org/dashboard/db/job-queue-rate?panelId=6=1464603245227=1464689645228=all
 but I'm not sure what that tells us.
  
  Can you tell which shards were (primarily) affected? s4 (commons)? I kind of 
suspect multilingual pages/ page views on commons to be responsible, but then 
again, I don't know.

TASK DETAIL
  https://phabricator.wikimedia.org/T136598

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo
Cc: JanZerebecki, hoo, aude, Aklapper, jcrespo, Zppix, Minhnv-2809, Volans, 
D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs