[Cloud] [Cloud-announce] New views on Wiki Replicas to help with slow actor and comment queries

2019-06-10 Thread Brooke Storm
The actor and comment views on the wiki replicas are slowed by a need to make subqueries against 8 other tables in order to determine which rows should and should not be visible on the replica service. With recent changes to the replica view schema, this problem has become much more visible. The

Re: [Cloud] Toolforge SQL performance issue with new comment table

2019-06-10 Thread Bryan Davis
On Mon, Jun 3, 2019 at 4:30 AM Bryan Davis wrote: > > One "fix" I could imagine for this would be for the Wiki Replicas to > also provide per-entity views of the comment table that only return > rows related to a single entity table. For example a > "comment_ipblocks" view could use a where clause

Re: [Cloud] excessive lagging

2019-06-10 Thread Bryan Davis
On Mon, Jun 10, 2019 at 4:20 PM Yetkin Sakal via Cloud wrote: > > Hello, > > What can be done to decrease the lagging on web.db.svc.eqiad.wmflabs? Tools > working on this are severely affected ands up with outdated results. We did a bit of live investigation with the help of the DBA team on a re

Re: [Cloud] excessive lagging

2019-06-10 Thread Manuel Arostegui
We also have one host down for maintenance https://phabricator.wikimedia.org/T222978 which puts more load on the other two. El lun., 10 jun. 2019 16:35, Yetkin Sakal escribió: > All shards are affected. Please view the heartbeat report at > https://tools.wmflabs.org/replag/ > > Thanks. > On Mond

Re: [Cloud] excessive lagging

2019-06-10 Thread Yetkin Sakal via Cloud
All shards are affected. Please view the heartbeat report at https://tools.wmflabs.org/replag/ Thanks. On Monday, June 10, 2019, 6:27:44 PM GMT+3, Manuel Arostegui wrote: Hello, We currently have some issues going on.One of the hosts had issues with s4 (commonswiki) https://phabricator.

Re: [Cloud] excessive lagging

2019-06-10 Thread Manuel Arostegui
Hello, We currently have some issues going on. One of the hosts had issues with s4 (commonswiki) https://phabricator.wikimedia.org/T225390 And then S3 replica's master (which holds like 900 wikis) had hardware issues we are still trying to figure out https://phabricator.wikimedia.org/T225391 so t

Re: [Cloud] excessive lagging

2019-06-10 Thread John
Can you provide more information? Most of the time lag is minimal. enwiki is at 7 seconds, dewiki is at 0. On Mon, Jun 10, 2019 at 11:20 AM Yetkin Sakal via Cloud < cloud@lists.wikimedia.org> wrote: > Hello, > > What can be done to decrease the lagging on web.db.svc.eqiad.wmflabs? > Tools working

[Cloud] excessive lagging

2019-06-10 Thread Yetkin Sakal via Cloud
Hello, What can be done to decrease the lagging on web.db.svc.eqiad.wmflabs? Tools working on this are severely affected ands up with outdated results. Regards. ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wi