Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-11-29 Thread Amir Sarabadani
Hey, The last update on this thread. The day has finally come, there is no part of mediawiki that points out to ct_tag column. This column will be dropped in the next couple of weeks. It had only empty value for a several weeks already. Best On Thu, 11 Oct 2018 at 13:47, Amir Sarabadani wrote:

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-10-11 Thread Amir Sarabadani
Hello, One other update regarding this: We just set reading to use the new change tag backend (and stop writing to ct_tag column) in mediawiki.org, test wikis and several other small wikis. This means if you are depending on ct_tag column, your tool/service will be broken soon. Also, since this

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-07-31 Thread Jon Robson
 On Tue, Jul 31, 2018, 3:42 AM Derk-Jan Hartman wrote: > That is an impressive difference ! > > On Mon, Jul 30, 2018 at 6:22 PM Amir Sarabadani < > amir.sarabad...@wikimedia.de> wrote: > > > And this is the load on vslow database nodes on s7: > > > > >

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-07-30 Thread Derk-Jan Hartman
That is an impressive difference ! On Mon, Jul 30, 2018 at 6:22 PM Amir Sarabadani < amir.sarabad...@wikimedia.de> wrote: > And this is the load on vslow database nodes on s7: > >

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-07-30 Thread Jaime Crespo
Awesome news, Amir, You made some function calls one million times faster, making contributors happier and making available resources that can now be used for other mission-related tasks. That also made, at least, WMF DBAs very happy! Cheers, On Mon, Jul 30, 2018 at 6:22 PM Amir Sarabadani <

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-07-30 Thread Amir Sarabadani
And this is the load on vslow database nodes on s7: https://grafana.wikimedia.org/dashboard/db/mysql?panelId=3=1=1532794373712=1532967173714=eqiad%20prometheus%2Fops=db1090=13317 You can see similar drops on other sections from exactly the moment it got deployed: s1:

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-07-30 Thread Amir Sarabadani
Hey, Using the new table as backend of Special:Tags (and similar APIs) is now enabled everywhere. Contact me if there's any issues with that. Best On Wed, 25 Jul 2018 at 19:17, Amir Sarabadani wrote: > Hello, > One update regarding this. > We enabled using the new table for Special:Tags in

Re: [Wikitech-l] [Wikidata-tech] Normalization of change tag schema

2018-07-25 Thread Amir Sarabadani
Hello, One update regarding this. We enabled using the new table for Special:Tags in several large wikis which caused a massive improvement in the performance of the page. For example loading Special:Tags on Wikidata used to take around a minute and now it takes less than a second. English