[Cloud] Re: Changes in schema of pagelinks tables

Hi, It's me again. The data have been migrated in all wikis except Turkish Wikipedia and Chinese Wikipedia (last two wikis of s2) and these two wikis will be also migrated in a week or so. So if you rely on the old columns of pagelinks, you need to migrate them to use the normalized schema ASAP.

[Cloud] Re: Changes in schema of pagelinks tables

Hi Huji and Xabriel, Am Sa., 20. Jan. 2024 um 21:43 Uhr schrieb Huji Lee : > Yes, a communication would be great (including, on this thread). > > As it stands right now, the linktargets table is incomplete on the wikis I > checked. For instance, this fawiki query >

[Cloud] Re: Changes in schema of pagelinks tables

Yes, a communication would be great (including, on this thread). As it stands right now, the linktargets table is incomplete on the wikis I checked. For instance, this fawiki query returns 388 results but the equivalent query

[Cloud] Re: Changes in schema of pagelinks tables

Amir, To summarize: the only wiki that will soon get the old columns dropped is commonswiki and the rest of the wikis will keep the old columns until the migration to the new columns is complete on all wikis, at which time there will be a communication. Is this correct? Thanks, -- Xabriel J.

[Cloud] Re: Changes in schema of pagelinks tables

Thanks for the clear explanation, this gives more context for the urgency. > On Jan 17, 2024, at 3:04 PM, Amir Sarabadani > wrote: > What about only dropping it from Commons to reduce the risk of outage and > leave the rest until the all are finished (or all except Wikidata)? You'd > have to

[Cloud] Re: Changes in schema of pagelinks tables

Changing queries to support a new database format is one thing. Writing migration code to deal with a situation that should not exist (columns being dropped before the migration is completed) is another. I suppose I am lucky in that the only tool I maintain that queries the pagelinks table is

[Cloud] Re: Changes in schema of pagelinks tables

Hi! Am Mi., 17. Jan. 2024 um 19:37 Uhr schrieb Ben Kurtovic < wikipedia.ear...@gmail.com>: > Hi Amir & others, > > I’m glad we are making changes to improve DB storage/query efficiency. I > wanted to express my agreement with Tacsipacsi that dropping the data > before the migration has completed

[Cloud] Re: Changes in schema of pagelinks tables

Hi Amir & others, I’m glad we are making changes to improve DB storage/query efficiency. I wanted to express my agreement with Tacsipacsi that dropping the data before the migration has completed is a really bad outcome. Now tool maintainers need to deal with multiple migrations depending on

[Cloud] Re: Changes in schema of pagelinks tables

Hi, Yes that is correct but given the size these tables and the databases (for s4, see https://phabricator.wikimedia.org/T343131) we don't really have a choice in this specific case, Commons has grown to 1.8TB already. My apologies for the inconvenience. One thing that help here is that s3 and

[Cloud] Re: Changes in schema of pagelinks tables

Hi, Do I understand correctly that I can’t use the old columns on s3, s4 and s5 anymore, but I can’t use the new columns on s1 and s8 yet? Please don’t do that, I don’t want to write code that first needs to consult some list of wikis to decide how to query the database. I want to migrate

[Cloud] Re: Changes in schema of pagelinks tables

Who are you people?? I don't know the first thing about all this developer talk! On Tue, Jan 16, 2024, 3:57 AM Amir Sarabadani wrote: > Hello, > The data migration for several sections have been completed. We will start > dropping the old columns on s4 >

[Cloud] Re: Changes in schema of pagelinks tables

Hello, The data migration for several sections have been completed. We will start dropping the old columns on s4 and s5 this and next week and right after will start dropping the old columns on s3