+1 to Marteen Another idea is to have the database structured as-planned, but add a server with *all* databases that would be slower/less stable, but will provide a solution for those who really need cross database joins
Martin pá 13. 11. 2020 v 0:31 odesílatel Maarten Dammers <maar...@mdammers.nl> napsal: > I recall some point in time (Toolserver maybe?) when all the slices > (overview at https://tools-info.toolforge.org/?listmetap ) were at > different servers, but the Commons slice (s4) was on every server. > At some point new fancy database servers were introduced with all the > slices on all servers. Having 6 servers with each one having a slice + s4 > (Commons) + s8 (Wikidata) might be a good compromise. > On 12-11-2020 00:58, John wrote: > > I’ll throw my hat in this too. Moving it to the application layer will > make a number of queries just not feasible any longer. It might make sense > from the administration side, but from the user perspective it beaks one of > the biggest features that toolforge has. > > On Wed, Nov 11, 2020 at 6:40 PM Martin Urbanec < > martin.urba...@wikimedia.cz> wrote: > >> MusikAnimal is right, however, Wikidata and Commons either have a sui >> generis slice, or they share it with a few very large wikis. Tools that do >> any kind of crosswiki analysis would instantly break, as most of them >> utilise joining by Wikidata items at the very least. >> >> I second Maarten here. This would mean a lot of things that currently >> require a (relatively simple) SQL query would need a full script, which >> would do the join at the application level. >> >> I fully understand the reasoning, but there needs to be some replacement. >> Intentionally introduce breaking changes while providing no "new standard" >> is a bad pattern in a community environment. >> >> Martin >> >> On Wed, Nov 11, 2020, 10:31 PM MusikAnimal <musikani...@gmail.com> wrote: >> >>> Technically, cross-wiki joins aren't completely disallowed, you just >>> have to make sure each of the db names are on the same slice/section, >>> right? >>> >>> ~ MA >>> >>> On Wed, Nov 11, 2020 at 4:11 PM Maarten Dammers <maar...@mdammers.nl> >>> wrote: >>> >>>> Hi Joaquin, >>>> On 10-11-2020 21:26, Joaquin Oltra Hernandez wrote: >>>> >>>> TLDR: Wiki Replicas' architecture is being redesigned for stability and >>>> performance. Cross database JOINs will not be available and a host >>>> connection will only allow querying its associated DB. See [1] >>>> <https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign> >>>> for more details. >>>> >>>> If you only think of Wikipedia, not a lot will break probably, but if >>>> you take into account Commons and Wikidata a lot will break. A quick grep >>>> in my folder with Commons queries returns 123 lines with cross database >>>> joins. So yes, stuff will break and tools will be abandoned. This follows >>>> the practice that seems to have become standard for the WMF these days: >>>> Decisions are made with a small group within the WMF without any community >>>> involved. Only after the decision has been made, it's announced. >>>> >>>> Unhappy and disappointed, >>>> >>>> Maarten >>>> _______________________________________________ >>>> Wikimedia Cloud Services mailing list >>>> Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) >>>> https://lists.wikimedia.org/mailman/listinfo/cloud >>>> >>> _______________________________________________ >>> Wikimedia Cloud Services mailing list >>> Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) >>> https://lists.wikimedia.org/mailman/listinfo/cloud >>> >> _______________________________________________ >> Wikimedia Cloud Services mailing list >> Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) >> https://lists.wikimedia.org/mailman/listinfo/cloud >> > > _______________________________________________ > Wikimedia Cloud Services mailing listcl...@lists.wikimedia.org (formerly > lab...@lists.wikimedia.org)https://lists.wikimedia.org/mailman/listinfo/cloud > > _______________________________________________ > Wikimedia Cloud Services mailing list > Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) > https://lists.wikimedia.org/mailman/listinfo/cloud >
_______________________________________________ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud
