[Wikidata-bugs] [Maniphest] T233520: Wikidata changes do not get sent to client sites on initial sitelink addition (in some cases), leading to things such as missing page props in page_props table

Ladsgroup added a comment. FWIW, I looked at how dispatching works and we changed its infrastructure as part of a project before departing WMDE. We did it together with Michael who also knows a lot in this topic. I have some ideas on how to improve this which I wrote in details in

[Wikidata-bugs] [Maniphest] T298405: Wikidata/Wikibase Entity Draft Namespace

Bugreporter added a comment. This may also allow users to mass import from some crude sources (such as cebwiki, and various from Mix'n'Match). before checking them manually. TASK DETAIL https://phabricator.wikimedia.org/T298405 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T115223: Provide wikidata downloads as multiple files to make access more robust and efficient

Mitar added a comment. I learned today that Wikipedia has a nice approach with a multistream bz2 archive and additional file with an index, which tells you an offset into the bz2 archive you have to decompress as a chunk to access particular page.