Lucas_Werkmeister_WMDE added a comment.

  Hm, this would be visible in the dump files, right? I remember noticing a 
while ago that the dump started with a subset of item IDs in ascending order, 
then eventually jumped back to the beginning and did another subset, and so on. 
If I understand correctly, this is because we run eight(?) dumpers in parallel, 
going through item IDs congruent 0-7 modulo 8 (or something like that – it 
might also be based on the page ID), and then we concatenate their results at 
the end (with some slight editing to fix up the JSON array syntax). If we 
increase the number of dumpers, the results will probably be listed in a 
different order.

TASK DETAIL
  https://phabricator.wikimedia.org/T300255

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Michael, Lucas_Werkmeister_WMDE, hoo, LSobanski, Marostegui, Aklapper, 
Ladsgroup, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Addshore, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

Reply via email to