A reprieve! Code's not ready and I need to do some timing tests, so the March 20th run will do the standard recombining.
For updates, don't forget to check the Phab ticket! https://phabricator.wikimedia.org/T179059 On Mon, Mar 5, 2018 at 1:10 PM, Ariel Glenn WMF <ar...@wikimedia.org> wrote: > Please forward wherever you think appropriate. > > For some time we have provided multiple numbered pages-articles bz2 file > for large wikis, as well as a single file with all of the contents combined > into one. This is consuming enough time for Wikidata that it is no longer > sustainable. For wikis where the sizes of these files to recombine is "too > large", we will skip this recombine step. This means that downloader > scripts relying on this file will need to check its existence, and if it's > not there, fall back to downloading the multiple numbered files. > > I expect to get this done and deployed by the March 20th dumps run. You > can follow along here: https://phabricator.wikimedia.org/T179059 > > Thanks! > > Ariel > _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
