| hoo added a comment. |
In T177550#3901012, @ArielGlenn wrote:How is this coming along?
No work has been done on this yet, but it shouldn't be to hard.
At very least we will need a --continue parameter for the dump maintenance script. Also we will need to find a way to stop… keep dumping in batches of say 100,000 until the batches are empty? How would we know from where to continue? Grep this from the logs or do we want a special "state file" for this that has the entity id last dumped by that shard?
TASK DETAIL
EMAIL PREFERENCES
To: hoo
Cc: Liuxinyu970226, Lydia_Pintscher, daniel, ArielGlenn, Aklapper, hoo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Svick, Mbch331, jeremyb
Cc: Liuxinyu970226, Lydia_Pintscher, daniel, ArielGlenn, Aklapper, hoo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Svick, Mbch331, jeremyb
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
