I'm starting on a project which will process every edit comment in the enwiki
dumps using k8s jobs on toolforge. There's 736
enwiki-20211201-pages-meta-history*.xml*bz2 files. Would kicking off 736 jobs
(one per file) be a reasonable thing to do from the resource consumption point
of view, or would that lead to a WTF response from the sysadmins?
_______________________________________________
Cloud mailing list -- cloud@lists.wikimedia.org
List information:
https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
