I did such script a long time ago. I should start by asking, how much disk space do you have for this?
Local images are cheap: +--------+---------+ | number | size | +--------+---------+ | 22 | 2108819 | +--------+---------+ eswiktionary +--------+--------+ | number | size | +--------+--------+ | 14 | 390539 | +--------+--------+ frwiktionary +--------+--------+ | number | size | +--------+--------+ | 6 | 702706 | +--------+--------+ dewiktionary +--------+---------+ | number | size | +--------+---------+ | 104 | 4943453 | +--------+---------+ enwikiquote +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+ eswikiquote +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+ frwikiquote +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+ dewikiquote +--------+---------+ | number | size | +--------+---------+ | 17 | 2236129 | +--------+---------+ enwikibooks +--------+-----------+ | number | size | +--------+-----------+ | 2716 | 153301990 | +--------+-----------+ eswikibooks +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+ frwikibooks +--------+---------+ | number | size | +--------+---------+ | 169 | 8244783 | +--------+---------+ dewikibooks +--------+------------+ | number | size | +--------+------------+ | 7697 | 2772943547 | +--------+------------+ but the commons files will start requiring a bit more space (about 1 TB): enwiktionary +--------+--------------+ | number | size | +--------+--------------+ | 724855 | 154587222013 | +--------+--------------+ eswiktionary +--------+-------------+ | number | size | +--------+-------------+ | 18938 | 12918158214 | +--------+-------------+ frwiktionary +--------+--------------+ | number | size | +--------+--------------+ | 560321 | 146933557784 | +--------+--------------+ dewiktionary +--------+-------------+ | number | size | +--------+-------------+ | 933737 | 84462331479 | +--------+-------------+ enwikiquote +--------+-------------+ | number | size | +--------+-------------+ | 55186 | 98435989071 | +--------+-------------+ eswikiquote +--------+------------+ | number | size | +--------+------------+ | 5712 | 7522618990 | +--------+------------+ frwikiquote +--------+-------------+ | number | size | +--------+-------------+ | 7348 | 11151209748 | +--------+-------------+ dewikiquote +--------+------------+ | number | size | +--------+------------+ | 4211 | 6149070638 | +--------+------------+ enwikibooks +--------+--------------+ | number | size | +--------+--------------+ | 106405 | 133670795995 | +--------+--------------+ eswikibooks +--------+--------------+ | number | size | +--------+--------------+ | 44309 | 122871671629 | +--------+--------------+ frwikibooks +--------+--------------+ | number | size | +--------+--------------+ | 98843 | 248629243582 | +--------+--------------+ dewikibooks +--------+-------------+ | number | size | +--------+-------------+ | 69669 | 54020348470 | +--------+-------------+ All of them: +---------+--------------+ | number | size | +---------+--------------+ | 2021173 | 981218142389 | +---------+--------------+ for wiki in enwiktionary eswiktionary frwiktionary dewiktionary enwikiquote eswikiquote frwikiquote dewikiquote enwikibooks eswikibooks frwikibooks dewikibooks; do echo $wiki; sql "${wiki}_p" "SELECT COUNT(img_name) AS number, SUM(img_size) AS size FROM image;"; echo; done for wiki in enwiktionary eswiktionary frwiktionary dewiktionary enwikiquote eswikiquote frwikiquote dewikiquote enwikibooks eswikibooks frwikibooks dewikibooks; do echo $wiki; sql commonswiki_p "SELECT COUNT(img_name) AS number, SUM(img_size) AS size FROM image WHERE img_name IN (SELECT DISTINCT gil_to FROM globalimagelinks WHERE gil_wiki='$wiki')"; echo; done SELECT COUNT(img_name) AS number, SUM(img_size) AS size FROM image WHERE img_name IN (SELECT DISTINCT gil_to FROM globalimagelinks WHERE gil_wiki IN ('enwiktionary', 'eswiktionary', 'frwiktionary', 'dewiktionary', 'enwikiquote', 'eswikiquote', 'frwikiquote', 'dewikiquote', 'enwikibooks', 'eswikibooks', 'frwikibooks', 'dewikibooks')) ;
_______________________________________________ Xmldatadumps-l mailing list -- xmldatadumps-l@lists.wikimedia.org To unsubscribe send an email to xmldatadumps-l-le...@lists.wikimedia.org