[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-11-22T01:09:00Z] Cleaned out remaining T180934 related log blow up on snapshot1007 (dumpwikidatajson-wikidata-20171120-all-0.log)TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: Stashbot, gerritbot, hoo, ArielGlenn, Aklapper, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-11-20T10:23:19Z] Manually re-started the Wikidata entity JSON dump on snapshot1007 (T180934)TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, gerritbot, hoo, ArielGlenn, Aklapper, Lahi, Gq86, Lordiis, GoranSMilovanovic, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
ArielGlenn added a comment. @hoo if you don't see anything else amiss, feel free to start the job manually at any time. I'll clean up that temp log file I left laying around then, too.TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlennCc: gerritbot, hoo, ArielGlenn, Aklapper, Lahi, Gq86, Lordiis, GoranSMilovanovic, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
gerritbot added a comment. Change 392398 merged by ArielGlenn: [operations/puppet@production] fix missing redirect for wikidata json dumps https://gerrit.wikimedia.org/r/392398TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hoo, ArielGlenn, Aklapper, Lahi, Gq86, Lordiis, GoranSMilovanovic, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
gerritbot added a comment. Change 392398 had a related patch set uploaded (by ArielGlenn; owner: ArielGlenn): [operations/puppet@production] fix missing redirect for wikidata json dumps https://gerrit.wikimedia.org/r/392398TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hoo, ArielGlenn, Aklapper, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
ArielGlenn added a comment. Contents of the output files in /mnt/data/xmldatadumps/temp: -rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.3.gz -rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.5.gz -rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.2.gz -rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.4.gz -rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.1.gz -rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.0.gzTASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlennCc: hoo, ArielGlenn, Aklapper, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180934: Wikidata json dumps filling /var/log
ArielGlenn added a comment. The command that wrote the above log was this: php5 /srv/mediawiki/multiversion/MWScript.php extensions/Wikidata/extensions/Wikibase/repo/maintenance/dumpJson.php --wiki wikidatawiki --shard 1 --sharding-factor 6 --batch-size 1000 --snippet 2 --no-cacheTASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlennCc: hoo, ArielGlenn, Aklapper, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs