ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/276907
Change subject: [WIP] dumps: convert generation of media titles per project to onallwikis ...................................................................... [WIP] dumps: convert generation of media titles per project to onallwikis This must wait for https://gerrit.wikimedia.org/r/#/c/276905/ to be merged Change-Id: I9ff574098999da38a8b887a1690cdd567d22cb8f --- M modules/snapshot/templates/create-media-per-project-lists.sh.erb 1 file changed, 10 insertions(+), 7 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/07/276907/1 diff --git a/modules/snapshot/templates/create-media-per-project-lists.sh.erb b/modules/snapshot/templates/create-media-per-project-lists.sh.erb index 73101bc..9bbb44b 100755 --- a/modules/snapshot/templates/create-media-per-project-lists.sh.erb +++ b/modules/snapshot/templates/create-media-per-project-lists.sh.erb @@ -7,20 +7,23 @@ DATE=`/bin/date '+%Y%m%d'` outputdir="<%= scope.lookupvar('snapshot::dirs::datadir') -%>/public/other/imageinfo/$DATE" -wqdir="<%= scope.lookupvar('snapshot::dirs::wikiqueriesdir') %>" +scriptdir="<%= scope.lookupvar('snapshot::dirs::dumpsdir') %>" errors=0 -python "$wqdir/listmediaperproject.py" --outputdir "$outputdir" \ - --remotereponame commonswiki --wqpath "$wqdir/wikiqueries.py" \ - --wqconfig "$wqdir/confs/wq.conf.media" --nooverwrite --localonly +python "${scriptdir}/onallwikis.py" --outputdir "$outputdir" \ + --config "${scriptdir}/confs/wikidump.conf.monitor" --nooverwrite \ + --query "'select img_name, img_timestamp from image;'" \ + --filenameformat "{w}-{d}-local-wikiqueries.gz" if [ $? -ne 0 ]; then echo "failed sql dump of image tables" errors=1 fi -python "$wqdir/listmediaperproject.py" --outputdir "$outputdir" \ - --remotereponame commonswiki --wqpath "$wqdir/wikiqueries.py" \ - --wqconfig "$wqdir/confs/wq.conf.media" --nooverwrite --remoteonly +python "${scriptdir}/onallwikis.py" --outputdir "$outputdir" \ + --config "${scriptdir}/confs/wikidump.conf.media" --nooverwrite \ + --query "'select gil_to from globalimagelinks where gil_wiki= \"{w};\"'" \ + --filenameformat "{w}-{d}-remote-wikiqueries.gz" + if [ $? -ne 0 ]; then echo "failed sql dump of globalimagelink tables" errors=1 -- To view, visit https://gerrit.wikimedia.org/r/276907 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I9ff574098999da38a8b887a1690cdd567d22cb8f Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: ArielGlenn <ar...@wikimedia.org> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
