Jcrespo has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/371944 )
Change subject: [WIP]mariadb: First attempt at a mydumper-based dump script
......................................................................
[WIP]mariadb: First attempt at a mydumper-based dump script
Bug: T169516
Change-Id: I995cc704b5368df5a92a4763fcbde8e171e3d705
---
A modules/role/files/mariadb/dump_shards.sh
1 file changed, 31 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/44/371944/1
diff --git a/modules/role/files/mariadb/dump_shards.sh
b/modules/role/files/mariadb/dump_shards.sh
new file mode 100644
index 0000000..e996d64
--- /dev/null
+++ b/modules/role/files/mariadb/dump_shards.sh
@@ -0,0 +1,31 @@
+#!/bin/bash
+
+numthreads=16
+backupdir=backups
+shards="s1 s4 s5 s2 s6 s7 s3 x1"
+rowsmax=100000000
+
+[ -z "$backupdir" ] && { echo "backupdir variable is empty"; exit 1 }
+[ "$backupdir" == "/" ] && { echo "backupdir variable cannot be the root
directory"; exit 1 }
+[[ "$HOST" =~ ^sqldata.* ]] && { echo "backupdir variable cannot start with
sqldata"; exit 1 }
+
+mkdir -p "/srv/$backupdir"
+chmod go-rwx "/srv/$backupdir"
+
+find "/srv/$backupdir" -mtime +14 -type f -delete
+find "/srv/$backupdir" -mtime +14 -type d -exec rmdir \{\} \;
+
+# stopping all replication activity to save iops
+for stop_shard in $shards; do
+ /usr/local/bin/mysql --socket="/run/mysqld/mysqld.$stop_shard.sock" -e
"STOP SLAVE"
+done
+
+for backup_shard in $shards; do
+
+ /usr/bin/mydumper/mydumper --compress --host=localhost
--threads="$numthreads" --user="`whoami`"
--socket="/run/mysqld/mysqld.$backup_shard.sock" --triggers --routines --events
--rows="$rowsmax" --logfile="/srv/$backupdir/dump.$shard.log"
--outputdir="/srv/$backupdir/$backup_shard.`date +%Y%m%d%H%M%S`"
+done
+
+# Restarting replication
+for start_shard in $shards; do
+ /usr/local/bin/mysql --socket="/run/mysqld/mysqld.$start_shard.sock" -e
"START SLAVE"
+done
--
To view, visit https://gerrit.wikimedia.org/r/371944
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I995cc704b5368df5a92a4763fcbde8e171e3d705
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Jcrespo <jcre...@wikimedia.org>
_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
