If you have multiple archives, you quickly tire of typing stuff like python3 manage.py parsearchive --list-id=patchwork.ozlabs.org foo-1 & python3 manage.py parsearchive --list-id=patchwork.ozlabs.org foo-2 & python3 manage.py parsearchive --list-id=patchwork.ozlabs.org foo-3 & python3 manage.py parsearchive --list-id=patchwork.ozlabs.org foo-4 & and having to copy and paste it - or retype it! - each time you reset the database.
Instead, this patch allows you to do tools/scripts/parallel_parsearchive.sh --list-id=patchwork.ozlabs.org -- foo-* Much easier, especially when you are doing it a dozen times. Reviewed-by: Andrew Donnellan <andrew.donnel...@au1.ibm.com> Signed-off-by: Daniel Axtens <d...@axtens.net> -- v2: Include example, thanks Andrew Allow python to be overridden by the PW_PYTHON variable, defaulting to Python 3. --- tools/scripts/parallel_parsearchive.sh | 61 ++++++++++++++++++++++++++++++++++ 1 file changed, 61 insertions(+) create mode 100755 tools/scripts/parallel_parsearchive.sh diff --git a/tools/scripts/parallel_parsearchive.sh b/tools/scripts/parallel_parsearchive.sh new file mode 100755 index 000000000000..f03875b85d6a --- /dev/null +++ b/tools/scripts/parallel_parsearchive.sh @@ -0,0 +1,61 @@ +#!/bin/bash +# Patchwork - automated patch tracking system +# Copyright (C) 2018 Daniel Axtens <d...@axtens.net> +# +# This file is part of the Patchwork package. +# +# Patchwork is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# Patchwork is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. + +set -euo pipefail + +usage() { + cat <<EOF +parallel_parsearchive.sh - load archives in parallel +Usage: + parallel_parsearchive.sh [parsearchive options] -- <archives> + The -- is mandatory. + As many processes as there are archives will be spun up. + +Example: + tools/scripts/parallel_parsearchive.sh --list-id=patchwork.ozlabs.org -- foo-* +EOF + exit 1 +} + +if [ $# -eq 0 ] || [[ $1 == "-h" ]]; then + usage; +fi + +PARSEARCHIVE_OPTIONS="" +while [[ $1 != "--" ]]; do + PARSEARCHIVE_OPTIONS="$PARSEARCHIVE_OPTIONS $1" + shift + if [ $# -eq 0 ]; then + usage; + fi +done +shift + +if [ $# -eq 0 ]; then + usage; +fi + +set +u +if [ -z "$PW_PYTHON" ]; then + PW_PYTHON=python3 +fi +set -u + +for x in "$@"; do + echo "Starting $x" + "$PW_PYTHON" manage.py parsearchive $PARSEARCHIVE_OPTIONS "$x" & +done +echo "Processes started in the background." -- 2.14.1 _______________________________________________ Patchwork mailing list Patchwork@lists.ozlabs.org https://lists.ozlabs.org/listinfo/patchwork