From: Leonardo Sandoval <leonardo.sandoval.gonza...@linux.intel.com> Parallelize oe-selftest execution using GNU/Parallel: for each test defined, a job will be launched and at any time at maximun of jobs will be executing (defaults to 4). Extra parameters can be given to parallel cmd after double dashes ('--'). Some cmd line examples:
1. Run all modules parallel-oe-selftest.sh 2. Run certaing modules and print results in order (see parallel man page for more info) echo wic bblayers | parallel-oe-selftest.sh -- --keep-order Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonza...@linux.intel.com> --- scripts/contrib/parallel-oe-selftest.sh | 81 +++++++++++++++++++++++++++++++++ 1 file changed, 81 insertions(+) create mode 100755 scripts/contrib/parallel-oe-selftest.sh diff --git a/scripts/contrib/parallel-oe-selftest.sh b/scripts/contrib/parallel-oe-selftest.sh new file mode 100755 index 0000000000..5fbdff9f95 --- /dev/null +++ b/scripts/contrib/parallel-oe-selftest.sh @@ -0,0 +1,81 @@ +#!/bin/sh + +# paralell-oe-selftest: executes oe-selftest in 'parallel'. The tests (modules, clases or test methods, same +# as oe-selftest --run-tests) to be executed can be piped to this script; if this is not the case, all modules +# are executed +# +# Copyright (c) 2013-2017 Intel Corporation +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License version 2 as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License along +# with this program; if not, write to the Free Software Foundation, Inc., +# 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA. +# + +# Before anything else, check oe-core environment +if [ -z "$BUILDDIR" ]; then + echo "Please initialize the OE-Core environment through oe-init-build-env script" + exit 1 +fi + +usage() { +CMD=$(basename $0) +cat <<EOM +Usage: $CMD [-h] [-j jobs] [-- <parallel options>] + -j jobs Number of jobs to be running concurrently + -h Display this help message + + Examples: + # run all tests, output results in order and show progress + $CMD -j 4 -- --keep-order --progress + + # run just wic and bblayers + echo wic bblayers | $CMD + +EOM +} + +JOBS=4 +# Parse and validate arguments +while getopts "hj:" OPT; do + case $OPT in + j) + JOBS="$OPTARG" + ;; + h) + usage + exit 0 + ;; + --) + shift + break + ;; + esac +done + +shift "$((OPTIND - 1))" +extraopts="$@" +echo $extraopts + +if [ -t 0 ]; then + # no stdin, run all modules + TESTCASES="$(oe-selftest -m | awk '{ print $NF } ' | grep -v ':')" +else + TESTCASES="$(cat /dev/stdin)" +fi + +# Parallelization is done through GNU/Paralell, so it must be present in host machine +which parallel 2>&1 >/dev/null || { echo "Please install GNU/Parallel"; exit 1; } + +echo "The following tests will be run in parallel with a $JOBS jobs" +echo ""; for t in $TESTCASES; do echo -e "\t$t"; done; echo "" + +echo "$TESTCASES" | parallel --jobs $JOBS $extraopts oe-selftest -r -- 2.12.3 -- _______________________________________________ Openembedded-core mailing list Openembedded-core@lists.openembedded.org http://lists.openembedded.org/mailman/listinfo/openembedded-core