Matt Sinclair has submitted this change. (
https://gem5-review.googlesource.com/c/public/gem5/+/51968 )
Change subject: tests: add Pannotia to weekly regression
......................................................................
tests: add Pannotia to weekly regression
Add the Pannotia benchmarks to the weekly regression suite. These
applications do a good job of testing the GPU support for irregular
access patterns of various kinds. All inputs have been sized to use
relatively small graphs to avoid increasing runtime too much. However,
even with small input sizes Pannotia does run for a while.
Note that the Pannotia benchmarks also use m5ops in them. Thus, this
commit also adds support into the weekly regression for compiling the
m5ops (for x86, since that is what the GPU model assumes for the CPU).
Change-Id: I1f68b02b38ff24505a2894694b7544977024f8fa
Reviewed-on: https://gem5-review.googlesource.com/c/public/gem5/+/51968
Tested-by: kokoro <noreply+kok...@google.com>
Maintainer: Matt Sinclair <mattdsincl...@gmail.com>
Reviewed-by: Jason Lowe-Power <power...@gmail.com>
---
M tests/weekly.sh
1 file changed, 165 insertions(+), 2 deletions(-)
Approvals:
Jason Lowe-Power: Looks good to me, approved
Matt Sinclair: Looks good to me, approved
kokoro: Regressions pass
diff --git a/tests/weekly.sh b/tests/weekly.sh
index c7ba7e6..51376bd 100755
--- a/tests/weekly.sh
+++ b/tests/weekly.sh
@@ -44,10 +44,16 @@
"${gem5_root}"/tests --rm
gcr.io/gem5-test/ubuntu-20.04_all-dependencies \
./main.py run --length very-long -j${threads} -t${threads}
+mkdir -p tests/testing-results
+
+# GPU weekly tests start here
# before pulling gem5 resources, make sure it doesn't exist already
docker run --rm --volume "${gem5_root}":"${gem5_root}" -w \
"${gem5_root}" gcr.io/gem5-test/gcn-gpu:latest bash -c \
"rm -rf ${gem5_root}/gem5-resources"
+# delete Pannotia datasets and output files in case a failed regression
run left
+# them around
+rm -f coAuthorsDBLP.graph 1k_128k.gr result.out
# Pull gem5 resources to the root of the gem5 directory -- currently the
# pre-built binares for LULESH are out-of-date and won't run correctly with
@@ -71,9 +77,14 @@
"scons build/GCN3_X86/gem5.opt -j${threads} \
|| rm -rf build && scons build/GCN3_X86/gem5.opt -j${threads}"
-# test LULESH
-mkdir -p tests/testing-results
+# Some of the apps we test use m5ops (and x86), so compile them for x86
+# Note: setting TERM in the environment is necessary as scons fails for
m5ops if
+# it is not set.
+docker run --rm -u $UID:$GID --volume "${gem5_root}":"${gem5_root}" -w \
+ "${gem5_root}/util/m5" hacc-test-weekly bash -c \
+ "export TERM=xterm-256color ; scons build/x86/out/m5"
+# test LULESH
# build LULESH
docker run --rm --volume "${gem5_root}":"${gem5_root}" -w \
"${gem5_root}/gem5-resources/src/gpu/lulesh" \
@@ -163,8 +174,137 @@
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/halo-finder/src/hip \
-c ForceTreeTest --options="0.5 0.1 64 0.1 1 N 12 rcb"
+# test Pannotia
+# Pannotia has 6 different benchmarks (BC, Color, FW, MIS, PageRank,
SSSP), of
+# which 3 (Color, PageRank, SSSP) have 2 different variants. Since they
are
+# useful for testing irregular GPU application behavior, we test each.
+
+# build BC
+docker run --rm -v ${PWD}:${PWD} \
+ -w ${gem5_root}/gem5-resources/src/gpu/pannotia/bc -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; make gem5-fusion"
+
+# # get input dataset for BC test
+wget http://dist.gem5.org/dist/develop/datasets/pannotia/bc/1k_128k.gr
+# run BC
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+ --benchmark-root=gem5-resources/src/gpu/pannotia/bc/bin -c bc.gem5 \
+ --options="1k_128k.gr"
+
+# build Color Max
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/color -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; make gem5-fusion"
+
+# run Color (Max) (use same input dataset as BC for faster testing)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/color/bin \
+ -c color_max.gem5 --options="1k_128k.gr 0"
+
+# build Color (MaxMin)
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/color -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; export VARIANT=MAXMIN ; make
gem5-fusion"
+
+# run Color (MaxMin) (use same input dataset as BC for faster testing)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/color/bin \
+ -c color_maxmin.gem5 --options="1k_128k.gr 0"
+
+# build FW
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/fw -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; make gem5-fusion"
+
+# run FW (use same input dataset as BC for faster testing)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/fw/bin \
+ -c fw_hip.gem5 --options="1k_128k.gr"
+
+# build MIS
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/mis -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; make gem5-fusion"
+
+# run MIS (use same input dataset as BC for faster testing)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/mis/bin \
+ -c mis_hip.gem5 --options="1k_128k.gr 0"
+
+# build Pagerank Default variant
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/pagerank -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; make gem5-fusion"
+
+# get PageRank input dataset
+wget
http://dist.gem5.org/dist/develop/datasets/pannotia/pagerank/coAuthorsDBLP.graph
+# run PageRank (Default)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/pagerank/bin \
+ -c pagerank.gem5 --options="coAuthorsDBLP.graph 1"
+
+# build PageRank SPMV variant
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/pagerank -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; export VARIANT=SPMV ; make
gem5-fusion"
+
+# run PageRank (SPMV)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/pagerank/bin \
+ -c pagerank_spmv.gem5 --options="coAuthorsDBLP.graph 1"
+
+# build SSSP CSR variant
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/sssp -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; make gem5-fusion"
+
+# run SSSP (CSR) (use same input dataset as BC for faster testing)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/sssp/bin \
+ -c sssp.gem5 --options="1k_128k.gr 0"
+
+# build SSSP ELL variant
+docker run --rm -v ${gem5_root}:${gem5_root} -w \
+ ${gem5_root}/gem5-resources/src/gpu/pannotia/sssp -u $UID:$GID \
+ hacc-test-weekly bash -c \
+ "export GEM5_PATH=${gem5_root} ; export VARIANT=ELL ; make
gem5-fusion"
+
+# run SSSP (ELL) (use same input dataset as BC for faster testing)
+docker run --rm -v ${gem5_root}:${gem5_root} -w ${gem5_root} -u $UID:$GID \
+ hacc-test-weekly ${gem5_root}/build/GCN3_X86/gem5.opt \
+ ${gem5_root}/configs/example/apu_se.py -n3 --mem-size=8GB \
+
--benchmark-root=${gem5_root}/gem5-resources/src/gpu/pannotia/sssp/bin \
+ -c sssp_ell.gem5 --options="1k_128k.gr 0"
+
# Delete the gem5 resources repo we created -- need to do in docker
because of
# cachefiles DNNMark creates
docker run --rm --volume "${gem5_root}":"${gem5_root}" -w \
"${gem5_root}" hacc-test-weekly bash -c \
"rm -rf ${gem5_root}/gem5-resources"
+
+# delete Pannotia datasets we downloaded and output files it created
+rm -f coAuthorsDBLP.graph 1k_128k.gr result.out
--
To view, visit https://gem5-review.googlesource.com/c/public/gem5/+/51968
To unsubscribe, or for help writing mail filters, visit
https://gem5-review.googlesource.com/settings
Gerrit-Project: public/gem5
Gerrit-Branch: develop
Gerrit-Change-Id: I1f68b02b38ff24505a2894694b7544977024f8fa
Gerrit-Change-Number: 51968
Gerrit-PatchSet: 7
Gerrit-Owner: Matt Sinclair <mattdsincl...@gmail.com>
Gerrit-Reviewer: Bobby R. Bruce <bbr...@ucdavis.edu>
Gerrit-Reviewer: Jason Lowe-Power <power...@gmail.com>
Gerrit-Reviewer: Matt Sinclair <mattdsincl...@gmail.com>
Gerrit-Reviewer: kokoro <noreply+kok...@google.com>
Gerrit-CC: GAURAV JAIN <gja...@wisc.edu>
Gerrit-CC: Kyle Roarty <kyleroarty1...@gmail.com>
Gerrit-CC: Matthew Poremba <matthew.pore...@amd.com>
Gerrit-MessageType: merged
_______________________________________________
gem5-dev mailing list -- gem5-dev@gem5.org
To unsubscribe send an email to gem5-dev-le...@gem5.org
%(web_page_url)slistinfo%(cgiext)s/%(_internal_name)s
