No, it should take a couple of hours tops (for me it was like half an hour I think).  Try using gdb as Giacomo suggested and also maybe share the command you used to run gem5.  You can also run gem5 and attach a terminal (look at the wiki of how to do this).  This will give you interactive access to gem5, while running, and maybe you can see this way where it gets stuck, if that's the case.

On 1/17/2020 8:32 PM, Giacomo Travaglini wrote:
If by chance simulation is stuck while generating a checkpoint, I suggest you to use GDB to understand where it is stuck.
Let us know your findings.

Giacomo
------------------------------------------------------------------------
*From:* gem5-users <gem5-users-boun...@gem5.org> on behalf of Giacomo Travaglini <giacomo.travagl...@arm.com>
*Sent:* 17 January 2020 19:29
*To:* ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com>; Dimitrios Chasapis <dchas...@bsc.es>; gem5 users mailing list <gem5-users@gem5.ortNo, I think it should be done in a couple of hours tops.g>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode
I don't know what is going on and what the boot script is doing.
For me the easy way to create a checkpoint is to

1) $cd util/term
2) $make

Now you have m5term compiled.
From another terminal run your simulation (without bootscritpt) and see which is the local port (usually 3456)
From the other terminal do

$./m5term localhost 3456

Now you have a terminal attached to your guest system: once you boot Linux, just type on this terminal:

$/sbin/m5 checkpoint

This will create a checkpoint.
If you now want to exit simulation, type on the same terminal

$/sbin/m5 exit

Regards

Giacomo


------------------------------------------------------------------------
*From:* gem5-users <gem5-users-boun...@gem5.org> on behalf of ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com>
*Sent:* 17 January 2020 19:18
*To:* Dimitrios Chasapis <dchas...@bsc.es>; gem5 users mailing list <gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode
PLEASE HELP ME.

I have run the hack_back_ckpt.rcS to create checkpoint and is still running 15 hours ago. Could you please tell me how much time does it take to finish?

Best Regards


------------------------------------------------------------------------
*From:* gem5-users <gem5-users-boun...@gem5.org> on behalf of ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com>
*Sent:* Friday, January 17, 2020 6:33 PM
*To:* Dimitrios Chasapis <dchas...@bsc.es>; gem5 users mailing list <gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode
Hi All,

I have run the hack_back_ckpt.rcS to create checkpoint and is still running 15 hours ago. Could you please tell me how much time does it take to finish?

Best Regards

------------------------------------------------------------------------
*From:* Dimitrios Chasapis <dchas...@bsc.es>
*Sent:* Thursday, January 16, 2020 1:05 PM
*To:* ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com>; gem5 users mailing list <gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode

I guess using -l 1000000000 is not enough to reach the benchmark itself and you finish before bootup, that's why you observe the same behavior.  To create the checkpoint after boot, you need to run the script found in

configs/boot/hack_back_ckpt.rcS. Run it like this:

gem5.opt \

--outdir=a/directory/to/store/boot_ckpt \
        configs/example/fs.py \
                --kernel=...\
                --disk-image=... \
--script=/configs/boot/hack_back_ckpt.rcS \
                --cpu-type=AtomicSimpleCPU --num-cpus=1 --mem-size=...


You should have your checkpoint in the director you set with outdir.


To run from the checkpoint you need to use the following with your fs.py:

--checkpoint-dir=a/directory/to/store/boot_ckpt -r 1


On 1/16/20 4:21 AM, ABD ALRHMAN ABO ALKHEEL wrote:
Hi Dimitrios,

I run this command on Gem5 FS mode for different benchmarks and i got the same results for all benchmarks. So should i create checkpoint after the image is booted and if so how to create it?

./build/X86/gem5.fast ./configs/example/fs.py -I 100000000 --kernel=/home/abdkhail/linux4.19/vmlinux --disk-image=/home/abdkhail/ubuntu16.img --script=configs/boot/benchmark/gcc.rcS --mem-size=3GB --num-cpus=4 --cpu-clock=2GHz --caches --l2_size=2MB --l1i_size=32kB --l1d_size=32kB

Any help would be appreciated.

Best Regards

------------------------------------------------------------------------
*From:* Dimitrios Chasapis <dchas...@bsc.es> <mailto:dchas...@bsc.es>
*Sent:* Tuesday, January 14, 2020 3:22 PM
*To:* ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com> <mailto:abdkeel...@hotmail.com>; gem5 users mailing list <gem5-users@gem5.org> <mailto:gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode

Can you share the output from stdout and stderr?  Also have you checked system.terminal? There may be some clues of the error there as well if the commands in the rcs script are not correct or you have any missing dependencies in your disk image, for whatever reason.

You can also try to first generate simpoints etc for a simple program, something like a simple loop in C, so that we can figure out if the problem is in the SPEC or gem5.


On 1/14/20 3:20 PM, ABD ALRHMAN ABO ALKHEEL wrote:
Please help me.
------------------------------------------------------------------------
*From:* gem5-users <gem5-users-boun...@gem5.org> <mailto:gem5-users-boun...@gem5.org> on behalf of ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com> <mailto:abdkeel...@hotmail.com>
*Sent:* Tuesday, January 14, 2020 2:13:26 AM
*To:* Dimitrios Chasapis <dchas...@bsc.es> <mailto:dchas...@bsc.es>; gem5 users mailing list <gem5-users@gem5.org> <mailto:gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode
Hi All,

I run this command on GEM5 and got nothing in the stats.txt

./build/X86/gem5.fast ./configs/example/fs.py --simpoint-interval 1000 --mem-size=3GB --kernel=/home/abdkhail/linux4.19/vmlinux --disk-image=/home/abdkhail/ubuntu16.img --script=configs/boot/benchmark.rcS

benchmark.rcS

#!/bin/sh

cd /home/ubuntu/cpu/benchspec/CPU2006/473.astar/run/run_base_ref_amd64-m64-gcc42-nn.0000/astar_base.amd64-m64-gcc42-nn
/sbin/m5 dumpresetstats
/home/ubuntu/cpu/benchspec/CPU2006/473.astar/exe/astar_base.amd64-m64-gcc42-nn
echo "Done :D"
/sbin/m5 exit

Any help would be appreciated.

Best Regards

------------------------------------------------------------------------
*From:* ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com> <mailto:abdkeel...@hotmail.com>
*Sent:* Monday, January 13, 2020 8:40 PM
*To:* Dimitrios Chasapis <dchas...@bsc.es> <mailto:dchas...@bsc.es>; gem5 users mailing list <gem5-users@gem5.org> <mailto:gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode
Hi All,

I run this command on GEM5 and got nothing in the stats.txt

./build/X86/gem5.fast ./configs/example/fs.py --simpoint-interval 1000 --mem-size=3GB --kernel=/home/abdkhail/linux4.19/vmlinux --disk-image=/home/abdkhail/ubuntu16.img --script=configs/boot/benchmark.rcS

benchmark.rcS

#!/bin/sh

cd /home/ubuntu/cpu/benchspec/CPU2006/473.astar/run/run_base_ref_amd64-m64-gcc42-nn.0000/astar_base.amd64-m64-gcc42-nn
/sbin/m5 dumpresetstats
/home/ubuntu/cpu/benchspec/CPU2006/473.astar/exe/astar_base.amd64-m64-gcc42-nn
echo "Done :D"
/sbin/m5 exit

Any help would be appreciated.

Best Regards

------------------------------------------------------------------------
*From:* Dimitrios Chasapis <dchas...@bsc.es> <mailto:dchas...@bsc.es>
*Sent:* Monday, January 13, 2020 2:48 PM
*To:* ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com> <mailto:abdkeel...@hotmail.com>; gem5 users mailing list <gem5-users@gem5.org> <mailto:gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode

I think this should work fine to generate the *.bb.gz


On 1/13/20 4:49 AM, ABD ALRHMAN ABO ALKHEEL wrote:
Hi Dear Dimitrios,

I run the CPU2006 benchmark on gem5 in FS mode for 1000 instructions as follows:

The command is :

./build/X86/gem5.fast ./configs/example/fs.py --mem-size=3GB --kernel=/home/abdkhail/linux4.19/vmlinux --disk-image=/home/abdkhail/ubuntu16.img --script=configs/boot/benchmark.rcS --simpoint-interval 1000


The benchmark.rcS

#!/bin/sh

cd /home/ubuntu/cpu/benchspec/CPU2006/473.astar/run/run_base_ref_amd64-m64-gcc42-nn.0000/astar_base.amd64-m64-gcc42-nn
/sbin/m5 dumpresetstats
cd /home/ubuntu/cpu/benchspec/CPU2006/473.astar/exe/astar_base.amd64-m64-gcc42-nn
/sbin/m5 exit

I am wondering if that works well! any help or update would be appreciated.

Best Regards




------------------------------------------------------------------------
*From:* Dimitrios Chasapis <dchas...@bsc.es> <mailto:dchas...@bsc.es>
*Sent:* Friday, January 10, 2020 2:03 PM
*To:* ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com> <mailto:abdkeel...@hotmail.com>; gem5 users mailing list <gem5-users@gem5.org> <mailto:gem5-users@gem5.org>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode

I am not sure if this is possible in FS, at least not the same way you do in SE. You will need to use simpoints in order to create checkpoints for you code.  After that you basically segment your code into smaller, say 1000000 instructions per segment, which you can run.  Check the link I sent in my previous message.  However note that you will need to run the code for each benchmark  twice, once for generating the simpoint files and once to set the checkpoints.  For me this can take up to 4 week for the larger codes, and a few days for the smaller ones in SPEC CPU 2017.  Once you have the checkpoints though, it should take a couple of hours.  I don't know if there is a faster way to do this, maybe someone else has a better suggestion.

On 1/10/20 1:19 AM, ABD ALRHMAN ABO ALKHEEL wrote:
Hi Dimitrios, I appreciate your help. How I can run the benchmark for one million instruction in the FS mode. In SE mode I used -I 1000000 . Any help would be appreciated. Best Regards
------------------------------------------------------------------------
*From:* Dimitrios Chasapis <dchas...@bsc.es> <mailto:dchas...@bsc.es>
*Sent:* Thursday, January 9, 2020 5:39:51 PM
*To:* gem5 users mailing list <gem5-users@gem5.org> <mailto:gem5-users@gem5.org>; ABD ALRHMAN ABO ALKHEEL <abdkeel...@hotmail.com> <mailto:abdkeel...@hotmail.com>
*Subject:* Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode

Hi,

Here is an example of an .rcs script.  As Ciro told you, first you need to have a bootable image, optionally create a checkpoint after boot and finally add the benchmarks to the cd image.

#/bin/bash
cd /your/path/SPEC_CPU_2017/benchspec/CPU/627.cam4_s/run/run_base_refspeed_aarch64-64.0000
/sbin/m5 dumpresetstats
/yourpath/SPEC_CPU_2017/benchspec/CPU/627.cam4_s/exe/cam4_s_base.aarch64-64
/sbin/m5 exit

In the example above you simply cd to the directory of the benchmark you want to use and then run it. /sbin/m5 dumperesetstats resets your statistics counters and exit is used to finish the execution. Note I use spec 2017, which I found that it's best to run directly as I do above than use their infrastructure.  Problem is that FS is too slow and you waste a lot of time running their python scripts.  Also, I would encourage you to learn about simpoints <http://gem5.org/Simpoints> if you plan on running SPEC CPU 2006 with anything more than the test inputs.  Running with ref will take days/weeks.

Best,

Dimitrios Chasapis


On 1/9/20 6:03 PM, Ciro Santilli wrote:
The linked documentation runs an arbitrary benchmark of your choice.
You just have to add SPEC CPU to the image yourself as explained
there. I can't fully automate SPEC CPU build because it is closed source.


On Thu, Jan 9, 2020 at 3:10 PM ABD ALRHMAN ABO ALKHEEL
<abdkeel...@hotmail.com>  <mailto:abdkeel...@hotmail.com>  wrote:
Thanks Ciro, I appreciate your help. Can you provide me an example on .rcs 
script to run the benchmark. Any help would be appreciated. Best Regards 
________________________________
From: Ciro Santilli<ciro.santi...@gmail.com>  <mailto:ciro.santi...@gmail.com>
Sent: Thursday, January 9, 2020 9:52:28 AM
To: gem5 users mailing list<gem5-users@gem5.org>  
<mailto:gem5-users@gem5.org>;abdkeel...@hotmail.com  <mailto:abdkeel...@hotmail.com>  
<abdkeel...@hotmail.com>  <mailto:abdkeel...@hotmail.com>
Subject: Re: [gem5-users] Run CPU 2006 benchmark on gem5 fs mode

1. get Linux to boot, e.g.:
https://github.com/cirosantilli/linux-kernel-module-cheat/tree/657c59249e56d861bb0a437a1b1c757797281910#gem5-buildroot-setup
2. learn to checkpoint at the end of boot, restore, and run an
executable afterwards, e.g.:
https://github.com/cirosantilli/linux-kernel-module-cheat/tree/657c59249e56d861bb0a437a1b1c757797281910#gem5-run-benchmark
3. learn to add your own files to the image, e.g.:
https://github.com/cirosantilli/linux-kernel-module-cheat/tree/657c59249e56d861bb0a437a1b1c757797281910#add-new-files-to-the-buildroot-image

On Thu, Jan 9, 2020 at 1:43 AM ABD ALRHMAN ABO ALKHEEL
<abdkeel...@hotmail.com>  <mailto:abdkeel...@hotmail.com>  wrote:
Hello all, I wanna run benchmark on the gem5 in FS mode. Any help would be 
appreciated. Best Regards
_______________________________________________
gem5-users mailing list
gem5-users@gem5.org  <mailto:gem5-users@gem5.org>
http://m5sim.org/cgi-bin/mailman/listinfo/gem5-users
_______________________________________________
gem5-users mailing list
gem5-users@gem5.org  <mailto:gem5-users@gem5.org>
http://m5sim.org/cgi-bin/mailman/listinfo/gem5-users


WARNING / LEGAL TEXT: This message is intended only for the use of the individual or entity to which it is addressed and may contain information which is privileged, confidential, proprietary, or exempt from disclosure under applicable law. If you are not the intended recipient or the person responsible for delivering the message to the intended recipient, you are strictly prohibited from disclosing, distributing, copying, or in any way using this message. If you have received this communication in error, please notify the sender and destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer


WARNING / LEGAL TEXT: This message is intended only for the use of the individual or entity to which it is addressed and may contain information which is privileged, confidential, proprietary, or exempt from disclosure under applicable law. If you are not the intended recipient or the person responsible for delivering the message to the intended recipient, you are strictly prohibited from disclosing, distributing, copying, or in any way using this message. If you have received this communication in error, please notify the sender and destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer


WARNING / LEGAL TEXT: This message is intended only for the use of the individual or entity to which it is addressed and may contain information which is privileged, confidential, proprietary, or exempt from disclosure under applicable law. If you are not the intended recipient or the person responsible for delivering the message to the intended recipient, you are strictly prohibited from disclosing, distributing, copying, or in any way using this message. If you have received this communication in error, please notify the sender and destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer


WARNING / LEGAL TEXT: This message is intended only for the use of the individual or entity to which it is addressed and may contain information which is privileged, confidential, proprietary, or exempt from disclosure under applicable law. If you are not the intended recipient or the person responsible for delivering the message to the intended recipient, you are strictly prohibited from disclosing, distributing, copying, or in any way using this message. If you have received this communication in error, please notify the sender and destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer


WARNING / LEGAL TEXT: This message is intended only for the use of the individual or entity to which it is addressed and may contain information which is privileged, confidential, proprietary, or exempt from disclosure under applicable law. If you are not the intended recipient or the person responsible for delivering the message to the intended recipient, you are strictly prohibited from disclosing, distributing, copying, or in any way using this message. If you have received this communication in error, please notify the sender and destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.


http://bsc.es/disclaimer
_______________________________________________
gem5-users mailing list
gem5-users@gem5.org
http://m5sim.org/cgi-bin/mailman/listinfo/gem5-users

Reply via email to