[gem5-users] Re: RENAME: HELP Needed for Running Benchmarks in GPU Full System Simulation

[Matt Sinclair via gem5-users]

Just to add to this: to the best of my knowledge online compilation in
OpenCL is not supported in gem5 outside of KVM (which does that compilation
on the real CPU).  I don't think it just increases simulation time -- I
think it just throws an error.

Matt

On Tue, Jan 2, 2024 at 1:37 PM Poremba, Matthew via gem5-users <
gem5-users@gem5.org> wrote:

> [Public]
>
> Hi Sandy,
>
>
>
>
>
> Depending on the benchmark, OpenCL might do an online compile (i.e.,
> compile the kernels right before running them).  If you are using KVM it
> should just work.  Otherwise, the online compilation will take a
> significant amount of simulation time and offline compiling would be
> preferred (i.e., compile the kernels offline on the disk image).
>
>
>
>
>
> -Matt
>
>
>
> *From:* 关富润 via gem5-users 
> *Sent:* Saturday, December 23, 2023 7:44 PM
> *To:* gem5-users 
> *Cc:* 关富润 <448367...@qq.com>
> *Subject:* [gem5-users] RENAME: HELP Needed for Running Benchmarks in GPU
> Full System Simulation
>
>
>
> *Caution:* This message originated from an External Source. Use proper
> caution when opening attachments, clicking links, or responding.
>
>
>
> Dear all,
>
> I am currently engaged in GPU full system simulation using gem5 and am at
> a stage where I seek to run benchmark suites, specifically Rodinia and
> PolyBench. I have observed that both of these benchmark suites support
> compilation for OpenCL architecture, and I have a few questions regarding
> the compilation and execution process within the gem5 environment. Compilation
> Framework: Should I compile these benchmarks under the OpenCL framework?
> Is this the recommended approach for compatibility with the gem5 GPU full
> system simulation?
>
>
>
> Utilizing ROCm in gem5: I noticed that the ROCm installed in the gpu-fs
> docker image includes OpenCL compilation tools. Is it feasible to directly
> compile these benchmarks within this environment? Are there any specific
> considerations or steps that I should be aware of? Guidance and
> Documentation: Would anyone be able to provide guidance or point me
> towards documentation on how to properly set up and execute these
> benchmarks in the gem5 GPU full system simulation context?
>
>
>
> Thank you in advance for your time and assistance. I look forward to any
> suggestions or guidance you can offer.
>
>
>
> Best regards,
>
> Sandy.
> ___
> gem5-users mailing list -- gem5-users@gem5.org
> To unsubscribe send an email to gem5-users-le...@gem5.org
>
___
gem5-users mailing list -- gem5-users@gem5.org
To unsubscribe send an email to gem5-users-le...@gem5.org

[gem5-users] Re: RENAME: HELP Needed for Running Benchmarks in GPU Full System Simulation

[Poremba, Matthew via gem5-users]

[Public]

Hi Sandy,


Depending on the benchmark, OpenCL might do an online compile (i.e., compile 
the kernels right before running them).  If you are using KVM it should just 
work.  Otherwise, the online compilation will take a significant amount of 
simulation time and offline compiling would be preferred (i.e., compile the 
kernels offline on the disk image).


-Matt

From: 关富润 via gem5-users 
Sent: Saturday, December 23, 2023 7:44 PM
To: gem5-users 
Cc: 关富润 <448367...@qq.com>
Subject: [gem5-users] RENAME: HELP Needed for Running Benchmarks in GPU Full 
System Simulation

Caution: This message originated from an External Source. Use proper caution 
when opening attachments, clicking links, or responding.

Dear all,
I am currently engaged in GPU full system simulation using gem5 and am at a 
stage where I seek to run benchmark suites, specifically Rodinia and PolyBench. 
I have observed that both of these benchmark suites support compilation for 
OpenCL architecture, and I have a few questions regarding the compilation and 
execution process within the gem5 environment. Compilation Framework: Should I 
compile these benchmarks under the OpenCL framework? Is this the recommended 
approach for compatibility with the gem5 GPU full system simulation?


Utilizing ROCm in gem5: I noticed that the ROCm installed in the gpu-fs docker 
image includes OpenCL compilation tools. Is it feasible to directly compile 
these benchmarks within this environment? Are there any specific considerations 
or steps that I should be aware of? Guidance and Documentation: Would anyone be 
able to provide guidance or point me towards documentation on how to properly 
set up and execute these benchmarks in the gem5 GPU full system simulation 
context?


Thank you in advance for your time and assistance. I look forward to any 
suggestions or guidance you can offer.



Best regards,

Sandy.
___
gem5-users mailing list -- gem5-users@gem5.org
To unsubscribe send an email to gem5-users-le...@gem5.org

[gem5-users] Re: 回复：Re: Fail to run gpu-fs

[Poremba, Matthew via gem5-users]

[Public]

Hi Sandy,


The docker image to build GPU applications and the disk image were not updated 
in sync.  Therefore, the docker image will build for ROCm 5 but the disk image 
is for ROCm 4.  You will need to follow the instructions to create a ROCm 5 
disk image here:  https://github.com/gem5/gem5-resources/pull/12 .  That will 
hopefully be merged soon and become the default.


-Matt

From: 关富润 via gem5-users 
Sent: Tuesday, December 19, 2023 7:04 PM
To: The gem5 Users mailing list 
Cc: 关富润 <448367...@qq.com>
Subject: [gem5-users] 回复：Re: Fail to run gpu-fs

Caution: This message originated from an External Source. Use proper caution 
when opening attachments, clicking links, or responding.

Thanks for the ad, Firstly, I want to express my gratitude for your previous 
advice regarding the use of 'sudo'. It effectively resolved the issue I was 
facing earlier. After implementing it, I was able to successfully create the 
disk-image using packer, which was a significant breakthrough.
However, during the disk-image creation process, I observed numerous red font 
warnings from qemu, and I'm uncertain if these might affect subsequent 
emulation tasks. I'd appreciate any insights you might have on this. 
Additionally, I've encountered a new challenge. Following the steps in the 
README, I executed the command: sudo build/VEGA_X86/gem5.opt 
configs/example/gpufs/vega10_kvm.py --disk-image 
../gem5-resources/src/gpu-fs/disk-image/rocm42/rocm42-image/rocm42 --kernel 
../gem5-resources/src/gpu-fs/vmlinux-5.4.0-105-generic --gpu-mmio-trace 
../gem5-resources/src/gpu-fs/vega_mmio.log --app 
../gem5-resources/src/gpu/square/bin/square Unfortunately, this resulted in an 
error. The specific error message form the system.pc.com_1.device was: [ 
4.694416] amdgpu :00:08.0: amdgpu: ring page1 uses VM inv eng 5 on hub 1 [ 
4.733771] [drm] Initialized amdgpu 3.41.0 20150101 for :00:08.0 on minor 0 
Running ../gem5-resources/src/gpu/square/bin/square ./myapp: error while 
loading shared libraries: libamdhip64.so.5: cannot open shared object file: No 
such file or directory

This seems to suggest a missing shared library file. I am wondering if this 
issue could be a result of the disk-image creation process, and how I might go 
about resolving it. Any guidance or suggestions you could provide would be 
immensely helpful.

Thank you once again for your support and looking forward to your advice.
Best regards, Sandy

-- 原始邮件 --
发件人: "The gem5 Users mailing list" 
mailto:gem5-users@gem5.org>>;
发送时间: 2023年12月20日(星期三) 上午6:54
收件人: "The gem5 Users mailing 
list"mailto:gem5-users@gem5.org>>;
抄送: "Pau Galindo 
Figuerola"mailto:pau.galindo.figuer...@estudiantat.upc.edu>>;
主题: [gem5-users] Re: Fail to run gpu-fs

Hi,

It might seem dumb but I faced a similar issue where vega10_atomic worked and 
vega10_kvm not and the fix was typing 'sudo' at the beginning of the command.

Hope it works!

Regards,
Pau

El mar, 19 dic 2023 18:57, Poremba, Matthew via gem5-users 
mailto:gem5-users@gem5.org>> escribió:

[AMD Official Use Only - General]

Hi Sandy,


Could you share the file “m5out/system.pc.com_1.device” as well?

You could also try using vega10_atomic.py instead of vega10_kvm.py.  Initially 
it looks to me like a KVM issue.


-Matt

From: Matt Sinclair 
mailto:mattdsinclair.w...@gmail.com>>
Sent: Tuesday, December 19, 2023 9:28 AM
To: The gem5 Users mailing list 
mailto:gem5-users@gem5.org>>
Cc: 关富润 <448367...@qq.com>; Poremba, Matthew 
mailto:matthew.pore...@amd.com>>; VISHNU RAMADAS 
mailto:vrama...@wisc.edu>>
Subject: Re: [gem5-users] Fail to run gpu-fs

Caution: This message originated from an External Source. Use proper caution 
when opening attachments, clicking links, or responding.

Hi Sandy,

Can you please give us a bit more information about what you were running?  It 
looks like you were just trying to run square from the README?  Normally that 
works out of the box, so I'm wondering if you made any changes to your local 
setup.

(I am not the primary developer for GPUFS, but am trying to help)

Thanks,
Matt

On Tue, Dec 19, 2023 at 5:16 AM 关富润 via gem5-users 
mailto:gem5-users@gem5.org>> wrote:
Dear all，
I've encountered while performing a gpu-fs simulation using the gem5 simulator. 
Following the instructions outlined in the 
https://github.com/gem5/gem5-resources/blob/stable/src/gpu-fs/README.md, and 
using the disk image obtained from 
https://www.gem5.org/2023/02/13/moving-to-full-system-gpu.html, I executed the 
following command:
build/VEGA_X86/gem5.opt configs/example/gpufs/vega10_kvm.py --disk-image 
../gem5-resources/src/gpu-fs/disk-image/rocm42/rocm42-image/rocm42 --kernel 
../gem5-resources/src/gpu-fs/vmlinux-5.4.0-105-generic --gpu-mmio-trace 
../gem5-resources/src/gpu-fs/vega_mmio.log --app 
../gem5-resources/src/gpu/square/bin/square During the execution, I encountered 
multiple warning messages related to unsupported MSR (Model Specific Regi

[gem5-users] Re: importing packages like numpy

[saras nanda via gem5-users]

I am using atomic cpu model ,chekcpointed the system after the boot , I am
also trying to import this library , using atomic CPU model again so that I
can checkpoint it once its loaded but it does not even after this , its
been running for 3-4 days now but has been stuck at this import line

I also tried this method of kernel-init
./build/ARM/gem5.opt configs/example/arm/fs_bigLITTLE.py
--kernel=/home/saras/gem5-resources/src/arm-ubuntu/gem5/full_system_images/binaries/vmlinux.arm64
--disk=/home/saras/gem5-resources/src/arm-ubuntu/gem5/full_system_images/disks/arm64-ubuntu-server.img
--caches --cpu-type=atomic --kernel-init=/bin/bash

To speed up the boot up

And it is successful however the import numpy statement takes forever to
run

Regards
Saras

On Tue, Jan 2, 2024 at 9:35 AM Eliot Moss  wrote:

> On 1/2/2024 9:28 AM, saras nanda via gem5-users wrote:
> > Hi Everyone ,
> >
> > I am doing a full system simulation on ARM using fs_bigLITTLE.py and
> fs_power.py , I am trying to import numpy library
> > in my python script but it takes 3-4 days and is still running but the
> library is not imported , how can I speedup this
> > , once I import I can checkpoint but somehow its very slow and takes a
> really long time.please provide me some
> > suggestions on this.
>
> You can run to checkpoint using a simple and fast cpu model,
> such as the atomic simple cpu.  Then you can run after checkpoint
> with a more complex cpu model.  Of course, the system may already
> be doing that for you.
>
> Another possible issue is whether you're firing up a gazillion
> server processes in the OS.  Trimming down the boot sequence
> helped me save a lot.
>
> HTH
>
> Eliot Moss
>
>
___
gem5-users mailing list -- gem5-users@gem5.org
To unsubscribe send an email to gem5-users-le...@gem5.org

[gem5-users] Re: importing packages like numpy

[Eliot Moss via gem5-users]

On 1/2/2024 9:28 AM, saras nanda via gem5-users wrote:

Hi Everyone ,

I am doing a full system simulation on ARM using fs_bigLITTLE.py and fs_power.py , I am trying to import numpy library 
in my python script but it takes 3-4 days and is still running but the library is not imported , how can I speedup this 
, once I import I can checkpoint but somehow its very slow and takes a really long time.please provide me some 
suggestions on this.


You can run to checkpoint using a simple and fast cpu model,
such as the atomic simple cpu.  Then you can run after checkpoint
with a more complex cpu model.  Of course, the system may already
be doing that for you.

Another possible issue is whether you're firing up a gazillion
server processes in the OS.  Trimming down the boot sequence
helped me save a lot.

HTH

Eliot Moss
___
gem5-users mailing list -- gem5-users@gem5.org
To unsubscribe send an email to gem5-users-le...@gem5.org

[gem5-users] importing packages like numpy

[saras nanda via gem5-users]

Hi Everyone ,

I am doing a full system simulation on ARM using fs_bigLITTLE.py and
fs_power.py , I am trying to import numpy library in my python script but
it takes 3-4 days and is still running but the library is not imported ,
how can I speedup this , once I import I can checkpoint but somehow its
very slow and takes a really long time.please provide me some suggestions
on this.

Thank you in advance

Regards
Srinija
___
gem5-users mailing list -- gem5-users@gem5.org
To unsubscribe send an email to gem5-users-le...@gem5.org