Re: [petsc-dev] hypre and CUDA

2019-08-15 Thread Karl Rupp via petsc-dev

Hi,

one way to test is to run a sequential example through nv-prof:
 $> nvprof ./ex56 ...

https://devblogs.nvidia.com/cuda-pro-tip-nvprof-your-handy-universal-gpu-profiler/

If it uses the GPU, then you will get some information on the GPU 
kernels called. If it doesn't use the GPU, the list will be (almost) empty.


Best regards,
Karli



On 8/15/19 5:47 PM, Mark Adams via petsc-dev wrote:
I have configured with Hypre on SUMMIT, with cuda, and it ran. I'm now 
trying to verify that it used GPUs (I doubt it). Any ideas on how to 
verify this? Should I use the cuda vecs and mats, or does Hypre not 
care. Can I tell hypre not to use GPUs other than configuring an 
non-cude PETSc? I'm not sure how to run a job without GPUs, but I will 
look into it.


Mark


Re: [petsc-dev] hypre and CUDA

2019-08-15 Thread Mark Adams via petsc-dev
On Thu, Aug 15, 2019 at 2:34 PM Smith, Barry F.  wrote:

>
>   Mark,
>
>I don't know how one uses it; we don't yet have an option in hypre.py
> to turn it on.
>

Any ideas about when this might get done?


>
>You should just use regular PETSc matrices and vectors, not CUDA ones.
> Hypre manages all that stuff internally for itsetl.
>
>I don't know how one knows if hypre is using the GPU or not, there are
> some Nvidia profiling tools for tracking GPU usage, perhaps you can use
> those to see if it says the GPU is being used.
>

I have just been timing it. It is very slow. 3x slower than GAMG/CPU and
20x slower than GAMG/GPU. But Hypers parameters tend to be optimized for 2D
and I have not optimized parameters. But clearly its not using GPUs.


>
>Barry
>
>
> > On Aug 15, 2019, at 10:47 AM, Mark Adams via petsc-dev <
> petsc-dev@mcs.anl.gov> wrote:
> >
> > I have configured with Hypre on SUMMIT, with cuda, and it ran. I'm now
> trying to verify that it used GPUs (I doubt it). Any ideas on how to verify
> this? Should I use the cuda vecs and mats, or does Hypre not care. Can I
> tell hypre not to use GPUs other than configuring an non-cude PETSc? I'm
> not sure how to run a job without GPUs, but I will look into it.
> >
> > Mark
>
>


Re: [petsc-dev] hypre and CUDA

2019-08-15 Thread Smith, Barry F. via petsc-dev


  Mark,

   I don't know how one uses it; we don't yet have an option in hypre.py to 
turn it on. 

   You should just use regular PETSc matrices and vectors, not CUDA ones. Hypre 
manages all that stuff internally for itsetl.

   I don't know how one knows if hypre is using the GPU or not, there are some 
Nvidia profiling tools for tracking GPU usage, perhaps you can use those to see 
if it says the GPU is being used.

   Barry


> On Aug 15, 2019, at 10:47 AM, Mark Adams via petsc-dev 
>  wrote:
> 
> I have configured with Hypre on SUMMIT, with cuda, and it ran. I'm now trying 
> to verify that it used GPUs (I doubt it). Any ideas on how to verify this? 
> Should I use the cuda vecs and mats, or does Hypre not care. Can I tell hypre 
> not to use GPUs other than configuring an non-cude PETSc? I'm not sure how to 
> run a job without GPUs, but I will look into it.
> 
> Mark



[petsc-dev] hypre and CUDA

2019-08-15 Thread Mark Adams via petsc-dev
I have configured with Hypre on SUMMIT, with cuda, and it ran. I'm now
trying to verify that it used GPUs (I doubt it). Any ideas on how to verify
this? Should I use the cuda vecs and mats, or does Hypre not care. Can I
tell hypre not to use GPUs other than configuring an non-cude PETSc? I'm
not sure how to run a job without GPUs, but I will look into it.

Mark