Re: [petsc-dev] PETSc amg solver with gpu seems run slowly

2022-03-28 Thread Jed Brown
You can run on AMD GPUs now with -dm_vec_type kokkos -dm_mat_type aijkokkos, for example. GAMG works that way, with the PtAP setup on device. If you use MatSetValuesCOO, then matrix assembly is also entirely on-device. Justin Chang writes: > Hi Qi, Mark, > > My colleague Suyash Tandon has almo

Re: [petsc-dev] PETSc amg solver with gpu seems run slowly

2022-03-28 Thread Justin Chang
Hi Qi, Mark, My colleague Suyash Tandon has almost completed a PETSc HIP port (essentially a hipification of the CUDA port) and has been trying to test it on the same OpenFOAM 3D Lid-driven case. It would be interesting to see what the optimal HYPRE parameters are as we could experiment from the A

Re: [petsc-dev] PETSc amg solver with gpu seems run slowly

2022-03-28 Thread Qi Yang
Hi Mark, Sure, I will try a 3D Lid-driven case by combining OpenFOAM, PETSc and HYPRE, let's see what would happen. Kind regards, Qi On Mon, Mar 28, 2022 at 11:04 PM Mark Adams wrote: > Hi Qi, these are good discussions and data and we like to share, so let's > keep this on the list. > > * I w

Re: [petsc-dev] PETSc amg solver with gpu seems run slowly

2022-03-28 Thread Mark Adams
Hi Qi, these are good discussions and data and we like to share, so let's keep this on the list. * I would suggest you use a 3D test. This is more relevant to what HPC applications do. * In my experience, hypre's default parameters are tuned for 2D low order problems like this so I would start wit