Re: [petsc-users] Error with VecDestroy_MPIFFTW+0x61

2019-04-15 Thread Smith, Barry F. via petsc-users
> On Apr 15, 2019, at 6:57 PM, Matthew Knepley wrote: > > On Mon, Apr 15, 2019 at 2:44 PM Smith, Barry F. wrote: > > There are two distinct issues here. > > 1) the use of fftw_malloc(). This is a relatively minor issue. This is > causing the crash in the code because VecDuplicate()

Re: [petsc-users] Link broken for: PETSc users manual - pdf (fully searchable with hyperlinks)

2019-04-15 Thread Balay, Satish via petsc-users
Looks like the manual didn't get generated correctly for petsc-3.11.1. For now - I've restored the 3.11 manual - so the URL should work now. Satish On Mon, 15 Apr 2019, Xiang Huang via petsc-users wrote: > http://www.mcs.anl.gov/petsc/petsc-current/docs/manual.pdf > > Error 404 > The web

Re: [petsc-users] Error with VecDestroy_MPIFFTW+0x61

2019-04-15 Thread Smith, Barry F. via petsc-users
There are two distinct issues here. 1) the use of fftw_malloc(). This is a relatively minor issue. This is causing the crash in the code because VecDuplicate() uses PetscMalloc() to obtain the array but when the array is freed fftw_malloc() is called on it. 2) the padding that FFTW needs

Re: [petsc-users] Bad memory scaling with PETSc 3.10

2019-04-15 Thread Zhang, Hong via petsc-users
Myriam: Thank you very much for providing these results! I have put effort to accelerate execution time and avoid using global sizes in PtAP, for which the algorithm of transpose of P_local and P_other likely doubles the memory usage. I'll try to investigate why it becomes unscalable. Hong Hi,

Re: [petsc-users] Error with VecDestroy_MPIFFTW+0x61

2019-04-15 Thread Sajid Ali via petsc-users
Hi Barry & Matt, I'd be happy to contribute a patch once I understand what's going on. @Matt, Where is the padding occurring? In the VecCreateFFTW I see that each process looks up the dimension of array it's supposed to hold and asks for memory to hold that via fftw_malloc (which as you say is

Re: [petsc-users] Bad memory scaling with PETSc 3.10

2019-04-15 Thread Myriam Peyrounette via petsc-users
Hi, you'll find the new scaling attached (green line). I used the version 3.11 and the four scalability options : -matptap_via scalable -inner_diag_matmatmult_via scalable -inner_offdiag_matmatmult_via scalable -mat_freeintermediatedatastructures The scaling is much better! The code even uses