Re: [petsc-users] Fieldsplit with sub pc MUMPS in parallel

2017-01-06 Thread Barry Smith
Great, you should be now about to remove the extra options I had you add. > -fieldsplit_0_ksp_type gmres -fieldsplit_0_ksp_pc_side right > -fieldsplit_1_ksp_type gmres -fieldsplit_1_ksp_pc_side right) > On Jan 6, 2017, at 5:17 AM, Karin&NiKo wrote: > > Barry, > > you are goddamn right -

Re: [petsc-users] Fieldsplit with sub pc MUMPS in parallel

2017-01-05 Thread Barry Smith
This is not good. Something is out of whack. First run 1 and 2 processes with -ksp_view_mat binary -ksp_view_rhs binary in each case this will generate a file called binaryoutput . Send both files to petsc-ma...@mcs.anl.gov I want to confirm that the matrices are the same in both c

Re: [petsc-users] Fieldsplit with sub pc MUMPS in parallel

2017-01-05 Thread Barry Smith
> On Jan 5, 2017, at 5:58 AM, Dave May wrote: > > Do you now see identical residual histories for a job using 1 rank and 4 > ranks? Please send the residual histories with the extra options, I'm curious too, because a Krylov method should not be needed in the inner solve, I just asked for

Re: [petsc-users] Fieldsplit with sub pc MUMPS in parallel

2017-01-05 Thread Dave May
Do you now see identical residual histories for a job using 1 rank and 4 ranks? If not, I am inclined to believe that the IS's you are defining for the splits in the parallel case are incorrect. The operator created to approximate the Schur complement with selfp should not depend on the number of

Re: [petsc-users] Fieldsplit with sub pc MUMPS in parallel

2017-01-05 Thread
Dear Barry, dear Dave, THANK YOU! You two pointed out the right problem.By using the options you provided (-fieldsplit_0_ksp_type gmres -fieldsplit_0_ksp_pc_side right -fieldsplit_1_ksp_type gmres -fieldsplit_1_ksp_pc_side right), the solver converges in 3 iterations whatever the size of the commu

Re: [petsc-users] Fieldsplit with sub pc MUMPS in parallel

2017-01-04 Thread Barry Smith
There is something wrong with your set up. 1 process total: nonzeros=140616, allocated nonzeros=140616 total: nonzeros=68940, allocated nonzeros=68940 total: nonzeros=3584, allocated nonzeros=3584 total: nonzeros=1000, allocated nonzeros=1