Thanks Dave for your reply.
For sure PETSc is awesome :D
Yes, in both cases petsc was configured with --with-debugging=0 and
fortunately I do have the old and new -log-veiw outputs which I attached.
Best,
Mohammad
On Tue, Mar 23, 2021 at 1:37 AM Dave May <[email protected]> wrote:
> Nice to hear!
> The answer is simple, PETSc is awesome :)
>
> Jokes aside, assuming both petsc builds were configured with
> —with-debugging=0, I don’t think there is a definitive answer to your
> question with the information you provided.
>
> It could be as simple as one specific implementation you use was improved
> between petsc releases. Not being an Ubuntu expert, the change might be
> associated with using a different compiler, and or a more efficient BLAS
> implementation (non threaded vs threaded). However I doubt this is the
> origin of your 2x performance increase.
>
> If you really want to understand where the performance improvement
> originated from, you’d need to send to the email list the result of
> -log_view from both the old and new versions, running the exact same
> problem.
>
> From that info, we can see what implementations in PETSc are being used
> and where the time reduction is occurring. Knowing that, it should be
> clearer to provide an explanation for it.
>
>
> Thanks,
> Dave
>
>
> On Tue 23. Mar 2021 at 06:24, Mohammad Gohardoust <[email protected]>
> wrote:
>
>> Hi,
>>
>> I am using a code which is based on petsc (and also parmetis). Recently I
>> made the following changes and now the code is running about two times
>> faster than before:
>>
>> - Upgraded Ubuntu 18.04 to 20.04
>> - Upgraded petsc 3.13.4 to 3.14.5
>> - This time I installed parmetis and metis directly via petsc by
>> --download-parmetis --download-metis flags instead of installing them
>> separately and using --with-parmetis-include=... and
>> --with-parmetis-lib=... (the version of installed parmetis was 4.0.3
>> before)
>>
>> I was wondering what can possibly explain this speedup? Does anyone have
>> any suggestions?
>>
>> Thanks,
>> Mohammad
>>
>
************************************************************************************************************************
*** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document ***
************************************************************************************************************************
---------------------------------------------- PETSc Performance Summary: ----------------------------------------------
/home/mohammad/Programs/parswms_v1.30/parswms on a arch-linux-c-opt named mohammad-box with 16 processors, by mohammad Mon Mar 22 22:10:51 2021
Using Petsc Release Version 3.14.5, unknown
Max Max/Min Avg Total
Time (sec): 2.353e+02 1.000 2.353e+02
Objects: 1.194e+04 1.000 1.194e+04
Flop: 1.062e+10 1.215 9.958e+09 1.593e+11
Flop/sec: 4.513e+07 1.215 4.232e+07 6.771e+08
MPI Messages: 1.770e+06 2.863 9.871e+05 1.579e+07
MPI Message Lengths: 1.512e+09 2.537 9.827e+02 1.552e+10
MPI Reductions: 1.777e+05 1.000
Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract)
e.g., VecAXPY() for real vectors of length N --> 2N flop
and VecAXPY() for complex vectors of length N --> 8N flop
Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions --
Avg %Total Avg %Total Count %Total Avg %Total Count %Total
0: Main Stage: 5.4095e+00 2.3% 4.3700e+03 0.0% 4.764e+05 3.0% 3.135e+02 1.0% 2.244e+04 12.6%
1: Solute_Assembly: 1.3977e+02 59.4% 7.3353e+09 4.6% 3.263e+06 20.7% 1.278e+03 26.9% 1.059e+04 6.0%
2: Solute_Solve: 5.7144e+00 2.4% 5.1093e+10 32.1% 2.924e+06 18.5% 7.478e+02 14.1% 5.291e+04 29.8%
3: Water_Assembly: 7.3978e+01 31.4% 1.6183e+10 10.2% 4.744e+06 30.0% 1.214e+03 37.1% 1.874e+04 10.5%
4: Water_Solve: 1.0431e+01 4.4% 8.4711e+10 53.2% 4.387e+06 27.8% 7.420e+02 21.0% 7.300e+04 41.1%
------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on interpreting output.
Phase summary info:
Count: number of times phase was executed
Time and Flop: Max - maximum over all processors
Ratio - ratio of maximum to minimum over all processors
Mess: number of messages sent
AvgLen: average message length (bytes)
Reduct: number of global reductions
Global: entire computation
Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop().
%T - percent time in this phase %F - percent flop in this phase
%M - percent messages in this phase %L - percent message lengths in this phase
%R - percent reductions in this phase
Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors)
------------------------------------------------------------------------------------------------------------------------
Event Count Time (sec) Flop --- Global --- --- Stage ---- Total
Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------
--- Event Stage 0: Main Stage
BuildTwoSided 3532 1.0 1.0642e+0026.7 0.00e+00 0.0 1.0e+02 4.0e+00 3.5e+03 0 0 0 0 2 11 0 0 0 16 0
BuildTwoSidedF 3531 1.0 1.0667e+0025.3 0.00e+00 0.0 0.0e+00 0.0e+00 3.5e+03 0 0 0 0 2 11 0 0 0 16 0
VecScatterBegin 3533 1.0 3.0379e-02 2.0 0.00e+00 0.0 3.6e+05 3.5e+02 0.0e+00 0 0 2 1 0 0 0 75 83 0 0
VecScatterEnd 3533 1.0 1.1214e-02 1.6 4.54e+02 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0100 0 0 0 0
SFSetGraph 1 1.0 3.3379e-06 7.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFSetUp 1 1.0 2.2888e-04 1.4 0.00e+00 0.0 2.0e+02 8.9e+01 1.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFBcastOpBegin 3532 1.0 2.8479e-02 2.1 0.00e+00 0.0 3.6e+05 3.5e+02 0.0e+00 0 0 2 1 0 0 0 75 83 0 0
SFBcastOpEnd 3532 1.0 8.1592e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFReduceBegin 1 1.0 4.6015e-05 1.9 0.00e+00 0.0 1.0e+02 3.5e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFReduceEnd 1 1.0 1.5073e-03191.6 4.54e+02 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0100 0 0 0 3
SFPack 3533 1.0 2.3899e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 3533 1.0 3.7878e-03 2.7 4.54e+02 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0100 0 0 0 1
MatAssemblyBegin 3531 1.0 1.0774e+0020.0 0.00e+00 0.0 0.0e+00 0.0e+00 3.5e+03 0 0 0 0 2 12 0 0 0 16 0
MatAssemblyEnd 3531 1.0 5.3182e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 1: Solute_Assembly
BuildTwoSided 3531 1.0 2.8025e+0026.3 0.00e+00 0.0 3.6e+05 4.0e+00 3.5e+03 1 0 2 0 2 1 0 11 0 33 0
BuildTwoSidedF 3531 1.0 2.8678e+0013.2 0.00e+00 0.0 7.1e+05 3.6e+03 3.5e+03 1 0 5 17 2 1 0 22 62 33 0
VecScatterBegin 7062 1.0 7.1911e-02 1.9 0.00e+00 0.0 7.1e+05 3.5e+02 0.0e+00 0 0 5 2 0 0 0 22 6 0 0
VecScatterEnd 7062 1.0 2.1248e-01 3.0 1.60e+06 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 73
SFBcastOpBegin 3531 1.0 2.6516e-02 2.4 0.00e+00 0.0 3.6e+05 3.5e+02 0.0e+00 0 0 2 1 0 0 0 11 3 0 0
SFBcastOpEnd 3531 1.0 9.5041e-02 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFReduceBegin 3531 1.0 3.8955e-02 2.1 0.00e+00 0.0 3.6e+05 3.5e+02 0.0e+00 0 0 2 1 0 0 0 11 3 0 0
SFReduceEnd 3531 1.0 1.3791e-01 3.9 1.60e+06 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 112
SFPack 7062 1.0 6.5591e-03 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 7062 1.0 7.4186e-03 2.1 1.60e+06 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2080
MatAssemblyBegin 3531 1.0 4.7846e+00 1.1 0.00e+00 0.0 7.1e+05 3.6e+03 3.5e+03 2 0 5 17 2 3 0 22 62 33 0
MatAssemblyEnd 3531 1.0 1.5468e+00 2.7 1.68e+07 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 2 0 0 0 104
MatZeroEntries 3531 1.0 3.0998e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 2: Solute_Solve
VecMDot 24688 1.0 1.0809e+00 2.8 4.82e+08 1.2 0.0e+00 0.0e+00 2.5e+04 0 5 0 0 14 13 14 0 0 47 6659
VecNorm 28219 1.0 2.6753e-01 1.1 9.61e+07 1.2 0.0e+00 0.0e+00 2.8e+04 0 1 0 0 16 5 3 0 0 53 5366
VecScale 28033 1.0 2.3884e-02 1.5 4.77e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 29854
VecCopy 3531 1.0 1.1024e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 6876 1.0 1.8580e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 3345 1.0 5.1932e-03 1.5 1.14e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 32767
VecMAXPY 28033 1.0 8.1569e-02 1.2 5.66e+08 1.2 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 1 17 0 0 0 103667
VecScatterBegin 28219 1.0 2.6222e-01 2.0 0.00e+00 0.0 2.9e+06 7.5e+02 0.0e+00 0 0 19 14 0 3 0100100 0 0
VecScatterEnd 28219 1.0 9.2789e-01 3.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 10 0 0 0 0 0
SFBcastOpBegin 28219 1.0 2.4878e-01 2.0 0.00e+00 0.0 2.9e+06 7.5e+02 0.0e+00 0 0 19 14 0 3 0100100 0 0
SFBcastOpEnd 28219 1.0 9.1971e-01 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 10 0 0 0 0 0
SFPack 28219 1.0 3.7499e-02 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 28219 1.0 7.5884e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatMult 24688 1.0 1.6074e+00 1.4 1.12e+09 1.2 2.6e+06 8.0e+02 0.0e+00 1 11 16 13 0 23 33 88 94 0 10618
MatSOR 24688 1.0 1.5189e+00 1.2 1.10e+09 1.3 0.0e+00 0.0e+00 0.0e+00 1 10 0 0 0 25 31 0 0 0 10568
KSPSetUp 3531 1.0 1.3194e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPSolve 3531 1.0 3.9245e+00 1.0 3.41e+09 1.2 2.6e+06 8.0e+02 5.3e+04 2 32 16 13 30 69100 88 94100 13019
KSPGMRESOrthog 24688 1.0 1.1539e+00 2.5 9.63e+08 1.2 0.0e+00 0.0e+00 2.5e+04 0 9 0 0 14 14 28 0 0 47 12478
PCSetUp 3531 1.0 8.1897e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
PCApply 24688 1.0 1.5278e+00 1.2 1.10e+09 1.3 0.0e+00 0.0e+00 0.0e+00 1 10 0 0 0 25 31 0 0 0 10507
--- Event Stage 3: Water_Assembly
BuildTwoSided 17548 1.0 4.9331e+00 9.9 0.00e+00 0.0 5.9e+05 4.0e+00 1.8e+04 1 0 4 0 10 4 0 12 0 94 0
BuildTwoSidedF 17547 1.0 5.0489e+00 7.3 0.00e+00 0.0 1.2e+06 3.6e+03 1.8e+04 1 0 7 27 10 4 0 25 74 94 0
VecSet 1 1.0 2.3842e-06 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecScatterBegin 35094 1.0 3.0171e-01 2.0 0.00e+00 0.0 3.6e+06 4.2e+02 0.0e+00 0 0 23 10 0 0 0 75 26 0 0
VecScatterEnd 35094 1.0 1.0165e+01 3.4 2.66e+06 2.7 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 7 0 0 0 0 3
SFSetGraph 1 1.0 1.1921e-06 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFSetUp 1 1.0 1.1373e-04 1.5 0.00e+00 0.0 2.1e+02 2.0e+02 1.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFBcastOpBegin 29245 1.0 2.2571e-01 2.1 0.00e+00 0.0 3.0e+06 4.4e+02 0.0e+00 0 0 19 8 0 0 0 63 23 0 0
SFBcastOpEnd 29245 1.0 3.8333e+0015.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 3 0 0 0 0 0
SFReduceBegin 5849 1.0 6.6611e-02 2.1 0.00e+00 0.0 5.9e+05 3.5e+02 0.0e+00 0 0 4 1 0 0 0 12 4 0 0
SFReduceEnd 5849 1.0 7.3741e+00 6.3 2.66e+06 2.7 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 4 0 0 0 0 3
SFPack 35094 1.0 2.9744e-02 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 35094 1.0 2.7862e-02 2.1 2.66e+06 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 917
MatMult 5849 1.0 1.9439e+00 3.7 2.64e+08 1.2 6.1e+05 8.0e+02 0.0e+00 1 3 4 3 0 2 25 13 8 0 2080
MatAssemblyBegin 17547 1.0 8.8252e+00 1.1 0.00e+00 0.0 1.2e+06 3.6e+03 1.8e+04 4 0 7 27 10 11 0 25 74 94 0
MatAssemblyEnd 17547 1.0 2.6903e+00 2.8 2.79e+07 2.7 2.1e+02 2.0e+02 1.0e+01 1 0 0 0 0 2 2 0 0 0 99
MatZeroEntries 5848 1.0 5.0946e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 4: Water_Solve
VecMDot 30652 1.0 1.2650e+00 2.6 4.82e+08 1.2 0.0e+00 0.0e+00 3.1e+04 0 5 0 0 17 8 9 0 0 42 5700
VecNorm 42350 1.0 8.9660e-01 2.0 1.44e+08 1.2 0.0e+00 0.0e+00 4.2e+04 0 1 0 0 24 6 3 0 0 58 2403
VecScale 36501 1.0 2.2763e-02 1.3 6.21e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 40787
VecCopy 5849 1.0 1.2470e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 48198 1.0 6.2513e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0
VecAXPY 11697 1.0 1.2462e-02 1.3 3.98e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 47748
VecMAXPY 36500 1.0 8.1806e-02 1.2 5.87e+08 1.2 0.0e+00 0.0e+00 0.0e+00 0 6 0 0 0 1 10 0 0 0 107230
VecScatterBegin 42350 1.0 3.8240e-01 1.8 0.00e+00 0.0 4.4e+06 7.4e+02 0.0e+00 0 0 28 21 0 3 0100100 0 0
VecScatterEnd 42350 1.0 1.5626e+00 3.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0
VecNormalize 36501 1.0 8.1323e-01 1.9 1.86e+08 1.2 0.0e+00 0.0e+00 3.7e+04 0 2 0 0 21 5 3 0 0 50 3425
SFBcastOpBegin 42350 1.0 3.6255e-01 1.9 0.00e+00 0.0 4.4e+06 7.4e+02 0.0e+00 0 0 28 21 0 2 0100100 0 0
SFBcastOpEnd 42350 1.0 1.5502e+00 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0
SFPack 42350 1.0 4.6472e-02 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 42350 1.0 9.7978e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatMult 36501 1.0 2.5198e+00 1.4 1.65e+09 1.2 3.8e+06 8.0e+02 0.0e+00 1 16 24 20 0 20 30 87 94 0 10015
MatSolve 42350 1.0 2.1073e+00 1.2 1.80e+09 1.3 0.0e+00 0.0e+00 0.0e+00 1 17 0 0 0 19 31 0 0 0 12487
MatLUFactorNum 5849 1.0 1.8509e+00 1.2 8.91e+08 1.2 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 16 16 0 0 0 7295
MatILUFactorSym 1 1.0 1.6952e-04 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatGetRowIJ 1 1.0 4.7684e-07 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatGetOrdering 1 1.0 2.1935e-05 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPSetUp 11698 1.0 2.2082e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPSolve 5849 1.0 7.6610e+00 1.0 5.66e+09 1.2 3.8e+06 8.0e+02 7.3e+04 3 53 24 20 41 73100 87 94100 11057
KSPGMRESOrthog 30652 1.0 1.3376e+00 2.4 9.65e+08 1.2 0.0e+00 0.0e+00 3.1e+04 0 9 0 0 17 9 17 0 0 42 10783
PCSetUp 11698 1.0 1.8751e+00 1.2 8.91e+08 1.2 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 17 16 0 0 0 7200
PCSetUpOnBlocks 5849 1.0 1.8700e+00 1.2 8.91e+08 1.2 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 16 16 0 0 0 7220
PCApply 42350 1.0 2.2370e+00 1.2 1.80e+09 1.3 0.0e+00 0.0e+00 0.0e+00 1 17 0 0 0 20 31 0 0 0 11763
------------------------------------------------------------------------------------------------------------------------
Memory usage is given in bytes:
Object Type Creations Destructions Memory Descendants' Mem.
Reports information only for process 0.
--- Event Stage 0: Main Stage
Vec Scatter 1 2 1600 0.
Vector 6 213 1856320 0.
Index Set 2 5 24400 0.
IS L to G Mapping 1 1 7840 0.
Star Forest Graph 1 2 2272 0.
Matrix 3 4 655196 0.
Krylov Solver 2 3 85744 0.
Preconditioner 2 3 2792 0.
Viewer 1 0 0 0.
--- Event Stage 1: Solute_Assembly
--- Event Stage 2: Solute_Solve
Vector 136 0 0 0.
--- Event Stage 3: Water_Assembly
Vec Scatter 1 0 0 0.
Vector 2 1 1696 0.
Index Set 2 2 3592 0.
Star Forest Graph 1 0 0 0.
--- Event Stage 4: Water_Solve
Vector 11768 11698 102942400 0.
Index Set 3 0 0 0.
Matrix 1 0 0 0.
Krylov Solver 1 0 0 0.
Preconditioner 1 0 0 0.
========================================================================================================================
Average time to get PetscTime(): 7.15256e-08
Average time for MPI_Barrier(): 5.43594e-06
Average time for zero size MPI_Send(): 1.92225e-06
#PETSc Option Table entries:
-log_view :run6.py:ascii_info
#End of PETSc Option Table entries
Compiled without FORTRAN kernels
Compiled with full precision matrices (default)
sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4
Configure options: --with-cc=gcc --with-cxx=g++ --with-cxx-dialect=C++11 --with-fc=gfortran --with-debugging=0 COPTFLAGS="-Ofast -march=native -mtune=native" CXXOPTFLAGS="-Ofast -march=native -mtune=native" FOPTFLAGS="-Ofast -march=native -mtune=native" --download-mpich --download-fblaslapack --download-openblas --download-scalapack --download-hwloc --download-parmetis --download-metis --download-hypre
-----------------------------------------
Libraries compiled on 2021-03-23 02:59:39 on mohammad-box
Machine characteristics: Linux-5.4.0-67-generic-x86_64-with-glibc2.29
Using PETSc directory: /home/mohammad/Programs/petsc
Using PETSc arch: arch-linux-c-opt
-----------------------------------------
Using C compiler: /home/mohammad/Programs/petsc/arch-linux-c-opt/bin/mpicc -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -fstack-protector -fvisibility=hidden -Ofast -march=native -mtune=native
Using Fortran compiler: /home/mohammad/Programs/petsc/arch-linux-c-opt/bin/mpif90 -Wall -ffree-line-length-0 -Wno-unused-dummy-argument -Ofast -march=native -mtune=native
-----------------------------------------
Using include paths: -I/home/mohammad/Programs/petsc/include -I/home/mohammad/Programs/petsc/arch-linux-c-opt/include
-----------------------------------------
Using C linker: /home/mohammad/Programs/petsc/arch-linux-c-opt/bin/mpicc
Using Fortran linker: /home/mohammad/Programs/petsc/arch-linux-c-opt/bin/mpif90
Using libraries: -Wl,-rpath,/home/mohammad/Programs/petsc/arch-linux-c-opt/lib -L/home/mohammad/Programs/petsc/arch-linux-c-opt/lib -lpetsc -Wl,-rpath,/home/mohammad/Programs/petsc/arch-linux-c-opt/lib -L/home/mohammad/Programs/petsc/arch-linux-c-opt/lib -Wl,-rpath,/usr/lib/gcc/x86_64-linux-gnu/9 -L/usr/lib/gcc/x86_64-linux-gnu/9 -Wl,-rpath,/usr/lib/x86_64-linux-gnu -L/usr/lib/x86_64-linux-gnu -Wl,-rpath,/lib/x86_64-linux-gnu -L/lib/x86_64-linux-gnu -lHYPRE -lscalapack -lflapack -lfblas -lopenblas -lpthread -lhwloc -lparmetis -lmetis -lm -lstdc++ -ldl -lmpifort -lmpi -lgfortran -lm -lgfortran -lm -lgcc_s -lquadmath -lstdc++ -ldl
-----------------------------------------
************************************************************************************************************************
*** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document ***
************************************************************************************************************************
---------------------------------------------- PETSc Performance Summary: ----------------------------------------------
/home/mohammad/Programs/parswms_v1.23/parswms on a arch-linux-c-opt named mohammad-box with 16 processors, by mohammad Thu Mar 18 10:17:51 2021
Using Petsc Release Version 3.13.4, Aug 01, 2020
Max Max/Min Avg Total
Time (sec): 4.968e+02 1.000 4.968e+02
Objects: 1.206e+04 1.000 1.206e+04
Flop: 1.146e+10 1.299 1.090e+10 1.745e+11
Flop/sec: 2.307e+07 1.299 2.195e+07 3.512e+08
MPI Messages: 1.567e+06 2.430 1.041e+06 1.665e+07
MPI Message Lengths: 1.480e+09 2.328 9.751e+02 1.624e+10
MPI Reductions: 1.905e+05 1.000
Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract)
e.g., VecAXPY() for real vectors of length N --> 2N flop
and VecAXPY() for complex vectors of length N --> 8N flop
Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions --
Avg %Total Avg %Total Count %Total Avg %Total Count %Total
0: Main Stage: 1.1983e+01 2.4% 4.3910e+03 0.0% 4.855e+05 2.9% 3.105e+02 0.9% 2.260e+04 11.9%
1: Solute_Assembly: 2.7291e+02 54.9% 7.3824e+09 4.2% 3.310e+06 19.9% 1.270e+03 25.9% 1.066e+04 5.6%
2: Solute_Solve: 2.6166e+01 5.3% 5.7899e+10 33.2% 3.208e+06 19.3% 7.622e+02 15.1% 5.821e+04 30.6%
3: Water_Assembly: 1.4651e+02 29.5% 1.6364e+10 9.4% 4.878e+06 29.3% 1.196e+03 35.9% 1.893e+04 9.9%
4: Water_Solve: 3.9189e+01 7.9% 9.2834e+10 53.2% 4.772e+06 28.7% 7.558e+02 22.2% 8.005e+04 42.0%
------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on interpreting output.
Phase summary info:
Count: number of times phase was executed
Time and Flop: Max - maximum over all processors
Ratio - ratio of maximum to minimum over all processors
Mess: number of messages sent
AvgLen: average message length (bytes)
Reduct: number of global reductions
Global: entire computation
Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop().
%T - percent time in this phase %F - percent flop in this phase
%M - percent messages in this phase %L - percent message lengths in this phase
%R - percent reductions in this phase
Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors)
------------------------------------------------------------------------------------------------------------------------
Event Count Time (sec) Flop --- Global --- --- Stage ---- Total
Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------
--- Event Stage 0: Main Stage
BuildTwoSided 3553 1.0 3.6706e+00 3.7 0.00e+00 0.0 1.0e+02 4.0e+00 3.6e+03 0 0 0 0 2 20 0 0 0 16 0
BuildTwoSidedF 3552 1.0 3.6785e+00 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 3.6e+03 0 0 0 0 2 20 0 0 0 16 0
VecScatterBegin 3554 1.0 3.1640e-01 2.0 0.00e+00 0.0 3.7e+05 3.4e+02 0.0e+00 0 0 2 1 0 2 0 75 83 0 0
VecScatterEnd 3554 1.0 2.9531e-02 1.5 4.42e+02 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0100 0 0 0 0
SFSetGraph 1 1.0 4.5300e-06 6.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFSetUp 1 1.0 1.6975e-03 3.6 0.00e+00 0.0 2.1e+02 8.7e+01 1.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFBcastOpBegin 3553 1.0 3.1073e-01 2.1 0.00e+00 0.0 3.7e+05 3.4e+02 0.0e+00 0 0 2 1 0 2 0 75 83 0 0
SFBcastOpEnd 3553 1.0 2.0800e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFReduceBegin 1 1.0 1.3566e-04 1.8 0.00e+00 0.0 1.0e+02 3.4e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFReduceEnd 1 1.0 2.2776e-0353.7 4.42e+02 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0100 0 0 0 2
SFPack 3554 1.0 5.2617e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 3554 1.0 9.5730e-03 2.3 4.42e+02 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0100 0 0 0 0
MatAssemblyBegin 3552 1.0 3.7102e+00 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 3.6e+03 0 0 0 0 2 21 0 0 0 16 0
MatAssemblyEnd 3552 1.0 1.4350e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 1: Solute_Assembly
BuildTwoSided 3552 1.0 6.6943e+00 2.7 0.00e+00 0.0 3.7e+05 4.0e+00 3.6e+03 1 0 2 0 2 2 0 11 0 33 0
BuildTwoSidedF 3552 1.0 6.8938e+00 2.5 0.00e+00 0.0 7.3e+05 3.5e+03 3.6e+03 1 0 4 16 2 2 0 22 61 33 0
VecScatterBegin 7104 1.0 6.7192e-01 2.1 0.00e+00 0.0 7.3e+05 3.4e+02 0.0e+00 0 0 4 2 0 0 0 22 6 0 0
VecScatterEnd 7104 1.0 2.1020e+00 4.3 1.57e+06 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 7
SFBcastOpBegin 3552 1.0 3.3262e-01 2.3 0.00e+00 0.0 3.7e+05 3.4e+02 0.0e+00 0 0 2 1 0 0 0 11 3 0 0
SFBcastOpEnd 3552 1.0 7.3998e-01 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFReduceBegin 3552 1.0 3.4026e-01 2.2 0.00e+00 0.0 3.7e+05 3.4e+02 0.0e+00 0 0 2 1 0 0 0 11 3 0 0
SFReduceEnd 3552 1.0 1.4032e+00 5.2 1.57e+06 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 11
SFPack 7104 1.0 1.1835e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 7104 1.0 1.2283e-02 1.3 1.57e+06 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1270
MatAssemblyBegin 3552 1.0 1.0722e+01 1.1 0.00e+00 0.0 7.3e+05 3.5e+03 3.6e+03 2 0 4 16 2 4 0 22 61 33 0
MatAssemblyEnd 3552 1.0 3.5504e+00 2.0 1.62e+07 2.5 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 2 0 0 0 45
MatZeroEntries 3552 1.0 1.4266e-01 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 2: Solute_Solve
VecMDot 27331 1.0 8.2218e+00 1.4 5.72e+08 1.3 0.0e+00 0.0e+00 2.7e+04 1 5 0 0 14 26 15 0 0 47 1055
VecNorm 30883 1.0 6.0506e+00 1.2 1.04e+08 1.3 0.0e+00 0.0e+00 3.1e+04 1 1 0 0 16 20 3 0 0 53 260
VecScale 30697 1.0 6.7509e-02 1.2 5.14e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 11566
VecCopy 3552 1.0 3.4043e-02 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 6918 1.0 5.3823e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 3366 1.0 2.8732e-02 1.8 1.13e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 5960
VecMAXPY 30697 1.0 3.4552e-01 1.5 6.63e+08 1.3 0.0e+00 0.0e+00 0.0e+00 0 6 0 0 0 1 17 0 0 0 29135
VecScatterBegin 30883 1.0 3.0335e+00 2.1 0.00e+00 0.0 3.2e+06 7.6e+02 0.0e+00 0 0 19 15 0 8 0100100 0 0
VecScatterEnd 30883 1.0 3.4145e+00 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 10 0 0 0 0 0
SFBcastOpBegin 30883 1.0 2.9879e+00 2.2 0.00e+00 0.0 3.2e+06 7.6e+02 0.0e+00 0 0 19 15 0 8 0100100 0 0
SFBcastOpEnd 30883 1.0 3.3756e+00 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0
SFPack 30883 1.0 7.3117e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 30883 1.0 1.7570e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatMult 27331 1.0 7.6207e+00 1.4 1.22e+09 1.2 2.8e+06 8.2e+02 0.0e+00 1 11 17 14 0 25 33 89 95 0 2480
MatSOR 27331 1.0 4.1402e+00 1.3 1.19e+09 1.4 0.0e+00 0.0e+00 0.0e+00 1 10 0 0 0 15 31 0 0 0 4285
KSPSetUp 3552 1.0 2.9981e-03 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPSolve 3552 1.0 2.3627e+01 1.0 3.81e+09 1.3 2.8e+06 8.2e+02 5.8e+04 5 33 17 14 31 90100 89 95100 2451
KSPGMRESOrthog 27331 1.0 8.4812e+00 1.4 1.14e+09 1.3 0.0e+00 0.0e+00 2.7e+04 1 10 0 0 14 27 30 0 0 47 2046
PCSetUp 3552 1.0 2.0628e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
PCApply 27331 1.0 4.1689e+00 1.3 1.19e+09 1.4 0.0e+00 0.0e+00 0.0e+00 1 10 0 0 0 15 31 0 0 0 4255
--- Event Stage 3: Water_Assembly
BuildTwoSided 17737 1.0 1.6041e+01 2.3 0.00e+00 0.0 6.1e+05 4.0e+00 1.8e+04 2 0 4 0 9 7 0 12 0 94 0
BuildTwoSidedF 17736 1.0 1.6403e+01 2.2 0.00e+00 0.0 1.2e+06 3.5e+03 1.8e+04 2 0 7 26 9 7 0 25 74 94 0
VecSet 1 1.0 1.6689e-06 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecScatterBegin 35472 1.0 3.7188e+00 2.3 0.00e+00 0.0 3.7e+06 4.2e+02 0.0e+00 1 0 22 9 0 2 0 75 26 0 0
VecScatterEnd 35472 1.0 2.1008e+01 1.9 2.61e+06 2.5 0.0e+00 0.0e+00 0.0e+00 3 0 0 0 0 9 0 0 0 0 1
SFSetGraph 1 1.0 1.9073e-06 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFSetUp 1 1.0 5.5671e-04 1.3 0.00e+00 0.0 2.1e+02 2.1e+02 1.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFBcastOpBegin 29560 1.0 2.9852e+00 2.4 0.00e+00 0.0 3.1e+06 4.4e+02 0.0e+00 0 0 18 8 0 1 0 63 23 0 0
SFBcastOpEnd 29560 1.0 8.3798e+00 2.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 4 0 0 0 0 0
SFReduceBegin 5912 1.0 6.7414e-01 2.0 0.00e+00 0.0 6.1e+05 3.4e+02 0.0e+00 0 0 4 1 0 0 0 12 4 0 0
SFReduceEnd 5912 1.0 1.7996e+01 5.8 2.61e+06 2.5 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 5 0 0 0 0 1
SFPack 35472 1.0 5.7814e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 35472 1.0 5.8718e-02 1.5 2.61e+06 2.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 442
MatMult 5912 1.0 4.2657e+00 2.4 2.64e+08 1.2 6.1e+05 8.2e+02 0.0e+00 1 2 4 3 0 2 25 13 9 0 958
MatAssemblyBegin 17736 1.0 2.2571e+01 1.2 0.00e+00 0.0 1.2e+06 3.5e+03 1.8e+04 4 0 7 26 9 13 0 25 74 94 0
MatAssemblyEnd 17736 1.0 5.4978e+00 2.0 2.70e+07 2.5 2.1e+02 2.1e+02 1.0e+01 1 0 0 0 0 3 2 0 0 0 49
MatZeroEntries 5911 1.0 1.5717e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 4: Water_Solve
VecMDot 34113 1.0 9.5456e+00 1.4 5.71e+08 1.3 0.0e+00 0.0e+00 3.4e+04 2 5 0 0 18 20 9 0 0 43 908
VecNorm 45937 1.0 8.9365e+00 1.1 1.54e+08 1.3 0.0e+00 0.0e+00 4.6e+04 2 1 0 0 24 21 3 0 0 57 262
VecScale 40025 1.0 7.5304e-02 1.1 6.71e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 13520
VecCopy 5912 1.0 3.5429e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 51848 1.0 1.7312e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 11823 1.0 4.0195e-02 1.4 3.96e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 14964
VecMAXPY 40024 1.0 2.3160e-01 1.4 6.86e+08 1.3 0.0e+00 0.0e+00 0.0e+00 0 6 0 0 0 1 11 0 0 0 44921
VecScatterBegin 45937 1.0 4.3219e+00 2.1 0.00e+00 0.0 4.8e+06 7.6e+02 0.0e+00 1 0 29 22 0 8 0100100 0 0
VecScatterEnd 45937 1.0 5.0312e+00 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 9 0 0 0 0 0
VecNormalize 40025 1.0 7.8267e+00 1.1 2.01e+08 1.3 0.0e+00 0.0e+00 4.0e+04 1 2 0 0 21 19 3 0 0 50 390
SFBcastOpBegin 45937 1.0 4.2569e+00 2.2 0.00e+00 0.0 4.8e+06 7.6e+02 0.0e+00 1 0 29 22 0 8 0100100 0 0
SFBcastOpEnd 45937 1.0 4.9762e+00 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 9 0 0 0 0 0
SFPack 45937 1.0 1.0338e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SFUnpack 45937 1.0 2.4770e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatMult 40025 1.0 1.1252e+01 1.5 1.79e+09 1.2 4.2e+06 8.2e+02 0.0e+00 2 16 25 21 0 25 30 87 94 0 2459
MatSolve 45937 1.0 4.3289e+00 1.4 1.91e+09 1.4 0.0e+00 0.0e+00 0.0e+00 1 16 0 0 0 10 31 0 0 0 6585
MatLUFactorNum 5912 1.0 4.0666e+00 1.4 9.19e+08 1.4 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 10 15 0 0 0 3352
MatILUFactorSym 1 1.0 4.9281e-04 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatGetRowIJ 1 1.0 9.0599e-0638.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatGetOrdering 1 1.0 3.7670e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPSetUp 11824 1.0 5.8346e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPSolve 5912 1.0 3.5141e+01 1.0 6.11e+09 1.3 4.2e+06 8.2e+02 8.0e+04 7 53 25 21 42 89100 87 94100 2642
KSPGMRESOrthog 34113 1.0 9.8042e+00 1.4 1.14e+09 1.3 0.0e+00 0.0e+00 3.4e+04 2 10 0 0 18 21 19 0 0 43 1768
PCSetUp 11824 1.0 4.1342e+00 1.4 9.19e+08 1.4 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 10 15 0 0 0 3298
PCSetUpOnBlocks 5912 1.0 4.1298e+00 1.4 9.19e+08 1.4 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 10 15 0 0 0 3301
PCApply 45937 1.0 4.7625e+00 1.3 1.91e+09 1.4 0.0e+00 0.0e+00 0.0e+00 1 16 0 0 0 11 31 0 0 0 5985
------------------------------------------------------------------------------------------------------------------------
Memory usage is given in bytes:
Object Type Creations Destructions Memory Descendants' Mem.
Reports information only for process 0.
--- Event Stage 0: Main Stage
Vec Scatter 1 2 1600 0.
Vector 6 213 1908016 0.
Index Set 2 5 24988 0.
IS L to G Mapping 1 1 8092 0.
Star Forest Graph 1 2 2240 0.
Matrix 3 4 670032 0.
Krylov Solver 2 3 85688 0.
Preconditioner 2 3 2768 0.
Viewer 1 0 0 0.
--- Event Stage 1: Solute_Assembly
--- Event Stage 2: Solute_Solve
Vector 136 0 0 0.
--- Event Stage 3: Water_Assembly
Vec Scatter 1 0 0 0.
Vector 2 1 1688 0.
Index Set 2 2 3832 0.
Star Forest Graph 1 0 0 0.
--- Event Stage 4: Water_Solve
Vector 11894 11824 106936256 0.
Index Set 3 0 0 0.
Matrix 1 0 0 0.
Krylov Solver 1 0 0 0.
Preconditioner 1 0 0 0.
========================================================================================================================
Average time to get PetscTime(): 4.76837e-08
Average time for MPI_Barrier(): 0.000198364
Average time for zero size MPI_Send(): 3.50773e-05
#PETSc Option Table entries:
-log_view :run.py:ascii_info
#End of PETSc Option Table entries
Compiled without FORTRAN kernels
Compiled with full precision matrices (default)
sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4
Configure options: --with-cc=gcc --with-cxx=g++ --with-cxx-dialect=C++11 --with-fc=gfortran --with-debugging=0 COPTFLAGS="-Ofast -march=native -mtune=native" CXXOPTFLAGS="-Ofast -march=native -mtune=native" FOPTFLAGS="-Ofast -march=native -mtune=native" --download-mpich --download-fblaslapack --download-openblas --download-fscalapack --download-hwloc --with-parmetis-include=/home/mohammad/Programs/parmetis-4.0.3/include --with-metis-include=/home/mohammad/Programs/parmetis-4.0.3/metis/include --with-parmetis-lib="[/home/mohammad/Programs/parmetis-4.0.3/build/Linux-x86_64/libparmetis/libparmetis.a]" --with-metis-lib="[/home/mohammad/Programs/parmetis-4.0.3/build/Linux-x86_64/libmetis/libmetis.a]" --download-hypre
-----------------------------------------
Libraries compiled on 2020-08-31 02:14:17 on mohammad-box
Machine characteristics: Linux-4.15.0-112-generic-x86_64-with-Ubuntu-18.04-bionic
Using PETSc directory: /home/mohammad/Programs/petsc-3.13.4
Using PETSc arch: arch-linux-c-opt
-----------------------------------------
Using C compiler: /home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/bin/mpicc -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -fstack-protector -fvisibility=hidden -Ofast -march=native -mtune=native
Using Fortran compiler: /home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/bin/mpif90 -Wall -ffree-line-length-0 -Wno-unused-dummy-argument -Ofast -march=native -mtune=native
-----------------------------------------
Using include paths: -I/home/mohammad/Programs/petsc-3.13.4/include -I/home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/include -I/home/mohammad/Programs/parmetis-4.0.3/include -I/home/mohammad/Programs/parmetis-4.0.3/metis/include
-----------------------------------------
Using C linker: /home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/bin/mpicc
Using Fortran linker: /home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/bin/mpif90
Using libraries: -Wl,-rpath,/home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/lib -L/home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/lib -lpetsc -Wl,-rpath,/home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/lib -L/home/mohammad/Programs/petsc-3.13.4/arch-linux-c-opt/lib -Wl,-rpath,/home/mohammad/Programs/parmetis-4.0.3/build/Linux-x86_64/libparmetis -L/home/mohammad/Programs/parmetis-4.0.3/build/Linux-x86_64/libparmetis -Wl,-rpath,/home/mohammad/Programs/parmetis-4.0.3/build/Linux-x86_64/libmetis -L/home/mohammad/Programs/parmetis-4.0.3/build/Linux-x86_64/libmetis -Wl,-rpath,/usr/lib/gcc/x86_64-linux-gnu/7 -L/usr/lib/gcc/x86_64-linux-gnu/7 -Wl,-rpath,/usr/lib/x86_64-linux-gnu -L/usr/lib/x86_64-linux-gnu -Wl,-rpath,/lib/x86_64-linux-gnu -L/lib/x86_64-linux-gnu -lHYPRE -lflapack -lfblas -lopenblas -lpthread -lhwloc -lparmetis -lmetis -lm -lstdc++ -ldl -lmpifort -lmpi -lgfortran -lm -lgfortran -lm -lgcc_s -lquadmath -lstdc++ -ldl
-----------------------------------------
