Re: [OMPI users] stdout scrambled in file

2021-12-18 Thread Ralph Castain via users
___ > From: users on behalf of Fisher (US), Mark > S via users > Sent: Monday, December 6, 2021 3:45 PM > To: Joachim Protze; Open MPI Users > Cc: Fisher (US), Mark S > Subject: Re: [OMPI users] stdout scrambled in file > > This usual

Re: [OMPI users] stdout scrambled in file

2021-12-07 Thread Jeff Squyres (jsquyres) via users
m: users on behalf of Fisher (US), Mark S via users Sent: Monday, December 6, 2021 3:45 PM To: Joachim Protze; Open MPI Users Cc: Fisher (US), Mark S Subject: Re: [OMPI users] stdout scrambled in file This usually happens if we get a number of warning message from multiple processes. Seems

Re: [OMPI users] stdout scrambled in file

2021-12-06 Thread Fisher (US), Mark S via users
Protze Sent: Monday, December 06, 2021 11:12 AM To: Fisher (US), Mark S ; Open MPI Users Subject: Re: [OMPI users] stdout scrambled in file I would assume, that the buffering mode is compiler/runtime specific. At least for Intel compiler, the default seems to be/have been unbuffered for

Re: [OMPI users] stdout scrambled in file

2021-12-06 Thread Joachim Protze via users
: Joachim Protze Sent: Monday, December 6, 2021 9:24 AM To: Open MPI Users Cc: Fisher (US), Mark S Subject: Re: [OMPI users] stdout scrambled in file Hi Mark, "[...] MPI makes neither requirements nor recommendations for the output [...]" (MPI4.0, §2.9.1) From my experience, an appli

Re: [OMPI users] stdout scrambled in file

2021-12-06 Thread Fisher (US), Mark S via users
Message- From: Joachim Protze Sent: Monday, December 6, 2021 9:24 AM To: Open MPI Users Cc: Fisher (US), Mark S Subject: Re: [OMPI users] stdout scrambled in file Hi Mark, "[...] MPI makes neither requirements nor recommendations for the output [...]" (MPI4.0, §2.9.1) From my

Re: [OMPI users] stdout scrambled in file

2021-12-06 Thread Joachim Protze via users
Hi Mark, "[...] MPI makes neither requirements nor recommendations for the output [...]" (MPI4.0, §2.9.1) From my experience, an application can avoid such scrambling (still no guarantee), if the output of lines is written atomically. C++ streams are worst for concurrent output, as every str

Re: [OMPI users] stdout scrambled in file

2021-12-06 Thread Fisher (US), Mark S via users
5, 2021 2:48 PM To: Open MPI Users Cc: Ralph Castain Subject: [EXTERNAL] Re: [OMPI users] stdout scrambled in file EXT email: be mindful of links/attachments. There are several output-controlling options - e.g., you could redirect the output from each process to its own file or directory

Re: [OMPI users] stdout scrambled in file

2021-12-05 Thread Ralph Castain via users
<mailto:users@lists.open-mpi.org> Cc: Fisher (US), Mark S Subject: [OMPI users] stdout scrambled in file We are using Mellanox HPC-X MPI based on OpenMPI 4.1.1RC1 and having issues with lines scrambling together occasionally. This causes issues our convergence checking code since we put conv

Re: [OMPI users] stdout scrambled in file

2021-12-05 Thread Gus Correa via users
> > -- > Jeff Squyres > jsquy...@cisco.com > > > From: users on behalf of Fisher (US), > Mark S via users > Sent: Thursday, December 2, 2021 10:48 AM > To: users@lists.open-mpi.org > Cc: Fisher (US), Mark S > Subject: [OM

Re: [OMPI users] stdout scrambled in file

2021-12-05 Thread Jeff Squyres (jsquyres) via users
mpi.org Cc: Fisher (US), Mark S Subject: [OMPI users] stdout scrambled in file We are using Mellanox HPC-X MPI based on OpenMPI 4.1.1RC1 and having issues with lines scrambling together occasionally. This causes issues our convergence checking code since we put convergence data there. We are not

[OMPI users] stdout scrambled in file

2021-12-02 Thread Fisher (US), Mark S via users
We are using Mellanox HPC-X MPI based on OpenMPI 4.1.1RC1 and having issues with lines scrambling together occasionally. This causes issues our convergence checking code since we put convergence data there. We are not using any mpirun options for stdout we just redirect stdout/stderr to a file b