Re: [QE-users] [neb.x] How to lessen I/O?

2021-03-24 Thread Takahiro Chiba
Thank you Giannozzi, I will watch the issue at gitlab. ---Sender--- Takahiro Chiba Undergraduate at Hokkaido University Expected graduation date: Mar. 2021 Expected to be a graduate student at HU from Apr. 2021 takahiro_ch...@eis.hokudai.ac.jp - 2021年3月22日(月) 21:48 Paolo Giannozzi : > > Yes,

Re: [QE-users] [neb.x] How to lessen I/O?

2021-03-22 Thread Paolo Giannozzi
Yes, a fast file system. NFS via Ethernet may still be usable as long as you do not have heavy or frequent I/O. Writing via NFS is especially slow. For your information: https://gitlab.com/QEF/q-e/-/issues/299 Paolo On Mon, Mar 22, 2021 at 10:15 AM Takahiro Chiba < takahiro_ch...@eis.hokudai.ac.

Re: [QE-users] [neb.x] How to lessen I/O?

2021-03-22 Thread Takahiro Chiba
Dear Dr. Giannozzi, By the expression "parallel file system", you meant fast file systems such as LUSTRE, not NFS via ethernet, right? ---Sender--- Takahiro Chiba Undergraduate at Hokkaido University Expected graduation date: Mar. 2021 Expected to be a graduate student at HU from Apr. 2021 takahi

Re: [QE-users] [neb.x] How to lessen I/O?

2021-03-18 Thread Paolo Giannozzi
On Thu, Mar 18, 2021 at 6:59 PM Paolo Giannozzi wrote: The "wfcdir"" option is no longer implemented, if I remember correctly. > I didn't remember correctly: it is still implemented. As I mentioned earlier, though, it is expected to work only for a subset of all possible use cases. In particula

Re: [QE-users] [neb.x] How to lessen I/O?

2021-03-18 Thread Paolo Giannozzi
On Wed, Mar 17, 2021 at 12:21 PM Takahiro Chiba < takahiro_ch...@eis.hokudai.ac.jp> wrote: > 1. Regardless of the existence of the wfcdir option, wavefunctions > from each MPI processes (pwscf.wfc1, pwscf.wfc2, pwscf.wfc3, ... > pwscf.wfc$ProcPerNode) are written under 'outdir' except for the fir

Re: [QE-users] [neb.x] How to lessen I/O?

2021-03-17 Thread Takahiro Chiba
Dear users, P.S. to the previous post: 1. To execute with multiple machines, outdir needs to be NFS-mounted in order to be visible from all processes. 2. In nowf case, wavefunction files exist, but 0KB in size. ---Sender--- Mr. Takahiro Chiba Undergraduate at Hokkaido University Expected gradua

[QE-users] [neb.x] How to lessen I/O?

2021-03-17 Thread Takahiro Chiba
Dear QE users, To lessen I/O with neb.x, what should I do? The 'outdir' grows really fast. I want advice from experienced users or devs. Issue: Although the image parallelism (neb.x -ni $NumOfNodes) is scaling well with the number of nodes even with gigabit ethernet, massive I/O to 'outdir' is ob