Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1
Am 05.08.2014 um 18:56 schrieb Woodruff, Robert J : > Although we did add backports for RHEL 7 into OFED-3.5-2-MIC, we only tested > the core components, MPI, and IPoIB and not NFS/RDMA or SRP, > so there may be issues with NFS/RMDA that will have to wait till OFED-3.12-1 > to get resolved. Thanks for the info. We’ll just stay on CentOS 6.5 for the time being. Steffen > > From: ewg-boun...@lists.openfabrics.org > [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Jeff Becker > Sent: Tuesday, August 05, 2014 9:49 AM > To: Steffen Müthing; Cheng, Wendy > Cc: ewg@lists.openfabrics.org > Subject: Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1 > > Hello, > > I do the OFED distro ports for NFSRDMA. It will be supported on CENTOS 7 in > OFED 3.12.1 (coming soon). Not sure how this relates to MPSS/OFED. > > -jeff > > On 08/05/2014 09:07 AM, Steffen Müthing wrote: > Hi Wendy, > > thanks for the response! > > Am 05.08.2014 um 18:04 schrieb Cheng, Wendy : > > Did you mount the NFS share on MIC or on host ? Be aware that 3.3 MPSS/OFED > does not support NFS/RDMA yet; that is, mounting NFS/RDMA on MIC is NOT > supported at this moment. > > I’m aware of that restriction. I was just mounting a host-exported share on a > different host. > > Steffen > > > -- Wendy > > -Original Message- > From: ewg-boun...@lists.openfabrics.org [mailto:ewg- > boun...@lists.openfabrics.org] On Behalf Of Steffen Müthing > Sent: Tuesday, August 05, 2014 2:39 AM > To: ewg@lists.openfabrics.org > Subject: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2- > rc1 > > Hi, > > I'm trying to get the new 3.3 MPSS stack to work together with OFED-MIC- > 3.5-2-rc1 on CentOS 7, but I've run into a problem with NFS/RDMA: While I > can mount file systems and traverse them, I cannot access any files larger > than about 800 bytes. Trying to cat such a file results in errors like > this: > > cat: gcc.lua: Input/output error > > or, when copying: > > [root@node01 files]# cp test.txt /tmp > cp: error reading 'test.txt': Input/output error > cp: failed to extend '/tmp/test.txt': Input/output error > [root@node01 files]# > > At the same time, trying to write a file that is larger than 800 bytes to a > server > running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5 > server works just fine (I just can't access the data afterwards). > > On the other hand, exporting an NFS share on a CentOS 7 server and > mounting it on a CentOS 6.5 client works without any problem. > > We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are > currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone > have an idea of what might be going wrong here? > > Thank you! > > Steffen Müthing > > --- > > Steffen Müthing > Interdisciplinary Center for Scientific Computing Heidelberg University > > Im Neuenheimer Feld 368 > 69120 Heidelberg > Germany > > +49 6221 54 > steffen.mueth...@iwr.uni-heidelberg.de > > > > > ___ > ewg mailing list > ewg@lists.openfabrics.org > http://lists.openfabrics.org/mailman/listinfo/ewg > > > > > > ___ > ewg mailing list > ewg@lists.openfabrics.org > http://lists.openfabrics.org/mailman/listinfo/ewg > signature.asc Description: Message signed with OpenPGP using GPGMail ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1
Although we did add backports for RHEL 7 into OFED-3.5-2-MIC, we only tested the core components, MPI, and IPoIB and not NFS/RDMA or SRP, so there may be issues with NFS/RMDA that will have to wait till OFED-3.12-1 to get resolved. From: ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Jeff Becker Sent: Tuesday, August 05, 2014 9:49 AM To: Steffen Müthing; Cheng, Wendy Cc: ewg@lists.openfabrics.org Subject: Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1 Hello, I do the OFED distro ports for NFSRDMA. It will be supported on CENTOS 7 in OFED 3.12.1 (coming soon). Not sure how this relates to MPSS/OFED. -jeff On 08/05/2014 09:07 AM, Steffen Müthing wrote: Hi Wendy, thanks for the response! Am 05.08.2014 um 18:04 schrieb Cheng, Wendy <mailto:wendy.ch...@intel.com>: Did you mount the NFS share on MIC or on host ? Be aware that 3.3 MPSS/OFED does not support NFS/RDMA yet; that is, mounting NFS/RDMA on MIC is NOT supported at this moment. I'm aware of that restriction. I was just mounting a host-exported share on a different host. Steffen -- Wendy -Original Message- From: ewg-boun...@lists.openfabrics.org<mailto:ewg-boun...@lists.openfabrics.org> [mailto:ewg- boun...@lists.openfabrics.org<mailto:boun...@lists.openfabrics.org>] On Behalf Of Steffen Müthing Sent: Tuesday, August 05, 2014 2:39 AM To: ewg@lists.openfabrics.org<mailto:ewg@lists.openfabrics.org> Subject: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2- rc1 Hi, I'm trying to get the new 3.3 MPSS stack to work together with OFED-MIC- 3.5-2-rc1 on CentOS 7, but I've run into a problem with NFS/RDMA: While I can mount file systems and traverse them, I cannot access any files larger than about 800 bytes. Trying to cat such a file results in errors like this: cat: gcc.lua: Input/output error or, when copying: [root@node01 files]# cp test.txt /tmp cp: error reading 'test.txt': Input/output error cp: failed to extend '/tmp/test.txt': Input/output error [root@node01 files]# At the same time, trying to write a file that is larger than 800 bytes to a server running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5 server works just fine (I just can't access the data afterwards). On the other hand, exporting an NFS share on a CentOS 7 server and mounting it on a CentOS 6.5 client works without any problem. We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone have an idea of what might be going wrong here? Thank you! Steffen Müthing --- Steffen Müthing Interdisciplinary Center for Scientific Computing Heidelberg University Im Neuenheimer Feld 368 69120 Heidelberg Germany +49 6221 54 steffen.mueth...@iwr.uni-heidelberg.de<mailto:steffen.mueth...@iwr.uni-heidelberg.de> ___ ewg mailing list ewg@lists.openfabrics.org<mailto:ewg@lists.openfabrics.org> http://lists.openfabrics.org/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org<mailto:ewg@lists.openfabrics.org> http://lists.openfabrics.org/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1
Hello, I do the OFED distro ports for NFSRDMA. It will be supported on CENTOS 7 in OFED 3.12.1 (coming soon). Not sure how this relates to MPSS/OFED. -jeff On 08/05/2014 09:07 AM, Steffen Müthing wrote: Hi Wendy, thanks for the response! Am 05.08.2014 um 18:04 schrieb Cheng, Wendy : Did you mount the NFS share on MIC or on host ? Be aware that 3.3 MPSS/OFED does not support NFS/RDMA yet; that is, mounting NFS/RDMA on MIC is NOT supported at this moment. I'm aware of that restriction. I was just mounting a host-exported share on a different host. Steffen -- Wendy -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Steffen Müthing Sent: Tuesday, August 05, 2014 2:39 AM To: ewg@lists.openfabrics.org Subject: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2- rc1 Hi, I'm trying to get the new 3.3 MPSS stack to work together with OFED-MIC- 3.5-2-rc1 on CentOS 7, but I've run into a problem with NFS/RDMA: While I can mount file systems and traverse them, I cannot access any files larger than about 800 bytes. Trying to cat such a file results in errors like this: cat: gcc.lua: Input/output error or, when copying: [root@node01 files]# cp test.txt /tmp cp: error reading 'test.txt': Input/output error cp: failed to extend '/tmp/test.txt': Input/output error [root@node01 files]# At the same time, trying to write a file that is larger than 800 bytes to a server running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5 server works just fine (I just can't access the data afterwards). On the other hand, exporting an NFS share on a CentOS 7 server and mounting it on a CentOS 6.5 client works without any problem. We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone have an idea of what might be going wrong here? Thank you! Steffen Müthing --- Steffen Müthing Interdisciplinary Center for Scientific Computing Heidelberg University Im Neuenheimer Feld 368 69120 Heidelberg Germany +49 6221 54 steffen.mueth...@iwr.uni-heidelberg.de ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1
Hi Wendy, thanks for the response! Am 05.08.2014 um 18:04 schrieb Cheng, Wendy : > Did you mount the NFS share on MIC or on host ? Be aware that 3.3 MPSS/OFED > does not support NFS/RDMA yet; that is, mounting NFS/RDMA on MIC is NOT > supported at this moment. I’m aware of that restriction. I was just mounting a host-exported share on a different host. Steffen > > -- Wendy > >> -Original Message- >> From: ewg-boun...@lists.openfabrics.org [mailto:ewg- >> boun...@lists.openfabrics.org] On Behalf Of Steffen Müthing >> Sent: Tuesday, August 05, 2014 2:39 AM >> To: ewg@lists.openfabrics.org >> Subject: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2- >> rc1 >> >> Hi, >> >> I'm trying to get the new 3.3 MPSS stack to work together with OFED-MIC- >> 3.5-2-rc1 on CentOS 7, but I've run into a problem with NFS/RDMA: While I >> can mount file systems and traverse them, I cannot access any files larger >> than about 800 bytes. Trying to cat such a file results in errors like >> this: >> >> cat: gcc.lua: Input/output error >> >> or, when copying: >> >> [root@node01 files]# cp test.txt /tmp >> cp: error reading 'test.txt': Input/output error >> cp: failed to extend '/tmp/test.txt': Input/output error >> [root@node01 files]# >> >> At the same time, trying to write a file that is larger than 800 bytes to a >> server >> running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5 >> server works just fine (I just can't access the data afterwards). >> >> On the other hand, exporting an NFS share on a CentOS 7 server and >> mounting it on a CentOS 6.5 client works without any problem. >> >> We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are >> currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone >> have an idea of what might be going wrong here? >> >> Thank you! >> >> Steffen Müthing >> >> --- >> >> Steffen Müthing >> Interdisciplinary Center for Scientific Computing Heidelberg University >> >> Im Neuenheimer Feld 368 >> 69120 Heidelberg >> Germany >> >> +49 6221 54 >> steffen.mueth...@iwr.uni-heidelberg.de >> >> >> >> >> ___ >> ewg mailing list >> ewg@lists.openfabrics.org >> http://lists.openfabrics.org/mailman/listinfo/ewg > signature.asc Description: Message signed with OpenPGP using GPGMail ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1
Did you mount the NFS share on MIC or on host ? Be aware that 3.3 MPSS/OFED does not support NFS/RDMA yet; that is, mounting NFS/RDMA on MIC is NOT supported at this moment. -- Wendy > -Original Message- > From: ewg-boun...@lists.openfabrics.org [mailto:ewg- > boun...@lists.openfabrics.org] On Behalf Of Steffen Müthing > Sent: Tuesday, August 05, 2014 2:39 AM > To: ewg@lists.openfabrics.org > Subject: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2- > rc1 > > Hi, > > I'm trying to get the new 3.3 MPSS stack to work together with OFED-MIC- > 3.5-2-rc1 on CentOS 7, but I've run into a problem with NFS/RDMA: While I > can mount file systems and traverse them, I cannot access any files larger > than about 800 bytes. Trying to cat such a file results in errors like > this: > > cat: gcc.lua: Input/output error > > or, when copying: > > [root@node01 files]# cp test.txt /tmp > cp: error reading 'test.txt': Input/output error > cp: failed to extend '/tmp/test.txt': Input/output error > [root@node01 files]# > > At the same time, trying to write a file that is larger than 800 bytes to a > server > running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5 > server works just fine (I just can't access the data afterwards). > > On the other hand, exporting an NFS share on a CentOS 7 server and > mounting it on a CentOS 6.5 client works without any problem. > > We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are > currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone > have an idea of what might be going wrong here? > > Thank you! > > Steffen Müthing > > --- > > Steffen Müthing > Interdisciplinary Center for Scientific Computing Heidelberg University > > Im Neuenheimer Feld 368 > 69120 Heidelberg > Germany > > +49 6221 54 > steffen.mueth...@iwr.uni-heidelberg.de > > > > > ___ > ewg mailing list > ewg@lists.openfabrics.org > http://lists.openfabrics.org/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg
[ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1
Hi, I’m trying to get the new 3.3 MPSS stack to work together with OFED-MIC-3.5-2-rc1 on CentOS 7, but I’ve run into a problem with NFS/RDMA: While I can mount file systems and traverse them, I cannot access any files larger than about 800 bytes. Trying to cat such a file results in errors like this: cat: gcc.lua: Input/output error or, when copying: [root@node01 files]# cp test.txt /tmp cp: error reading ‘test.txt’: Input/output error cp: failed to extend ‘/tmp/test.txt’: Input/output error [root@node01 files]# At the same time, trying to write a file that is larger than 800 bytes to a server running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5 server works just fine (I just can’t access the data afterwards). On the other hand, exporting an NFS share on a CentOS 7 server and mounting it on a CentOS 6.5 client works without any problem. We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone have an idea of what might be going wrong here? Thank you! Steffen Müthing --- Steffen Müthing Interdisciplinary Center for Scientific Computing Heidelberg University Im Neuenheimer Feld 368 69120 Heidelberg Germany +49 6221 54 steffen.mueth...@iwr.uni-heidelberg.de ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/mailman/listinfo/ewg
