Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-29 Thread John Hearns
Adding to what Chris said, the RPM libmlx4 contains an /etc/modprobe.d/libmlx4.conf which has: install mlx4_core /sbin/modprobe --ignore-install mlx4_core && (if [ -f /usr/libexec/setup-mlx4.sh -a -f /etc/rdma/mlx4.conf ]; then /usr/libexec/setup-mlx4.sh < /etc/rdma/mlx4.conf; fi; /sbin/modprobe

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-28 Thread Christopher J. Walker
HPC Systems Management Architect >> Lenovo >> >> >> -Original Message- >> From: Christopher J. Walker [mailto:c.j.wal...@qmul.ac.uk] >> Sent: Tuesday, May 19, 2015 5:24 PM >> To: xcat-user@lists.sourceforge.net >> Subject: Re: [xcat-user] xcat genesis ke

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-24 Thread Christopher Samuel
On 22/05/15 09:51, Christopher Samuel wrote: > Interesting, then it might be a different issue we see then as we've not > hit it from RHEL5 through to RHEL6.5, only at RHEL 6.6. Red Hat tell us this bug should be fixed in RHEL 6.7. -- Christopher SamuelSenior Systems Administrator VLS

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-22 Thread Christopher J. Walker
od Johnson > HPC Systems Management Architect > Lenovo > > > -Original Message- > From: Christopher J. Walker [mailto:c.j.wal...@qmul.ac.uk] > Sent: Tuesday, May 19, 2015 5:24 PM > To: xcat-user@lists.sourceforge.net > Subject: Re: [xcat-user] xcat genesis kernel and me

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-21 Thread Christopher Samuel
On 20/05/15 23:12, Jarrod Johnson wrote: > Well, we had done a modprobe rule because the phenomenon you describe > has been on and off the case for some time. Interesting, then it might be a different issue we see then as we've not hit it from RHEL5 through to RHEL6.5, only at RHEL 6.6. -- Chr

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-20 Thread Jarrod Johnson
Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards On 19/05/15 19:50, Jarrod Johnson wrote: > I am starting to guess that you have a VPI adapter that doesn't set the PCI > class to Ethernet.. amending the 98-mlx.rules to remove the criteria for > class may do the trick.

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-20 Thread Jarrod Johnson
day, May 19, 2015 11:17 PM To: xcat-user@lists.sourceforge.net Subject: Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards On 20/05/15 03:50, Christopher J. Walker wrote: > I think what's happening is that although the mlx4_core driver is > being loaded, the mlx4_en isn&

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-19 Thread Guang Cheng Li
北京市海淀区东北旺西路8号中关村软件园28号楼 邮编: 100193 From: Christopher Samuel To: xcat-user@lists.sourceforge.net Date: 2015/05/20 11:20 Subject: Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards On 20/05/15 03:50, Christopher J. Walker wrote: > I think what's happeni

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-19 Thread Christopher Samuel
On 20/05/15 03:50, Christopher J. Walker wrote: > I think what's happening is that although the mlx4_core driver is > being loaded, the mlx4_en isn't - and having pxe/uefi network booted > from the card, it can't see it - hence the node discovery process hanging. Would this be using a RHEL 6.

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-19 Thread Christopher J. Walker
rebuild the genesis kernel? Chris Jarrod Johnson HPC Systems Management Architect Lenovo -Original Message- From: Jarrod Johnson [mailto:jjohns...@lenovo.com] Sent: Tuesday, May 19, 2015 2:20 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] xcat genesis kernel and mellanox ethern

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-19 Thread Jarrod Johnson
hnson [mailto:jjohns...@lenovo.com] Sent: Tuesday, May 19, 2015 2:20 PM To: xCAT Users Mailing list Subject: Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards Interesting, what is the output of lspci and lspci -n? For what it is worth, /opt/xcat/share/xcat/netboot/genesis/x86_64/fs/etc/udev/ru

Re: [xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-19 Thread Jarrod Johnson
HPC Systems Management Architect  Lenovo  -Original Message- From: Christopher J. Walker [mailto:c.j.wal...@qmul.ac.uk] Sent: Tuesday, May 19, 2015 1:50 PM To: xcat-user@lists.sourceforge.net Subject: [xcat-user] xcat genesis kernel and mellanox ethernet cards I seem to have run into

[xcat-user] xcat genesis kernel and mellanox ethernet cards

2015-05-19 Thread Christopher J. Walker
I seem to have run into: http://sourceforge.net/p/xcat/bugs/4578/ but for x86_64 - which I don't quite understand as that implies it has been fixed. If I plug the mellanox ConnectX-3 card in and try to do node discovery, the node hangs with the following prompt on the screen: Waiting