Hi Michel,
I don't have any experience using vlan tagging on the management network with xNBA. I did some research and based on a cursory investigation, I think it is not supported. If anyone else is successfully using vlan tagging on the management network with xNBA, please chime in. If you have the option of using an untagged vlan for your management network, I would recommend that as an alternative solution. If that is not an option or you are otherwise motivated to try to get management network vlan tagging working, here are some pointers to assist your investigation: One simple thing you can try is upgrading xNBA to the latest version available here to see if you have any better results: https://xcat.org/files/xcat/repos/yum/xcat-dep/xnba-undi-1.21.1-1.noarch.rpm It's possible the problem is due to lack of VLAN support in xNBA. xNBA is a rebuilt version of iPXE. By default, both iPXE and xNBA appear to be built without VLAN support. If VLAN support is enabled, I think it should appear in the Features line of the boot message: xCAT Network Boot Agent xNBA 1.0.0+ -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu If you want to try to rebuild xNBA with VLAN support included, you can try to follow the instructions here: https://github.com/xcat2/xcat-dep/blob/master/xnba/README and turn on VLAN support using: config/general.h://#define VLAN_CMD /* VLAN commands */ From: "Semedo, Michel" <[email protected]> To: "[email protected]" <[email protected]> Date: 12/15/2021 10:23 AM Subject: [EXTERNAL] [xcat-user] Unable to do a disk full install on a vlan tagged management network - xCAT 2.16.2 Hello, On my environment lab I’m currently trying to install a node (CN) by using vlan tagging on the management network. I’m running xCAT release 2.16.2 on top of RHEL 7.9. Note: I also tried to did the install without the vlan tagging and of course it’s working well without pb on the iPXE side as I still have the same setup on the node except for the vlan interface. On my server a tagged vlan is defined, on the compute I enable the vlan with an id (same as server) at the BIOS level in order to be able to communicate with the server. On the switch I also create a vlan with ports (tagged) connected to both servers (MN & CN). Here are some setup on site table: [root@mosupc ~]# tabdump site | grep -E "dns|dhcp" "dnshandler","ddns",, "dhcplease","43200",, "dhcpinterfaces","eno1.21,eno1",, "dnsinterfaces","eno1.21,eno4",, [root@mosupc ~]# lsdef r12-hpcn-u35-cmu | grep -E "addkcmdline|netboot" addkcmdline=earlyprintk=ttyS0,115200 console=tty0 console=ttyS0,115200 biosdevname=1 network vlan=em1.21:em1 netboot=xnba [root@mosupc ~]# [root@mosupc ~]# tabdump networks #netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,vlanid,domain,mtu,comments,disable "mgmt-net","10.128.21.0","255.255.255.0","eno1.21","<xcatmaster>",,"<xcatmaster>",,,,"10.128.21.150-10.128.21.220","10.128.21.1-10.128.21.100",,,,"21",,"1500",, "pub-net","15.129.28.0","255.255.254.0","eno4","15.129.28.1",,"<xcatmaster>",,,,,,,,,,,"1500",, "admin-cust","10.128.50.0","255.255.255.0","eno1.50",,,,,,,,,,,,"50",,,, [root@mosupc ~]# My Configuration is as below: Management server => DL385 Gen10 Compute Node => Apollo 4200 Gen10 1 Procurve switch (2848) for the management network Another Procurve for the BMC/iLO network I faced an issue during the IPXE boot just after the DHCP sequence and the download of the NBP file (xnba.efi in my case), then the network is no more working The network error I have on the console is: >> Booting Embedded LOM 1 Port 1 : HPE Ethernet 1Gb 2-port 332i Adapter - NIC (PXE IPv4) [2021-12-10T14:46:21+01:00] >>Start PXE over IPv4. [2021-12-10T14:46:25+01:00] Station IP address is 10.128.21.17 [2021-12-10T14:46:25+01:00] Server IP address is 10.128.21.20 [2021-12-10T14:46:25+01:00] NBP filename is xcat/xnba.efi [2021-12-10T14:46:25+01:00] NBP filesize is 955520 Bytes [2021-12-10T14:46:25+01:00] Downloading NBP file... [2021-12-10T14:46:25+01:00] [2021-12-10T14:46:25+01:00] NBP file downloaded successfully. [2021-12-10T14:46:25+01:00] xNBA initialising devices...ok [2021-12-10T14:46:25+01:00] [2021-12-10T14:46:25+01:00] xCAT Network Boot Agent [2021-12-10T14:46:25+01:00] xNBA 1.0.0+ -- Open Source Network Boot Firmware -- http://ipxe.org [2021-12-10T14:46:25+01:00] Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu [2021-12-10T14:46:25+01:00] [2021-12-10T14:46:25+01:00] net0: ec:eb:b8:8d:65:a4 using 14e4-165f on 0000:02:00.0 (open) [2021-12-10T14:46:27+01:00] [Link:down, TX:0 TXE:0 RX:0 RXE:0] [2021-12-10T14:46:27+01:00] [Link status: Down (http://ipxe.org/38086193 )] [2021-12-10T14:46:27+01:00] Waiting for link-up on net0...... ok [2021-12-10T14:46:31+01:00] Configuring (net0 ec:eb:b8:8d:65:a4).................. No configuration methods succeeded ( http://ipxe.org/040ee186) [2021-12-10T14:46:46+01:00] No more network devices Then I still looping on the same attempt (trying to netboot over iPXE). From the console of my CN I did also a “ctrl + B” when was asked for in order to get into the XNBA utility an run an ifstat command with the below result: xNBA> ifstat net0: ec:eb:b8:8d:65:a4 using 14e4-165f on 0000:02:00.0 (open) [Link:up, TX:4 TXE:0 RX:9 RXE:9] [RXE: 9 x "Operation not supported (http://ipxe.org/3c086083)"] net1: ec:eb:b8:8d:65:a5 using 14e4-165f on 0000:02:00.1 (closed) [Link:down, TX:0 TXE:0 RX:0 RXE:0] [Link status: Unknown (http://ipxe.org/1a086194)] net2: 48:df:37:88:10:72 using x550t2 on 0000:af:00.0 (closed) [Link:down, TX:0 TXE:0 RX:0 RXE:0] [Link status: Down (http://ipxe.org/38086193)] net3: 48:df:37:88:10:73 using x550t2 on 0000:af:00.1 (closed) [Link:down, TX:0 TXE:0 RX:0 RXE:0] [Link status: Down (http://ipxe.org/38086193)] xNBA> Question: Is vlan tagging is supported on the management network on xCAT setup? After googling without success around iPXE, I would like to have any hints on where to look for in order to progress on this topic. Thanks in advance for any ideas which could help on that. If additional logs are needed I’ll provide them. Michel Semedo Technical Consultant Open Source Linux/HPC HPE Pointnext Services [email protected] +33 6 7299 3848 Office +33 6 7299 3848 Mobile Puteaux hpe.com/pointnext Michel Semedo Technical Consultant Open Source Linux/HPC HPE Pointnext Services [email protected] +33 6 7299 3848 Office +33 6 7299 3848 Mobile Puteaux hpe.com/pointnext _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
