Answering your Item 3: For IBM nodes we use the following to determine the address for the IMM 172.29.1xx.y xx = rack number (rack A1, node 1 = 172.29.101.1 which follows the node ip we would assign 172.20.101.1 y=node number in the rack, with the first node being in the lower U location, if rack is two wide then it would be lower left side going up then lower right side going up
Since your racks came at different timesthey were seen as different orders and we will always start at the first rack and go contiguous from there. We assign the bmc to a group, for example 84bmcperrack (see hosts tab) #node,ip,hostnames,otherinterfaces,comments,disable "84bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/84)).(($1-1)%84+1)|",,,, "idataplex-bmc","|\D+(\d+).*$|172.29.(101+(($1-1)/84)).(($1-1)%84+1)|",,,, "40bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/40)).(($1-1)%40+1)|",,,, "41bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/41)).(($1-1)%41+1)|",,,, "42bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/42)).(($1-1)%42+1)|",,,, "20bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/20)).(($1-1)%20+1)|",,,, "21bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/21)).(($1-1)%21+1)|",,,, You can set up your scheme when you bring up the cluster and this will all get done during the discovery/bmcsetup. Regards, Tom Thomas Alandt WW Test Engineer Complex Solutions IBM-ISC Phone:919-543-7581 (t/l 441-7581 From: David D Johnson <david_john...@brown.edu> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>, Date: 01/22/2014 08:11 AM Subject: Re: [xcat-user] Frustrating time with sequential node discovery I've been lurking on this discussion, and just checked to see what we've got -- nbroot or genesis -- and we have both of them. I had given up on node discovery years ago, we originally used the switch port numbers and forwarding tables to assign node names. Now I use ASU to collect the macs, and populate the mac table with a bit of grep and awk. But last week we powered on a rack of 20 non-ibm nodes, and I was wishing we had something easier since ASU didn't work for them. So I have two questions -- 1) Can I safely delete the xCAT-nbroot-core* RPMS ? 2) What is the current best practice method? What about for non-ibm hardware? No, three questions 3) How do you get IBM manufacturing to use a specific different 172.29.X for each rack they build for you? We've had three racks arrive in different months all with 172.29.101 addresses for the IMM, and I have to spend 5-10 minutes reprogramming each one. I can't put them on the same network until the conflicts are gone. What's hard for me is that we get new nodes only a couple times a year, and I forget everything in between. Thanks, -- ddj On Jan 22, 2014, at 7:12 AM, Lissa Valletta <lis...@us.ibm.com> wrote: xCAT-nbroot-core* was replaced by xCAT-genesis-* in xCAT 2.8. Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 <graycol.gif>Xiao Peng Wang ---01/22/2014 02:58:13 AM---Why do you say that you need nbk.x86_64? Is this file listed in the </tftpboot/xcat/xnba/nets/>? From: Xiao Peng Wang <w...@cn.ibm.com> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>, Cc: xCAT Users Mailing list <xcat-user@lists.sourceforge.net> Date: 01/22/2014 02:58 AM Subject: Re: [xcat-user] Frustrating time with sequential node discovery Why do you say that you need nbk.x86_64? Is this file listed in the </tftpboot/xcat/xnba/nets/>? With the latest xCAT build, it needs /tftpboot/xcat/genesis.kernel.x86_64 instead of nbk.* Thanks Best Regards ---------------------------------------------------------------------- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 <graycol.gif>Jonathan Mills ---2014/01/22 14:10:32---It would seem to me that what I am missing is the whole of the xCAT-nbroot infrastructure...because From: Jonathan Mills <jonmi...@renci.org> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>, Date: 2014/01/22 14:10 Subject: Re: [xcat-user] Frustrating time with sequential node discovery It would seem to me that what I am missing is the whole of the xCAT-nbroot infrastructure...because it isn't part of xcat-core, nor xcat-dep. So I didn't grab it. But it just so happens...you need it. The file /tftpboot/xcat/nbk.x86_64 is provided by the RPM xCAT-nbkernel-x86_64. Which is missing from my yum repo mirrior, and from my hosts. Anything else I'm missing? Hopefully if I grab correct copies of xCAT-nbkernel and xCAT-nbroot (or xCAT-nbroot2?) then node discovery will actually work. On 1/22/14, 12:08 AM, Xiao Peng Wang wrote: > Both Josh and Russell are correct. > > xNBA is a customized pxe and genesis is a xCAT customized diskless linux > system to run discovery and other tasks like 'bmcsetup'. It does not > need the /tftpboot/pxelinux.cfg/.* to load the genesis. > > For discovery, if a node is not defined in xCAT, the dhcp configuration > in the /etc/dhcp/dhcpd.conf or /etc/dhcpd.conf is used to reply the dhcp > request from not-discovered node. > > In your dhcpd.conf, it should have the following part for your > deployment network. If not, run 'makedhcp -n' to recreate your dhcpd.conf. > if option user-class-identifier = "xNBA" and option > client-architecture = 00:00 { #x86, xCAT Network Boot Agent > always-broadcast on; > filename = " http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16"; > } else if option user-class-identifier = "xNBA" and option > client-architecture = 00:09 { #x86, xCAT Network Boot Agent > filename = > "http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16.uefi"; > } else if option client-architecture = 00:00 { #x86 > filename "xcat/xnba.kpxe"; > } else if option vendor-class-identifier = "Etherboot-5.4" { #x86 > filename "xcat/xnba.kpxe"; > } else if option client-architecture = 00:07 { #x86_64 uefi > filename "xcat/xnba.efi"; > } else if option client-architecture = 00:09 { #x86_64 uefi > alternative id > filename "xcat/xnba.efi"; > } > > During the boot process of a not-discovered node, dhcpd will tell the > node to load xcat/xnba.kpxe first and then the configuration file > http://<xcat mn>/tftpboot/xcat/xnba/nets/10.1.0.0_16. Then the xnba will > load the genesis. > > Take a look of the syslog to see whether the xnba was downloaded > successfully from tftp server. And look into the httpd log to see > whether the genesis has been downloaded successfully. > > > Thanks > Best Regards > ---------------------------------------------------------------------- > Wang Xiaopeng (王晓朋) > IBM China System Technology Laboratory > Tel: 86-10-82453455 > Email: w...@cn.ibm.com > Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, > Haidian District Beijing P.R.China 100193 > > Inactive hide details for Josh Nielsen ---2014/01/22 05:56:00---Ah, I > see what you are saying now. Well, I hope the thread I stJosh Nielsen > ---2014/01/22 05:56:00---Ah, I see what you are saying now. Well, I hope > the thread I stumbled on that Jarrod replied to help > > From: Josh Nielsen <jniel...@hudsonalpha.org> > To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>, > Date: 2014/01/22 05:56 > Subject: Re: [xcat-user] Frustrating time with sequential node discovery > > ------------------------------------------------------------------------ > > > > Ah, I see what you are saying now. Well, I hope the thread I stumbled > on that Jarrod replied to helps figure out why his configuration is > looking to the outdated (according to what Jarrod said) configuration > files in /tftpboot/pxelinux.cfg/. Looks like it is either > /etc/dhcpd.conf or /var/lib/dhcpd/dhcpd.leases related in that case. > > On Tue, Jan 21, 2014 at 3:51 PM, Russell Jones > <russell-l...@jonesmail.me> wrote: > > It *should* work with xNBA and Genesis - xNBA is the PXE image that > > loads Genesis. :-) > > > > Genesis is the utility image that handles shell commands, runimages, etc. > > > > Don't confuse NBFS with xNBA - NBFS is deprecated via Genesis. xNBA is > > the gpxe image that loads Genesis or your normal OS image depending on > > what you sent via nodeset. Genesis would not be able to load without > > xNBA (or standard PXE), and neither would any netboot images. > > > > On 1/21/2014 3:33 PM, Josh Nielsen wrote: > >> my case it still works with > >> both xnba and genesis because of the nature of PXE chainloading. It > >> probably adds deployment time, but it actually works in such a mixed > >> configuration. > >> > >> -Josh > > > > > > > ------------------------------------------------------------------------------ > > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > > Learn Why More Businesses Are Choosing CenturyLink Cloud For > > Critical Workloads, Development Environments & Everything In Between. > > Get a Quote or Start a Free Trial Today. > > > http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk > > _______________________________________________ > > xCAT-user mailing list > > xCAT-user@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/xcat-user > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In Between. > Get a Quote or Start a Free Trial Today. > http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk > _______________________________________________ > xCAT-user mailing list > xCAT-user@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/xcat-user > > -- Jonathan Mills Systems Administrator Renaissance Computing Institute UNC-Chapel Hill ------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk _______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk _______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk _______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
<<inline: graycol.gif>>
------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user