Re: [xcat-user] Genesis kernel on Haswell

2014-01-22 Thread Xiao Peng Wang
In this case, you should make the genesis for yourself. Clone the xcatcore from git to your CentOS 6.4 and 6.5 cd xcat-core/xCAT-genesis-builder ./buildrpm Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System T

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Xiao Peng Wang
There's no problem that mknb command created configuration files in /tftpboot/pxelinux.cfg/, but which files were loaded during the boot process. Could you check that xnba.efi, xnba.kpxe and genesis.fs/genesis.kernel have been installed in /tftpboot/xcat? You said the node booted to a dead end, w

Re: [xcat-user] Embedding GPFS 3.5 into xcat diskless boot images

2014-01-22 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 23/01/14 06:26, Christian Caruthers wrote: > In the past, with stateless nodes, I install the rpms during image > build and set rc.local to run mmsdrrestore on the stateless node to > sync it with the cluster. We use statelite and set this in lite

Re: [xcat-user] Embedding GPFS 3.5 into xcat diskless boot images

2014-01-22 Thread David D Johnson
Yes! this is exactly what I needed. It works perfectly. Thanks! /usr/lpp/mmfs/bin/mmsdrrestore -p -R /usr/bin/scp -- ddj Dave Johnson On Jan 22, 2014, at 2:26 PM, Christian Caruthers wrote: > In the past, with stateless nodes, I install the rpms during image build and > set rc.local to

Re: [xcat-user] Sequential discovery does not support virtual machines message

2014-01-22 Thread Jarrod B Johnson
Well, in /opt/xcat/share/xcat/netboot/genesis/x86_64/fs/bin/dodiscovery you'll find: if [ -r /sys/devices/virtual/dmi/id/product_name ]; then #x86 PRODNAME=`cat /sys/devices/virtual/dmi/id/product_name` IAMAVM=0 if [ "$PRODNAME" = "KVM" ]; then IAMAVM=1

[xcat-user] Sequential discovery does not support virtual machines message

2014-01-22 Thread Josh Nielsen
Sorry list denizens, another issue I ran into. I am trying to rediscover a VM that I already once discovered with sequential discovery, but now it is acting up. From my /var/log/messages log when I PXE-boot the VM: Jan 22 16:28:36 x3650-head01 dhcpd: DHCPDISCOVER from 00:50:56:bc:0c:db via eth0 Ja

Re: [xcat-user] Genesis kernel on Haswell (AND OTHER MISSING DRIVERS AND SUCH)

2014-01-22 Thread Jarrod B Johnson
So given this and the discovery discussion elsewhere, I've decided to upload the genesis builder rpm. It's not particularly documented, so here's a stab at how to make a new genesis out of some CentOS6 (or obviously similar): -Install rpm onto some 'donor' system. -Run: /opt/xcat/share/xcat/netbo

[xcat-user] Genesis kernel on Haswell

2014-01-22 Thread Dan Kulinski
We are deploying a small cluster and when using sequential discovery the boot to the genesis kernel fails with an unsupport CPU and a kernel panic. It looks like the genesis kernel is from CentOS 6.3, is there a way to force it to 6.4 or 6.5? Thanks, Daniel Kul

[xcat-user] consoleondemand for only some nodes?

2014-01-22 Thread Russell Jones
Hi all, Is it possible to have site.consoleondemand=yes for most nodes, but for a few have the console permanently connected? I like the idea of having some of the consoles be connected all of the time due to the console logging in /var/log/consoles. I don't want to have to have a screen sessi

Re: [xcat-user] Embedding GPFS 3.5 into xcat diskless boot images

2014-01-22 Thread Christian Caruthers
In the past, with stateless nodes, I install the rpms during image build and set rc.local to run mmsdrrestore on the stateless node to sync it with the cluster.Regards,Christian CaruthersSenior ConsultantSystem x Linux HPCMobile: 757-289-9872Sent from Lotus TravelerDavid D Johnson --- [xcat-user] E

[xcat-user] Embedding GPFS 3.5 into xcat diskless boot images

2014-01-22 Thread David D Johnson
We had a method that worked for the last 4.5 years up to this point, but today it stopped working. The old way had a copy of mgt node's /var/mmfs/gen embedded in the image. Adding new nodes was tedious, but doable: ssh to each node, remove the previous contents of /var/mmfs/gen, mmaddnode the

Re: [xcat-user] passwordless ssh for common users between nodes

2014-01-22 Thread Jonathan Hermann
Thanks, Jarrod - so ssh for common users IS possible in xCAT environments. Might be that we screwed something up by installing some pam module. Mit freundlichen Grüßen / Kind regards Jonathan (Nathan) Hermann IT Specialist Global Technology Services / Data Center Services

Re: [xcat-user] passwordless ssh for common users between nodes

2014-01-22 Thread Russell Jones
Something else that should of course be a given, the /etc/passwd and /etc/shadow files should be synced to your compute nodes that users are accessing. I do this via the standard xCAT syncfiles method. Whenever a new user is added I just add them to the MN, then run "updatenode compute -F" to p

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Jarrod B Johnson
1) If running 2.8, go ahead and delete nbroot-core. genesis is far more maintainable and easier to muck with on the end point (e.g. having full fledged glibc) 2) The greatest common denominator remains switch based. It's the only frequently instrumented topology cue that is pretty universal. For

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Josh Nielsen
Whoops, I meant to write "Jarrod" not "Jarros". I went a little Koine Greek on your name there. Sorry about that. :-) On Wed, Jan 22, 2014 at 10:22 AM, Josh Nielsen wrote: > Jarros, I know you haven't been following the whole thread but Jonathan's > problem (which this discussion originated from

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread David D Johnson
I'm not clear anymore remembering what gave is the most grief back 2-3 years ago when the first add-on racks were added to the cluster. There were some xcat update growing pains, some bugs that weren't fixed soon enough for us to move on, and the original design/rollout was done in 2009 by an I

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Jonathan Mills
xCAT-cisco works to an extent. It is fabulous for fetching MAC addresses via UCS Manager. However, for me at least, the rsetboot command fails flat out. But worst of all is that rpower commands do not "shoot the node in the head" like an IPMI command. Instead, UCS Manager tries to be cute a

Re: [xcat-user] passwordless ssh for common users between nodes

2014-01-22 Thread Jarrod B Johnson
Correct, should be a simple case of: ssh-keygen -b 2048 cat ~/.ssh/id_rsa.pb >> ~/.ssh/authorized_keys chmod 600 ~/.ssh/authorized_keys For a shared home directory setup. It's the reason why we haven't bothered getting in the business of user key management because *usually* it's that straightf

[xcat-user] passwordless ssh for common users between nodes

2014-01-22 Thread Jonathan Hermann
Hi all, we've got the situation that some users need passwordless ssh between compute nodes. Management node is running PCM 4.1.1.1 with xCAT 2.8.2 underneath. Since it's a comparably small cluster and only few users, they are administered locally via /etc/passwd on the MN. /home is exported via

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Jarrod B Johnson
Ok, fwiw, I have tried to make switch to switch variability less pronounced (in xCAT 1, you had to tell it what type of switch it was and sometimes what firmware version, etc etc, in xCAT 2 it auto detects and endeavors to tolerate a few different naming conventions as well as varying firmware con

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Josh Nielsen
Jarros, I know you haven't been following the whole thread but Jonathan's problem (which this discussion originated from) is that somehow his installation is still using the /tftpboot/pxelinux.cfg/ files despite being up to date with genesis. I saw a response on the list from you to someone else ab

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Jarrod B Johnson
0A6400 simply is hex for the '10.100.0' portion of the IP network. Broadly, rpm -qf is handy: rpm -qf /tftpboot/xcat/nbk.x86_64 Will tell you which rpm actually owns that file. We should have been more aggressive in the upgrade to get rid of nbfs. At the time, I was afraid of breaking working s

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Russell Jones
I can answer that point from a personal viewpoint - it's just a pain. A real bad pain, especially when you do not have homogenous switch models/vendors in the environment. By the time you've finally gotten it to work you could have just went node to node and hand-written down the MAC's and popu

Re: [xcat-user] Determine which otherpkgs.pkglist file is being used

2014-01-22 Thread Josh Nielsen
Okay, but did you see the problem I mentioned with provmethod=centos6.4-x86_64-install-service? That would mean (I think) that you have to create one (sub)directory name per service image under /install/custom in order for it to find the .tmpl and .pkglist files, since the scheme for locating those

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Jonathan Mills
Wang (& Lissa): Thanks, again, for your patience. I realize that Genesis is/was supposed to replace all the nbroot* packages. However, clearly from the responses on this list there are people who are using it to chain-load the genesis kernel. But even assuming we don't care about that, I sti

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Russell Jones
xNBA comes from xnba-undi-1.0.3-131028.noarch Genesis comes from xCAT-genesis-base-x86_64-2.8-snap201308090229.noarch and xCAT-genesis-scripts-x86_64-2.8.3-snap201311122318.noarch On 1/22/2014 7:30 AM, Jonathan Mills wrote: > I still don't know! Because if using the chain-loading, I don't see

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread David D Johnson
No, sorry, that does not answer question 3. I understand the numbering scheme. We have 13 racks. I just need to know where in the ordering process can we convince the folks to user OUR choice of rack number. On Jan 22, 2014, at 9:56 AM, Thomas Alandt wrote: > Answering your Item 3: > For IBM

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Thomas Alandt
Answering your Item 3: For IBM nodes we use the following to determine the address for the IMM 172.29.1xx.y xx = rack number (rack A1, node 1 = 172.29.101.1 which follows the node ip we would assign 172.20.101.1 y=node number in the rack, with the first node being in the lower U location, if rack i

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread David D Johnson
On Jan 22, 2014, at 8:30 AM, Jonathan Mills wrote: > Comments inline... > > On 1/22/14, 8:08 AM, David D Johnson wrote: >> I've been lurking on this discussion, and just checked to see what we've >> got -- nbroot or genesis -- and we have both of them. >> >> I had given up on node discovery ye

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Jonathan Mills
Comments inline... On 1/22/14, 8:08 AM, David D Johnson wrote: > I've been lurking on this discussion, and just checked to see what we've > got -- nbroot or genesis -- and we have both of them. > > I had given up on node discovery years ago, we originally used the > switch port numbers and forward

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread David D Johnson
I've been lurking on this discussion, and just checked to see what we've got -- nbroot or genesis -- and we have both of them. I had given up on node discovery years ago, we originally used the switch port numbers and forwarding tables to assign node names. Now I use ASU to collect the macs, a

Re: [xcat-user] Determine which otherpkgs.pkglist file is being used

2014-01-22 Thread Lissa Valletta
It is supported, but we are encouraging everyone to go the osimage. The provmethod install, netboot, statelite will be sunset over time and even now our testing is with provmethod=. This is why we are warning. Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 From: Jo

Re: [xcat-user] Frustrating time with sequential node discovery

2014-01-22 Thread Lissa Valletta
xCAT-nbroot-core* was replaced by xCAT-genesis-* in xCAT 2.8. Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 From: Xiao Peng Wang To: xCAT Users Mailing list , Cc: xCAT Users Mailing list Date: 01/22/2014 02:58 AM Subject:Re: [xcat-user] Frustrati