David, Next thing you can try is to restart xcat with "restartxcatd" and see if any errors are displayed in /var/log/xcat/cluster.log
There is a scan_plugins() module in /opt/xcat/sbin/xcatd that is suppose to scan and register Perl modules. Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein From: [email protected] To: xCAT Users Mailing list <[email protected]> Date: 10/21/2019 05:06 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? ls -l /opt/xcat/lib/perl/xCAT_plugin/openbmc* -rw-r--r-- 1 root root 19126 Mar 29 2019 /opt/xcat/lib/perl/xCAT_plugin/openbmc2.pm -rw-r--r-- 1 root root 225520 Mar 29 2019 /opt/xcat/lib/perl/xCAT_plugin/openbmc.pm [root@mgt5 ~]# Yes it is there but the access time does not change when I do the rpower command. It has the handled commands structure you quoted. I don’t think it’s getting loaded. -- ddj Dave Johnson On Oct 21, 2019, at 4:59 PM, Mark Gurevich <[email protected]> wrote: Do you the file /opt/xcat/lib/perl/xCAT_plugin/openbmc2.pm ? And in it, is there a function handled_commands() with an entry for "rpower" ? sub handled_commands { return { rbeacon => 'nodehm:mgt=openbmc', rflash => 'nodehm:mgt=openbmc', rinv => 'nodehm:mgt=openbmc', rpower => 'nodehm:mgt=openbmc', rsetboot => 'nodehm:mgt=openbmc', rvitals => 'nodehm:mgt=openbmc', rspconfig => 'nodehm:mgt=openbmc', reventlog => 'nodehm:mgt=openbmc', }; } Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif> david_johnson---10/21/2019 03:33:52 PM---Only the allowing log line is showing up. Nothing else. -- ddj From: [email protected] To: xCAT Users Mailing list <[email protected]> Date: 10/21/2019 03:33 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? Only the allowing log line is showing up. Nothing else. -- ddj Dave Johnson On Oct 21, 2019, at 3:08 PM, Mark Gurevich <[email protected]> wrote: Run your "rpower <node> stat -V" And then look into /var/log/xcat/cluster.log file. There sould be lines similar to: Oct 21 15:02:53 fs2vm101 xcat[15792]: DEBUG xcatd: open new process : xcatd SSL: rpower to <node> for root@localhost Oct 21 15:02:53 fs2vm101 xcat[15793]: DEBUG xcatd: dispatch request 'rpower <node> stat -V' to plugin 'openbmc2' Oct 21 15:02:53 fs2vm101 xcat[15793]: DEBUG xcatd: handle request 'rpower' by plugin 'openbmc2''s preprocess_request Oct 21 15:02:53 fs2vm101 xcat[15794]: DEBUG xcatd: dispatch request 'rpower <node> stat -V' to plugin 'openbmc' Oct 21 15:02:53 fs2vm101 xcat[15792]: INFO xCAT: Allowing rpower to <node> stat -V for root from localhost Oct 21 15:02:53 fs2vm101 xcat[15794]: DEBUG xcatd: handle request 'rpower' by plugin 'openbmc''s preprocess_request Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif> David Johnson ---10/21/2019 01:52:05 PM---I removed it, and it’s still broken. The dependencies are python2-greenlet and python2-gevent. I de From: David Johnson <[email protected]> To: xCAT Users Mailing list <[email protected]> Date: 10/21/2019 01:52 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? I removed it, and it’s still broken. The dependencies are python2-greenlet and python2-gevent. I deleted those and it’s still broken. Is there possibly some environment variable used to find the python modules that I’m missing? A missing RPM? — ddj On Oct 21, 2019, at 1:31 PM, Mark Gurevich <[email protected]> wrote: David, The definition for the node appears to be correct. Can you uninstall xCAT-openbmc-py-2.14.6-snap201903290319.noarch and the two dependencies you installed manually, and see if that helps ? Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif>David Johnson ---10/21/2019 12:07:56 PM---Inline > On Oct 21, 2019, at 11:55 AM, Mark Gurevich < [email protected]> wrote: From: David Johnson < [email protected]> To: xCAT Users Mailing list < [email protected]> Date: 10/21/2019 12:07 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? Inline On Oct 21, 2019, at 11:55 AM, Mark Gurevich < [email protected]> wrote: David, 1. How were you able to install xCAT-openbmc-py-2.14.6-snap201903290319.noarch ? Were you able to install its's dependencies? I did find the two dependencies on the fedora websites and did wget and yum install. I can get rid of it if it might be a problem….. 2. Can you run "lsdef gpu1413 -V" so we can see which table each attribute is being pulled from ? [root@mgt5 ~]# lsdef gpu1413 -V Object name: gpu1413 addkcmdline=mce=ignore_ce (Table:bootparams - Key:node - Column:addkcmdline) bmc=gpu1413-bmc (Table:openbmc - Key:node - Column:bmc) bmcpassword=#@#@## (Table:openbmc - Key:node - Column:password) bmcusername=root (Table:openbmc - Key:node - Column:username) cons=openbmc (Table:nodehm - Key:node - Column:cons) consport=0 (Table:openbmc - Key:node - Column:consport) groups=gpu,power-bmc,rackB10,all,rh7,chs (Table:nodelist - Key:node - Column:groups) hostnames=ppc001 (Table:hosts - Key:node - Column:hostnames) installnic=mac (Table:noderes - Key:node - Column:installnic) ip=172.20.210.13 (Table:hosts - Key:node - Column:ip) mgt=openbmc (Table:nodehm - Key:node - Column:mgt) netboot=xnba (Table:noderes - Key:node - Column:netboot) nfsserver=172.20.0.6 (Table:noderes - Key:node - Column:nfsserver) postbootscripts=otherpkgs (Table:postscripts - Key:node - Column:postbootscripts) postscripts=syslog,remoteshell,syncfiles,setupntp,ipoib,hardeths (Table:postscripts - Key:node - Column:postscripts) power=openbmc (Table:nodehm - Key:node - Column:power) primarynic=mac (Table:noderes - Key:node - Column:primarynic) tftpserver=172.20.0.6 (Table:noderes - Key:node - Column:tftpserver) 3. Can you run "tabdump openbmc" so we can see if gpu1413 has an entry t [root@mgt5 ~]# tabdump openbmc #node,bmc,consport,taggedvlan,username,password,comments,disable "gpu1413","gpu1413-bmc","0",,"root”,”#@#@##",, [root@mgt5 ~]# here ? Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif>David Johnson ---10/21/2019 10:55:19 AM---[root@mgt5 ~]# rpm -qa | grep -i xcat | sort conserver-xcat-8.2.1-1.x86_64 From: David Johnson <[email protected]> To: xCAT Users Mailing list <[email protected] > Date: 10/21/2019 10:55 AM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? [root@mgt5 ~]# rpm -qa | grep -i xcat | sort conserver-xcat-8.2.1-1.x86_64 elilo-xcat-3.14-4.noarch grub2-xcat-2.02-0.16.el7.snap201506090204.noarch ipmitool-xcat-1.8.18-0.x86_64 perl-xCAT-2.14.6-snap201903290319.noarch syslinux-xcat-3.86-2.noarch xCAT-2.14.6-snap201903290319.x86_64 xCAT-buildkit-2.14.6-snap201903290319.noarch xCAT-client-2.14.6-snap201903290319.noarch xCAT-genesis-base-ppc64-2.14.5-snap201811160710.noarch xCAT-genesis-base-x86_64-2.14.5-snap201811190037.noarch xCAT-genesis-scripts-ppc64-2.14.6-snap201903290319.noarch xCAT-genesis-scripts-x86_64-2.14.6-snap201903290319.noarch xCAT-openbmc-py-2.14.6-snap201903290319.noarch xCAT-probe-2.14.6-snap201903290319.noarch xCAT-server-2.14.6-snap201903290319.noarch yaboot-xcat-1.3.17-rc1.noarch I did confirm that openbmc.pm does exist in the place you mentioned. I had managed to confuse the BMC address with the petitboot IP address, that is now sorted out, and I can access "ssh -p 2200 gpu1413-bmc” and the web gui, which I was previously unable to do. Still the rpower command is the same result as before… [root@mgt5 ~]# rpower gpu1413 stat gpu1413: [mgt5]: Error: Unable to identify plugin for this command, check relevant tables: nodehm.power,mgt;nodehm.mgt;pduoutlet.pdu=.* On Oct 21, 2019, at 10:33 AM, Mark Gurevich <[email protected]> wrote: David, I would like to understand why you are getting "Unable to identify plugin for this command" when your BMC is pingable but not accessible. You should have gotten something like this on xCAT 2.14.6: [root@fs2vm101 ~]# rpower f5u14 stat f5u14: [fs2vm101]: Error: [500] Login to BMC failed: 500 Can't connect to 10.5.14.1:443 (Connection refused). f5u14: [fs2vm101]: Error: BMC did not respond. Validate BMC configuration and retry the command. [root@fs2vm101 ~]# What version of xCAT are you running ? Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif>David Johnson ---10/18/2019 05:17:35 PM---I think I’m missing the last step in setting up the BMC: d. To reset your firmware run the followin From: David Johnson < [email protected]> To: xCAT Users Mailing list < [email protected]> Date: 10/18/2019 05:17 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? I think I’m missing the last step in setting up the BMC: d. To reset your firmware run the following command: ipmitool raw 0x06 0x40. Will try it and see if that helps. I can ping the BMC address, but as I said earlier, I get connection refused on ipmitool as well as ssh. Also when in the Exit to shell environment, netstat -an shows nothing listening on any ethernet ports. I’ve just written myself a 7.6 rhel-alt USB stick, and trying to figure out how to make the two flash drives into a raid1 mirror (maybe I’ll just skip that part). Thanks for the help so far…. — ddj On Oct 18, 2019, at 4:43 PM, Mark Gurevich <[email protected]> wrote: The definition looks correct. Which version of xCAT? "lsxcatd -a" What is the OS of the xCAT management node ? Is there a file "/opt/xcat/lib/perl/xCAT_plugin/openbmc.pm" on the xCAT management node ? Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif>David Johnson ---10/18/2019 04:09:30 PM---OK, here is the lsdef gpu1413 after a few fixes I made. Still doesn’t work. Password redacted. A few From: David Johnson <[email protected]> To: xCAT Users Mailing list <[email protected]> Date: 10/18/2019 04:09 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? OK, here is the lsdef gpu1413 after a few fixes I made. Still doesn’t work. Password redacted. A few things are inherited from cluster defaults, but I’m not planning to boot this host diskless. [root@mgt5 ~]# lsdef gpu1413 Object name: gpu1413 addkcmdline=mce=ignore_ce bmc=gpu1413-bmc bmcpassword=#*#*#*#* bmcusername=root cons=openbmc consport=0 groups=gpu,power-bmc,rackB10,all,rh7,chs hostnames=ppc001 installnic=mac ip=172.20.210.13 mgt=openbmc netboot=xnba nfsserver=172.20.0.6 postbootscripts=otherpkgs postscripts=syslog,remoteshell,syncfiles,setupntp,ipoib,hardeths power=openbmc primarynic=mac tftpserver=172.20.0.6 On Oct 18, 2019, at 1:13 PM, Mark Gurevich <[email protected]> wrote: David, The xCAT-openbmc.py is part of beta level Python version of xCAT support for OpenBMC. The standard Perl support for OpenBMC is done by /opt/xcat/lib/perl/xCAT_plugin/openbmc.pm If you really want to try using Python, you can follow https://xcat-docs.readthedocs.io/en/stable/references/coral/cluster_mgmt/scalability/python/index.html You can see if Python or Perl is used by running hardware control commands, like rpower or rvitals with "-V" flag. The error you are seeing "Unable to identify plugin for this command, " usually mean xCAT can not find appropriate module to handle the command. The "mgt=openbmc" suppose to tell xCAT to use "/opt/xcat/lib/perl/xCAT_plugin/openbmc.pm" module. Can you run "lsdef gpu1413" ? Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif>David Johnson ---10/18/2019 12:40:19 PM---I found openbmctool already installed on my system, but that indicates connection refused. I’m wonde From: David Johnson <[email protected]> To: xCAT Users Mailing list <[email protected]> Date: 10/18/2019 12:40 PM Subject: [EXTERNAL] Re: [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? I found openbmctool already installed on my system, but that indicates connection refused. I’m wondering if I need to enable remote management within petitboot? On Oct 18, 2019, at 10:50 AM, [email protected] wrote: I did set up nodehm this way, but I get [root@mgt5 ~]# rpower gpu1413 stat gpu1413: [mgt5]: Error: Unable to identify plugin for this command, check relevant tables: nodehm.power,mgt;nodehm.mgt;pduoutlet.pdu=.* tabdump nodelist |grep gpu1413 "gpu1413","gpu,power-bmc,rackB10,all,rh7,chs",,,,,,,,,,, " [root@mgt5 ~]# tabdump nodehm |grep power#node,power,mgt,cons,termserver,termport,conserver,serialport,serialspeed,serialflow,getmac,cmdmapping,consoleondemand,consoleenabled,comments,disable "power-bmc","openbmc","openbmc","openbmc",,,,,,,,,,,"IBM There is no openbmc executable on the system and xCAT-openbmc.py rpm will not install due to dependencies. -- ddj Dave Johnson On Oct 18, 2019, at 10:35 AM, Mark Gurevich < [email protected]> wrote: The latest version of xCAT 2.14.6 should support management of AC922 machines. The node definition for these nodes should contain "mgt=openbmc" and "cons=openbmc" After that normal xCAT commands like "rpower", "rcons", "rflash", etc should work. Mark Gurevich Poughkeepsie Development Lab HPC Software Development - xCAT "If we knew what it was we were doing, it would not be called research, would it?" --Albert Einstein <graycol.gif> david_johnson---10/18/2019 10:11:50 AM---I’m having trouble finding out how to use either ipmitool or openbmc tools to manage power and conso From: [email protected] To: [email protected] Date: 10/18/2019 10:11 AM Subject: [EXTERNAL] [xcat-user] How to manage Power AC922 from Intel based xcat cluster ? I’m having trouble finding out how to use either ipmitool or openbmc tools to manage power and console for a new IBM powerpc GPU node. Existing cluster is running the latest update of xcat. Can’t find openbmc executable or the openbmctool package download referred to in the ibm documentation. We had one of these machines for a POC about a year ago, but I forgot how we dealt with it. -- ddj Dave Johnson _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list [email protected] https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_xcat-2Duser&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cGs4a-jfx6Emudek2Wdi4FLq2XKm1pvrlbCQ-h7Qq7A&m=Fp4Rk8glbAQNMTTY9DU7v2UzlHU8CjvSXqXXyYhd3Hw&s=wYCKKUTUheGCUoG9kXFP_pQB4SDDNYwMgPIDP0WmP6g&e=
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
