Correct. I do not have /tftpboot mounted from the MN on the service nodes, and site.sharedtftp is 0.

To clarify the behavior that I am seeing right now, the /tftpboot/mypostscript/mypostscript.c100n1 file is updated on the service node that the compute node is assigned to when running updatenode c100n1 -P otherpkgs (time stamp changes and contents change).  However, the node is getting pushed the /tftpboot/mypostscript/mypostscript.c100n1 file from the Management Node, not the Service Node, when it is running.

This is causing a problem because if I change, for example, OTHERPKGDIR in the osimage and then run an "updatenode c100n1 -P otherpkgs", the service node gets the updated mypostscript.c100n1 file, but that file is never then pushed to the node. The management node does *not* have its mypostscript.c100n1 file updated with the new configuration, and as a result the compute node is pushed an old mypostscript.c100n1 file from the management node.

Is this the expected behavior, or should the node be getting the mypostscript file from the Service Node it is assigned to?




On 1/21/2014 9:48 AM, Lissa Valletta wrote:

If you do not have /tftpboot mounted on the service node usually because   site.sharedtftp=0 and hierarchy is setup correctly. Then when you run updatenode to the compute node, you should see a /tftpboot/mypostscripts directory on the service node of the compute node containing the new mypostscript..<computenodename> file.



Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102



Inactive hide details for Lissa Valletta---01/21/2014
          08:54:38 AM---How many service nodes do you have? I hope you
          have enouLissa Valletta---01/21/2014 08:54:38 AM---How many service nodes do you have?   I hope  you have enough  memory, cpus etc on the Management No

From: Lissa Valletta/Poughkeepsie/IBM@IBMUS
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>,
Cc: xcat-user@lists.sourceforge.net
Date: 01/21/2014 08:54 AM
Subject: Re: [xcat-user] xCAT ignoring my otherpkgdir setting





How many service nodes do you have?   I hope  you have enough  memory, cpus etc on the Management Node and Service nodes to handle 6000 nodes or 500-1000 nodes from each service node.

We also have some hints and tips for Large Cluster tuning.

https://sourceforge.net/apps/mediawiki/xcat/index.php?title=Hints_and_Tips_for_Large_Scale_Clusters

updatenode to the node should  update the mypostscript file when you have precreatemypostscripts=1.  It sounds like something is happening that that does not get downloaded to the nodes.


Try this set the attribute: chtab key=precreatemypostscripts site.value=1
Run an simple updatenode to one of your nodes.


updatenode compute-03 -P mytest


Look in on the MN
/tftpboot/mypostscripts
You should see a file mypostscript.compute-03  where compute-03 is your nodename
It should change (date) each time you run updatenode or nodeset.   That is the file that is put on the node and  modified  during updatenode and should contain the latest changes.  It will be modified and put in /xcatpost/mypostscript


You do have to have /tftpboot mounted on the Service nodes from the Management Node for updatenode,  if you are updating a compute node attached to a service node.  updatenode is actually running on the service node in this case.







Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102



Inactive hide details for Russell Jones ---01/20/2014
        09:36:26 PM---Thanks! It is working fine now that I figured out
        what the Russell Jones ---01/20/2014 09:36:26 PM---Thanks! It is working fine now that I figured out what the issue is. We will

From:
Russell Jones <russell-l...@jonesmail.me>
To:
xcat-user@lists.sourceforge.net,
Date:
01/20/2014 09:36 PM
Subject:
Re: [xcat-user] xCAT ignoring my otherpkgdir setting




Thanks!

It is working fine now that I figured out what the issue is. We will gain a lot better performance with site.precreatemypostscripts enabled, so we wish to keep it on. This is a cluster with ~6000 nodes.


On 1/20/2014 7:32 PM, Xiao Peng Wang wrote:
 

    The question turns to whether to use the site.precreatemypostscripts. This site attribute is used to improve the performance of postscript mechanism in a big cluster.

    If site.precreatpostescripts is enabled, the mypostscript for the node will be generated by nodeset command on xCAT MN. When booting of node, the created mypostscript will be copied to compute node directly for using. The advantage is it can save the computing resource of MN during the node booting process, the shortage is you must run nodeset for each changing which related to postscripts.

    If site.precreatescripts is disabled, nodeset command won't do anything for mypostscirpt. When booting of node, it will try to require the xCAT MN to generate the mypostscript at that time.

    So for your issue, you can try to disable the site.precreatemypostscripts and to see whether it works well.


    Thanks
    Best Regards
    ----------------------------------------------------------------------
    Wang Xiaopeng (王晓朋)
    IBM China System Technology Laboratory
    Tel: 86-10-82453455
    Email:
    w...@cn.ibm.com
    Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193


    Inactive hide details for Russell Jones ---2014/01/18
          03:40:35---I figured out what's going on - we are using the
          site.precreaRussell Jones ---2014/01/18 03:40:35---I figured out what's going on - we are using the  site.precreatemypostscripts=1 option. Even though

    From:
    Russell Jones <russell-l...@jonesmail.me>
    To:
    xcat-user@lists.sourceforge.net,
    Date:
    2014/01/18 03:40
    Subject:
    Re: [xcat-user] xCAT ignoring my otherpkgdir setting 



    I figured out what's going on - we are using the site.precreatemypostscripts=1 option. Even though the man page on the site table states that the mypostscript file for the node should be updated when an updatenode is ran as all as a nodeset, this is not happening. I have to do a nodeset on the node to have that file updated.

    There's also a gap here in that since the node utilizes it's local /xcatpost/mypostscript for pulling in variables that the otherpkgs script needs, specifically $OTHERPKGDIR and $OTHERPKGS1, you need to reboot your node or manually push the new copy of this file to the nodes for your changes to OTHERPKGDIR in the osimage to be seen by your node. In my opinion, enhancements to updatenode need to be made so that:

    A) updatenode rewrites the mypostscript file to capture any changes you may have made to your osimage definitions

    and

    B) updatenode pushes this new mypostscript file to the node so that updatenode will be aware of any osimage definition changes.



    On 1/17/2014 12:40 PM, Russell Jones wrote:
      Well, genimage seems to pick up my change just fine - it's just updatenode that doesn't. Here's the temp yum.conf that is created during otherpkgs time with genimage:

      [otherpkgs1]
      name=otherpkgs1
      baseurl=
      file:///install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute//.
      gpgpcheck=0

      [otherpkgs2]
      name=otherpkgs2
      baseurl=
      file:///install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute//dell
      gpgpcheck=0


      We are wanting to separate out the otherpkgs based on image name. Being able to configure otherpkgdir is a good feature that seems to work fine during genimage time - I would highly encourage you guys continue with this feature and push it to the otherpkgs postscript.



      On 1/17/2014 12:25 PM, Lissa Valletta wrote:

      .



      Take a look at this documentation ,   the otherpkgdir always ends with the architecture directory and then the directories under that contain the rpms.   I have never seen anything different so this may be a limitation in our code.

      In other words in your case it should be
      otherpkgdir=/install/post/otherpkgs/centos5.4-new-kernel/x86_64

      https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start#Installing_Additional_Packages_Using_an_Otherpkgs_Pkglist





      Lissa K. Valletta
      8-3/B10
      Poughkeepsie, NY 12601
      (tie 293) 433-3102




      Inactive hide details for Russell Jones ---01/17/2014
            12:42:10 PM---Hi all, I am manually setting my otherpkgdir
            for an osimageRussell Jones ---01/17/2014 12:42:10 PM---Hi all, I am manually setting my otherpkgdir for an osimage that a node belongs

      From:
      Russell Jones <russell-l...@jonesmail.me>
      To:
      xCAT Users Mailing list <xcat-user@lists.sourceforge.net>,
      Date:
      01/17/2014 12:42 PM
      Subject:
      [xcat-user] xCAT ignoring my otherpkgdir setting




      Hi all,

      I am manually setting my otherpkgdir for an osimage that a node belongs to. However when running "updatenode $node -S", the setting is being ignored. The problem is bolded below.

      Example is below, how do I get this thing to look at the right path?


      [root@master v5.4.8-dl-compute]# chdef -t osimage v5.4.8-dl-compute otherpkgdir=/install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute/
      1 object definitions have been created or modified.

      [root@master v5.4.8-dl-compute]# lsdef -t osimage v5.4.8-dl-compute
      Object name: v5.4.8-dl-compute
      exlist=/install/custom/netboot/centos/v5.4.8-dl-compute.exlist
      groups=all
      imagetype=linux
      kerneldir=/install/netboot/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute
      netdrivers=libphy,tg3,bnx2,e1000,dca,8021q,igb,forcedeth,squashfs,aufs,loop
      nodebootif=eth0
      osarch=x86_64
      osdistroname=centos5.4-new-kernel-x86_64
      osname=Linux
      osvers=centos5.4-new-kernel
      otherpkgdir=/install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute/
      otherpkglist=/install/custom/netboot/centos/v5.4.8-dl-compute.otherpkgs.pkglist
      pkgdir=/install/centos5.4-new-kernel/x86_64/
      pkglist=/install/custom/netboot/centos/v5.4.8-dl-compute.pkglist
      postinstall=/install/custom/netboot/centos/v5.4.8-dl-compute.postinstall
      postscripts=remoteshell,localrepo5,hardeths,postage.sh
      profile=""> provmethod=netboot
      rootimgdir=/install/netboot/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute


      [root@master v5.4.8-dl-compute]# lsdef c100n4
      Object name: c100n4
      <snip>
      profile=""> provmethod=v5.4.8-dl-compute


      [root@master v5.4.8-dl-compute]# updatenode c100n4 -S
      Performing software maintenance operations. This could take a while, if there are packages to install.

      c100n4: Fri Jan 17 11:32:04 CST 2014 Running postscript: ospkgs
      c100n4: Postscript: ospkgs exited with code 0
      c100n4: Fri Jan 17 11:32:57 CST 2014 Running postscript: otherpkgs
      c100n4: NFSSERVER=master

      c100n4: OTHERPKGDIR=master/install/post/otherpkgs/centos5.4-new-kernel/x86_64

      c100n4: Loaded plugins: changelog, fastestmirror, keys, list-data, tmprepo, verify
      c100n4: Cleaning up Everything
      c100n4: Loaded plugins: changelog, fastestmirror, keys, list-data, tmprepo, verify
      c100n4: Cleaning up Everything
      c100n4: Cleaning up list of fastest mirrors
      c100n4:  yum -y upgrade
      c100n4: Loaded plugins: changelog, fastestmirror, keys, list-data, tmprepo, verify
      c100n4: Loading mirror speeds from cached hostfile
      c100n4:
      http://master/install/post/otherpkgs/centos5.4-new-kernel/x86_64/dell/repodata/repomd.xml: [Errno 14] HTTP Error 404: Not Found
      c100n4: Trying other mirror.
      c100n4: Error: Cannot retrieve repository metadata (repomd.xml) for repository: xcat-otherpkgs0. Please verify its path and try again
      <snip>
      c100n4: Postscript: otherpkgs exited with code 34
      c100n4: Running of Software Maintenance has completed.

      ------------------------------------------------------------------------------
      CenturyLink Cloud: The Leader in Enterprise Cloud Services.
      Learn Why More Businesses Are Choosing CenturyLink Cloud For
      Critical Workloads, Development Environments & Everything In Between.
      Get a Quote or Start a Free Trial Today.

      http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
      xCAT-user mailing list

      xCAT-user@lists.sourceforge.net
      https://lists.sourceforge.net/lists/listinfo/xcat-user



      ------------------------------------------------------------------------------
      CenturyLink Cloud: The Leader in Enterprise Cloud Services.
      Learn Why More Businesses Are Choosing CenturyLink Cloud For
      Critical Workloads, Development Environments & Everything In Between.
      Get a Quote or Start a Free Trial Today.

      http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


      _______________________________________________
      xCAT-user mailing list

      xCAT-user@lists.sourceforge.net
      https://lists.sourceforge.net/lists/listinfo/xcat-user




      ------------------------------------------------------------------------------
      CenturyLink Cloud: The Leader in Enterprise Cloud Services.
      Learn Why More Businesses Are Choosing CenturyLink Cloud For
      Critical Workloads, Development Environments & Everything In Between.
      Get a Quote or Start a Free Trial Today.

      http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


      _______________________________________________
      xCAT-user mailing list

      xCAT-user@lists.sourceforge.net
      https://lists.sourceforge.net/lists/listinfo/xcat-user
    ------------------------------------------------------------------------------
    CenturyLink Cloud: The Leader in Enterprise Cloud Services.
    Learn Why More Businesses Are Choosing CenturyLink Cloud For
    Critical Workloads, Development Environments & Everything In Between.
    Get a Quote or Start a Free Trial Today.

    http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
    xCAT-user mailing list

    xCAT-user@lists.sourceforge.net
    https://lists.sourceforge.net/lists/listinfo/xcat-user



    ------------------------------------------------------------------------------
    CenturyLink Cloud: The Leader in Enterprise Cloud Services.
    Learn Why More Businesses Are Choosing CenturyLink Cloud For
    Critical Workloads, Development Environments & Everything In Between.
    Get a Quote or Start a Free Trial Today.

    http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


    _______________________________________________
    xCAT-user mailing list

    xCAT-user@lists.sourceforge.net
    https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.

http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net

https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user



------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today. 
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user


------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today. 
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

Reply via email to