[zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
Last Friday 2/29 I decided to try Live Upgrade on my Solaris 10 Update 4 V480 Sparc box to apply about 50 or so patches with PCA (http://www.par.univie.ac.at/solaris/pca/). # cat /etc/release Solaris 10 8/07 s10s_u4wos_12b SPARC Copyright 2007 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 16 August 2007 # uname -a SunOS ldap-global1 5.10 Generic_127111-07 sun4u sparc SUNW,Sun-Fire-480R My 2 internal drives are mirrored with SVM for the BE and ABE. I also have 2 sparse zones installed. I disabled the primary applications (Directory Proxy Server and Directory Server) in the respective zones and applied the following 2 patches first in the global zone of the BE with no errors. ./pca --install 119254-51 119254 50 < 51 RS- 15 SunOS 5.10: Install and Patch Utilities Patch ./pca --install 121430-22 121430 21 < 22 --- 15 SunOS 5.8 5.9 5.10: Live Upgrade Patch I then ran the following Live Upgrade and PCA commands with no errors. lumake -s sol10-2007-08 -n d2 lumount d2 ./pca -R /.alt.d2 --install luumount d2 lurename -e d2 -n sol10p-20080229 luactivate sol10p-20080229 init 6 The reboot seemed fine with no errors on the console. After logging in though I noticed that only 1 of my zones started up correctly ldap-global1:/ 124# zoneadm list -cv ID NAME STATUS PATH BRANDIP 0 global running/ native shared 9 ldap-proxy1 running/zones/ldap-proxy1 native shared - ldap-supplc incomplete /zones/ldap-supplc native shared ldap-global1:/ 125# zoneadm -z ldap-supplc boot zoneadm: zone 'ldap-supplc': must be installed before boot. Since it seems that the only way to resolve an "incomplete" zone is to uninstall and then install, I decided instead to luactivate the original BE and fallback to that instead. I didn't see any zone or patch errors in the /var/adm/messages file. Perhaps someone can give me a tip of where else to look for relevant error or log files? If more information on my system config is needed please let me know too. I would ultimately like to resolve this since applying patches with Live Upgrade seems very easy to do and provides a minimal amount of downtime. Regards, -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
On Wed, Mar 05, 2008 at 04:44:19PM -0800, Eric Ham wrote: > Last Friday 2/29 I decided to try Live Upgrade on my Solaris 10 Update > 4 V480 Sparc box to apply about 50 or so patches with PCA > (http://www.par.univie.ac.at/solaris/pca/). > > [...] > > Perhaps someone can give me a tip of where else to look for relevant > error or log files? If more information on my system config is needed > please let me know too. I would ultimately like to resolve this since > applying patches with Live Upgrade seems very easy to do and provides > a minimal amount of downtime. There is a document at bigadmin: http://www.sun.com/bigadmin/sundocs/articles/sluonngzones.jsp which describes the whole process. Also please remember that Live Upgrade with zones requires patches mentioned in sunsolve document: http://sunsolve.sun.com/search/document.do?assetkey=1-9-72099-1 HTH Regards przemol -- http://przemol.blogspot.com/ -- Szybki przepis na smaczne danie? Sprawdz! kliknij >> http://link.interia.pl/f1d23 ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
Eric Ham wrote: > > I then ran the following Live Upgrade and PCA commands with no errors. > > lumake -s sol10-2007-08 -n d2 > lumount d2 > ./pca -R /.alt.d2 --install > luumount d2 > lurename -e d2 -n sol10p-20080229 > luactivate sol10p-20080229 > init 6 > live-upgrade patching should be done with "luupgrade -p", not with pca. -- Renaud ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
> Last Friday 2/29 I decided to try Live Upgrade on my Solaris 10 Update > 4 V480 Sparc box to apply about 50 or so patches with PCA > (http://www.par.univie.ac.at/solaris/pca/). > > # cat /etc/release > Solaris 10 8/07 s10s_u4wos_12b SPARC > Copyright 2007 Sun Microsystems, Inc. All Rights Reserved. > Use is subject to license terms. > Assembled 16 August 2007 > # uname -a > SunOS ldap-global1 5.10 Generic_127111-07 sun4u sparc SUNW,Sun-Fire-480R > > My 2 internal drives are mirrored with SVM for the BE and ABE. I also > have 2 sparse zones installed. I disabled the primary applications > (Directory Proxy Server and Directory Server) in the respective zones > and applied the following 2 patches first in the global zone of the BE > with no errors. > > ./pca --install 119254-51 > 119254 50 < 51 RS- 15 SunOS 5.10: Install and Patch Utilities Patch > > ./pca --install 121430-22 > 121430 21 < 22 --- 15 SunOS 5.8 5.9 5.10: Live Upgrade Patch > > I then ran the following Live Upgrade and PCA commands with no errors. > > lumake -s sol10-2007-08 -n d2 > lumount d2 > ./pca -R /.alt.d2 --install > luumount d2 > lurename -e d2 -n sol10p-20080229 > luactivate sol10p-20080229 > init 6 > > The reboot seemed fine with no errors on the console. After logging > in though I noticed that only 1 of my zones started up correctly > > ldap-global1:/ 124# zoneadm list -cv >ID NAME STATUS PATH BRAND >IP > 0 global running/ > native shared > 9 ldap-proxy1 running/zones/ldap-proxy1 > native shared > - ldap-supplc incomplete /zones/ldap-supplc > native shared > > ldap-global1:/ 125# zoneadm -z ldap-supplc boot > zoneadm: zone 'ldap-supplc': must be installed before boot. > > Since it seems that the only way to resolve an "incomplete" zone is to > uninstall and then install, I decided instead to luactivate the > original BE and fallback to that instead. I didn't see any zone or > patch errors in the /var/adm/messages file. > > Perhaps someone can give me a tip of where else to look for relevant > error or log files? If more information on my system config is needed > please let me know too. I would ultimately like to resolve this since > applying patches with Live Upgrade seems very easy to do and provides > a minimal amount of downtime. > Have you tried a luactivate directly after the lumake ? There is a bug in cpio that causes lucreate to fail to create the zones in the new be when there is a server in the zone that uses unix domain sockets. One server I had that caused the problem was the admin server used for the directory server. I don't have the CR number available right now. Paul ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
> There is a document at bigadmin: > http://www.sun.com/bigadmin/sundocs/articles/sluonngzones.jsp > which describes the whole process. Also please remember that > Live Upgrade with zones requires patches mentioned in sunsolve > document: > http://sunsolve.sun.com/search/document.do?assetkey=1-9-72099-1 Przemol, Thank you for the links. From the bigadmin article it looks like I should have tried the luactivate right after the lumake to make sure the zones were working at that point before adding the uncertainties of patching first and then doing luactivate. I'll try the luactivate sooner in my process when I get approval to take the box offline again. >From that patches link it seems that I am up to date with everything there. Though I do see the following ones are newer than what is on that list: 119254 51 < 52 RS- 5 SunOS 5.10: Install and Patch Utilities Patch 124630 14 < 15 --- 1 SunOS 5.10: System Administration Applications, Network, and Core 120272 16 < 18 RS- 13 SunOS 5.10: SMA patch I'll try updating those in the global zone first before doing any of the LU commands. Thanks, -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
On Thu, Mar 6, 2008 at 2:09 AM, Renaud Manus <[EMAIL PROTECTED]> wrote: > > > Eric Ham wrote: > > > > I then ran the following Live Upgrade and PCA commands with no errors. > > > > lumake -s sol10-2007-08 -n d2 > > lumount d2 > > ./pca -R /.alt.d2 --install > > luumount d2 > > lurename -e d2 -n sol10p-20080229 > > luactivate sol10p-20080229 > > init 6 > > > > live-upgrade patching should be done with "luupgrade -p", not with pca. > > -- Renaud > Ok, I'll give that a shot as something else to try. Now I just have to get approval for taking the box offline again, which might be late next week. Thanks, -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
Jordan Brown wrote: > Renaud Manus wrote: >> Eric Ham wrote: >>> I then ran the following Live Upgrade and PCA commands with no errors. >>> >>> lumake -s sol10-2007-08 -n d2 >>> lumount d2 >>> ./pca -R /.alt.d2 --install >>> luumount d2 >>> lurename -e d2 -n sol10p-20080229 >>> luactivate sol10p-20080229 >>> init 6 >>> >> >> live-upgrade patching should be done with "luupgrade -p", not with pca. > > luupgrade -p does essentially that same set of operations. > lumount+pca+luumount should be OK. But we (Sun) don't support it. -- Renaud ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
> Have you tried a luactivate directly after the lumake ? > There is a bug in cpio that causes lucreate to fail to create the zones in > the new be when > there is a server in the zone that uses unix domain sockets. One server I > had that caused the > problem was the admin server used for the directory server. > > I don't have the CR number available right now. Paul, After reading that BigAdmin article that przemol suggested I see that I should have tried the luactivate after the lumake. You may be onto something with the unix domain sockets. The zone that failed (ldap-supplc) is running Directory Server 5.2P4. Looking at the box now in production I see that there are several sockets from the "netstat -an" output below for the admin server. Since I turned Directory Server off before running the LU commands I would have thought those sockets would be cleaned up? If you can find the CR number maybe it's related to my system. 60005bdc728 stream-ord /var/Sun/mps/admin-serv/tmp/iwsadmin.2012 60005bdc8f0 stream-ord /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 60005bdcab8 stream-ord /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 60005bdcc80 stream-ord 600070e1640 /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 60005bdce48 stream-ord 6000713c000 /var/Sun/mps/admin-serv/tmp/iwsadmin.2012 60005bdd010 stream-ord 600070e1640 /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 60005bdd1d8 stream-ord 6000713c000 /var/Sun/mps/admin-serv/tmp/iwsadmin.2012 60005bdd3a0 stream-ord 60006e04d40 /var/run/.inetd.uds 60005bdd730 stream-ord 600070e1640 /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 Thanks, -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
On Thu, Mar 6, 2008 at 9:42 AM, Renaud Manus <[EMAIL PROTECTED]> wrote: > Jordan Brown wrote: > > Renaud Manus wrote: > >> Eric Ham wrote: > >>> I then ran the following Live Upgrade and PCA commands with no errors. > >>> > >>> lumake -s sol10-2007-08 -n d2 > >>> lumount d2 > >>> ./pca -R /.alt.d2 --install > >>> luumount d2 > >>> lurename -e d2 -n sol10p-20080229 > >>> luactivate sol10p-20080229 > >>> init 6 > >>> > >> > >> live-upgrade patching should be done with "luupgrade -p", not with pca. > > > > luupgrade -p does essentially that same set of operations. > > lumount+pca+luumount should be OK. > > But we (Sun) don't support it. > Understood. I'm trying to get approval now to redo the LU and patching tasks, but it probably won't be until late next week. I'll give the "luupgrade -p" a shot at that time. Thanks to everyone for the quick responses. Regards, -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
[ Sorry if this is a repeat. I tried to abort it during the original send and haven't gotten my own copy, so I think something went a bit weird. ] Renaud Manus wrote: > Eric Ham wrote: >> I then ran the following Live Upgrade and PCA commands with no errors. >> >> lumake -s sol10-2007-08 -n d2 >> lumount d2 >> ./pca -R /.alt.d2 --install >> luumount d2 >> lurename -e d2 -n sol10p-20080229 >> luactivate sol10p-20080229 >> init 6 >> > > live-upgrade patching should be done with "luupgrade -p", not with pca. luupgrade -p does essentially that same set of operations. lumount+pca+luumount should be OK. (Of course, we'd really rather that you use smpatch update -b instead of pca, but that's a different question.) ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
Renaud Manus wrote: > Jordan Brown wrote: >> luupgrade -p does essentially that same set of operations. >> lumount+pca+luumount should be OK. > > But we (Sun) don't support it. True (which is why I said we'd prefer you used smpatch), but I believe that lumount + patchadd -R + luumount *is* supported, and that's basically what the PCA sequence does. ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
Sorry, it's '-t' and not '-p'. -- Renaud Eric Ham wrote: > On Thu, Mar 6, 2008 at 9:42 AM, Renaud Manus <[EMAIL PROTECTED]> wrote: >> Jordan Brown wrote: >> > Renaud Manus wrote: >> >> Eric Ham wrote: >> >>> I then ran the following Live Upgrade and PCA commands with no errors. >> >>> >> >>> lumake -s sol10-2007-08 -n d2 >> >>> lumount d2 >> >>> ./pca -R /.alt.d2 --install >> >>> luumount d2 >> >>> lurename -e d2 -n sol10p-20080229 >> >>> luactivate sol10p-20080229 >> >>> init 6 >> >>> >> >> >> >> live-upgrade patching should be done with "luupgrade -p", not with pca. >> > >> > luupgrade -p does essentially that same set of operations. >> > lumount+pca+luumount should be OK. >> >> But we (Sun) don't support it. >> > > Understood. I'm trying to get approval now to redo the LU and > patching tasks, but it probably won't be until late next week. I'll > give the "luupgrade -p" a shot at that time. > > Thanks to everyone for the quick responses. > > Regards, > -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
On Thu, Mar 6, 2008 at 11:41 AM, Renaud Manus <[EMAIL PROTECTED]> wrote: > Sorry, it's '-t' and not '-p'. > > -- Renaud > Ah yes, after consulting the man page on luupgrade, '-t' is what I would need. ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
> > Have you tried a luactivate directly after the lumake ? > > There is a bug in cpio that causes lucreate to fail to create the > zones in the new be when > > there is a server in the zone that uses unix domain sockets. One > server I had that caused the > > problem was the admin server used for the directory server. > > > > I don't have the CR number available right now. > > Paul, > > After reading that BigAdmin article that przemol suggested I see that > I should have tried the luactivate after the lumake. > > You may be onto something with the unix domain sockets. The zone that > failed (ldap-supplc) is running Directory Server 5.2P4. Looking at > the box now in production I see that there are several sockets from > the "netstat -an" output below for the admin server. Since I turned > Directory Server off before running the LU commands I would have > thought those sockets would be cleaned up? If you can find the CR > number maybe it's related to my system. > I only ran into it with the servers enabled at boot in the zones, disabling the servers seems to fix the problem. The sockets apparently only were created when the server was running. Even though I had the zones halted the lucreate process started them enough to have the server processes started. I did get an error message from lucreate that the zone copy in the new BE was not created correctly. If you don't get that error you are probably running into something else. The CR number is 2154382, it's an old one but has been bumped up to P1. Paul > 60005bdc728 stream-ord > /var/Sun/mps/admin-serv/tmp/iwsadmin.2012 > 60005bdc8f0 stream-ord > /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 > 60005bdcab8 stream-ord > /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 > 60005bdcc80 stream-ord 600070e1640 > /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 > 60005bdce48 stream-ord 6000713c000 > /var/Sun/mps/admin-serv/tmp/iwsadmin.2012 > 60005bdd010 stream-ord 600070e1640 > /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 > 60005bdd1d8 stream-ord 6000713c000 > /var/Sun/mps/admin-serv/tmp/iwsadmin.2012 > 60005bdd3a0 stream-ord 60006e04d40 /var/run/.inetd.uds > 60005bdd730 stream-ord 600070e1640 > /var/Sun/mps/admin-serv/tmp/iwswatchdog.2011 > > > Thanks, > -Eric > ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Patches via Live Upgrade with 2 zones on Solaris 10 Update 4 failed
On Fri, Mar 7, 2008 at 7:41 AM, Paul Van Der Zwan wrote: > I only ran into it with the servers enabled at boot in the zones, disabling > the servers seems > to fix the problem. > The sockets apparently only were created when the server was running. Even > though I had > the zones halted the lucreate process started them enough to have the server > processes started. > I did get an error message from lucreate that the zone copy in the new BE > was not created > correctly. If you don't get that error you are probably running into > something else. > > The CR number is 2154382, it's an old one but has been bumped up to P1. Paul, So it looks like that CR is definitely what I was running into. I see from http://bugs.opensolaris.org/view_bug.do?bug_id=2154382 that this has been fixed in Solaris 10 Update 5. Do you know if a patch will be made for Solaris 10 Update 4? I finally got a chance to retry the LU on my server yesterday 4/2. I started with the lumake and this time I got the following error. Copying root of zone . ERROR: Zone in BE : cannot copy root See for details. Checking that error file I see the following. cpio: Cannot open "./root/var/Sun/mps/admin-serv/tmp/iwswatchdog.19207", skipped, errno 122, Operation not supported on transport endpoint cpio: Cannot open "./root/var/Sun/mps/admin-serv/tmp/iwsadmin.19208", skipped, errno 122, Operation not supported on transport endpoint 8052896 blocks 2 error(s) Sure enough these were sockets that were not cleaned up when I shutdown Directory Server 5.2P4. So I went ahead and manully ran rm on each socket file and tried lumake again. This time there were no errors. I did luactivate and booted to the ABE with no problem and the 2 zones started up fine. I then went back to the BE and applied my patches with PCA (yes I know PCA is not supported by Sun) with the following commands. lumount sol10p-20080402 ./pca -R /.alt.sol10p-20080402 --install luumount sol10p-20080402 Another luactivate of the ABE followed by an init 6 and all seems to be fine now. So, hopefully there will be a patch to cpio in the future, or I'll just have to pay closer attention to those lingering sockets. Thanks again to everyone's input and help. I really appreciate it. Regards, -Eric ___ zones-discuss mailing list zones-discuss@opensolaris.org
