John, We checked the linux scripts on several guests with what you sent us and our scripts are very similar. We went through the process with one test linux /oracle guest and reviewed the log. This guest came down cleanly without any issues. Oracle shutdown down normally, all within about 30 seconds. The problem that occurred on Sunday was that we shutdown approximately 35 linux guests of which about 20 have Oracle databases. We did stagger the shutdowns to some degree to alleviate system contention for resources. The test database was also a small database. Some of the production databases are about 2-3tb each, and would probably take longer than 30 seconds to shutdown depending on what they were doing at the time. It seems as though all of the guests shutdown within 30 seconds and the scripts on some have not completed processing yet. We are going to continue to research this and see where we might have made a mistake. I am also going to look at the SYSVINIT product, since it appears that it could be very helpful in an orderly shutdown/startup of the guests from a vm standpoint. The input from the list respondants has been very informative. We are kind of new to this environment; but it is growing very fast at our site. Thanks, Bob
-----Original Message----- From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Romanowski, John (OFT) Sent: Wednesday, June 10, 2009 3:38 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Clean Linux Guest Shutdown ( resent to correct my /etc/init.d/rc.3/ to /etc/init.d/rc3.d/) Bob, I think it's as the others said, Linux is shutting down the way you told it to do but not the way you intend it to do: Here's how we shutdown a disconnected sles 10 oracle server gracefully here, hope the example helps you: /etc/inittab has a record to run 'shutdown -h now' in response to the SIGNAL SHUTDOWN or FORCE WITHIN ca::ctrlaltdel:/sbin/shutdown -h -t 4 now our zipl.conf doesn't have any vmpoff/halt-whatevers in it. CP Q SIGNALS shows the oracle guest enabled for the SHUTDOWN signal Signalled Timeout Userid Signal Signal Status By Remaining DZ2DF138 SHUTDOWN Enabled - - init script dbora (see listing below) with proper comment headers is in /etc/init.d/dbora I ran command 'chkconfig dbora on' so the start/kill symlinks to dbora are built in /etc/init.d/rc3.d/ 'chkconfig -l dbora' reports dbora is on in run level 3 dz2df138 is running disconnected; From VM did CP SIGNAL SHUTDOWN dz2df138 On dz2df138 oracle shutdown cleanly and then linux finished shutting down, and VM then logged off dz2df138. This is our /etc/init.d/dbora script: ------------------------------------- #!/bin/sh # OFT John R 3/20/2007 An init script to start/stop oracle 10gR2 database(s) # and the Oracle "listener" by running Oracle's scripts based on this script's # input parameter of "start" or "stop". # The Oracle scripts are run as userid oracle. # #This incorporates some code from Oracle's dbora script shown in their doc. We use # 'su' not 'rsh' that Oracle used. ### BEGIN INIT INFO # Provides: dbora # Required-Start: $local_fs $network $syslog # Should-Start: $local_fs $network $syslog nscd sshd # Default-Start: 3 # Short-Description: Starts/stops oracle db and listener. # Description: dbora is OFT's script to start/stop oracle database and its listener; # also starts/stops oracle dbconsole. ### END INIT INFO case "$1" in 'start') echo "... ORACLE listener, database(s) and dbconsole starting ..." su - oracle -c "sh -c \"dbstart \$ORACLE_HOME \" " echo " emctl start dbconsole..." su - oracle -c "sh -c \"emctl start dbconsole \" " & #can be in parallel ;; 'stop') echo "... ORACLE dbconsole, database(s) and listener stopping ..." su - oracle -c "sh -c \"emctl stop dbconsole \" " echo " dbshut..." su - oracle -c "sh -c \"dbshut \$ORACLE_HOME \" " ;; *) echo "usage: $0 {start | stop}" exit ;; esac #-------------------------------------------------------- > -----Original Message----- > From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] > On Behalf Of Robert J McCarthy > Sent: Wednesday, June 10, 2009 1:59 PM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Clean Linux Guest Shutdown > > John, > I am sorry I wasn't clear. VM and linux are communicating : > When I enter the CP SIGNAL SHUTDOWN command from MAINT linux begins > shutting down. A short time later vm receives the termination from > linux and writes the following message to the vm MAINT log : > HCPSIG2113I User ZORACLE2 has reported successful termination From a > vm standpoint everything appears to be working as designed. It appears > that linux sends the termination response to vm before it has really > completed it's (linux)shutdown. In linux's inittab we have "shutdown > -h" coded. > Thanks, Bob > > -----Original Message----- > From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] > On Behalf Of Romanowski, John (OFT) > Sent: Wednesday, June 10, 2009 12:57 PM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Clean Linux Guest Shutdown > > I CP FORCE guest WITHIN nn > Like CP SIGNAL SHUTDOWN that triggers the linux's inittab CTRLALTDEL > entry. > > What do you mean when you say "linux appears to send a response to VM > saying it has completed shutdown; but apparently it really hasn't "? > > Is that sent response just a message on the guest's console or a linux > script doing VMCP MESSAGE userid blah blah blah? > > > -----Original Message----- > > From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] > > On Behalf Of Robert J McCarthy > > Sent: Wednesday, June 10, 2009 12:34 PM > > To: IBMVM@LISTSERV.UARK.EDU > > Subject: Re: Clean Linux Guest Shutdown > > > > John, > > When you shutdown your linux guest, do you use a "CP SIGNAL > > SHUTDOWN" > > command to tell linux to shutdown, or do you manually shutdown linux. > > Our manual shutdown appears to work, but when we try to automate it > > with the "CP SIGNAL SHUTDOWN" from vm; linux appears to send a > > response to vm saying it has completed shutdown; but appraently it > > really hasn't. > > Thanks, Bob > > > > -----Original Message----- > > From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] > > On Behalf Of Romanowski, John (OFT) > > Sent: Wednesday, June 10, 2009 9:19 AM > > To: IBMVM@LISTSERV.UARK.EDU > > Subject: Re: Clean Linux Guest Shutdown > > > > We start/stop oracle with an init.d script so oracle's start/stop is > > part of Linux's boot and shutdown sequence. This e-mail, including any attachments, may be confidential, privileged or otherwise legally protected. It is intended only for the addressee. If you received this e-mail in error or from someone who was not authorized to send it to you, do not disseminate, copy or otherwise use this e-mail or its attachments. Please notify the sender immediately by reply e-mail and delete the e-mail from your system.