The root problem seems to be a mismatch of the private IP address for the management node defined in /etc/hosts (136.159.222.142) and the address actually being used on the management node (136.159.222.191). This caused a problem when the firewall was initially configured for the reservation due to some poorly written firewall code which locked the management node out of the VM. The image capture is failing because the management node is not able to log in to the VM via SSH due to the firewall.
To fix the problem, first check /etc/hosts on the management node and make sure the entry for vcl-mgmtnode-1 matches what the management node is actually using. You will then need to log in to the VM and fix iptables so the management node can log in on port 22. The VM's root password was randomized but you can find it in the vcld.log output by searching for 'passwd'. Verify that you can log in via SSH from the management node to the VM and then reattempt the image capture by changing the value in the database's request table. Find request ID = 117, change request.stateid from 10 to 16. Regards, Andy On Wed, Jul 23, 2014 at 6:17 PM, Xiaowei Liu (Vivien) <[email protected]> wrote: > Hi Aaron, > > I collected the related logs with request and reservation id 117:117, and > attached the log with the email. I searched for "failed" keyword, and there > are several places that have different errors. > > Could you please advice some next step to try in order to solve our issue? > > Thanks a lot for your prompt reply. > > > > On Wed, Jul 23, 2014 at 2:22 PM, Aaron Peeler <[email protected]> > wrote: > >> You will need to find the request id that relates to the failed >> reservation. >> >> In the logfile you will see the format string of: >> <data_time>|pid from OS|requestid:reservationid|<state>|....... >> >> You can grep for the state image. >> >> or >> >> The you can find out the requestid from the mysql db. >> >> Go to the database and using phpmyadmin or cmdline, or which ever db >> management tool you use and look in the request table for any >> reservations in with stateid=16 which is the maintenance state. >> >> Once you have the request.id you can narrow down the log file to trace >> through the part where it failed. >> >> The log output you sent only contains reservations in the inuse state. >> >> Aaron >> >> >> On Wed, Jul 23, 2014 at 3:59 PM, Xiaowei Liu (Vivien) >> <[email protected]> wrote: >> > Hi Aaron, >> > >> > Yes. I have the administrator access to VCL system. >> > >> > I look at the /var/log/vcld.log and there are lots of content in it, not >> > sure which keywords I should search for. Could you please hint some >> keywords >> > related to updating an existing base image? >> > >> > >> > On Wed, Jul 23, 2014 at 1:36 PM, Aaron Peeler <[email protected]> >> wrote: >> >> >> >> Hello, >> >> >> >> You'll need to look at the /var/log/vcld.log file for the details of >> >> why it failed. >> >> >> >> Do you have access to the log file on the vcl management node? Are you >> >> the VCL administrator for that system? Sorry, that's not clear from >> >> your email. >> >> >> >> Thanks, >> >> Aaron >> >> >> >> >> >> On Wed, Jul 23, 2014 at 2:04 PM, Xiaowei Liu (Vivien) >> >> <[email protected]> wrote: >> >> > Hi, >> >> > >> >> > We are following this wiki page >> >> > >> >> > >> https://cwiki.apache.org/confluence/display/VCL/Updating+an+Existing+Image >> >> > to try to update an existing base image in our VCL system. But when >> we >> >> > try >> >> > to save the image, the user kept getting the following email and the >> >> > process >> >> > doesn't seem to work. >> >> > >> >> > Could someone please kindly advice what should we do about it? Does >> the >> >> > administrator need to configure something manually to make it happen? >> >> > Thanks >> >> > a lot! >> >> > >> >> > The email notification has the following content: >> >> > >> >> > "We apologize for the inconvenience. >> >> > Your image creation of av2014_testbase has been delayed >> >> > due to a system issue that prevented the automatic completion. >> >> > >> >> > The image creation request and the computing resource have >> >> > been placed in a safe mode. The VCL system administrators >> >> > have been notified for manual intervention. >> >> > >> >> > Once the issues have been resolved, you will be notified >> >> > by the successful completion email or contacted directly >> >> > by the VCL system administrators. >> >> > >> >> > If you do not receive a response within one business day, please >> >> > reply to this email. >> >> > >> >> > Thank You, >> >> > VCL Team" >> >> >> >> >> >> >> >> -- >> >> Aaron Peeler >> >> Program Manager >> >> Virtual Computing Lab >> >> NC State University >> >> >> >> All electronic mail messages in connection with State business which >> >> are sent to or received by this account are subject to the NC Public >> >> Records Law and may be disclosed to third parties. >> > >> > >> >> >> >> -- >> Aaron Peeler >> Program Manager >> Virtual Computing Lab >> NC State University >> >> All electronic mail messages in connection with State business which >> are sent to or received by this account are subject to the NC Public >> Records Law and may be disclosed to third parties. >> > >
