vcld.log has been attached in this email..!! On Tue, Apr 6, 2010 at 11:37 AM, Kiran N <kiran.nellima...@gmail.com> wrote:
> Hello All, > I am trying to make a reservation for an Windows203 image using ESX > provisioning. > I am facing an SSH error (as seen in the log file) with error code of 255. > > The IDENTITY * lines in the /etc/vcl/vcld.conf are : > IDENTITY_blade_linux=/etc/vcl/vcl.key > IDENTITY_solaris_lab=/etc/vcl/vcl.key > IDENTITY_linux_lab=/etc/vcl/vcl.key > IDENTITY_blade_win=/etc/vcl/vcl.key > > I am using NFS as my datastore. In my vmprofile table I have set the 2 > important fields as below: > datastorepath: 10.0.0.2:/vcl-nfs/export/golden ---- this is the path on > the management node from where vmhost has mounted the image. > vmpath: /vmfs/volumes/VCL --- This is path on my vmhost machine for the > image. > Also, when I try to ssh into my vmhost machine - cleesx(10.0.0.3) from > command line on management node, then it does login into it successfully. > > The vcld.log file has been attached with this email. > Please provide me with some inputs! > > -- > Thanks, > Kiranmye N > WSTI Intern >
|16143|23:23|reload| ---- WARNING ---- |16143|23:23|reload| 2010-04-05 11:22:12|16143|23:23|reload|vcld:warning_handler(636)|Use of uninitialized value in pattern match (m//) at /usr/local/vcl/bin/../lib/VCL/Module/State.pm line 312. |16143|23:23|reload| ( 0) utils.pm, notify (line: 727) |16143|23:23|reload| (-1) vcld, warning_handler (line: 636) |16143|23:23|reload| (-2) State.pm, reservation_failed (line: 312) |16143|23:23|reload| (-3) new.pm, process (line: 316) |16143|23:23|reload| (-4) vcld, make_new_child (line: 594) |16143|23:23|reload| (-5) vcld, main (line: 341) 2010-04-05 11:22:12|16143|23:23|reload|utils.pm:update_computer_state(2218)|computer 2 state updated to: failed 2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(312)|computer vcl01 (2) state set to failed 2010-04-05 11:22:12|16143|23:23|reload|utils.pm:update_request_state(2176)|request 23 state updated to: failed, laststate to: reload 2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(325)|set request state to 'failed'/'reload' 2010-04-05 11:22:12|16143|23:23|reload|utils.pm:is_inblockrequest(6953)|zero rows were returned from database select 2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(343)|vcl01 is NOT in blockcomputers table 2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(346)|exiting 1 2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(905)|destructor called, ref($self)=VCL::new 2010-04-05 11:22:12|16143|23:23|reload|utils.pm:delete_computerloadlog_reservation(7532)|removing computerloadlog entries matching loadstate = begin 2010-04-05 11:22:12|16143|23:23|reload|utils.pm:delete_computerloadlog_reservation(7579)|deleted rows from computerloadlog for reservation id=23 2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(912)|removed computerloadlog rows with loadstate=begin for reservation 2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(924)|number of database handles state process created: 1 2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(933)|process has a database handle stored in $ENV{dbh}, attempting disconnect 2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(935)|$ENV{dbh}: database disconnect successful 2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(949)|VCL::new process 16143 exiting 2010-04-05 11:22:12|11472|vcld:REAPER(744)|VCL process exited for reservation 23 2010-04-05 11:22:12|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:12 2010-04-05 11:22:12|11472|23:23|failed|vcld:main(250)|request deleted 2010-04-05 11:22:17|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:17 2010-04-05 11:22:22|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:22 2010-04-05 11:22:27|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:27 2010-04-05 11:22:32|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:32 2010-04-05 11:22:37|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:37 2010-04-05 11:22:42|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:42 2010-04-05 11:22:47|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:47 2010-04-05 11:22:52|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:52 2010-04-05 11:22:57|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:22:57 [r...@vclrhel01 ~]# tail -f /var/log/vcld.log 2010-04-05 11:24:22|16380|24:24|reload|utils.pm:get_management_node_id(9345)|environment variable: 1 2010-04-05 11:24:22|16380|24:24|reload|new.pm:reload_image(514)|calling VCL::Module::Provisioning::vmware->node_status() 2010-04-05 11:24:22|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, statuscheck, checking status of node 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1872)|identity_keys= /etc/vcl/vcl.key 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1873)|requestedimagename= esx3-win2003-v0 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1874)|image_os_type= windows 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1875)|request_forimaging= 0 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1876)|vmpath= /vmfs/volumes/VCL 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1877)|datastorepath= 10.0.0.2:/vcl-nfs/export/golden 2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1895)|checking if vcl01 is pingable 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1901)|vcl01 is not pingable (0) 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6167)|executing SSH command on cleesx.democentral.ibm.com: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx.democentral.ibm.com 'vmware-cmd /vmfs/volumes/VCL/esx3-win2003-v0vcl01/esx3-win2003-v0vcl01.vmx getstate' 2>&1 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6249)|run_ssh_command output: |16380|24:24|reload| VMControl error -11: No such virtual machine 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6259)|SSH command executed on cleesx.democentral.ibm.com, command: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx.democentral.ibm.com 'vmware-cmd /vmfs/volumes/VCL/esx3-win2003-v0vcl01/esx3-win2003-v0vcl01.vmx getstate' 2>&1 |16380|24:24|reload| returning (11, "VMControl error -11: No such v...") 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1914)|VMControl error -11: No such virtual machine 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1925)|vcl01 vmstate reports 0 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1963)|returning node status hash reference ($node_status->{status}=RELOAD) 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(529)|node_status returned a hash reference 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(534)|node_status hash reference contains key {status}=RELOAD |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:23|16380|24:24|reload|vcld:warning_handler(636)|Use of uninitialized value in string eq at /usr/local/vcl/bin/../lib/VCL/new.pm line 573. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) vcld, warning_handler (line: 636) |16380|24:24|reload| (-2) new.pm, reload_image (line: 573) |16380|24:24|reload| (-3) new.pm, process (line: 266) |16380|24:24|reload| (-4) vcld, make_new_child (line: 594) |16380|24:24|reload| (-5) vcld, main (line: 341) 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(602)|node status is RELOAD, vcl01 will be reloaded 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, loadimageblade, vcl01 must be reloaded with esx3-win2003-v0 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(616)|calling VCL::Module::Provisioning::vmware->does_image_exist() 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:does_image_exist(2002)|image repository path: /install/vmware_images 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_command(9718)|executed command: du -c /install/vmware_images/*esx3-win2003-v0* 2>&1 | grep total 2>&1, pid: 16387, exit status: 0, output: |16380|24:24|reload| 28731484 total 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:does_image_exist(2054)|esx3-win2003-v0 exists in /install/vmware_images, size: 28058 MB 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(619)|esx3-win2003-v0 exists on this management node 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, doesimageexists, confirmed image exists 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:update_computer_state(2218)|computer 2 state updated to: reloading 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(652)|computer vcl01 state set to reloading 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, info, computer state updated to reloading 2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(663)|calling VCL::Module::Provisioning::vmware->load() subroutine 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, info, calling VCL::Module::Provisioning::vmware->load() subroutine 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:control_VM(1510)|control remove is defined 2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:control_VM(1574)|checking for base image on cleesx 10.0.0.2:/vcl-nfs/export/golden 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6167)|executing SSH command on cleesx: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1 |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 1/3: failed to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit status: 255, SSH exits with the exit status of the remote command or with 255 if an error occurred, output: |16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239) |16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575) |16380|24:24|reload| (-3) vmware.pm, load (line: 130) |16380|24:24|reload| (-4) new.pm, reload_image (line: 665) |16380|24:24|reload| (-5) new.pm, process (line: 266) |16380|24:24|reload| (-6) vcld, make_new_child (line: 594) 2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping for 2 seconds before making next SSH attempt 2010-04-05 11:24:25|16380|24:24|reload|utils.pm:run_ssh_command(6171)|attempt 2/3: executing SSH command on cleesx: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1 |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:25|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 2/3: failed to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit status: 255, SSH exits with the exit status of the remote command or with 255 if an error occurred, output: |16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239) |16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575) |16380|24:24|reload| (-3) vmware.pm, load (line: 130) |16380|24:24|reload| (-4) new.pm, reload_image (line: 665) |16380|24:24|reload| (-5) new.pm, process (line: 266) |16380|24:24|reload| (-6) vcld, make_new_child (line: 594) 2010-04-05 11:24:25|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping for 15 seconds before making next SSH attempt 2010-04-05 11:24:27|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:24:27 2010-04-05 11:24:32|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:24:32 2010-04-05 11:24:37|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:24:37 2010-04-05 11:24:40|16380|24:24|reload|utils.pm:run_ssh_command(6171)|attempt 3/3: executing SSH command on cleesx: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1 |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:40|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 3/3: failed to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit status: 255, SSH exits with the exit status of the remote command or with 255 if an error occurred, output: |16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239) |16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575) |16380|24:24|reload| (-3) vmware.pm, load (line: 130) |16380|24:24|reload| (-4) new.pm, reload_image (line: 665) |16380|24:24|reload| (-5) new.pm, process (line: 266) |16380|24:24|reload| (-6) vcld, make_new_child (line: 594) |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:40|16380|24:24|reload|utils.pm:run_ssh_command(6272)|failed to run SSH command after 3 attempts, command: /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1, exit status: 255, output: |16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6272) |16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575) |16380|24:24|reload| (-3) vmware.pm, load (line: 130) |16380|24:24|reload| (-4) new.pm, reload_image (line: 665) |16380|24:24|reload| (-5) new.pm, process (line: 266) |16380|24:24|reload| (-6) vcld, make_new_child (line: 594) |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:40|16380|24:24|reload|vmware.pm:control_VM(1577)|failed to run ssh command: ls -1 10.0.0.2:/vcl-nfs/export/golden |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) vmware.pm, control_VM (line: 1577) |16380|24:24|reload| (-2) vmware.pm, load (line: 130) |16380|24:24|reload| (-3) new.pm, reload_image (line: 665) |16380|24:24|reload| (-4) new.pm, process (line: 266) |16380|24:24|reload| (-5) vcld, make_new_child (line: 594) |16380|24:24|reload| (-6) vcld, main (line: 341) 2010-04-05 11:24:40|16380|24:24|reload|DataStructure.pm:get_computer_private_ip_address(1418)|returning private IP address previously retrieved from /etc/hosts: 10.0.0.10 2010-04-05 11:24:41|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, startload, vcl01 esx3-win2003-v0 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(216)|identity file set /etc/vcl/vcl.key vmhost imagename noimage bladekey /etc/vcl/vcl.key 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(244)|persistent= 0 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(245)|myvmdir= esx3-win2003-v0vcl01 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(246)|myvmx= /vmfs/volumes/VCL/esx3-win2003-v0vcl01/esx3-win2003-v0vcl01.vmx 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(247)|mybasedirname= esx3-win2003-v0 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(248)|myimagename= esx3-win2003-v0 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(251)|checking for base image esx3-win2003-v0vcl01 on cleesx 2010-04-05 11:24:41|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted computer=2, vmround1, checking host for requested image files 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(256)|trying to create exclusive lock on /tmp/cleesxesx3-win2003-v0lock while checking if image files exist on host 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(259)|owning exclusive lock on /tmp/cleesxesx3-win2003-v0lock 2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(260)|listing datestore 10.0.0.2:/vcl-nfs/export/golden 2010-04-05 11:24:41|16380|24:24|reload|utils.pm:run_ssh_command(6167)|executing SSH command on cleesx: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1 |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:41|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 1/3: failed to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit status: 255, SSH exits with the exit status of the remote command or with 255 if an error occurred, output: |16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239) |16380|24:24|reload| (-2) vmware.pm, load (line: 262) |16380|24:24|reload| (-3) new.pm, reload_image (line: 665) |16380|24:24|reload| (-4) new.pm, process (line: 266) |16380|24:24|reload| (-5) vcld, make_new_child (line: 594) |16380|24:24|reload| (-6) vcld, main (line: 341) 2010-04-05 11:24:41|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping for 2 seconds before making next SSH attempt 2010-04-05 11:24:42|11472|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-05 11:24:42 2010-04-05 11:24:43|16380|24:24|reload|utils.pm:run_ssh_command(6171)|attempt 2/3: executing SSH command on cleesx: |16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1 |16380|24:24|reload| ---- WARNING ---- |16380|24:24|reload| 2010-04-05 11:24:43|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 2/3: failed to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit status: 255, SSH exits with the exit status of the remote command or with 255 if an error occurred, output: |16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed. |16380|24:24|reload| ( 0) utils.pm, notify (line: 727) |16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239) |16380|24:24|reload| (-2) vmware.pm, load (line: 262) |16380|24:24|reload| (-3) new.pm, reload_image (line: 665) |16380|24:24|reload| (-4) new.pm, process (line: 266) |16380|24:24|reload| (-5) vcld, make_new_child (line: 594) |16380|24:24|reload| (-6) vcld, main (line: 341) 2010-04-05 11:24:43|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping for 15 seconds before making next SSH attempt