vcld.log has been attached in this email..!!
On Tue, Apr 6, 2010 at 11:37 AM, Kiran N <[email protected]> wrote:
> Hello All,
> I am trying to make a reservation for an Windows203 image using ESX
> provisioning.
> I am facing an SSH error (as seen in the log file) with error code of 255.
>
> The IDENTITY * lines in the /etc/vcl/vcld.conf are :
> IDENTITY_blade_linux=/etc/vcl/vcl.key
> IDENTITY_solaris_lab=/etc/vcl/vcl.key
> IDENTITY_linux_lab=/etc/vcl/vcl.key
> IDENTITY_blade_win=/etc/vcl/vcl.key
>
> I am using NFS as my datastore. In my vmprofile table I have set the 2
> important fields as below:
> datastorepath: 10.0.0.2:/vcl-nfs/export/golden ---- this is the path on
> the management node from where vmhost has mounted the image.
> vmpath: /vmfs/volumes/VCL --- This is path on my vmhost machine for the
> image.
> Also, when I try to ssh into my vmhost machine - cleesx(10.0.0.3) from
> command line on management node, then it does login into it successfully.
>
> The vcld.log file has been attached with this email.
> Please provide me with some inputs!
>
> --
> Thanks,
> Kiranmye N
> WSTI Intern
>
|16143|23:23|reload| ---- WARNING ----
|16143|23:23|reload| 2010-04-05
11:22:12|16143|23:23|reload|vcld:warning_handler(636)|Use of uninitialized
value in pattern match (m//) at /usr/local/vcl/bin/../lib/VCL/Module/State.pm
line 312.
|16143|23:23|reload| ( 0) utils.pm, notify (line: 727)
|16143|23:23|reload| (-1) vcld, warning_handler (line: 636)
|16143|23:23|reload| (-2) State.pm, reservation_failed (line: 312)
|16143|23:23|reload| (-3) new.pm, process (line: 316)
|16143|23:23|reload| (-4) vcld, make_new_child (line: 594)
|16143|23:23|reload| (-5) vcld, main (line: 341)
2010-04-05
11:22:12|16143|23:23|reload|utils.pm:update_computer_state(2218)|computer 2
state updated to: failed
2010-04-05
11:22:12|16143|23:23|reload|State.pm:reservation_failed(312)|computer vcl01 (2)
state set to failed
2010-04-05
11:22:12|16143|23:23|reload|utils.pm:update_request_state(2176)|request 23
state updated to: failed, laststate to: reload
2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(325)|set
request state to 'failed'/'reload'
2010-04-05 11:22:12|16143|23:23|reload|utils.pm:is_inblockrequest(6953)|zero
rows were returned from database select
2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(343)|vcl01
is NOT in blockcomputers table
2010-04-05 11:22:12|16143|23:23|reload|State.pm:reservation_failed(346)|exiting
1
2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(905)|destructor called,
ref($self)=VCL::new
2010-04-05
11:22:12|16143|23:23|reload|utils.pm:delete_computerloadlog_reservation(7532)|removing
computerloadlog entries matching loadstate = begin
2010-04-05
11:22:12|16143|23:23|reload|utils.pm:delete_computerloadlog_reservation(7579)|deleted
rows from computerloadlog for reservation id=23
2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(912)|removed
computerloadlog rows with loadstate=begin for reservation
2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(924)|number of database
handles state process created: 1
2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(933)|process has a
database handle stored in $ENV{dbh}, attempting disconnect
2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(935)|$ENV{dbh}:
database disconnect successful
2010-04-05 11:22:12|16143|23:23|reload|State.pm:DESTROY(949)|VCL::new process
16143 exiting
2010-04-05 11:22:12|11472|vcld:REAPER(744)|VCL process exited for reservation 23
2010-04-05 11:22:12|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:12
2010-04-05 11:22:12|11472|23:23|failed|vcld:main(250)|request deleted
2010-04-05 11:22:17|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:17
2010-04-05 11:22:22|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:22
2010-04-05 11:22:27|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:27
2010-04-05 11:22:32|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:32
2010-04-05 11:22:37|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:37
2010-04-05 11:22:42|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:42
2010-04-05 11:22:47|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:47
2010-04-05 11:22:52|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:52
2010-04-05 11:22:57|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:22:57
[r...@vclrhel01 ~]# tail -f /var/log/vcld.log
2010-04-05
11:24:22|16380|24:24|reload|utils.pm:get_management_node_id(9345)|environment
variable: 1
2010-04-05 11:24:22|16380|24:24|reload|new.pm:reload_image(514)|calling
VCL::Module::Provisioning::vmware->node_status()
2010-04-05 11:24:22|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, statuscheck, checking status of node
2010-04-05
11:24:22|16380|24:24|reload|vmware.pm:node_status(1872)|identity_keys=
/etc/vcl/vcl.key
2010-04-05
11:24:22|16380|24:24|reload|vmware.pm:node_status(1873)|requestedimagename=
esx3-win2003-v0
2010-04-05
11:24:22|16380|24:24|reload|vmware.pm:node_status(1874)|image_os_type= windows
2010-04-05
11:24:22|16380|24:24|reload|vmware.pm:node_status(1875)|request_forimaging= 0
2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1876)|vmpath=
/vmfs/volumes/VCL
2010-04-05
11:24:22|16380|24:24|reload|vmware.pm:node_status(1877)|datastorepath=
10.0.0.2:/vcl-nfs/export/golden
2010-04-05 11:24:22|16380|24:24|reload|vmware.pm:node_status(1895)|checking if
vcl01 is pingable
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1901)|vcl01 is not
pingable (0)
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6167)|executing
SSH command on cleesx.democentral.ibm.com:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
cleesx.democentral.ibm.com 'vmware-cmd
/vmfs/volumes/VCL/esx3-win2003-v0vcl01/esx3-win2003-v0vcl01.vmx getstate' 2>&1
2010-04-05
11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6249)|run_ssh_command
output:
|16380|24:24|reload| VMControl error -11: No such virtual machine
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6259)|SSH
command executed on cleesx.democentral.ibm.com, command:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
cleesx.democentral.ibm.com 'vmware-cmd
/vmfs/volumes/VCL/esx3-win2003-v0vcl01/esx3-win2003-v0vcl01.vmx getstate' 2>&1
|16380|24:24|reload| returning (11, "VMControl error -11: No such v...")
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1914)|VMControl
error -11: No such virtual machine
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1925)|vcl01
vmstate reports 0
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:node_status(1963)|returning
node status hash reference ($node_status->{status}=RELOAD)
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(529)|node_status
returned a hash reference
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(534)|node_status
hash reference contains key {status}=RELOAD
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:23|16380|24:24|reload|vcld:warning_handler(636)|Use of uninitialized
value in string eq at /usr/local/vcl/bin/../lib/VCL/new.pm line 573.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) vcld, warning_handler (line: 636)
|16380|24:24|reload| (-2) new.pm, reload_image (line: 573)
|16380|24:24|reload| (-3) new.pm, process (line: 266)
|16380|24:24|reload| (-4) vcld, make_new_child (line: 594)
|16380|24:24|reload| (-5) vcld, main (line: 341)
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(602)|node status is
RELOAD, vcl01 will be reloaded
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, loadimageblade, vcl01 must be reloaded with esx3-win2003-v0
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(616)|calling
VCL::Module::Provisioning::vmware->does_image_exist()
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:does_image_exist(2002)|image
repository path: /install/vmware_images
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_command(9718)|executed
command: du -c /install/vmware_images/*esx3-win2003-v0* 2>&1 | grep total 2>&1,
pid: 16387, exit status: 0, output:
|16380|24:24|reload| 28731484 total
2010-04-05
11:24:23|16380|24:24|reload|vmware.pm:does_image_exist(2054)|esx3-win2003-v0
exists in /install/vmware_images, size: 28058 MB
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(619)|esx3-win2003-v0
exists on this management node
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, doesimageexists, confirmed image exists
2010-04-05
11:24:23|16380|24:24|reload|utils.pm:update_computer_state(2218)|computer 2
state updated to: reloading
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(652)|computer vcl01
state set to reloading
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, info, computer state updated to reloading
2010-04-05 11:24:23|16380|24:24|reload|new.pm:reload_image(663)|calling
VCL::Module::Provisioning::vmware->load() subroutine
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, info, calling VCL::Module::Provisioning::vmware->load() subroutine
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:control_VM(1510)|control
remove is defined
2010-04-05 11:24:23|16380|24:24|reload|vmware.pm:control_VM(1574)|checking for
base image on cleesx 10.0.0.2:/vcl-nfs/export/golden
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6167)|executing
SSH command on cleesx:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx
'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 1/3: failed
to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit
status: 255, SSH exits with the exit status of the remote command or with 255
if an error occurred, output:
|16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239)
|16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575)
|16380|24:24|reload| (-3) vmware.pm, load (line: 130)
|16380|24:24|reload| (-4) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-5) new.pm, process (line: 266)
|16380|24:24|reload| (-6) vcld, make_new_child (line: 594)
2010-04-05 11:24:23|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping
for 2 seconds before making next SSH attempt
2010-04-05 11:24:25|16380|24:24|reload|utils.pm:run_ssh_command(6171)|attempt
2/3: executing SSH command on cleesx:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx
'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:25|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 2/3: failed
to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit
status: 255, SSH exits with the exit status of the remote command or with 255
if an error occurred, output:
|16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239)
|16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575)
|16380|24:24|reload| (-3) vmware.pm, load (line: 130)
|16380|24:24|reload| (-4) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-5) new.pm, process (line: 266)
|16380|24:24|reload| (-6) vcld, make_new_child (line: 594)
2010-04-05 11:24:25|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping
for 15 seconds before making next SSH attempt
2010-04-05 11:24:27|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:24:27
2010-04-05 11:24:32|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:24:32
2010-04-05 11:24:37|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:24:37
2010-04-05 11:24:40|16380|24:24|reload|utils.pm:run_ssh_command(6171)|attempt
3/3: executing SSH command on cleesx:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx
'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:40|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 3/3: failed
to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit
status: 255, SSH exits with the exit status of the remote command or with 255
if an error occurred, output:
|16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239)
|16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575)
|16380|24:24|reload| (-3) vmware.pm, load (line: 130)
|16380|24:24|reload| (-4) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-5) new.pm, process (line: 266)
|16380|24:24|reload| (-6) vcld, make_new_child (line: 594)
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:40|16380|24:24|reload|utils.pm:run_ssh_command(6272)|failed to run SSH
command after 3 attempts, command: /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p
22 -x cleesx 'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1, exit status: 255,
output:
|16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6272)
|16380|24:24|reload| (-2) vmware.pm, control_VM (line: 1575)
|16380|24:24|reload| (-3) vmware.pm, load (line: 130)
|16380|24:24|reload| (-4) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-5) new.pm, process (line: 266)
|16380|24:24|reload| (-6) vcld, make_new_child (line: 594)
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:40|16380|24:24|reload|vmware.pm:control_VM(1577)|failed to run ssh
command: ls -1 10.0.0.2:/vcl-nfs/export/golden
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) vmware.pm, control_VM (line: 1577)
|16380|24:24|reload| (-2) vmware.pm, load (line: 130)
|16380|24:24|reload| (-3) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-4) new.pm, process (line: 266)
|16380|24:24|reload| (-5) vcld, make_new_child (line: 594)
|16380|24:24|reload| (-6) vcld, main (line: 341)
2010-04-05
11:24:40|16380|24:24|reload|DataStructure.pm:get_computer_private_ip_address(1418)|returning
private IP address previously retrieved from /etc/hosts: 10.0.0.10
2010-04-05 11:24:41|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, startload, vcl01 esx3-win2003-v0
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(216)|identity file set
/etc/vcl/vcl.key vmhost imagename noimage bladekey /etc/vcl/vcl.key
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(244)|persistent= 0
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(245)|myvmdir=
esx3-win2003-v0vcl01
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(246)|myvmx=
/vmfs/volumes/VCL/esx3-win2003-v0vcl01/esx3-win2003-v0vcl01.vmx
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(247)|mybasedirname=
esx3-win2003-v0
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(248)|myimagename=
esx3-win2003-v0
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(251)|checking for base
image esx3-win2003-v0vcl01 on cleesx
2010-04-05 11:24:41|16380|24:24|reload|utils.pm:insertloadlog(4700)|inserted
computer=2, vmround1, checking host for requested image files
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(256)|trying to create
exclusive lock on /tmp/cleesxesx3-win2003-v0lock while checking if image files
exist on host
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(259)|owning exclusive
lock on /tmp/cleesxesx3-win2003-v0lock
2010-04-05 11:24:41|16380|24:24|reload|vmware.pm:load(260)|listing datestore
10.0.0.2:/vcl-nfs/export/golden
2010-04-05 11:24:41|16380|24:24|reload|utils.pm:run_ssh_command(6167)|executing
SSH command on cleesx:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx
'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:41|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 1/3: failed
to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit
status: 255, SSH exits with the exit status of the remote command or with 255
if an error occurred, output:
|16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239)
|16380|24:24|reload| (-2) vmware.pm, load (line: 262)
|16380|24:24|reload| (-3) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-4) new.pm, process (line: 266)
|16380|24:24|reload| (-5) vcld, make_new_child (line: 594)
|16380|24:24|reload| (-6) vcld, main (line: 341)
2010-04-05 11:24:41|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping
for 2 seconds before making next SSH attempt
2010-04-05 11:24:42|11472|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-04-05 11:24:42
2010-04-05 11:24:43|16380|24:24|reload|utils.pm:run_ssh_command(6171)|attempt
2/3: executing SSH command on cleesx:
|16380|24:24|reload| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x cleesx
'ls -1 10.0.0.2:/vcl-nfs/export/golden' 2>&1
|16380|24:24|reload| ---- WARNING ----
|16380|24:24|reload| 2010-04-05
11:24:43|16380|24:24|reload|utils.pm:run_ssh_command(6239)|attempt 2/3: failed
to execute SSH command on cleesx: ls -1 10.0.0.2:/vcl-nfs/export/golden, exit
status: 255, SSH exits with the exit status of the remote command or with 255
if an error occurred, output:
|16380|24:24|reload| ssh output (ls -1 10.0...): Host key verification failed.
|16380|24:24|reload| ( 0) utils.pm, notify (line: 727)
|16380|24:24|reload| (-1) utils.pm, run_ssh_command (line: 6239)
|16380|24:24|reload| (-2) vmware.pm, load (line: 262)
|16380|24:24|reload| (-3) new.pm, reload_image (line: 665)
|16380|24:24|reload| (-4) new.pm, process (line: 266)
|16380|24:24|reload| (-5) vcld, make_new_child (line: 594)
|16380|24:24|reload| (-6) vcld, main (line: 341)
2010-04-05 11:24:43|16380|24:24|reload|utils.pm:run_ssh_command(6159)|sleeping
for 15 seconds before making next SSH attempt
