Hi Dmitri
I thank you for your time sending me back, Im sorry I was late sending you
the log file since I couldn't have access to the management node the
earlier day.
this is the content of vcld.log file copied to .txt file from terminal, I
hope you could define the problem Im having and tell me what should I do to
fix it.
many thanks and appreciation in advance, it really means alot.
best wishes
Ahmad Diab
On Sat, Apr 6, 2013 at 8:15 PM, Dmitri Chebotarov <[email protected]> wrote:
> Hi Ahmad
>
> Could you please send entries from vcld.log file associated with the
> capture process?
>
> Thank you,
>
> Dmitri Chebotarov
> Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging
> 223 Aquia Building, Ffx, MSN: 1B5
> Phone: (703) 993-6175
> Fax: (703) 993-3404
>
> On Apr 5, 2013, at 16:03, Ahmad Diab <[email protected]> wrote:
>
> Greetings
>
> My name is Ahmad Diab, a computer engineer student at Jordan University of
> Science and Technology (JUST) in Jordan, Im working with my friend Al-Anoud
> Aljboor under the supervision of Dr. Mazen Kharbutli in our graduation
> project which is installing your VCL code in one of our HPC in JUST.
>
> I would like to mention the great job and tremendous effort you did making
> the VCL code and making it open source, here in JUST we want to follow you
> having our own VCL in the university by the help of your site and
> all guidelines provided.
>
> However, we have a problem and I wish you could help us with any yet
> helpful information you can give since we have a due date to finish a
> prototype with a worker not HPC tell 15 of June, best appreciation in
> advance.
>
> We are in step of creating "Linux base_image" from one of our CentOS
> workers, following the steps provided in this link "
> https://cwiki.apache.org/VCL/create-a-linux-base-image.html"; it starts
> creating the image but it doesnt succeed at the end; the image is deleted
> after being added to the website.
> After reading from log file (output shown on terminal) we found out that
> the "vcl setup" deletes the image at the end, Im sure it encounters a
> problem capturing the image but Im not sure what is it, but it might be
> related to the face that neither the worker nor the management node have
> provisioning engine (VMware).
>
> we also are not sure about what state should the worker be when capturing
> the image, should it be as (virtualmachine or blade) should it be in
> maintenance or available.
>
> if its possible; please tell us the description of the worker being
> captured and VMware version (if needed) and how to put it, and any further
> advises from you, we are much grateful.
>
>
Added new image to database: 'image3'
image.name: vmwarelinux-image34-v0
image.id: 4
imagerevision.id: 4
imagemeta.id: 3
resource.id: 14
----------------------------------------------------------------------------
Inserted imaging request to the database:
request ID: 3
reservation ID: 3
This process will now display the contents of the vcld.log file if the vcld
daemon is running. If you do not see many lines of additional output, exit this
process, start the vcld daemon, and monitor the image capture process by running
the command:
tail -f /var/log/vcld.log | grep '3:3'
----------------------------------------------------------------------------
2013-04-03 13:52:45|4139|vcld:main(167)|lastcheckin time updated for management
node 1: 2013-04-03 13:52:45
2013-04-03 13:52:46|21151|utils.pm:setup_get_array_choice(9802)|choices
argument:
2013-04-03 13:52:50|4139|vcld:main(167)|lastcheckin time updated for management
node 1: 2013-04-03 13:52:50
2013-04-03 13:52:55|21151|utils.pm:insert_request(8076)|inserted new reload
request into request table, request id=3
2013-04-03 13:52:55|21151|utils.pm:insert_request(8107)|inserted new reload
request into reservation table, reservation id=3
2013-04-03 13:52:55|4139|vcld:main(167)|lastcheckin time updated for management
node 1: 2013-04-03 13:52:55
2013-04-03
13:52:55|4139|3:3|image|utils.pm:reservation_being_processed(8667)|computerloadlog
'begin' entry does NOT exist for reservation 3
2013-04-03 13:52:55|4139|3:3|image|utils.pm:run_command(8739)|executed command:
pgrep -fl 'vcld [0-9]+:3 ', pid: 21202, exit status: 1, output:
2013-04-03
13:52:55|4139|3:3|image|utils.pm:is_management_node_process_running(8972)|process
is NOT running, identifier: 'vcld [0-9]+:3 '
2013-04-03
13:52:55|4139|3:3|image|utils.pm:reservation_being_processed(8688)|reservation
is NOT currently being processed
2013-04-03 13:52:55|4139|3:3|image|vcld:main(282)|reservation 3 is NOT already
being processed
2013-04-03 13:52:55|4139|3:3|image|utils.pm:get_imagemeta_info(4609)|retrieved
imagemeta info:
|4139|3:3|image| : {
|4139|3:3|image| : "architecture" => "",
|4139|3:3|image| : "checkuser" => 1,
|4139|3:3|image| : "id" => 3,
|4139|3:3|image| : "postoption" => "",
|4139|3:3|image| : "rootaccess" => 1,
|4139|3:3|image| : "subimages" => 0,
|4139|3:3|image| : "sysprep" => 1,
|4139|3:3|image| : "usergroupid" => ""
|4139|3:3|image| : }
2013-04-03
13:52:55|4139|3:3|image|utils.pm:get_management_node_info(5489)|retrieving
current management node info for 'localhost' from database, cached data is
stale: 5079 seconds old
2013-04-03
13:52:55|4139|3:3|image|utils.pm:get_management_node_info(5636)|retrieved
management node info: 'localhost' (localhost)
2013-04-03
13:52:55|4139|3:3|image|utils.pm:get_connect_method_info(10092)|attempting to
retrieve connect method info:
|4139|3:3|image| imagerevision: 4 - vmwarelinux-image34-v0
|4139|3:3|image| OS: 36 - vmwarelinux
|4139|3:3|image| OS type: 2 - linux
2013-04-03 13:52:55|4139|3:3|image|utils.pm:get_connect_method_info(10156)|ssh:
connectmethodid=1, OStypeid=2, OSid=NULL, imagerevisionid=NULL, disabled=0
2013-04-03
13:52:55|4139|3:3|image|utils.pm:get_connect_method_info(10185)|retrieved
connect method info:
|4139|3:3|image| : {
|4139|3:3|image| : 1 => {
|4139|3:3|image| : "connectmethodmap" => {
|4139|3:3|image| : "OSid" => undef,
|4139|3:3|image| : "OStypeid" => 2,
|4139|3:3|image| : "autoprovisioned" => undef,
|4139|3:3|image| : "connectmethodid" => 1,
|4139|3:3|image| : "disabled" => 0,
|4139|3:3|image| : "imagerevisionid" => undef
|4139|3:3|image| : },
|4139|3:3|image| : "description" => "ssh on port 22",
|4139|3:3|image| : "id" => 1,
|4139|3:3|image| : "name" => "ssh",
|4139|3:3|image| : "port" => 22,
|4139|3:3|image| : "protocol" => "",
|4139|3:3|image| : "servicename" => "ext_sshd",
|4139|3:3|image| : "startupscript" => "/etc/init.d/ext_sshd"
|4139|3:3|image| : }
|4139|3:3|image| : }
2013-04-03 13:52:55|4139|3:3|image|vcld:main(287)|retrieved request information
from database
2013-04-03
13:52:55|4139|3:3|image|DataStructure.pm:is_parent_reservation(993)|returning
true: parent reservation ID for this request: 3
2013-04-03 13:52:55|4139|3:3|image|utils.pm:update_request_state(1545)|request
3 state updated to: pending, laststate to: image
2013-04-03 13:52:56|4139|3:3|image|utils.pm:insertloadlog(3703)|inserted
computer=2, begin, beginning to process, state is image
2013-04-03 13:52:56|4139|3:3|image|vcld:make_new_child(518)|loaded VCL::image
module
2013-04-03 13:52:56|21219|3:3|image|vcld:make_new_child(558)|vcld environment
variable set to 0 for this process
2013-04-03 13:52:56|4139|3:3|image|vcld:make_new_child(542)|current number of
forked kids: 1
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_initialize(637)|image ID
argument was specified: noimage, DataStructure object will contain image
information for the production imagerevision of this image
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_initialize(668)|retrieved
data for imagerevision ID: 1
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_initialize(684)|retrieved
data for image ID: 1
2013-04-03
13:52:56|21219|3:3|image|Module.pm:create_mn_os_object(376)|VCL::Module::OS::Linux::ManagementNode
module loaded
2013-04-03
13:52:56|21219|3:3|image|Module.pm:new(196)|VCL::Module::OS::Linux::ManagementNode
object created for image noimage, address: 15670cc0
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_automethod(836)|data
structure updated, hash path:
$self->request_data->{reservation}{0}{computer}{hostname}, data identifier:
computer_hostname, data:
|21219|3:3|image| : "localhost"
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_automethod(836)|data
structure updated, hash path:
$self->request_data->{reservation}{0}{computer}{NODENAME}, data identifier:
computer_node_name, data:
|21219|3:3|image| : "localhost"
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_automethod(836)|data
structure updated, hash path:
$self->request_data->{reservation}{0}{computer}{SHORTNAME}, data identifier:
computer_short_name, data:
|21219|3:3|image| : "localhost"
2013-04-03 13:52:56|21219|3:3|image|DataStructure.pm:_automethod(836)|data
structure updated, hash path:
$self->request_data->{reservation}{0}{computer}{IPaddress}, data identifier:
computer_ip_address, data:
|21219|3:3|image| : "127.0.0.1"
2013-04-03
13:52:56|21219|3:3|image|Module.pm:create_mn_os_object(381)|VCL::Module::OS::Linux::ManagementNode
OS object created, address: 15670cc0
2013-04-03 13:52:56|21219|3:3|image|Module.pm:new(192)|VCL::image object
created for state image, address: 14ed5f90
2013-04-03 13:52:56|21219|3:3|image|State.pm:initialize(88)|obtained a database
handle for this state process, stored as $ENV{dbh}
2013-04-03 13:52:56|21219|3:3|image|State.pm:check_image_os(790)|no corrections
need to be made to image OS: vmwarelinux
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:is_parent_reservation(993)|returning
true: parent reservation ID for this request: 3
2013-04-03
13:52:56|21219|3:3|image|utils.pm:rename_vcld_process(6785)|reservation count: 1
2013-04-03
13:52:56|21219|3:3|image|utils.pm:rename_vcld_process(6804)|PARENTIMAGE: 1
2013-04-03
13:52:56|21219|3:3|image|utils.pm:rename_vcld_process(6805)|SUBIMAGE: 0
2013-04-03 13:52:56|21219|3:3|image|utils.pm:rename_vcld_process(6823)|renamed
process to 'vcld 3:3 image test2 vmwarelinux-image34-v0 admin'
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:is_parent_reservation(993)|returning
true: parent reservation ID for this request: 3
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:is_parent_reservation(993)|returning
true: parent reservation ID for this request: 3
2013-04-03
13:52:56|21219|3:3|image|Module.pm:create_os_object(308)|VCL::Module::OS::Linux
module loaded
2013-04-03 13:52:56|21219|3:3|image|Module.pm:new(196)|VCL::Module::OS::Linux
object created for image vmwarelinux-image34-v0, address: 156951c0
2013-04-03
13:52:56|21219|3:3|image|Module.pm:create_os_object(314)|VCL::Module::OS::Linux
OS object created, address: 156951c0
2013-04-03 13:52:56|21219|3:3|image|State.pm:initialize(132)|computer is NOT a
VM, VM host OS object not created
2013-04-03
13:52:56|21219|3:3|image|Module.pm:create_provisioning_object(519)|VCL::Module
module loaded
2013-04-03 13:52:56|21219|3:3|image|Module.pm:new(203)|VCL::Module object
created, address: 15695410
2013-04-03
13:52:56|21219|3:3|image|Module.pm:create_provisioning_object(525)|VCL::Module
provisioner object created for test2, address: 15695410
2013-04-03 13:52:56|21219|3:3|image|State.pm:initialize(154)|returning 1
2013-04-03 13:52:56|21219|3:3|image|vcld:make_new_child(568)|VCL::image object
created and initialized
2013-04-03 13:52:56|21219|3:3|image|utils.pm:mail(1253)|SUCCESS -- Sending mail
To: [email protected], VCL IMAGE Creation Started: vmwarelinux-image34-v0
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:get_computer_private_ip_address(1630)|attempting
to retrieve private IP address for computer: test2
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:get_computer_private_ip_address(1634)|retrieved
contents of /etc/hosts on this management node, contains 4 lines
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:get_computer_private_ip_address(1673)|did
not find any lines in /etc/hosts containing 'test2', returning private IP
address defined in the database: 192.168.1.20
2013-04-03 13:52:56|21219|3:3|image|utils.pm:is_inblockrequest(5793)|zero rows
were returned from database select
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:get_image_affiliation_name(2118)|image
owner id: 1
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:retrieve_user_data(1401)|attempting
to retrieve and store data for user: user.id = '1'
2013-04-03
13:52:56|21219|3:3|image|DataStructure.pm:retrieve_user_data(1464)|data has
been retrieved for user: admin (id: 1)
2013-04-03 13:52:57|21219|3:3|image|utils.pm:mail(1253)|SUCCESS -- Sending mail
To: [email protected], PROBLEM --
localhost|3:3|image|vcld|test2|vmwarelinux-image34-v0|admin
|21219|3:3|image| ---- CRITICAL ----
|21219|3:3|image| 2013-04-03
13:52:56|21219|3:3|image|vcld:die_handler(639)|Can't locate object method
"does_image_exist" via package "VCL::Module" at
/usr/local/vcl/bin/../lib/VCL/image.pm line 135.
|21219|3:3|image| ( 0) vcld, die_handler (line: 639)
|21219|3:3|image| (-1) image.pm, process (line: 135)
|21219|3:3|image| (-2) vcld, make_new_child (line: 571)
|21219|3:3|image| (-3) vcld, main (line: 350)
2013-04-03
13:52:57|21219|3:3|image|utils.pm:delete_computerloadlog_reservation(6429)|removing
computerloadlog entries matching loadstate = begin
2013-04-03
13:52:57|21219|3:3|image|utils.pm:delete_computerloadlog_reservation(6476)|deleted
rows from computerloadlog for reservation id=3
2013-04-03 13:52:57|21219|3:3|image|State.pm:DESTROY(929)|VCL::image process
duration: 1 seconds
2013-04-03 13:52:57|4139|vcld:REAPER(721)|VCL process exited for reservation 3,
PID: 21219, signal: CHLD
2013-04-03 13:52:57|4139|vcld:main(167)|lastcheckin time updated for management
node 1: 2013-04-03 13:52:57
