Hi,
I did some tests today and the deployment of a VM to the shared storage
fails with the following error:
2015-12-07 13:31:42,702 WARN [c.c.h.v.r.VmwareResource]
(DirectAgent-375:ctx-5e9a2b70 10.30.23.40) StartCommand failed due to
Exception: java.lang.NullPointerException
Message: null
java.lang.NullPointerException
at
com.cloud.hypervisor.vmware.mo.VirtualMachineMO.isMemoryHotAddSupported(VirtualMachineMO.java:2609)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2764)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:525)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
for details you can download the management server log at
http://www.due.bi/pub/management-server-sles11-tpl07.zip
the VM I tried to deploy was called sles11-tpl07 (this is a typo,
effectively this is a SLES12)
I can see in the Virtual Center that a VM pops up but then gets deleted
after a few minutes.
In the root directory of the primary storage I see a VMDK file which is not
deleted after the VM is expunged. And with every run, there appears a new
file.
Any idea what's wrong?
Kind regards
Bernhard
2015-12-05 15:39 GMT+01:00 Bernhard Dübi <1linuxengin...@gmail.com>:
> Hi Somesh,
>
> this was definitively a step in the right direction.
> I added the local storage of the ESX hosts. In the GUI I could only chose
> between cluster wide and zone wide storage. So, I hacked the DB and changed
> the type to HOST. After that the system VMs came up.
>
> I was now able to upload an ISO image but I was not yet able to deploy a
> VM. I tried with a disk offering for local storage and a disk offering for
> shareed storage but both fail with missing resources. I'll collect the info
> and post them here.
>
> Thank you very much for your help
> Bernhard
>
>
> 2015-12-05 0:25 GMT+01:00 Somesh Naidu <somesh.na...@citrix.com>:
>
>> Look at the column "use_local_storage" being set to 1 meaning the system
>> service offering requires local storage. That should be because the global
>> config "system.vm.use.local.storage" in your environment is set to true.
>>
>> I am not sure if 4.3.x has the capability to set the above config per
>> Zone so you may have to use local storage for system VMs in the new Zone
>> (ID 4) as well.
>>
>> Somesh
>> CloudPlatform Escalations
>> Citrix Systems, Inc.
>>
>> -----Original Message-----
>> From: Bernhard Dübi [mailto:1linuxengin...@gmail.com]
>> Sent: Friday, December 04, 2015 1:25 AM
>> To: users@cloudstack.apache.org
>> Subject: Re: CloudStack fails to deploy SSVM
>>
>> Hi Somesh,
>>
>> thank you for looking into this
>>
>>
>> mysql> select * from disk_offering where id=9;
>>
>> +----+-----------+------------------------------------------+--------------------------------------+--------------+-----------+---------+------+-------------+-------------------+----------------------------+------------+------------+---------+---------------------+----------+------------------+-----------------+----------+----------+-----------------+------------------+----------------+-----------------+--------+---------------+
>> | id | domain_id | name |
>> uuid | display_text | disk_size | type
>> |
>> tags | recreatable | use_local_storage | unique_name |
>> system_use | customized | removed | created | sort_key |
>> display_offering | customized_iops | min_iops | max_iops | bytes_read_rate
>> | bytes_write_rate | iops_read_rate | iops_write_rate | state |
>> hv_ss_reserve |
>>
>> +----+-----------+------------------------------------------+--------------------------------------+--------------+-----------+---------+------+-------------+-------------------+----------------------------+------------+------------+---------+---------------------+----------+------------------+-----------------+----------+----------+-----------------+------------------+----------------+-----------------+--------+---------------+
>> | 9 | NULL | System Offering For Secondary Storage VM |
>> e216d1da-f106-4db5-b9ea-72c6942d5d66 | NULL | 0 | Service
>> |
>> NULL | 1 | 1 | Cloud.com-SecondaryStorage
>> | 1 | 1 | NULL | 2013-12-20 15:25:16 | 0
>> | 1 | NULL | NULL | NULL |
>> NULL | NULL | NULL | NULL | Active
>> | NULL |
>>
>> +----+-----------+------------------------------------------+--------------------------------------+--------------+-----------+---------+------+-------------+-------------------+----------------------------+------------+------------+---------+---------------------+----------+------------------+-----------------+----------+----------+-----------------+------------------+----------------+-----------------+--------+---------------+
>> 1 row in set (0.00 sec)
>>
>> mysql> select * from storage_pool where data_center_id = 4;
>>
>> +-----+------------------+--------------------------------------+-------------------+------+----------------+--------+------------+---------------+----------------+--------------------------+-----------+----------+---------------------+---------+-------------+--------+-----------------------+---------+------------+---------+---------------+
>> | id | name | uuid |
>> pool_type | port | data_center_id | pod_id | cluster_id |
>> used_bytes | capacity_bytes | host_address | user_info |
>> path | created | removed | update_time | status |
>> storage_provider_name | scope | hypervisor | managed | capacity_iops |
>>
>> +-----+------------------+--------------------------------------+-------------------+------+----------------+--------+------------+---------------+----------------+--------------------------+-----------+----------+---------------------+---------+-------------+--------+-----------------------+---------+------------+---------+---------------+
>> | 173 | VMware_Primary01 | 8ed580cb-bed8-3de4-b2d6-ffd60d30b6a3 |
>> NetworkFilesystem | 2049 | 4 | 6 | 16 |
>> 1525553401856 | 2198886936576 | zcgnfsesx001.fpprod.corp | NULL |
>> /cloud01 | 2015-12-02 11:25:25 | NULL | NULL | Up |
>> DefaultPrimary | CLUSTER | NULL | 0 | NULL |
>>
>> +-----+------------------+--------------------------------------+-------------------+------+----------------+--------+------------+---------------+----------------+--------------------------+-----------+----------+---------------------+---------+-------------+--------+-----------------------+---------+------------+---------+---------------+
>> 1 row in set (0.00 sec)
>>
>>
>> 2015-12-04 0:45 GMT+01:00 Somesh Naidu <somesh.na...@citrix.com>:
>>
>> > > So, I assume the missing pool is the secondary storage pool.
>> >
>> > No, that's the primary storage the allocator is complaining about.
>> >
>> > Can you verify if there is a enabled storage pool (primary storage) in
>> > that Zone/Clusters with the matching "storage type" as that of the
>> service
>> > offering of the System VMs (SSVM/CPVM)? The tables you'd want to be
>> looking
>> > at is disk_offering (id=9) and storage_pool (data_center_id=4).
>> >
>> > Regards,
>> > Somesh
>> >
>> > -----Original Message-----
>> > From: Bernhard Dübi [mailto:1linuxengin...@gmail.com]
>> > Sent: Thursday, December 03, 2015 2:33 PM
>> > To: users@cloudstack.apache.org
>> > Subject: Re: CloudStack fails to deploy SSVM
>> >
>> > Hi,
>> >
>> > you can get an excerpt from my management-server.log at level DEBUG at
>> > http://www.due.bi/pub/management-server-debug.zip
>> > the log sais "no pool found" but I can see the primary storage mounted
>> in
>> > the VMware Virtual Center. So, I assume the missing pool is the
>> secondary
>> > storage pool.
>> > do we have a chicken & egg problem: to deploy the SSVM I need the
>> secondary
>> > storage and to access the secondary storage I need the SSVM
>> >
>> > Regards
>> > Bernhard
>> >
>> > 2015-12-02 23:28 GMT+01:00 Somesh Naidu <somesh.na...@citrix.com>:
>> >
>> > > The reason for SSVM and CPVM not being deployed would quite likely be
>> the
>> > > same.
>> > >
>> > > Here are the errors relevant to SSVM start failure:
>> > > 2015-12-02 18:19:27,314 INFO [c.c.s.s.SecondaryStorageManagerImpl]
>> > > (secstorage-1:ctx-f86ee694) Found a stopped secondary storage vm,
>> bring
>> > it
>> > > up to running pool. secStorageVm vm id : 3099
>> > > 2015-12-02 18:19:27,417 WARN [c.c.s.s.SecondaryStorageManagerImpl]
>> > > (secstorage-1:ctx-f86ee694) Exception while trying to start secondary
>> > > storage vm
>> > > com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create
>> > > a deployment for VM[SecondaryStorageVm|s-3099-VM]Scope=interface
>> > > com.cloud.dc.DataCenter; id=4
>> > >
>> > > There are similar for CPVM.
>> > >
>> > > I see that the logging level is set to INFO. Changing to DEBUG will
>> > > provide more pointers on the cause of the failures. I’d suspect
>> storage.
>> > I
>> > > believe mgmt server may be trying to deploy the System VMs on local
>> > storage
>> > > but there isn’t one available in the new Zone.
>> > >
>> > > Somesh
>> > > CloudPlatform Escalations
>> > > Citrix Systems, Inc.
>> > >
>> > > From: Bernhard Dübi [mailto:1linuxengin...@gmail.com]
>> > > Sent: Wednesday, December 02, 2015 3:12 PM
>> > > To: users@cloudstack.apache.org
>> > > Subject: CloudStack fails to deploy SSVM
>> > >
>> > > Hi,
>> > >
>> > > we have a CloudStack 4.3.2 installation with 152 XenServer 6.2.0 hosts
>> > > organized in 2 zones. We use local disks as primary storage and NFS
>> > shares
>> > > as secondary storage. So good so far.
>> > > Now I created a new zone and added a VMware cluster with 2 ESX 5.5
>> hosts.
>> > > I configured 2 NFS shares as primary and secondary storage. I copied
>> the
>> > > vSphere systemvm to the new secondary storage as described in the
>> > > installation guide.
>> > > If I understand right, this template will be used to deploy the SSVM.
>> > > Unfortunately something is missing and CloudStack fails to deploy the
>> > SSVM
>> > > and - probably as a consequence - the Console Proxy
>> > > Please find attached a small part of the management-server.log
>> > >
>> > > Any idea what's wrong? Thanks for your help
>> > >
>> > > Regards
>> > > Bernhard
>> > >
>> >
>>
>
>
