Any idea? On Sat, Mar 9, 2019 at 10:05 PM Fariborz Navidan <mdvlinqu...@gmail.com> wrote:
> Hi, > > Another noticeable issue about system is that cpu cores allocation is 19/8 > (237%) which may be thereason for error. However the RAM and CPU > utilization is fairly low and I should be able to create more VMs. How can > I change settings for cpu cores overprovisioning factor? > > Thanks > > On Sat, Mar 9, 2019 at 9:53 PM Fariborz Navidan <mdvlinqu...@gmail.com> > wrote: > >> Any idea? >> >> On Sat, Mar 9, 2019 at 8:38 PM Fariborz Navidan <mdvlinqu...@gmail.com> >> wrote: >> >>> Memory Total: 62.69 GB >>> Memory Allocated: *14.25 GB* >>> Memory Used: 19.03 GB >>> >>> There are also lots of storage available. As the log states, it is >>> complaining about resource type 1 (cpu). >>> >>> Please advise. >>> >>> Thanks >>> >>> On Sat, Mar 9, 2019 at 8:16 PM Ivan Kudryavtsev < >>> kudryavtsev...@bw-sw.com> wrote: >>> >>>> What about RAM and storage? >>>> >>>> сб, 9 мар. 2019 г., 9:22 Fariborz Navidan <mdvlinqu...@gmail.com>: >>>> >>>> > I have already set cluster.cpu.allocated.capacity.disablethreshold to >>>> 1 >>>> > and cpu.overprovisioning.factor to 10 both in global settings and >>>> cluster >>>> > level. >>>> > >>>> > Best Regards >>>> > >>>> > On Sat, Mar 9, 2019 at 6:47 PM Fariborz Navidan < >>>> mdvlinqu...@gmail.com> >>>> > wrote: >>>> > >>>> > > Hello >>>> > > >>>> > > This is host's cpu resource statistics: >>>> > > >>>> > > CPU Utilized: 30.2% >>>> > > CPU Allocated for VMs: 84.82% >>>> > > >>>> > > On Sat, Mar 9, 2019 at 4:20 PM Ivan Kudryavtsev < >>>> > kudryavtsev...@bw-sw.com> >>>> > > wrote: >>>> > > >>>> > >> Looks like your cluster is pretty full. Increase thresholds in >>>> cluster >>>> > >> vars >>>> > >> or add resources. >>>> > >> >>>> > >> сб, 9 мар. 2019 г., 6:55 Rafael Weingärtner < >>>> > rafaelweingart...@gmail.com >>>> > >> >: >>>> > >> >>>> > >> > In the log there is this message: >>>> > >> > > Cannot allocate cluster list [1] for vm creation since their >>>> > allocated >>>> > >> > percentage crosses the disable capacity threshold defined at each >>>> > >> > cluster/at global value for capacity Type : 1, skipping these >>>> clusters >>>> > >> > >>>> > >> > What is the status of your cluster's host? >>>> > >> > >>>> > >> > On Sat, Mar 9, 2019 at 7:14 AM Fariborz Navidan < >>>> > mdvlinqu...@gmail.com> >>>> > >> > wrote: >>>> > >> > >>>> > >> > > Hello, >>>> > >> > > >>>> > >> > > Here is the log for VM deployment: >>>> > >> > > >>>> > >> > > 2019-03-09 11:01:34,984 DEBUG [c.c.a.ApiServlet] >>>> > >> > > (qtp788117692-18:ctx-f51fd578) (logid:113f467d) ===START=== >>>> > >> 137.74.35.65 >>>> > >> > > -- GET >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> command=deployVirtualMachine&response=json&zoneid=bc4565d8-4029-4dbd-93eb-47137ff45188&templateid=4c10414a-51f2-4859-b673-e92c3f32cbfd&hypervisor=KVM&rootdisksize=10&serviceofferingid=cd1235b8-acdf-4ce3-a3ac-3f7ddcea8870&displayname=centos&name=centos&_=1552125695843 >>>> > >> > > 2019-03-09 11:01:34,989 DEBUG [c.c.a.ApiServer] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> CIDRs >>>> > >> from >>>> > >> > > which account >>>> 'Acct[27cd01ef-3907-11e9-87ab-a4bf012ed1a6-admin]' is >>>> > >> > allowed >>>> > >> > > to perform API calls: 0.0.0.0/0,::/0 >>>> > >> > > 2019-03-09 11:01:35,040 DEBUG [c.c.u.AccountManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Access >>>> > >> > granted >>>> > >> > > to Acct[27cd01ef-3907-11e9-87ab-a4bf012ed1a6-admin] to >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.quota.vo.ServiceOfferingVO$$EnhancerByCGLIB$$c370fca@68de8a96 >>>> > >> > > by AffinityGroupAccessChecker >>>> > >> > > 2019-03-09 11:01:35,042 DEBUG [c.c.u.AccountManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Access >>>> > >> > granted >>>> > >> > > to Acct[27cd01ef-3907-11e9-87ab-a4bf012ed1a6-admin] to null by >>>> > >> > > AffinityGroupAccessChecker >>>> > >> > > 2019-03-09 11:01:35,046 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Service >>>> > >> > > SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,058 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Service >>>> > >> > > SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,074 DEBUG [c.c.v.UserVmManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Rootdisksize >>>> > >> > > override validation successful. Template root disk size 8GB >>>> Root >>>> > disk >>>> > >> > size >>>> > >> > > specified 10GB >>>> > >> > > 2019-03-09 11:01:35,081 DEBUG [c.c.v.UserVmManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Allocating >>>> > >> > in >>>> > >> > > the DB for vm >>>> > >> > > 2019-03-09 11:01:35,098 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Allocating >>>> > >> > > entries for VM: VM[User|i-2-68-VM] >>>> > >> > > 2019-03-09 11:01:35,099 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Allocating >>>> > >> > > nics for VM[User|i-2-68-VM] >>>> > >> > > 2019-03-09 11:01:35,100 DEBUG [o.a.c.e.o.NetworkOrchestrator] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Allocating >>>> > >> > nic >>>> > >> > > for vm VM[User|i-2-68-VM] in network Ntwk[204|Guest|7] with >>>> > requested >>>> > >> > > profile NicProfile[0-0-null-null-null >>>> > >> > > 2019-03-09 11:01:35,106 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Service >>>> > >> > > SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,106 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Allocating >>>> > >> > > disks for VM[User|i-2-68-VM] >>>> > >> > > 2019-03-09 11:01:35,108 DEBUG [o.a.c.e.o.VolumeOrchestrator] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Using >>>> > >> root >>>> > >> > > disk size of 10737418240 Bytes for volume ROOT-68 >>>> > >> > > 2019-03-09 11:01:35,111 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > Updating >>>> > >> > > resource Type = volume count for Account = 2 Operation = >>>> increasing >>>> > >> > Amount >>>> > >> > > = 1 >>>> > >> > > 2019-03-09 11:01:35,116 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > Updating >>>> > >> > > resource Type = primary_storage count for Account = 2 >>>> Operation = >>>> > >> > > increasing Amount = 10737418240 >>>> > >> > > 2019-03-09 11:01:35,118 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Allocation >>>> > >> > > completed for VM: VM[User|i-2-68-VM] >>>> > >> > > 2019-03-09 11:01:35,118 DEBUG [c.c.v.UserVmManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > >> Successfully >>>> > >> > > allocated DB entry for VM[User|i-2-68-VM] >>>> > >> > > 2019-03-09 11:01:35,119 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > Updating >>>> > >> > > resource Type = user_vm count for Account = 2 Operation = >>>> increasing >>>> > >> > Amount >>>> > >> > > = 1 >>>> > >> > > 2019-03-09 11:01:35,120 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > Updating >>>> > >> > > resource Type = cpu count for Account = 2 Operation = >>>> increasing >>>> > >> Amount >>>> > >> > = 1 >>>> > >> > > 2019-03-09 11:01:35,122 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > Updating >>>> > >> > > resource Type = memory count for Account = 2 Operation = >>>> increasing >>>> > >> > Amount >>>> > >> > > = 512 >>>> > >> > > 2019-03-09 11:01:35,128 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Service >>>> > >> > > SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,130 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> Service >>>> > >> > > SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,138 INFO [o.a.c.f.j.i.AsyncJobMonitor] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:4c7ba6b4) Add >>>> > job-508 >>>> > >> > into >>>> > >> > > job monitoring >>>> > >> > > 2019-03-09 11:01:35,139 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> submit >>>> > >> async >>>> > >> > > job-508, details: AsyncJobVO {id:508, userId: 2, accountId: 2, >>>> > >> > > instanceType: VirtualMachine, instanceId: 68, cmd: >>>> > >> > > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, >>>> > >> cmdInfo: >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> {"httpmethod":"GET","templateid":"4c10414a-51f2-4859-b673-e92c3f32cbfd","ctxAccountId":"2","uuid":"f8926b46-c679-4e75-8410-bbe5e612bd93","cmdEventType":"VM.CREATE","serviceofferingid":"cd1235b8-acdf-4ce3-a3ac-3f7ddcea8870","response":"json","ctxUserId":"2","hypervisor":"KVM","displayname":"centos","name":"centos","zoneid":"bc4565d8-4029-4dbd-93eb-47137ff45188","rootdisksize":"10","ctxStartEventId":"995","id":"68","ctxDetails":"{\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.vm.VirtualMachine\":\"f8926b46-c679-4e75-8410-bbe5e612bd93\",\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.dc.DataCenter\":\"bc4565d8-4029-4dbd-93eb-47137ff45188\",\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.offering.ServiceOffering\":\"cd1235b8-acdf-4ce3-a3ac-3f7ddcea8870\",\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.template.VirtualMachineTemplate\":\"4c10414a-51f2-4859-b673-e92c3f32cbfd\"}","_":"1552125695843"}, >>>> > >> > > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, >>>> resultCode: 0, >>>> > >> > > result: null, initMsid: 279278805450982, completeMsid: null, >>>> > >> lastUpdated: >>>> > >> > > null, lastPolled: null, created: null} >>>> > >> > > 2019-03-09 11:01:35,141 DEBUG [c.c.a.ApiServlet] >>>> > >> > > (qtp788117692-18:ctx-f51fd578 ctx-a82cdf12) (logid:113f467d) >>>> > ===END=== >>>> > >> > > 137.74.35.65 -- GET >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> command=deployVirtualMachine&response=json&zoneid=bc4565d8-4029-4dbd-93eb-47137ff45188&templateid=4c10414a-51f2-4859-b673-e92c3f32cbfd&hypervisor=KVM&rootdisksize=10&serviceofferingid=cd1235b8-acdf-4ce3-a3ac-3f7ddcea8870&displayname=centos&name=centos&_=1552125695843 >>>> > >> > > 2019-03-09 11:01:35,142 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Executing >>>> > >> > > AsyncJobVO {id:508, userId: 2, accountId: 2, instanceType: >>>> > >> > VirtualMachine, >>>> > >> > > instanceId: 68, cmd: >>>> > >> > > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, >>>> > >> cmdInfo: >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> {"httpmethod":"GET","templateid":"4c10414a-51f2-4859-b673-e92c3f32cbfd","ctxAccountId":"2","uuid":"f8926b46-c679-4e75-8410-bbe5e612bd93","cmdEventType":"VM.CREATE","serviceofferingid":"cd1235b8-acdf-4ce3-a3ac-3f7ddcea8870","response":"json","ctxUserId":"2","hypervisor":"KVM","displayname":"centos","name":"centos","zoneid":"bc4565d8-4029-4dbd-93eb-47137ff45188","rootdisksize":"10","ctxStartEventId":"995","id":"68","ctxDetails":"{\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.vm.VirtualMachine\":\"f8926b46-c679-4e75-8410-bbe5e612bd93\",\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.dc.DataCenter\":\"bc4565d8-4029-4dbd-93eb-47137ff45188\",\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.offering.ServiceOffering\":\"cd1235b8-acdf-4ce3-a3ac-3f7ddcea8870\",\"interface >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.template.VirtualMachineTemplate\":\"4c10414a-51f2-4859-b673-e92c3f32cbfd\"}","_":"1552125695843"}, >>>> > >> > > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, >>>> resultCode: 0, >>>> > >> > > result: null, initMsid: 279278805450982, completeMsid: null, >>>> > >> lastUpdated: >>>> > >> > > null, lastPolled: null, created: null} >>>> > >> > > 2019-03-09 11:01:35,157 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Service SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,159 DEBUG [c.c.n.NetworkModelImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Service SecurityGroup is not supported in the network id=204 >>>> > >> > > 2019-03-09 11:01:35,173 DEBUG >>>> [c.c.d.DeploymentPlanningManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > DeploymentPlanner allocation algorithm: null >>>> > >> > > 2019-03-09 11:01:35,173 DEBUG >>>> [c.c.d.DeploymentPlanningManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Trying to allocate a host and storage pools from dc:1, >>>> > >> > > pod:null,cluster:null, requested cpu: 500, requested ram: >>>> 536870912 >>>> > >> > > 2019-03-09 11:01:35,173 DEBUG >>>> [c.c.d.DeploymentPlanningManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > Is >>>> > >> > > ROOT volume READY (pool already allocated)?: No >>>> > >> > > 2019-03-09 11:01:35,176 DEBUG >>>> [c.c.d.DeploymentPlanningManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Deploy avoids pods: [], clusters: [], hosts: [] >>>> > >> > > 2019-03-09 11:01:35,176 DEBUG [c.c.d.FirstFitPlanner] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Searching all possible resources under this Zone: 1 >>>> > >> > > 2019-03-09 11:01:35,177 DEBUG [c.c.d.FirstFitPlanner] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Listing clusters in order of aggregate capacity, that have >>>> (atleast >>>> > >> one >>>> > >> > > host with) enough CPU and RAM capacity under this Zone: 1 >>>> > >> > > 2019-03-09 11:01:35,179 DEBUG [c.c.d.FirstFitPlanner] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Removing from the clusterId list these clusters from avoid >>>> set: [] >>>> > >> > > 2019-03-09 11:01:35,181 DEBUG [c.c.d.FirstFitPlanner] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Cannot allocate cluster list [1] for vm creation since their >>>> > allocated >>>> > >> > > percentage crosses the disable capacity threshold defined at >>>> each >>>> > >> > cluster/ >>>> > >> > > at global value for capacity Type : 1, skipping these clusters >>>> > >> > > 2019-03-09 11:01:35,181 DEBUG [c.c.d.FirstFitPlanner] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > No >>>> > >> > > clusters found after removing disabled clusters and clusters in >>>> > avoid >>>> > >> > list, >>>> > >> > > returning. >>>> > >> > > 2019-03-09 11:01:35,183 DEBUG [c.c.v.UserVmManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Destroying vm VM[User|i-2-68-VM] as it failed to create on >>>> Host with >>>> > >> > > Id:null >>>> > >> > > 2019-03-09 11:01:35,189 DEBUG [c.c.c.CapacityManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > VM >>>> > >> > > state transitted from :Stopped to Error with event: >>>> > >> > > OperationFailedToErrorvm's original host id: null new host id: >>>> null >>>> > >> host >>>> > >> > id >>>> > >> > > before state transition: null >>>> > >> > > 2019-03-09 11:01:35,199 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Updating resource Type = volume count for Account = 2 >>>> Operation = >>>> > >> > > decreasing Amount = 1 >>>> > >> > > 2019-03-09 11:01:35,202 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Updating resource Type = primary_storage count for Account = 2 >>>> > >> Operation >>>> > >> > = >>>> > >> > > decreasing Amount = 10737418240 >>>> > >> > > 2019-03-09 11:01:35,204 WARN [o.a.c.alerts] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > AlertType:: 8 | dataCenterId:: 1 | podId:: null | clusterId:: >>>> null | >>>> > >> > > message:: Failed to deploy Vm with Id: 68, on Host with Id: >>>> null >>>> > >> > > 2019-03-09 11:01:35,206 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Updating resource Type = user_vm count for Account = 2 >>>> Operation = >>>> > >> > > decreasing Amount = 1 >>>> > >> > > 2019-03-09 11:01:35,208 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Updating resource Type = cpu count for Account = 2 Operation = >>>> > >> decreasing >>>> > >> > > Amount = 1 >>>> > >> > > 2019-03-09 11:01:35,209 DEBUG [c.c.a.m.AgentManagerImpl] >>>> > >> > > (AgentManager-Handler-12:null) (logid:) SeqA 11-96232: >>>> Processing >>>> > Seq >>>> > >> > > 11-96232: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":12,"_loadInfo":"{\n >>>> > >> > > \"connections\": []\n}","wait":0}}] } >>>> > >> > > 2019-03-09 11:01:35,210 DEBUG [c.c.a.m.AgentManagerImpl] >>>> > >> > > (AgentManager-Handler-12:null) (logid:) SeqA 11-96232: Sending >>>> Seq >>>> > >> > > 11-96232: { Ans: , MgmtId: 279278805450982, via: 11, Ver: v1, >>>> > Flags: >>>> > >> > > 100010, >>>> > >> > > >>>> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] >>>> > >> } >>>> > >> > > 2019-03-09 11:01:35,210 DEBUG [c.c.r.ResourceLimitManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Updating resource Type = memory count for Account = 2 >>>> Operation = >>>> > >> > > decreasing Amount = 512 >>>> > >> > > 2019-03-09 11:01:35,215 INFO >>>> [o.a.c.a.c.a.v.DeployVMCmdByAdmin] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > com.cloud.exception.InsufficientServerCapacityException: >>>> Unable to >>>> > >> > create a >>>> > >> > > deployment for VM[User|i-2-68-VM]Scope=interface >>>> > >> com.cloud.dc.DataCenter; >>>> > >> > > id=1 >>>> > >> > > 2019-03-09 11:01:35,215 INFO >>>> [o.a.c.a.c.a.v.DeployVMCmdByAdmin] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508 ctx-b6238917) >>>> > >> (logid:57397166) >>>> > >> > > Unable to create a deployment for VM[User|i-2-68-VM] >>>> > >> > > com.cloud.exception.InsufficientServerCapacityException: >>>> Unable to >>>> > >> > create a >>>> > >> > > deployment for VM[User|i-2-68-VM]Scope=interface >>>> > >> com.cloud.dc.DataCenter; >>>> > >> > > id=1 >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:215) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:200) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4492) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4057) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4044) >>>> > >> > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> > >> > > at java.lang.reflect.Method.invoke(Method.java:498) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) >>>> > >> > > at com.sun.proxy.$Proxy164.startVirtualMachine(Unknown Source) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50) >>>> > >> > > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) >>>> > >> > > at >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529) >>>> > >> > > at >>>> > >> > >>>> > >>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>>> > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) >>>> > >> > > at >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) >>>> > >> > > at java.lang.Thread.run(Thread.java:748) >>>> > >> > > 2019-03-09 11:01:35,216 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Complete >>>> > >> async >>>> > >> > > job-508, jobStatus: FAILED, resultCode: 530, result: >>>> > >> > > >>>> > >> > > >>>> > >> > >>>> > >> >>>> > >>>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":533,"errortext":"Unable >>>> > >> > > to create a deployment for VM[User|i-2-68-VM]"} >>>> > >> > > 2019-03-09 11:01:35,221 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Publish >>>> > >> async >>>> > >> > > job-508 complete on message bus >>>> > >> > > 2019-03-09 11:01:35,221 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Wake up >>>> > >> jobs >>>> > >> > > related to job-508 >>>> > >> > > 2019-03-09 11:01:35,221 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Update db >>>> > >> > status >>>> > >> > > for job-508 >>>> > >> > > 2019-03-09 11:01:35,221 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Wake up >>>> > >> jobs >>>> > >> > > joined with job-508 and disjoin all subjobs created from job- >>>> 508 >>>> > >> > > 2019-03-09 11:01:35,223 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) Done >>>> > >> executing >>>> > >> > > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin >>>> for >>>> > >> job-508 >>>> > >> > > 2019-03-09 11:01:35,223 INFO [o.a.c.f.j.i.AsyncJobMonitor] >>>> > >> > > (API-Job-Executor-1:ctx-0c22fa00 job-508) (logid:57397166) >>>> Remove >>>> > >> job-508 >>>> > >> > > from job monitoring >>>> > >> > > >>>> > >> > > >>>> > >> > > >>>> > >> > > On Fri, Mar 8, 2019 at 7:33 PM Ivan Kudryavtsev < >>>> > >> > kudryavtsev...@bw-sw.com> >>>> > >> > > wrote: >>>> > >> > > >>>> > >> > > > Hi Fariborz, there are no prophets here, we are just humans. >>>> Find >>>> > >> > > relevant >>>> > >> > > > logs and post here for a review. >>>> > >> > > > >>>> > >> > > > пт, 8 мар. 2019 г., 11:00 Fariborz Navidan < >>>> mdvlinqu...@gmail.com >>>> > >: >>>> > >> > > > >>>> > >> > > > > Hello, >>>> > >> > > > > >>>> > >> > > > > I get the following error when creating new VM on a KVM >>>> cluster. >>>> > >> > Unable >>>> > >> > > > to >>>> > >> > > > > create a deployment for VM[...] >>>> > >> > > > > >>>> > >> > > > > Please help me >>>> > >> > > > > >>>> > >> > > > > Thanks >>>> > >> > > > > >>>> > >> > > > >>>> > >> > > >>>> > >> > >>>> > >> > >>>> > >> > -- >>>> > >> > Rafael Weingärtner >>>> > >> > >>>> > >> >>>> > > >>>> > >>>> >>>