Sure enough. Its been a while since I configured a new cluster, I completely forgot they had their own over-provisioning limits.
Thanks! On Fri, Apr 17, 2015 at 4:10 PM, Andrija Panic <andrija.pa...@gmail.com> wrote: > If not mistaken, there is global overprovisioning factor, and there is > cluster level overprovisioning - the last one takes presedence I think... > > On 17 April 2015 at 23:01, Grayson Head <gray...@graysonhead.net> wrote: > >> I'm trying to figure out how CPU over-provisioning works in >> cloudstack. It seems that no matter how much I change the >> over-provisioning factor value in global settings, I cannot >> over-provision CPU allocation on the hosts. I suspect that I'm just >> having a lack of understanding on my part, but it seems like I should >> be able to increase the number of VMs I can deploy by increasing the >> CPU over-provisioning value (given that I'm not close to any other >> resource limits). But this doesn't seem to be the case in practice. >> >> https://screencloud.net/v/l1X7 >> >> https://screencloud.net/v/9ifx >> >> Error message when trying to create additional machine via API. >> >> grayson@gworkstation:~$ cloudmonkey deploy virtualmachine >> zoneid=a4c20770-f17e-425e-bb21-413dd610b975 >> serviceofferingid=4b391121-49c7-4434-883d-ffe569f63a3b >> templateid=e5701f73-b0c3-4dd7-8b2d-b8bf78875a85 keypair=key1 >> networkids=86e6ded0-6155-449b-a4bd-03411bf0a9cd name=tvmsman1 >> displayname & >> [1] 3907 >> Async job 09148c21-3c42-4334-93b2-428b48fb1fa2 failed >> Error 533, Unable to create a deployment for VM[User|i-15-1151-VM] >> accountid = a4e6eaed-9b06-4806-98f9-4fcc781b773f >> cmd = org.apache.cloudstack.api.command.user.vm.DeployVMCmd >> created = 2015-04-17T13:46:22-0700 >> jobid = 09148c21-3c42-4334-93b2-428b48fb1fa2 >> jobprocstatus = 0 >> jobresult: >> errorcode = 533 >> errortext = Unable to create a deployment for VM[User|i-15-1151-VM] >> jobresultcode = 530 >> jobresulttype = object >> jobstatus = 2 >> userid = c7a0889e-fcec-4095-9d07-d29ea3c1e5d9 >> >> >> (local) mycloudmonkey> list hosts >> >> filter=name,clustername,cpuallocated,cpunumber,cpusockets,cpuspeed,cpuused,cpuwithoverprovisioning, >> name = v-78-VM >> >> ================================================================================ >> name = s-871-VM >> >> ================================================================================ >> name = cl2hyper2 >> clustername = CL2 >> cpuallocated = 100.3% >> cpunumber = 8 >> cpusockets = 2 >> cpuspeed = 1994 >> cpuused = 1.2% >> cpuwithoverprovisioning = 63808.0 >> >> ================================================================================ >> name = v-1-VM >> >> ================================================================================ >> name = cl2hyper1 >> clustername = CL2 >> cpuallocated = 81.45% >> cpunumber = 8 >> cpusockets = 2 >> cpuspeed = 1995 >> cpuused = 0.6% >> cpuwithoverprovisioning = 63840.0 >> >> ================================================================================ >> >> >> >> 2015-04-17 13:46:22,517 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >> (catalina-exec-25:ctx-7b0eb43a ctx-751b2eca ctx-5c8a75fc) submit async >> job-7312, details: AsyncJobVO {id:7312, userId: 15, accountId: 15, >> instanceType: VirtualMachine, instanceId: 1151, cmd: >> org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdInfo: >> >> {"serviceofferingid":"4b391121-49c7-4434-883d-ffe569f63a3b","cmdEventType":"VM.CREATE","ctxUserId":"15","zoneid":"a4c20770-f17e-425e-bb21-413dd610b975","signatureversion":"3","httpmethod":"GET","templateid":"e5701f73-b0c3-4dd7-8b2d-b8bf78875a85","networkids":"86e6ded0-6155-449b-a4bd-03411bf0a9cd","apiKey":"wrxDdS8yi2kJPe8UrNdOdLtp55mCSKskk3MyTJ1ucIApdMoYnOWsd-dmigPywD1KC-6BVfVmKiJVenEM_kovpw","id":"1151","response":"json","ctxDetails":"{\"com.cloud.template.VirtualMachineTemplate\":\"e5701f73-b0c3-4dd7-8b2d-b8bf78875a85\",\"com.cloud.vm.VirtualMachine\":\"6b3ace85-8e4c-4467-afdf-b511136ca6b1\",\"com.cloud.network.Network\":\"86e6ded0-6155-449b-a4bd-03411bf0a9cd\",\"com.cloud.dc.DataCenter\":\"a4c20770-f17e-425e-bb21-413dd610b975\",\"com.cloud.offering.ServiceOffering\":\"4b391121-49c7-4434-883d-ffe569f63a3b\"}","expires":"2015-04-17T20:56:22+0000","keypair":"key1","name":"tvmsman1","uuid":"6b3ace85-8e4c-4467-afdf-b511136ca6b1","ctxAccountId":"15","ctxStartEventId":"11922","signature":"8Ebg1+qjfnk5nv7xz1GtdSju2ws\u003d"}, >> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, >> result: null, initMsid: 345050015385, completeMsid: null, lastUpdated: >> null, lastPolled: null, created: null} >> 2015-04-17 13:46:22,518 INFO [o.a.c.f.j.i.AsyncJobMonitor] >> (API-Job-Executor-16:ctx-e039eccb job-7312) Add job-7312 into job >> monitoring >> 2015-04-17 13:46:22,518 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312) Executing AsyncJobVO >> {id:7312, userId: 15, accountId: 15, instanceType: VirtualMachine, >> instanceId: 1151, cmd: >> org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdInfo: >> >> {"serviceofferingid":"4b391121-49c7-4434-883d-ffe569f63a3b","cmdEventType":"VM.CREATE","ctxUserId":"15","zoneid":"a4c20770-f17e-425e-bb21-413dd610b975","signatureversion":"3","httpmethod":"GET","templateid":"e5701f73-b0c3-4dd7-8b2d-b8bf78875a85","networkids":"86e6ded0-6155-449b-a4bd-03411bf0a9cd","apiKey":"wrxDdS8yi2kJPe8UrNdOdLtp55mCSKskk3MyTJ1ucIApdMoYnOWsd-dmigPywD1KC-6BVfVmKiJVenEM_kovpw","id":"1151","response":"json","ctxDetails":"{\"com.cloud.template.VirtualMachineTemplate\":\"e5701f73-b0c3-4dd7-8b2d-b8bf78875a85\",\"com.cloud.vm.VirtualMachine\":\"6b3ace85-8e4c-4467-afdf-b511136ca6b1\",\"com.cloud.network.Network\":\"86e6ded0-6155-449b-a4bd-03411bf0a9cd\",\"com.cloud.dc.DataCenter\":\"a4c20770-f17e-425e-bb21-413dd610b975\",\"com.cloud.offering.ServiceOffering\":\"4b391121-49c7-4434-883d-ffe569f63a3b\"}","expires":"2015-04-17T20:56:22+0000","keypair":"key1","name":"tvmsman1","uuid":"6b3ace85-8e4c-4467-afdf-b511136ca6b1","ctxAccountId":"15","ctxStartEventId":"11922","signature":"8Ebg1+qjfnk5nv7xz1GtdSju2ws\u003d"}, >> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, >> result: null, initMsid: 345050015385, completeMsid: null, lastUpdated: >> null, lastPolled: null, created: null} >> 2015-04-17 13:46:22,519 DEBUG [c.c.a.ApiServlet] >> (catalina-exec-25:ctx-7b0eb43a ctx-751b2eca ctx-5c8a75fc) ===END=== >> 10.101.1.28 -- GET >> >> networkids=86e6ded0-6155-449b-a4bd-03411bf0a9cd&apiKey=wrxDdS8yi2kJPe8UrNdOdLtp55mCSKskk3MyTJ1ucIApdMoYnOWsd-dmigPywD1KC-6BVfVmKiJVenEM_kovpw&name=tvmsman1&serviceofferingid=4b391121-49c7-4434-883d-ffe569f63a3b&expires=2015-04-17T20%3A56%3A22%2B0000&signatureversion=3&zoneid=a4c20770-f17e-425e-bb21-413dd610b975&keypair=key1&command=deployVirtualMachine&templateid=e5701f73-b0c3-4dd7-8b2d-b8bf78875a85&signature=8Ebg1%2Bqjfnk5nv7xz1GtdSju2ws%3D&response=json >> 2015-04-17 13:46:22,522 DEBUG [o.a.c.a.BaseCmd] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Ignoring >> paremeter displayvm as the caller is not authorized to pass it in >> 2015-04-17 13:46:22,522 DEBUG [o.a.c.a.BaseCmd] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Ignoring >> paremeter deploymentplanner as the caller is not authorized to pass it >> in >> 2015-04-17 13:46:22,539 DEBUG [c.c.u.AccountManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Access to >> Acct[a4e6eaed-9b06-4806-98f9-4fcc781b773f-graysonp] granted to >> Acct[a4e6eaed-9b06-4806-98f9-4fcc781b773f-graysonp] by DomainChecker >> 2015-04-17 13:46:22,552 DEBUG [c.c.u.AccountManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Access to >> Acct[a4e6eaed-9b06-4806-98f9-4fcc781b773f-graysonp] granted to >> Acct[a4e6eaed-9b06-4806-98f9-4fcc781b773f-graysonp] by DomainChecker >> 2015-04-17 13:46:22,565 DEBUG [c.c.u.AccountManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Access to >> Tmpl[222-QCOW2-222-3-98769ef0-8ddf-300a-874f-0e9320ad02c9 granted to >> Acct[a4e6eaed-9b06-4806-98f9-4fcc781b773f-graysonp] by DomainChecker >> 2015-04-17 13:46:22,565 DEBUG [o.a.c.a.BaseCmd] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Ignoring >> paremeter displayvm as the caller is not authorized to pass it in >> 2015-04-17 13:46:22,565 DEBUG [o.a.c.a.BaseCmd] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Ignoring >> paremeter deploymentplanner as the caller is not authorized to pass it >> in >> 2015-04-17 13:46:22,566 WARN [c.c.a.d.ParamGenericValidationWorker] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Received >> unknown parameters for command deployVirtualMachine. Unknown >> parameters : signatureversion expires >> 2015-04-17 13:46:22,588 DEBUG [c.c.u.AccountManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Access to >> VM[User|i-15-1151-VM] granted to >> Acct[a4e6eaed-9b06-4806-98f9-4fcc781b773f-graysonp] by DomainChecker >> 2015-04-17 13:46:22,614 DEBUG [c.c.n.NetworkModelImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Service >> SecurityGroup is not supported in the network id=243 >> 2015-04-17 13:46:22,621 DEBUG [c.c.n.NetworkModelImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Service >> SecurityGroup is not supported in the network id=243 >> 2015-04-17 13:46:22,658 DEBUG [c.c.d.DeploymentPlanningManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Deploy avoids >> pods: [], clusters: [], hosts: [] >> 2015-04-17 13:46:22,660 DEBUG [c.c.d.DeploymentPlanningManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) >> DeploymentPlanner allocation algorithm: >> com.cloud.deploy.FirstFitPlanner@6ba48686 >> 2015-04-17 13:46:22,660 DEBUG [c.c.d.DeploymentPlanningManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Trying to >> allocate a host and storage pools from dc:1, pod:null,cluster:null, >> requested cpu: 500, requested ram: 536870912 >> 2015-04-17 13:46:22,660 DEBUG [c.c.d.DeploymentPlanningManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Is ROOT >> volume READY (pool already allocated)?: No >> 2015-04-17 13:46:22,660 DEBUG [c.c.d.FirstFitPlanner] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Searching all >> possible resources under this Zone: 1 >> 2015-04-17 13:46:22,662 DEBUG [c.c.d.FirstFitPlanner] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Listing >> clusters in order of aggregate capacity, that have (atleast one host >> with) enough CPU and RAM capacity under this Zone: 1 >> 2015-04-17 13:46:22,668 DEBUG [c.c.d.FirstFitPlanner] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Removing from >> the clusterId list these clusters from avoid set: [] >> 2015-04-17 13:46:22,678 DEBUG [c.c.d.FirstFitPlanner] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Cannot >> allocate cluster list [2] for vm creation since their allocated >> percentage crosses the disable capacity threshold defined at each >> cluster/ at global value for capacity Type : 1, skipping these >> clusters >> 2015-04-17 13:46:22,678 DEBUG [c.c.d.FirstFitPlanner] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) No clusters >> found after removing disabled clusters and clusters in avoid list, >> returning. >> 2015-04-17 13:46:22,683 DEBUG [c.c.v.UserVmManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Destroying vm >> VM[User|i-15-1151-VM] as it failed to create on Host with Id:null >> 2015-04-17 13:46:22,706 DEBUG [c.c.c.CapacityManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) VM state >> transitted from :Stopped to Error with event: >> OperationFailedToErrorvm's original host id: null new host id: null >> host id before state transition: null >> 2015-04-17 13:46:22,724 WARN [o.a.c.alerts] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) alertType:: >> 8 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: >> Failed to deploy Vm with Id: 1151, on Host with Id: null >> 2015-04-17 13:46:22,780 INFO [o.a.c.a.c.u.v.DeployVMCmd] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) >> com.cloud.exception.InsufficientServerCapacityException: Unable to >> create a deployment for VM[User|i-15-1151-VM]Scope=interface >> com.cloud.dc.DataCenter; id=1 >> 2015-04-17 13:46:22,781 INFO [o.a.c.a.c.u.v.DeployVMCmd] >> (API-Job-Executor-16:ctx-e039eccb job-7312 ctx-40bb38cb) Unable to >> create a deployment for VM[User|i-15-1151-VM] >> com.cloud.exception.InsufficientServerCapacityException: Unable to >> create a deployment for VM[User|i-15-1151-VM]Scope=interface >> com.cloud.dc.DataCenter; id=1 >> at >> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:214) >> at >> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:200) >> at >> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3468) >> at >> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3123) >> at >> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3111) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) >> at >> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) >> at >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) >> at >> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106) >> at >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) >> at >> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) >> at >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) >> at >> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) >> at >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) >> at >> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) >> at com.sun.proxy.$Proxy207.startVirtualMachine(Unknown Source) >> at >> org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:449) >> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141) >> at >> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) >> at >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503) >> at >> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) >> at >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) >> at >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) >> at >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) >> at >> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) >> at >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:460) >> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:745) >> 2015-04-17 13:46:22,783 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] >> (API-Job-Executor-16:ctx-e039eccb job-7312) Complete async job-7312, >> jobStatus: FAILED, resultCode: 530, result: >> >> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":533,"errortext":"Unable >> to create a deployment for VM[User|i-15-1151-VM]"} >> 2015-04-17 13:46:22,794 DEBUG [o.a.c.f.j.i.AsyncJobManage >> > > > > -- > > Andrija Panić
