Hello, I try to build a basic cloudstack environment, and i have some issue, my question is if someone can help me with this issue.
1x CentOS 6.6 - CloudStack Management 4.5 1x CentOS 6.6 - Agent After i configured all the Zone, Pod, Cluster, Host, Storage. I get this error : Agent ======================= agent.log at org.libvirt.ErrorHandler.processError(Unknown Source) at org.libvirt.Connect.processError(Unknown Source) at org.libvirt.Connect.processError(Unknown Source) at org.libvirt.Connect.domainCreateXML(Unknown Source) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1267) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3828) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1361) at com.cloud.agent.Agent.processRequest(Agent.java:503) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808) at com.cloud.utils.nio.Task.run(Task.java:84) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2015-08-24 19:58:27,398 INFO [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-5:null) Attempting to remove volume 784dfb3b-38a0-4364-85c3-957559d0b996 from pool 8b0ef411-dcbf-4af5-a6f5-d75f70f69fda 2015-08-24 19:58:53,858 WARN [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-1:null) LibvirtException org.libvirt.LibvirtException: internal error Process exited while reading console log output: 2015-08-24T23:58:53.671841Z qemu-kvm: -chardev pty,id=charserial0: Failed to create chardev ======================== Management ======================== 2015-08-24 19:59:25,141 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-46:ctx-74cf9cb8 job-1/job-167) Done executing com.cloud.vm.VmWorkStart for job-167 2015-08-24 19:59:25,142 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-46:ctx-74cf9cb8 job-1/job-167) Remove job-167 from job monitoring 2015-08-24 19:59:25,176 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-df02251a) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-31-VM]Scope=interface com.cloud.dc.DataCenter; id=1 at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:947) at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4480) at sun.reflect.GeneratedMethodAccessor193.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636) at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2015-08-24 19:59:25,177 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-df02251a) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 31, will recycle it and start a new one 2015-08-24 19:59:25,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-df02251a) Sync job-169 execution on object VmWorkJobQueue.31 2015-08-24 19:59:27,062 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-47a5509d) Execute sync-queue item: SyncQueueItemVO {id:153, queueId: 150, contentType: AsyncJob, contentId: 169, lastProcessMsid: 130591767396, lastprocessNumber: 3, lastProcessTime: Mon Aug 24 19:59:26 EDT 2015, created: Mon Aug 24 19:59:25 EDT 2015} 2015-08-24 19:59:27,062 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-47a5509d) Schedule queued job-169 2015-08-24 19:59:27,083 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Add job-169 into job monitoring 2015-08-24 19:59:27,085 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Executing AsyncJobVO {id:169, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAH3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 130591767396, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Aug 24 19:59:25 EDT 2015} 2015-08-24 19:59:27,086 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Run VM work job: com.cloud.vm.VmWorkStop for VM 31, job origin: 1 2015-08-24 19:59:27,086 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":31,"handlerName":"VirtualMachineManagerImpl"} 2015-08-24 19:59:27,088 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) VM is already stopped: VM[SecondaryStorageVm|s-31-VM] 2015-08-24 19:59:27,088 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":31,"handlerName":"VirtualMachineManagerImpl"} 2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Complete async job-169, jobStatus: SUCCEEDED, resultCode: 0, result: null 2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Publish async job-169 complete on message bus 2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Wake up jobs related to job-169 2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Update db status for job-169 2015-08-24 19:59:27,088 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169 ctx-7b50a4ac) Wake up jobs joined with job-169 and disjoin all subjobs created from job- 169 2015-08-24 19:59:27,104 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 31, job origin: 1 2015-08-24 19:59:27,104 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Done executing com.cloud.vm.VmWorkStop for job-169 2015-08-24 19:59:27,104 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-48:ctx-35f6c76e job-1/job-169) Remove job-169 from job monitoring 2015-08-24 19:59:27,141 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-df02251a) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null 2015-08-24 19:59:27,141 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-df02251a) Destroying vm VM[SecondaryStorageVm|s-31-VM] 2015-08-24 19:59:27,141 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-df02251a) Cleaning up NICS 2015-08-24 19:59:27,141 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Cleaning network for vm: 31 2015-08-24 19:59:27,160 DEBUG [c.c.n.g.DirectNetworkGuru] (secstorage-1:ctx-df02251a) Deallocate network: networkId: 204, ip: 172.20.255.113 2015-08-24 19:59:27,161 DEBUG [c.c.n.g.DirectNetworkGuru] (secstorage-1:ctx-df02251a) remove nic 120 secondary ip 2015-08-24 19:59:27,195 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Removed nic id=120 2015-08-24 19:59:27,195 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ... 2015-08-24 19:59:27,228 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Removed nic id=121 2015-08-24 19:59:27,229 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ... 2015-08-24 19:59:27,262 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Removed nic id=122 2015-08-24 19:59:27,262 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ... 2015-08-24 19:59:27,295 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Removed nic id=123 2015-08-24 19:59:27,295 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-df02251a) Revoving nic secondary ip entry ... 2015-08-24 19:59:27,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-df02251a) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage 2015-08-24 19:59:27,295 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-df02251a) Cleaning storage for vm: 31 2015-08-24 19:59:27,337 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-df02251a) Seq 1-3472275312702652538: Sending { Cmd , MgmtId: 130591767396, via: 1(kvm001.shape.host), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"3eb007ec-7839-41e5-9ab1-65655fa13a3f","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b0ef411-dcbf-4af5-a6f5-d75f70f69fda","id":1,"poolType":"Filesystem","host":"167.114.101.20","path":"/var/lib/libvirt/images","port":0,"url":"Filesystem://167.114.101.20/var/lib/libvirt/images/?ROLE=Primary&STOREUUID=8b0ef411-dcbf-4af5-a6f5-d75f70f69fda"}},"name":"ROOT-31","size":0,"path":"3eb007ec-7839-41e5-9ab1-65655fa13a3f","volumeId":33,"vmName":"s-31-VM","accountId":1,"format":"QCOW2","provisioningType":"THIN","id":33,"deviceId":0,"hypervisorType":"KVM"}},"wait":0}}] } 2015-08-24 19:59:27,345 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) Seq 1-3472275312702652538: Processing: { Ans: , MgmtId: 130591767396, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } 2015-08-24 19:59:27,345 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-df02251a) Seq 1-3472275312702652538: Received: { Ans: , MgmtId: 130591767396, via: 1, Ver: v1, Flags: 10, { Answer } } 2015-08-24 19:59:27,363 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-df02251a) Volume 33 is not referred anywhere, remove it from volumes table 2015-08-24 19:59:27,395 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-df02251a) Expunged VM[SecondaryStorageVm|s-31-VM] 2015-08-24 19:59:27,412 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-df02251a) received secondary storage vm alert 2015-08-24 19:59:27,412 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-df02251a) Secondary Storage Vm creation failure, zone: zone001 2015-08-24 19:59:27,413 WARN [o.a.c.alerts] (secstorage-1:ctx-df02251a) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: zone001, error details: null 2015-08-24 19:59:27,429 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-df02251a) Primary secondary storage is not even started, wait until next turn 2015-08-24 19:59:28,993 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0abaaa2d) Begin cleanup expired async-jobs 2015-08-24 19:59:28,995 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0abaaa2d) End cleanup expired async-jobs 2015-08-24 19:59:29,067 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:ctx-42ef39cb) Found 0 running routers. 2015-08-24 19:59:29,067 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-43f5076d) Found 0 routers to update status. 2015-08-24 19:59:29,068 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-43f5076d) Found 0 networks to update RvR status. 2015-08-24 19:59:29,093 DEBUG [c.c.n.ExternalDeviceUsageManagerImpl] (ExternalNetworkMonitor-1:ctx-9b08ea84) External devices stats collector is running... 2015-08-24 19:59:29,152 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-acd70702) Snapshot scheduler.poll is being called at 2015-08-24 23:59:29 GMT 2015-08-24 19:59:29,153 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-acd70702) Got 0 snapshots to be executed at 2015-08-24 23:59:29 GMT 2015-08-24 19:59:38,993 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ed734d53) Begin cleanup expired async-jobs 2015-08-24 19:59:38,995 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ed734d53) End cleanup expired async-jobs 2015-08-24 19:59:39,138 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] (LBHealthCheck-1:ctx-7c74ed95) LB HealthCheck Manager is running and getting the updates from LB providers and updating service status 2015-08-24 19:59:39,142 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] (LBHealthCheck-1:ctx-7c74ed95) LB HealthCheck Manager is running and getting the updates from LB providers and updating service status 2015-08-24 19:59:40,849 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-8:null) Ping from 1 2015-08-24 19:59:40,849 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-8:null) Process host VM state report from ping process. host: 1 2015-08-24 19:59:40,849 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-8:null) Process VM state report. host: 1, number of records in report: 0 2015-08-24 19:59:40,850 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-8:null) Done with process of VM state report. host: 1 2015-08-24 19:59:44,071 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-13add4f6) AutoScaling Monitor is running... 2015-08-24 19:59:44,084 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-f71544c1) VmStatsCollector is running... 2015-08-24 19:59:44,569 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-53233e04) StorageCollector is running... 2015-08-24 19:59:44,570 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-53233e04) There is no secondary storage VM for secondary storage host Primary 2015-08-24 19:59:44,617 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-53233e04) Seq 1-3472275312702652539: Received: { Ans: , MgmtId: 130591767396, via: 1, Ver: v1, Fl Regards, Cristian