Hi Jia, 正常情况,当虚拟机被destroy是,其nics中removed字段会记录当时时间,同时在对应的ip的table中nic_id,reservation_id和taken也会恢复默认值NULL,此时资源被正常释放。
当系统异常,例如系统虚拟机由于存储等资源不足创建失败,在zone enable的状态下会持续被销毁,再创建,此时link local,management IP等资源有时不能被释放,因此当其他资源恢复后也会由于ip不足无法被创建。 Thanks and regards, Lily Liang On 4/2/15, 11:11 AM, "崔佳" <cui6522...@gmail.com> wrote: >了解~~~非常感谢 >我发现这个现象不是经常出现的对么? 我正式环境是这样了 但测试环境,我模拟了几遍都没出现 比较纠结 > >2015-04-02 10:58 GMT+08:00 Lily Liang <qiying.li...@citrix.com>: > >> Hi Jia, >> >> 生产环境下对数据库操作请先备份数据库,可参考以下命令: >> >> #mysqldump cloud > cloud.sql >> >> >> >> Thanks and regards, >> Lily Liang >> Technical Support Engineer >> Email: qiying.li...@citrix.com >> >> >> >> >> >> >> >> >> >> On 4/2/15, 10:54 AM, "崔佳" <cui6522...@gmail.com> wrote: >> >> >多谢~~~~~我尝试操作一下 >> > >> >2015-04-01 13:15 GMT+08:00 Lily Liang <qiying.li...@citrix.com>: >> > >> >> Hi Jia, >> >> >> >> 问题一:Management ip 用完了,可使用以下命令释放: >> >> >> >> update cloud.op_dc_ip_address_alloc set nic_id=NULL, >> >> reservation_id=NULL,taken=NULL where ip_address not in (SELECT >> ip4_address >> >> FROM cloud.nics where reserver_name='PodBasedNetworkGuru' and >> ip4_address >> >> is not NULL and removed is NULL); >> >> >> >> 问题二:从日志看依然是management ip不足的问题,您可以解决问题一后再尝试启动 >> >> >> >> com.cloud.exception.InsufficientAddressCapacityException: Unable to get >> a >> >> management ip addressScope=interface com.cloud.dc.Pod; id=1 >> >> >> >> >> >> Thanks and regards, >> >> Lily Liang >> >> >> >> >> >> >> >> >> >> From: 崔佳 >> >> Reply-To: "users-cn@cloudstack.apache.org<mailto: >> >> users-cn@cloudstack.apache.org>" >> >> Date: Tuesday, March 31, 2015 at 6:29 PM >> >> To: users-cn >> >> Subject: xen Server 管理机IP无法启动了 >> >> >> >> 同学们: >> >> >> >> 请教下如下几个问题: >> >> >> >> 首先我的环境是,cs4.2.0 ,xenserver 6.2.0,遇到如下几个问题,请各位指教 >> >> >> >> 1. 宿主机服务器重启后,管理机IP显示已经满了,导致虚拟路由器无法启动了 >> >> >> >> [内嵌图片 1] >> >> >> >> 2. 我的虚拟主机无法启动,proxy vm总是提示无法启动,重启之前都是正常的, 通过网上查找了几个原因,可能是内存不足,但明显不是这个问题, >> >> 还会有其他问题么? >> >> >> >> [内嵌图片 2] >> >> >> >> 附具体报错信息: >> >> >> >> 2015-03-31 18:27:29,613 DEBUG [db.Transaction.Transaction] >> >> (consoleproxy-1:null) Rolling back the transaction: Time = 0 Name = >> >> >> -SystemVmLoadScanner$1.run:70-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679; >> >> called by >> >> >> -Transaction.rollback:898-DataCenterIpAddressDaoImpl.takeIpAddress:59-ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept:125-DataCenterDaoImpl.allocatePrivateIpAddress:248-ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept:125-PodBasedNetworkGuru.reserve:119-NetworkManagerImpl.prepareNic:2157-NetworkManagerImpl.prepare:2127-VirtualMachineManagerImpl.advanceStart:887-VirtualMachineManagerImpl.start:578-VirtualMachineManagerImpl.start:571-ConsoleProxyManagerImpl.startProxy:556 >> >> 2015-03-31 18:27:29,613 INFO [cloud.vm.VirtualMachineManagerImpl] >> >> (consoleproxy-1:null) Insufficient capacity >> >> com.cloud.exception.InsufficientAddressCapacityException: Unable to get >> a >> >> management ip addressScope=interface com.cloud.dc.Pod; id=1 >> >> at >> >> >> com.cloud.network.guru.PodBasedNetworkGuru.reserve(PodBasedNetworkGuru.java:121) >> >> at >> >> >> com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:2157) >> >> at >> >> >> com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2127) >> >> at >> >> >> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:887) >> >> at >> >> >> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578) >> >> at >> >> >> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:571) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:556) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:928) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1672) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157) >> >> at >> com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) >> >> at >> com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) >> >> at >> >> >> com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) >> >> at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) >> >> at >> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >> >> at >> >> >> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) >> >> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) >> >> at >> >> >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) >> >> at >> >> >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) >> >> at >> >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> >> at >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> >> at java.lang.Thread.run(Thread.java:679) >> >> 2015-03-31 18:27:29,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] >> >> (consoleproxy-1:null) Cleaning up resources for the vm >> >> VM[ConsoleProxy|v-91-VM] in Starting state >> >> 2015-03-31 18:27:29,617 DEBUG [agent.transport.Request] >> >> (consoleproxy-1:null) Seq 1-105382744: Sending { Cmd , MgmtId: >> >> 117977750690, via: 1, Ver: v1, Flags: 100111, >> >> >> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"v-91-VM","wait":0}}] >> >> } >> >> 2015-03-31 18:27:29,617 DEBUG [agent.transport.Request] >> >> (consoleproxy-1:null) Seq 1-105382744: Executing: { Cmd , MgmtId: >> >> 117977750690, via: 1, Ver: v1, Flags: 100111, >> >> >> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"v-91-VM","wait":0}}] >> >> } >> >> 2015-03-31 18:27:29,618 DEBUG [agent.manager.DirectAgentAttache] >> >> (DirectAgent-420:null) Seq 1-105382744: Executing request >> >> 2015-03-31 18:27:29,673 DEBUG [agent.manager.DirectAgentAttache] >> >> (DirectAgent-77:null) Seq 1-105381892: Executing request >> >> 2015-03-31 18:27:29,683 INFO [xen.resource.CitrixResourceBase] >> >> (DirectAgent-420:null) VM does not exist on >> >> XenServer97cbe662-67ba-4d60-a93b-ba64c1894ff6 >> >> 2015-03-31 18:27:29,683 DEBUG [agent.manager.DirectAgentAttache] >> >> (DirectAgent-420:null) Seq 1-105382744: Response Received: >> >> 2015-03-31 18:27:29,684 DEBUG [agent.transport.Request] >> >> (DirectAgent-420:null) Seq 1-105382744: Processing: { Ans: , MgmtId: >> >> 117977750690, via: 1, Ver: v1, Flags: 110, >> >> >> [{"com.cloud.agent.api.StopAnswer":{"vncPort":0,"result":true,"details":"VM >> >> does not exist","wait":0}}] } >> >> 2015-03-31 18:27:29,684 DEBUG [agent.manager.AgentAttache] >> >> (DirectAgent-420:null) Seq 1-105382744: No more commands found >> >> 2015-03-31 18:27:29,684 DEBUG [agent.transport.Request] >> >> (consoleproxy-1:null) Seq 1-105382744: Received: { Ans: , MgmtId: >> >> 117977750690, via: 1, Ver: v1, Flags: 110, { StopAnswer } } >> >> 2015-03-31 18:27:29,696 DEBUG [network.guru.ControlNetworkGuru] >> >> (consoleproxy-1:null) Released nic: NicProfile[360-91-null-null-null >> >> 2015-03-31 18:27:29,703 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] >> >> (consoleproxy-1:null) Releasing ip address for >> >> reservationId=6e43c842-cef7-45fb-95ce-c8cde1edd8c4, instance=361 >> >> 2015-03-31 18:27:29,703 DEBUG [network.guru.PodBasedNetworkGuru] >> >> (consoleproxy-1:null) Released nic: NicProfile[361-91-null-null-null >> >> 2015-03-31 18:27:29,705 DEBUG [cloud.vm.VirtualMachineManagerImpl] >> >> (consoleproxy-1:null) Successfully released network resources for the vm >> >> VM[ConsoleProxy|v-91-VM] >> >> 2015-03-31 18:27:29,705 DEBUG [cloud.vm.VirtualMachineManagerImpl] >> >> (consoleproxy-1:null) Successfully cleanued up resources for the vm >> >> VM[ConsoleProxy|v-91-VM] in Starting state >> >> 2015-03-31 18:27:29,707 DEBUG >> [cloud.deploy.DeploymentPlanningManagerImpl] >> >> (consoleproxy-1:null) Deploy avoids pods: [1], clusters: null, hosts: >> [1] >> >> 2015-03-31 18:27:29,708 DEBUG >> [cloud.deploy.DeploymentPlanningManagerImpl] >> >> (consoleproxy-1:null) DeploymentPlanner allocation algorithm: >> >> com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_51711e75@3f7ebc6c >> >> 2015-03-31 18:27:29,708 DEBUG >> [cloud.deploy.DeploymentPlanningManagerImpl] >> >> (consoleproxy-1:null) Trying to allocate a host and storage pools from >> >> dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824 >> >> 2015-03-31 18:27:29,708 DEBUG >> [cloud.deploy.DeploymentPlanningManagerImpl] >> >> (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No >> >> 2015-03-31 18:27:29,708 DEBUG [cloud.deploy.FirstFitPlanner] >> >> (consoleproxy-1:null) Searching resources only under specified Pod: 1 >> >> 2015-03-31 18:27:29,708 DEBUG [cloud.deploy.FirstFitPlanner] >> >> (consoleproxy-1:null) The specified pod is in avoid set, returning. >> >> 2015-03-31 18:27:29,713 DEBUG [cloud.capacity.CapacityManagerImpl] >> >> (consoleproxy-1:null) VM state transitted from :Starting to Stopped with >> >> event: OperationFailedvm's original host id: null new host id: null >> host id >> >> before state transition: 1 >> >> 2015-03-31 18:27:29,719 DEBUG [cloud.capacity.CapacityManagerImpl] >> >> (consoleproxy-1:null) Hosts's actual total CPU: 19200 and CPU after >> >> applying overprovisioning: 19200 >> >> 2015-03-31 18:27:29,719 DEBUG [cloud.capacity.CapacityManagerImpl] >> >> (consoleproxy-1:null) Hosts's actual total RAM: 7544791296 and RAM after >> >> applying overprovisioning: 7544791040 >> >> 2015-03-31 18:27:29,719 DEBUG [cloud.capacity.CapacityManagerImpl] >> >> (consoleproxy-1:null) release cpu from host: 1, old used: >> 1000,reserved: 0, >> >> actual total: 19200, total with overprovisioning: 19200; new used: >> >> 500,reserved:0; movedfromreserved: false,moveToReserveredfalse >> >> 2015-03-31 18:27:29,719 DEBUG [cloud.capacity.CapacityManagerImpl] >> >> (consoleproxy-1:null) release mem from host: 1, old used: >> >> 1342177280,reserved: 0, total: 7544791040; new used: >> 268435456,reserved:0; >> >> movedfromreserved: false,moveToReserveredfalse >> >> 2015-03-31 18:27:29,721 WARN >> [cloud.consoleproxy.ConsoleProxyManagerImpl] >> >> (consoleproxy-1:null) Exception while trying to start console proxy >> >> com.cloud.exception.InsufficientServerCapacityException: Unable to >> create >> >> a deployment for VM[ConsoleProxy|v-91-VM]Scope=interface >> >> com.cloud.dc.DataCenter; id=1 >> >> at >> >> >> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:842) >> >> at >> >> >> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578) >> >> at >> >> >> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:571) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:556) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:928) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1672) >> >> at >> >> >> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157) >> >> at >> com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) >> >> at >> com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) >> >> at >> >> >> com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) >> >> at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) >> >> at >> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >> >> at >> >> >> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) >> >> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) >> >> at >> >> >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) >> >> at >> >> >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) >> >> at >> >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> >> at >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> >> at java.lang.Thread.run(Thread.java:679) >> >> 2015-03-31 18:27:29,895 DEBUG [agent.manager.DirectAgentAttache] >> >> (DirectAgent-77:null) Seq 1-105381892: Response Received: >> >> 2015-03-31 18:27:29,895 DEBUG [agent.transport.Request] >> >> (DirectAgent-77:null) Seq 1-105381892: Processing: { Ans: , MgmtId: >> >> 117977750690, via: 1, Ver: v1, Flags: 10, >> >> >> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] >> >> } >> >> 2015-03-31 18:27:32,372 DEBUG >> >> [network.router.VirtualNetworkApplianceManagerImpl] >> >> (RouterStatusMonitor-1:null) Found 0 routers to update status. >> >> 2015-03-31 18:27:32,374 DEBUG >> >> [network.router.VirtualNetworkApplianceManagerImpl] >> >> (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. >> >> 2015-03-31 18:27:32,467 DEBUG >> >> [network.router.VirtualNetworkApplianceManagerImpl] >> >> (RouterStatusMonitor-1:null) Found 0 routers to update status. >> >> 2015-03-31 18:27:32,469 DEBUG >> >> [network.router.VirtualNetworkApplianceManagerImpl] >> >> (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. >> >> 2015-03-31 18:27:33,669 DEBUG [cloudstack.storage.RemoteHostEndPoint] >> >> (Timer-10:null) Sending command >> >> org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 6 >> >> 2015-03-31 18:27:33,672 DEBUG [agent.transport.Request] (Timer-10:null) >> >> Seq 6-1022623893: Sending { Cmd , MgmtId: 117977750690, via: 6, Ver: >> v1, >> >> Flags: 100011, >> >> >> [{"org.apache.cloudstack.storage.command.DownloadProgressCommand":{"jobId":"3aaff441-0f9d-4c46-8355-0f5043a20e5a","request":"GET_STATUS","hvm":false,"description":"CentOS >> >> 5.6(64-bit) no GUI >> >> >> (XenServer)","checksum":"905cec879afd9c9d22ecc8036131a180","maxDownloadSizeInBytes":53687091200,"id":5,"resourceType":"TEMPLATE","installPath":"template/tmpl/1/5","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs:// >> >> 192.168.70.72/data1/export/secondary< >> >> >> http://secure-web.cisco.com/1S_O3vyDH7mtGM51DwJ6cWlZiK72mUdyVu3vGhZKJSgdwI_WVzFcGkw3AH5BOLM5J5j_-2wpVN_Hz4qscWqB0ZF1njiYUwDYDjKRZb5ik6-RGVjypGlVXrk2MnzaZVUsPN3MVWNO7by9vLtJrHyubK5nvTeg-bt6XjBXTPSHaHfM/http%3A%2F%2F192.168.70.72%2Fdata1%2Fexport%2Fsecondary >> >> >","_role":"Image"}},"url":" >> >> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 >> >> >> ","format":"VHD","accountId":1,"name":"centos56-x86_64-xen","secUrl":"nfs:// >> >> 192.168.70.72/data1/export/secondary< >> >> >> http://secure-web.cisco.com/1S_O3vyDH7mtGM51DwJ6cWlZiK72mUdyVu3vGhZKJSgdwI_WVzFcGkw3AH5BOLM5J5j_-2wpVN_Hz4qscWqB0ZF1njiYUwDYDjKRZb5ik6-RGVjypGlVXrk2MnzaZVUsPN3MVWNO7by9vLtJrHyubK5nvTeg-bt6XjBXTPSHaHfM/http%3A%2F%2F192.168.70.72%2Fdata1%2Fexport%2Fsecondary >> >","wait":0}}] >> >> } >> >> >> >> >> >> >>