麻烦如下事情提供下： 1.kvm主机cloudbr0 （eth0）网卡，承载了管理，公共，存储网络。网段是192.168.50.0/24 吗？属于哪个vlan？ 既然对应端口为trunk，那么cloudbr0（IP为 192.168.50.107），想要跟管理端通信，cloudbr0的数据包从trunk口出去肯定得有vlan id。要不就是trunk口设置本征vlan.。 如果设置了本征vlan，那区域里面的公共网络有没有配置vlan id？ 2.日志报错是无法ssh到vm，这个vm，指的就是vr。但至于是kvm主机无法ssh，还是管理端ssh？分析下。 vr分别连接公共网络，来宾网络和 cloud link local network。既然如你所说，CPVM和SSVM正常的话。那就奇怪了。 检查下vxlan模块是否加载正确，iprouter2是否配置正常。
3.另外，使用vxlan时，需要在你环境中，kvm主机防火墙，和交换机防火墙中开放udp的8472端口。 检查是否开启。 另外，希望可以附上区域物理网络中，管理，公共，存储和来宾的配置截图。 2014-08-06 21:15 GMT+08:00 刘宇超 <tanthalas...@hotmail.com>: > > > > > > > > Log里有这么一句：Unable to ssh to the VM: Can not ping System vm r-10-VMdue > to:Unable to connect > 看起来是VM连不上VR，获取不到更多信息，所以失败了，检查一下网络问题吧。 > > > 刘宇超?发件人：?wanghaicheng2...@gmail.com发送时间：?2014-08-06?17:58收件人：?users-cn主题：?回复: > VXLAN模式创建vm报错补充kvm节点上的错误日志： > ? > #agent.log > > > 2014-08-06 01:16:37,453 WARN? [kvm.resource.LibvirtComputingResource] > (agentRequest-Handler-3:null) Timed out: > /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/patchviasocket.pl > -n r-12-VM -p > %template=domP%name=r-12-VM%eth2ip=192.168.10.223%eth2mask=255.255.255.0%gateway=192.168.10.254%eth0ip=192.168.1.254%eth0mask=255.255.255.0%domain=cs2cloud.internal%dhcprange=192.168.1.1%eth1ip=169.254.0.55%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8 > .? Output is: > 2014-08-06 01:16:58,466 WARN? [kvm.resource.LibvirtComputingResource] > (Script-3:null) Interrupting script. > ? > ? > ? > ? > ? > ? > wanghaicheng2...@gmail.com > ? > 发件人： wanghaicheng2...@gmail.com > 发送时间： 2014-08-06 11:06 > 收件人： users-cn > 主题： VXLAN模式创建vm报错 > CS4.3+KVM > ? > Hypervisor: CentOS6.5 +Kernel 3.12 > ? > 网络隔离：VXLAN > ? > eth0（trunk）--cloudbr0? 192.168.50.107????? 管理、公共、存储 > eth1（trunk）--cloudbr1? 192.0.2.1??????????????? 来宾 > ? > 问题：创建第一台vm时报错，/var/log/cloudstack/management/catalina.out 报错日志： > ? > ? > INFO? [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-51:ctx-30453c11) Add > job-69 into job monitoring > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-3ca98c34) Task (job-69) > has been pending for 142 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-27402e73) Task (job-69) > has been pending for 202 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-33453472) Task (job-69) > has been pending for 262 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-61c8019e) Task (job-69) > has been pending for 322 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-b2f7e70f) Task (job-69) > has been pending for 382 seconds > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-1:ctx-709f354f) checking > health of usage server > WARN? [o.a.c.alerts] (HA-1:ctx-709f354f)? alertType:: 13 // dataCenterId:: > 0 // podId:: 0 // clusterId:: null // message:: No usage server process > running > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-432cc75c) Task (job-69) > has been pending for 442 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-54f26ce2) Task (job-69) > has been pending for 502 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-5384af05) Task (job-69) > has been pending for 562 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-062f1af3) Task (job-69) > has been pending for 622 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-ad5358b6) Task (job-69) > has been pending for 682 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-c41b27b0) Task (job-69) > has been pending for 742 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-a46e086d) Task (job-69) > has been pending for 802 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-d2bf8947) Task (job-69) > has been pending for 862 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-96cbabe5) Task (job-69) > has been pending for 922 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-b2ac4671) Task (job-69) > has been pending for 982 seconds > INFO? [c.c.n.v.VpcManagerImpl] (VpcChecker-1:ctx-ea3dafc3) Found 0 removed > VPCs to cleanup > INFO? [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-cb1ceb0b) Found 0 > removed accounts to cleanup > INFO? [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-cb1ceb0b) Found 0 > disabled accounts to cleanup > INFO? [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-cb1ceb0b) Found 0 > inactive domains to cleanup > INFO? [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-cb1ceb0b) Found 0 > disabled projects to cleanup > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-4:ctx-33cd71d6) HA Cleanup > Thread Running > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-2:ctx-d1a78940) checking > health of usage server > WARN? [o.a.c.alerts] (HA-2:ctx-d1a78940)? alertType:: 13 // dataCenterId:: > 0 // podId:: 0 // clusterId:: null // message:: No usage server process > running > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-46dabe8d) Task (job-69) > has been pending for 1042 seconds > WARN? [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-51:ctx-30453c11 ctx-ff79e24b) Unable to ssh to the VM: Can > not ping System vm r-10-VMdue to:Unable to connect > INFO? [c.c.v.VirtualMachineManagerImpl] (Job-Executor-51:ctx-30453c11 > ctx-ff79e24b) The guru did not like the answers so stopping > VM[DomainRouter|r-10-VM] > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-5fbbe89b) Task (job-69) > has been pending for 1102 seconds > WARN? [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-69b764be) Task (job-69) > has been pending for 1162 seconds > ERROR [c.c.v.VirtualMachineManagerImpl] (Job-Executor-51:ctx-30453c11 > ctx-ff79e24b) Failed to start instance VM[DomainRouter|r-10-VM] > com.cloud.utils.exception.ExecutionException: Unable to start > VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1039) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) > ??????? at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2845) > ??????? at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1924) > ??????? at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouters(VirtualNetworkApplianceManagerImpl.java:2024)at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployVirtualRouterInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:2002) > ??????? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ??????? at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > ??????? at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ??????? at java.lang.reflect.Method.invoke(Method.java:606) > ??????? at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > ??????? at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > ??????? at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) > ??????? at > com.sun.proxy.$Proxy240.deployVirtualRouterInGuestNetwork(Unknown Source) > ??????? at > com.cloud.network.element.VirtualRouterElement.implement(VirtualRouterElement.java:188) > ??????? at > org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1070) > ??????? at > org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetwork(NetworkOrchestrator.java:977) > ??????? at > org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:1238) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601) > ??????? at > org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:228) > ??????? at > org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147) > ...skipping... > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147) > ??????? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ??????? at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > ??????? at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ??????? at java.lang.reflect.Method.invoke(Method.java:606) > ??????? at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > ??????? at > com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) > ??????? at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > ??????? at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) > ??????? at com.sun.proxy.$Proxy169.startVirtualMachine(Unknown Source) > ??????? at > org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:443) > ??????? at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) > ??????? at > com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109) > ??????? at > com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > ??????? at > com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63) > ??????? at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509) > ??????? at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > ??????? at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > ??????? at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > ??????? at java.util.concurrent.FutureTask.run(FutureTask.java:262) > ??????? at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > ??????? at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > ??????? at java.lang.Thread.run(Thread.java:744) > Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable > to create a deployment for VM[User|vm-1]Scope=interface > com.cloud.dc.DataCenter; id=2 > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601) > ??????? ... 37 more > INFO? [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-51:ctx-30453c11) Remove > job-69 from job monitoring > INFO? [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-76fbcbd0) Found 1 > vms to expunge. > WARN? [o.a.c.f.j.AsyncJobExecutionContext] > (UserVm-Scavenger-1:ctx-76fbcbd0) Job is executed without a context, setup > psudo job for the executing thread > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-2:ctx-93ebf822) checking > health of usage server > WARN? [o.a.c.alerts] (HA-2:ctx-93ebf822)? alertType:: 13 // dataCenterId:: > 0 // podId:: 0 // clusterId:: null // message:: No usage server process > running > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-2:ctx-facbf7ea) checking > health of usage server > WARN? [o.a.c.alerts] (HA-2:ctx-facbf7ea)? alertType:: 13 // dataCenterId:: > 0 // podId:: 0 // clusterId:: null // message:: No usage server process > running > ...skipping... > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161) > ??????? at > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147) > ??????? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ??????? at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > ??????? at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ??????? at java.lang.reflect.Method.invoke(Method.java:606) > ??????? at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > ??????? at > com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) > ??????? at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) > ??????? at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > ??????? at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) > ??????? at com.sun.proxy.$Proxy169.startVirtualMachine(Unknown Source) > ??????? at > org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:443) > ??????? at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) > ??????? at > com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109) > ??????? at > com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > ??????? at > com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63) > ??????? at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509) > ??????? at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > ??????? at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > ??????? at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > ??????? at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > ??????? at java.util.concurrent.FutureTask.run(FutureTask.java:262) > ??????? at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > ??????? at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > ??????? at java.lang.Thread.run(Thread.java:744) > Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable > to create a deployment for VM[User|vm-1]Scope=interface > com.cloud.dc.DataCenter; id=2 > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) > ??????? at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601) > ??????? ... 37 more > INFO? [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-51:ctx-30453c11) Remove > job-69 from job monitoring > INFO? [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-76fbcbd0) Found 1 > vms to expunge. > WARN? [o.a.c.f.j.AsyncJobExecutionContext] > (UserVm-Scavenger-1:ctx-76fbcbd0) Job is executed without a context, setup > psudo job for the executing thread > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-2:ctx-93ebf822) checking > health of usage server > WARN? [o.a.c.alerts] (HA-2:ctx-93ebf822)? alertType:: 13 // dataCenterId:: > 0 // podId:: 0 // clusterId:: null // message:: No usage server process > running > INFO? [c.c.h.HighAvailabilityManagerImpl] (HA-2:ctx-facbf7ea) checking > health of usage server > WARN? [o.a.c.alerts] (HA-2:ctx-facbf7ea)? alertType:: 13 // dataCenterId:: > 0 // podId:: 0 // clusterId:: null // message:: No usage server process > running > ? > ? > ? > wanghaicheng2...@gmail.com > >
