Re: Performance problem within SSVM
Vlad Cloudstack agent.out or log on SSVM would tell you the last operation (or set of operations) it performed. Perhaps you can replay them by hand in shell to find the culprit? Also, if i read correctly, the NFS is a soft mount, hence you should not have system lockups. I suspect an underlying problem either in hypervisor or network stack.. Regards ilya On 5/26/15 10:55 AM, Vladislav Nazarenko wrote: Hi Everybody, I'm expierencing some performance problems with SSVM. /usr/local/cloud/systemvm/ssvm-check.sh shows no problems When the agent is running, I see 100% of io-wait. secondary storage is mounted, but due to the io-wait, I can not access it When I stop the agent(/etc/init.d/cloud stop), I can easily access the nfs mount. I also tried to download images manually (curl), works good. the physical host hos not IO problems /etc/exports: /storage 10.0.40.0/24(rw,async,no_root_squash,no_subtree_check) Mount in the SSVM: 10.0.40.10:/storage/secondary on /mnt/SecStorage/0405ba30-38b9-349d-9ea4-15ea09d67e09 type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acdirmin=0,acdirmax=0,soft,proto=tcp,timeo=133,retrans=2147483647,sec=sys,mountaddr=10.0.40.10,mountvers=3,mountport=892,mountproto=tcp,local_lock=none,addr=10.0.40.10) Cloudtack: 4.4.3 on centos 7 Please advice what to check Vlad
Re: Performance problem within SSVM
try running tcp dump on the hypervisor the SSVM is on.. On 5/26/15 10:55 AM, Vladislav Nazarenko wrote: Hi Everybody, I'm expierencing some performance problems with SSVM. /usr/local/cloud/systemvm/ssvm-check.sh shows no problems When the agent is running, I see 100% of io-wait. secondary storage is mounted, but due to the io-wait, I can not access it When I stop the agent(/etc/init.d/cloud stop), I can easily access the nfs mount. I also tried to download images manually (curl), works good. the physical host hos not IO problems /etc/exports: /storage 10.0.40.0/24(rw,async,no_root_squash,no_subtree_check) Mount in the SSVM: 10.0.40.10:/storage/secondary on /mnt/SecStorage/0405ba30-38b9-349d-9ea4-15ea09d67e09 type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acdirmin=0,acdirmax=0,soft,proto=tcp,timeo=133,retrans=2147483647,sec=sys,mountaddr=10.0.40.10,mountvers=3,mountport=892,mountproto=tcp,local_lock=none,addr=10.0.40.10) Cloudtack: 4.4.3 on centos 7 Please advice what to check Vlad
RE: Compatibility of CS 4.5.1 with XenServer 6.5 SP1
After upgrade we have a serious problem with VR for shared guest network. It seem everything is working OK, but after a while we got these errors on system console: Domain routerCommand: com.cloud.agent.api.Command failed while ...25 May 2015 16:58:08 Domain routerUnable to restart r-30-VM which was running on hos...availability zone: ZoneX: Pod 1 After VR restart everything goes back for a while (~ 3-4 min) and then problem comes back. VR is slow. Logging into VR from host for troubleshooting takes around 30 sec. All the VM-s in guest network are also slow because of the network. Network restart has failed. VR restart does not give anything. Inside VR even simple tasks like ps ax or top take seconds. Do you have any ideas why that can happen? Vadim. -Original Message- From: Jan-Arve Nygård [mailto:jan.arve.nyg...@gmail.com] Sent: Thursday, May 21, 2015 1:05 AM To: users@cloudstack.apache.org Subject: Re: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 We have tested upgrading to XS 6.5 SP1 with CloudStack 4.5.1 and we didn't run into any issues. We tested the following without any problems: Start of existing VM Deploy VM Destroy VM Attach ISO Detach ISO Snapshot of VM Live migration of VM to another host Storage migration to another SR Add NIC Remove NIC And probably some other stuff that i don't remember right now. -thinktwo 2015-05-20 21:17 GMT+02:00 Vadim Kimlaychuk vadim.kimlayc...@elion.ee: I am planning to do it within a couple of days. Will let you know Vadim. From: Jan-Arve Nygård jan.arve.nyg...@gmail.com Sent: Wednesday, May 20, 2015 15:38 To: users@cloudstack.apache.org Subject: Re: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 I guess it wouldn't be a problem, but I'm also interested if someone has tested and verified this yet. 2015-05-19 14:57 GMT+02:00 Ian Service iserv...@ts2.ca: The release notes for CS 4.5.1 don't specifically list XenServer 6.5 SP1 compatibility, likely because they overlapped in release timelines. Are there any compatibility concerns between the two latest versions of each? Thanks, - Ian
vmware虚拟机添加
各位好： 1、先创建一个zone选择xenserver，再添加vmware没有问题 2、开始创建zone时，就选择vmware，配置流量标签时，管理网配置为vswitch0时，公共流量和来宾配置为vswitch1时，创建 zone完成后，发现在vmware上创建反了。 2015-05-26 toudsf
Re: Cloudstack 4.3.2 with KVM system template from shapeblue not supported by qemu version
Just convert the template (use some newer ubuntu version of qemu-img) to qcow2 version 2... They provide qcow2 version 3, you need version 2 for centos something like (but please google and confirm): qemu-img convert -f qcow2 /var/lib/libvirt/images/qcow2v3.img -O qcow2 -o compat=0.10 /var/lib/libvirt/images/qcow2v2.img On 26 May 2015 at 05:09, Amin Samir amin.sa...@opencloud.net.au wrote: Hello, We are using Cloudstack 4.3.2 from shapeblue repo, along with KVM template dated 2015-01-28, our environment is as follows: 1) Cloud stack management server Centos 6.6, with Cloudstack 4.3.2 2) Centos 6.6 KVM with the cloudstack-agent installed from shapeblue repo 3) FreeNAS 9.3 for NFS primary secondary storage. 4) Advanced zone We have configured cloubr0 on eth0 in a single physical network, modified the labels during the zone launch to match the bridge names on the host. However System vm cannot launch due the following error in the agent: uses a qcow2 feature which is not supported by this qemu version: QCOW version 3 Anyone please help with this issue, shall we use another system template. Thanks in advance. -- Andrija Panić
RE: Compatibility of CS 4.5.1 with XenServer 6.5 SP1
More tests shows that VR is totally broken. I have created new isolated network with SNAT and was not able to ping even VR public IP. VM was not pinging as well. From the other side VPC networks are working correctly. Can someone answer the question -- which way those VM-s are different? Vadim. -Original Message- From: Vadim Kimlaychuk [mailto:vadim.kimlayc...@elion.ee] Sent: Tuesday, May 26, 2015 9:48 AM To: users@cloudstack.apache.org Subject: RE: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 After upgrade we have a serious problem with VR for shared guest network. It seem everything is working OK, but after a while we got these errors on system console: Domain routerCommand: com.cloud.agent.api.Command failed while ...25 May 2015 16:58:08 Domain routerUnable to restart r-30-VM which was running on hos...availability zone: ZoneX: Pod 1 After VR restart everything goes back for a while (~ 3-4 min) and then problem comes back. VR is slow. Logging into VR from host for troubleshooting takes around 30 sec. All the VM-s in guest network are also slow because of the network. Network restart has failed. VR restart does not give anything. Inside VR even simple tasks like ps ax or top take seconds. Do you have any ideas why that can happen? Vadim. -Original Message- From: Jan-Arve Nygård [mailto:jan.arve.nyg...@gmail.com] Sent: Thursday, May 21, 2015 1:05 AM To: users@cloudstack.apache.org Subject: Re: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 We have tested upgrading to XS 6.5 SP1 with CloudStack 4.5.1 and we didn't run into any issues. We tested the following without any problems: Start of existing VM Deploy VM Destroy VM Attach ISO Detach ISO Snapshot of VM Live migration of VM to another host Storage migration to another SR Add NIC Remove NIC And probably some other stuff that i don't remember right now. -thinktwo 2015-05-20 21:17 GMT+02:00 Vadim Kimlaychuk vadim.kimlayc...@elion.ee: I am planning to do it within a couple of days. Will let you know Vadim. From: Jan-Arve Nygård jan.arve.nyg...@gmail.com Sent: Wednesday, May 20, 2015 15:38 To: users@cloudstack.apache.org Subject: Re: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 I guess it wouldn't be a problem, but I'm also interested if someone has tested and verified this yet. 2015-05-19 14:57 GMT+02:00 Ian Service iserv...@ts2.ca: The release notes for CS 4.5.1 don't specifically list XenServer 6.5 SP1 compatibility, likely because they overlapped in release timelines. Are there any compatibility concerns between the two latest versions of each? Thanks, - Ian
AW: SSVM agent not starting
Ok, I just replaced the NONOSS with the OSS management server on my XenServer platform. Afterwards, the system VMs no longer connect, it's the dreaded 2015-05-26 09:13:59,164 INFO [utils.nio.NioClient] (Agent-Selector:null) Connecting to 10.32.0.16:8250 2015-05-26 09:14:29,202 ERROR [utils.nio.NioConnection] (Agent-Selector:null) Unable to initialize the threads. java.io.IOException: SSL: Fail to init SSL! java.io.IOException: Connection closed with -1 on reading size. at com.cloud.utils.nio.NioClient.init(NioClient.java:90) at com.cloud.utils.nio.NioConnection.run(NioConnection.java:113) at java.lang.Thread.run(Thread.java:745) 2015-05-26 09:14:34,204 INFO [utils.nio.NioClient] (Agent-Selector:null) Connecting to 10.32.0.16:8250 Message. The ssvm-check.sh script runs fine this time. I already destroyed the SSVM (and ACS created a new one), but it won't connect. What can I do? Thanks Martin -Ursprüngliche Nachricht- Von: Erik Weber [mailto:terbol...@gmail.com] Gesendet: Mittwoch, 20. Mai 2015 15:29 An: users@cloudstack.apache.org Betreff: Re: SSVM agent not starting On Wed, May 20, 2015 at 3:05 PM, Martin Emrich martin.emr...@empolis.com wrote: Hi! I built (obviously OSS) packages for el6 using the packages/centos63/package.sh script and installed them on my test management server instead of the NONOSS packages. Now it works. Is it possible to replace the NONOSS packages with OSS packages on a production server? Or are dangerous changes to the database necessary? Switching between NONOSS and OSS shouldn't tamper with the database AFAIK. Or the other way around: How can I build NONOSS packages for Ubuntu? https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack#HowtobuildCloudStack-BuildingDEBpackages -- Erik
CLoudStack 添加KVM后 系统虚拟机状态为空
各位好： 遇到一个问题，VMware上的一台VM上安装KVM及CloudStack Agent，将其添加 到CS4.3（简单网络）中去，系统虚拟机agent状态为空，console进去系统虚拟机，发 现它与来宾网络网关不通！！！这是什么原因？ 篇日志如下： KVM所在虚拟机网卡使用桥接模式： eth0配置如下： DEVICE=eth0 TYPE=Ethernet ONBOOT=yes HOTPLUG=no BOOTPROTO=none BRIDGE=cloudbr0 cloudbr0配置如下： DEVICE=cloudbr0 ONBOOT=yes BOOTPROTO=static IPADDR=10.4.41.101 NETMASK=255.255.254.0 GATEWAY=10.4.40.1 DNS1=210.83.210.155 IPV6INIT=no IPV6_AUTOCONF=no DELAY=5 STP=off TYPE=Bridge --- Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s) is intended only for the use of the intended recipient and may be confidential and/or privileged of Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying is strictly prohibited, and may be unlawful.If you have received this communication in error,please immediately notify the sender by return e-mail, and delete the original message and all copies from your system. Thank you. ---
Performance problem within SSVM
Hi Everybody, I'm expierencing some performance problems with SSVM. /usr/local/cloud/systemvm/ssvm-check.sh shows no problems When the agent is running, I see 100% of io-wait. secondary storage is mounted, but due to the io-wait, I can not access it When I stop the agent(/etc/init.d/cloud stop), I can easily access the nfs mount. I also tried to download images manually (curl), works good. the physical host hos not IO problems /etc/exports: /storage 10.0.40.0/24(rw,async,no_root_squash,no_subtree_check) Mount in the SSVM: 10.0.40.10:/storage/secondary on /mnt/SecStorage/0405ba30-38b9-349d-9ea4-15ea09d67e09 type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acdirmin=0,acdirmax=0,soft,proto=tcp,timeo=133,retrans=2147483647,sec=sys,mountaddr=10.0.40.10,mountvers=3,mountport=892,mountproto=tcp,local_lock=none,addr=10.0.40.10) Cloudtack: 4.4.3 on centos 7 Please advice what to check Vlad
Re: Performance problem within SSVM
Can it be network problem? What does your routing table say ? Vadim. From: Vladislav Nazarenko vladislav.nazare...@gmail.com Sent: Tuesday, May 26, 2015 20:55 To: users@cloudstack.apache.org Subject: Performance problem within SSVM Hi Everybody, I'm expierencing some performance problems with SSVM. /usr/local/cloud/systemvm/ssvm-check.sh shows no problems When the agent is running, I see 100% of io-wait. secondary storage is mounted, but due to the io-wait, I can not access it When I stop the agent(/etc/init.d/cloud stop), I can easily access the nfs mount. I also tried to download images manually (curl), works good. the physical host hos not IO problems /etc/exports: /storage 10.0.40.0/24(rw,async,no_root_squash,no_subtree_check) Mount in the SSVM: 10.0.40.10:/storage/secondary on /mnt/SecStorage/0405ba30-38b9-349d-9ea4-15ea09d67e09 type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acdirmin=0,acdirmax=0,soft,proto=tcp,timeo=133,retrans=2147483647,sec=sys,mountaddr=10.0.40.10,mountvers=3,mountport=892,mountproto=tcp,local_lock=none,addr=10.0.40.10) Cloudtack: 4.4.3 on centos 7 Please advice what to check Vlad
Re: Performance problem within SSVM
Hi Vadim, thanx for your response ... this is the only thing I can think about ... There is a dadicated storage network with a gateway configured the gateway is not in place (for now), but the both points (nfs server and nfs client) are in the same network and should access each other directly ... The default gateway is another one (present and works well) the IP Adress of the NFS Storage: 10.0.40.10 SSVM IP Address: 10.0.40.186 ip r default via B.B.28.1 dev eth2 (default) 10.0.40.0/24 dev eth3 proto kernel scope link src 10.0.40.186 (storage) X.X.X.176/28 dev eth1 proto kernel scope link src X.X.X.187 (management) 169.254.0.0/16 dev eth0 proto kernel scope link src 169.254.2.170 (local link) A.A.40.14 via X.X.X.177 dev eth1 (Route to the DNS Srever) B.B.28.0/24 dev eth2 proto kernel scope link src B.B.28.67 (Route to the physical host) Wenn I look at the parameters of the java process (agent), there is also the following: storagegateway=10.0.40.1 And this the, which GW ist not in place yet So you think it might be the problem? Kind regards Vlad On 26.05.2015 20:55, Vadim Kimlaychuk wrote: Can it be network problem? What does your routing table say ? Vadim. From: Vladislav Nazarenko vladislav.nazare...@gmail.com Sent: Tuesday, May 26, 2015 20:55 To: users@cloudstack.apache.org Subject: Performance problem within SSVM Hi Everybody, I'm expierencing some performance problems with SSVM. /usr/local/cloud/systemvm/ssvm-check.sh shows no problems When the agent is running, I see 100% of io-wait. secondary storage is mounted, but due to the io-wait, I can not access it When I stop the agent(/etc/init.d/cloud stop), I can easily access the nfs mount. I also tried to download images manually (curl), works good. the physical host hos not IO problems /etc/exports: /storage 10.0.40.0/24(rw,async,no_root_squash,no_subtree_check) Mount in the SSVM: 10.0.40.10:/storage/secondary on /mnt/SecStorage/0405ba30-38b9-349d-9ea4-15ea09d67e09 type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,acdirmin=0,acdirmax=0,soft,proto=tcp,timeo=133,retrans=2147483647,sec=sys,mountaddr=10.0.40.10,mountvers=3,mountport=892,mountproto=tcp,local_lock=none,addr=10.0.40.10) Cloudtack: 4.4.3 on centos 7 Please advice what to check Vlad
[Solved] Compatibility of CS 4.5.1 with XenServer 6.5 SP1
I have to admit that network created from the scratch works as expected. I could not reproduce the issue. Some VM-s has to be re-crated from the scratch as well to be able to work at VPC correctly. So I have resolved all the issues and will blame HA, cause after hosts update no VM-s were restarted. I used migration between hosts at runtime so update went without client VM shutdown. Vadim. -Original Message- From: Vadim Kimlaychuk [mailto:vadim.kimlayc...@elion.ee] Sent: Tuesday, May 26, 2015 11:30 AM To: users@cloudstack.apache.org Subject: RE: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 More tests shows that VR is totally broken. I have created new isolated network with SNAT and was not able to ping even VR public IP. VM was not pinging as well. From the other side VPC networks are working correctly. Can someone answer the question -- which way those VM-s are different? Vadim. -Original Message- From: Vadim Kimlaychuk [mailto:vadim.kimlayc...@elion.ee] Sent: Tuesday, May 26, 2015 9:48 AM To: users@cloudstack.apache.org Subject: RE: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 After upgrade we have a serious problem with VR for shared guest network. It seem everything is working OK, but after a while we got these errors on system console: Domain routerCommand: com.cloud.agent.api.Command failed while ...25 May 2015 16:58:08 Domain routerUnable to restart r-30-VM which was running on hos...availability zone: ZoneX: Pod 1 After VR restart everything goes back for a while (~ 3-4 min) and then problem comes back. VR is slow. Logging into VR from host for troubleshooting takes around 30 sec. All the VM-s in guest network are also slow because of the network. Network restart has failed. VR restart does not give anything. Inside VR even simple tasks like ps ax or top take seconds. Do you have any ideas why that can happen? Vadim. -Original Message- From: Jan-Arve Nygård [mailto:jan.arve.nyg...@gmail.com] Sent: Thursday, May 21, 2015 1:05 AM To: users@cloudstack.apache.org Subject: Re: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 We have tested upgrading to XS 6.5 SP1 with CloudStack 4.5.1 and we didn't run into any issues. We tested the following without any problems: Start of existing VM Deploy VM Destroy VM Attach ISO Detach ISO Snapshot of VM Live migration of VM to another host Storage migration to another SR Add NIC Remove NIC And probably some other stuff that i don't remember right now. -thinktwo 2015-05-20 21:17 GMT+02:00 Vadim Kimlaychuk vadim.kimlayc...@elion.ee: I am planning to do it within a couple of days. Will let you know Vadim. From: Jan-Arve Nygård jan.arve.nyg...@gmail.com Sent: Wednesday, May 20, 2015 15:38 To: users@cloudstack.apache.org Subject: Re: Compatibility of CS 4.5.1 with XenServer 6.5 SP1 I guess it wouldn't be a problem, but I'm also interested if someone has tested and verified this yet. 2015-05-19 14:57 GMT+02:00 Ian Service iserv...@ts2.ca: The release notes for CS 4.5.1 don't specifically list XenServer 6.5 SP1 compatibility, likely because they overlapped in release timelines. Are there any compatibility concerns between the two latest versions of each? Thanks, - Ian
RE: Increase Size VM C Partition Windows Server 2012
Shut down VM, increase it from Hypervisor (unless your hypervisor allows online size increase), update mysql table in CloudStack for that SR...it works :) -Original Message- From: David Amorín [mailto:david.amo...@adderglobal.com] Sent: Tuesday, May 26, 2015 11:57 AM To: users@cloudstack.apache.org Subject: Increase Size VM C Partition Windows Server 2012 Hi all, I have using CS 4.4.1 and we would like to extend in a VM with Windows Server 2012 the size of C drive If I attach a new volume the OS doesn't allow me to extend the size of the C partition with other disk What can I do? Thanks for your comments
Increase Size VM C Partition Windows Server 2012
Hi all, I have using CS 4.4.1 and we would like to extend in a VM with Windows Server 2012 the size of C drive If I attach a new volume the OS doesn't allow me to extend the size of the C partition with other disk What can I do? Thanks for your comments
