Re: Cloudstack and KVM clusters,
I would highly recommend looking at the Ceph storage instead of using too many tiers of complications. Ceph integrates well with kvm and cloudstack and has proven to work very well over the years. Andrei - Original Message - From: chiu ching cheng ccchiou...@gmail.com To: us...@cloudstack.apache.org Cc: dev@cloudstack.apache.org Sent: Wednesday, 1 April, 2015 2:31:42 AM Subject: Re: Cloudstack and KVM clusters, If I wnat to build a kvm native cluster with gfs2 + DLM , and use iscsi + DRBD in storage . Then add the kvm cluster to cloudstack , and add the SharedMountPoint to cloudstack as primary storage , Does it work ? On Wed, Apr 1, 2015 at 6:12 AM, Marcus shadow...@gmail.com wrote: Don't forget SharedMountPoint. This (in theory, haven't tried it recently) allows you to use any clustered filesystem that has a consistent mountpoint across all KVM hosts in a CS cluster, e.g. mount an OCFS2 to /vmstore1 then register /vmstore1 as a SharedMountPoint. The Ceph support is in the form of RBD, by the way. You could use CephFS if you wished via SharedMountPoint. On Tue, Mar 31, 2015 at 2:09 PM, Simon Weller swel...@ena.com wrote: The hosts need to be part of the same Cloudstack cluster, and depending on the underlying storage technology, you may need a clustered file system as well. A Cloudstack cluster is basically a group of physical hosts. For example: You build a new Zone in Cloudstack. Under the zone you have a pod. Within the pod, you build a new cluster (just a group of hosts). Then you assigned 4 servers (hosts) into that cluster. You will be able to live migrate between the 4 hosts assuming the original mentioned criteria are met. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 4:02 PM To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: Cloudstack and KVM clusters, Thanks Simon, I think I got it. So, the hosts do not need to be in a cluster to perform the live migration. On Tue, Mar 31, 2015 at 5:59 PM, Simon Weller swel...@ena.com wrote: Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner -- Rafael Weingärtner
Re: Cloudstack and KVM clusters,
Yes, Chiu. -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: chiu ching cheng ccchiou...@gmail.com To: us...@cloudstack.apache.org Cc: dev@cloudstack.apache.org Sent: Wednesday, 1 April, 2015 02:31:42 Subject: Re: Cloudstack and KVM clusters, If I wnat to build a kvm native cluster with gfs2 + DLM , and use iscsi + DRBD in storage . Then add the kvm cluster to cloudstack , and add the SharedMountPoint to cloudstack as primary storage , Does it work ? On Wed, Apr 1, 2015 at 6:12 AM, Marcus shadow...@gmail.com wrote: Don't forget SharedMountPoint. This (in theory, haven't tried it recently) allows you to use any clustered filesystem that has a consistent mountpoint across all KVM hosts in a CS cluster, e.g. mount an OCFS2 to /vmstore1 then register /vmstore1 as a SharedMountPoint. The Ceph support is in the form of RBD, by the way. You could use CephFS if you wished via SharedMountPoint. On Tue, Mar 31, 2015 at 2:09 PM, Simon Weller swel...@ena.com wrote: The hosts need to be part of the same Cloudstack cluster, and depending on the underlying storage technology, you may need a clustered file system as well. A Cloudstack cluster is basically a group of physical hosts. For example: You build a new Zone in Cloudstack. Under the zone you have a pod. Within the pod, you build a new cluster (just a group of hosts). Then you assigned 4 servers (hosts) into that cluster. You will be able to live migrate between the 4 hosts assuming the original mentioned criteria are met. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 4:02 PM To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: Cloudstack and KVM clusters, Thanks Simon, I think I got it. So, the hosts do not need to be in a cluster to perform the live migration. On Tue, Mar 31, 2015 at 5:59 PM, Simon Weller swel...@ena.com wrote: Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner -- Rafael Weingärtner
Re: Cloudstack and KVM clusters,
If I wnat to build a kvm native cluster with gfs2 + DLM , and use iscsi + DRBD in storage . Then add the kvm cluster to cloudstack , and add the SharedMountPoint to cloudstack as primary storage , Does it work ? On Wed, Apr 1, 2015 at 6:12 AM, Marcus shadow...@gmail.com wrote: Don't forget SharedMountPoint. This (in theory, haven't tried it recently) allows you to use any clustered filesystem that has a consistent mountpoint across all KVM hosts in a CS cluster, e.g. mount an OCFS2 to /vmstore1 then register /vmstore1 as a SharedMountPoint. The Ceph support is in the form of RBD, by the way. You could use CephFS if you wished via SharedMountPoint. On Tue, Mar 31, 2015 at 2:09 PM, Simon Weller swel...@ena.com wrote: The hosts need to be part of the same Cloudstack cluster, and depending on the underlying storage technology, you may need a clustered file system as well. A Cloudstack cluster is basically a group of physical hosts. For example: You build a new Zone in Cloudstack. Under the zone you have a pod. Within the pod, you build a new cluster (just a group of hosts). Then you assigned 4 servers (hosts) into that cluster. You will be able to live migrate between the 4 hosts assuming the original mentioned criteria are met. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 4:02 PM To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: Cloudstack and KVM clusters, Thanks Simon, I think I got it. So, the hosts do not need to be in a cluster to perform the live migration. On Tue, Mar 31, 2015 at 5:59 PM, Simon Weller swel...@ena.com wrote: Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner -- Rafael Weingärtner
Re: Cloudstack and KVM clusters,
The hosts need to be part of the same Cloudstack cluster, and depending on the underlying storage technology, you may need a clustered file system as well. A Cloudstack cluster is basically a group of physical hosts. For example: You build a new Zone in Cloudstack. Under the zone you have a pod. Within the pod, you build a new cluster (just a group of hosts). Then you assigned 4 servers (hosts) into that cluster. You will be able to live migrate between the 4 hosts assuming the original mentioned criteria are met. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 4:02 PM To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: Cloudstack and KVM clusters, Thanks Simon, I think I got it. So, the hosts do not need to be in a cluster to perform the live migration. On Tue, Mar 31, 2015 at 5:59 PM, Simon Weller swel...@ena.com wrote: Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner -- Rafael Weingärtner
Re: Cloudstack and KVM clusters,
Don't forget SharedMountPoint. This (in theory, haven't tried it recently) allows you to use any clustered filesystem that has a consistent mountpoint across all KVM hosts in a CS cluster, e.g. mount an OCFS2 to /vmstore1 then register /vmstore1 as a SharedMountPoint. The Ceph support is in the form of RBD, by the way. You could use CephFS if you wished via SharedMountPoint. On Tue, Mar 31, 2015 at 2:09 PM, Simon Weller swel...@ena.com wrote: The hosts need to be part of the same Cloudstack cluster, and depending on the underlying storage technology, you may need a clustered file system as well. A Cloudstack cluster is basically a group of physical hosts. For example: You build a new Zone in Cloudstack. Under the zone you have a pod. Within the pod, you build a new cluster (just a group of hosts). Then you assigned 4 servers (hosts) into that cluster. You will be able to live migrate between the 4 hosts assuming the original mentioned criteria are met. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 4:02 PM To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: Cloudstack and KVM clusters, Thanks Simon, I think I got it. So, the hosts do not need to be in a cluster to perform the live migration. On Tue, Mar 31, 2015 at 5:59 PM, Simon Weller swel...@ena.com wrote: Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner -- Rafael Weingärtner
Cloudstack and KVM clusters,
Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner
Re: Cloudstack and KVM clusters,
Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner
Re: Cloudstack and KVM clusters,
Thanks Simon, I think I got it. So, the hosts do not need to be in a cluster to perform the live migration. On Tue, Mar 31, 2015 at 5:59 PM, Simon Weller swel...@ena.com wrote: Rafael, KVM live migration really relies on whether the underlying shared storage (and file system) supports the ability to provide data consistency during a migration. You never ever want a situation where 2 hosts are able to mount and write to the same volume concurrently. You can live migrate in KVM today using the following underlying file systems/methods: 1. NFS 2. CEPH 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage via iSCSI,FC or FCOE. It's also possible to build your own storage driver and set a LUN to read only on a particular host using your SANs API. Solidfire, Nexenta and Cloudbyte have also added storage drivers more recently that may provide support for live migration, but as I'm not personally familiar with these storage platforms, I'll leave it up to others to comment if they wish. - Si From: Rafael Weingartner rafaelweingart...@gmail.com Sent: Tuesday, March 31, 2015 3:36 PM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Cloudstack and KVM clusters, Hi folks, I was looking a matrix of Cloudstack compatibility matrix at http://pt.slideshare.net/TimMackey/hypervisor-31754727, Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that true? Is it possible to live migrate VMs between KVM hosts that are not clustered in CS? -- Rafael Weingärtner -- Rafael Weingärtner