[Openstack-operators] Shared storage for live-migration with NFS, Ceph and Lustre

2015-06-17 Thread Miguel A Diaz Corchero
Hi friends. I'm evaluating different DFS to increase our infrastructure from 10 nodes to 40 nodes approximately. One of the bottleneck is the shared storage installed to enable the live-migration. Well, the selected candidate are NFS, Ceph or Lustre (which is already installed for HPC purpose)

Re: [Openstack-operators] Shared storage for live-migration with NFS, Ceph and Lustre

2015-06-20 Thread Dmitry Borodaenko
With Ceph, you'll want to use RBD instead of CephFS, we had OpenStack live migration working with Ceph RBD for about a year and a half now, here's a PDF slide deck with some details: https://drive.google.com/open?id=0BxYswyvIiAEZUEp4aWJPYVNjeU0 If you take CephFS and the bottlenecks associated wit

Re: [Openstack-operators] Shared storage for live-migration with NFS, Ceph and Lustre

2015-06-23 Thread Miguel A Diaz Corchero
Hi Dmitry After reading CephRDB the impressions were extremely good and even better than CephFS to ephemeral storage. Are you using qcow2 or raw type? I prefer qcow2, but in this case we cannot enable the writing cache in the cluster reducing a bit the performance. I should test the CephRDB p

Re: [Openstack-operators] Shared storage for live-migration with NFS, Ceph and Lustre

2015-06-24 Thread Andrew Woodward
Miguel, For RBD in Openstack, you will want to use raw images (even convert them while loading them into glance). The reason being is this enables the copy on write functions in RBD that allows for the image to be 'cloned' quickly. Not using raw will only impact storage sizes in glance since the c

Re: [Openstack-operators] Shared storage for live-migration with NFS, Ceph and Lustre

2015-06-25 Thread Miguel A Diaz Corchero
Great Andrew, thanks for the helpful clarification. The copy-on-write cloning is a crucial point for the "instant" boot of instances. Raw +1 with RBD. Miguel. El 24/06/15 21:19, Andrew Woodward escribió: Miguel, For RBD in Openstack, you will want to use raw images (even convert them while