Re: NFS vs Swift
Hi Sebastian, Yes we are using the commercial version, we are also using XenServer 6.1 for the underlying hypervisor and there seems to be problems with NFS / CloudPlatform, not confirmed. Just trying to work out reasonable options to make life easier. We have no control over the storage as such as it is centrally provisioned by the Universities IT department with very little transparency. The actual storage is in a datacentre next door 3 x hops - but I'm finding it difficult to troubleshoot as it is all very inconsistent. Thanks for your input. Damien On 5/11/13 6:51 PM, Sebastien Goasguen run...@gmail.com wrote: On Nov 5, 2013, at 12:44 AM, Damien Mannix damien.man...@unimelb.edu.au wrote: HI All, We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons any tips would be most helpful. Thanks in advance Damien Damien, 3.07 is not an official apache cloudstack release, you might be referring to a cloudplatform commercial version ? I would recommend to upgrade to 4.1.1 or 4.2.0 In 4.2 there is much better support for S3 backed secondary storage including Ceph radoggw, RiakCS and glusterfs. Basically any S3 object store can be used. That said having issues with NFS seems strange, I would personally first try to solve the NFS issues send us some logs if you want. Damien Mannix Cloud Systems Administrator ITS Research Services 317 Doug McDonell Building, University of Melbourne email: damien.man...@unimelb.edu.au NSP Support please email: nsp-h...@nectar.org.au Mobile: +61 (0) 481 005 367
Re: NFS vs Swift
On Nov 5, 2013, at 9:08 AM, Damien Mannix damien.man...@unimelb.edu.au wrote: Hi Sebastian, Yes we are using the commercial version, we are also using XenServer 6.1 for the underlying hypervisor and there seems to be problems with NFS / CloudPlatform, not confirmed. Just trying to work out reasonable options to make life easier. We have no control over the storage as such as it is centrally provisioned by the Universities IT department with very little transparency. The actual storage is in a datacentre next door 3 x hops - but I'm finding it difficult to troubleshoot as it is all very inconsistent. Technically we don't support non apache releases, but maybe if you post your mgt server logs and your secondary storage VM logs to pastebin.com something easy will jump out for someone on the list. -sebastien Thanks for your input. Damien On 5/11/13 6:51 PM, Sebastien Goasguen run...@gmail.com wrote: On Nov 5, 2013, at 12:44 AM, Damien Mannix damien.man...@unimelb.edu.au wrote: HI All, We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons any tips would be most helpful. Thanks in advance Damien Damien, 3.07 is not an official apache cloudstack release, you might be referring to a cloudplatform commercial version ? I would recommend to upgrade to 4.1.1 or 4.2.0 In 4.2 there is much better support for S3 backed secondary storage including Ceph radoggw, RiakCS and glusterfs. Basically any S3 object store can be used. That said having issues with NFS seems strange, I would personally first try to solve the NFS issues send us some logs if you want. Damien Mannix Cloud Systems Administrator ITS Research Services 317 Doug McDonell Building, University of Melbourne email: damien.man...@unimelb.edu.au NSP Support please email: nsp-h...@nectar.org.au Mobile: +61 (0) 481 005 367
Re: NFS vs Swift
On 05.11.2013 05:44, Damien Mannix wrote: HI All, We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons – any tips would be most helpful. Thanks in advance The main problem I have with NFS is scalability, it will hold back the whole setup when it gets real big. Luckily there are workarounds without messing with swift or other s3 clones, one could use glusterfs' nfs interface + RR dns (we do this currently - though not for ACS - and it works well). I'd love to see native glusterfs support for secondary storage. My 2 strips of gold-pressed latinum -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: NFS vs Swift
Yes I have heard of glusterfs any tips, tricks - advice? On 5/11/13 8:03 PM, Nux! n...@li.nux.ro wrote: On 05.11.2013 05:44, Damien Mannix wrote: HI All, We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons any tips would be most helpful. Thanks in advance The main problem I have with NFS is scalability, it will hold back the whole setup when it gets real big. Luckily there are workarounds without messing with swift or other s3 clones, one could use glusterfs' nfs interface + RR dns (we do this currently - though not for ACS - and it works well). I'd love to see native glusterfs support for secondary storage. My 2 strips of gold-pressed latinum -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: NFS vs Swift
On 05.11.2013 09:06, Damien Mannix wrote: Yes I have heard of glusterfs any tips, tricks - advice? Well, this is hardly the place, you should get on their ml, this is my first advice. Use CentOS/RHEL 6 if you can, use XFS as filesystem with 512b inodes. If you want speed you need 10G or Infiniband, otherwise you'll have to put up with sub 50 MB/s speeds on a mere 1Gbps network. HTH Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: NFS vs Swift
On Nov 5, 2013, at 12:44 AM, Damien Mannix damien.man...@unimelb.edu.au wrote: HI All, We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons – any tips would be most helpful. Thanks in advance Damien Damien, 3.07 is not an official apache cloudstack release, you might be referring to a cloudplatform commercial version ? I would recommend to upgrade to 4.1.1 or 4.2.0 In 4.2 there is much better support for S3 backed secondary storage including Ceph radoggw, RiakCS and glusterfs. Basically any S3 object store can be used. That said having issues with NFS seems strange, I would personally first try to solve the NFS issues send us some logs if you want. Damien Mannix Cloud Systems Administrator ITS Research Services 317 Doug McDonell Building, University of Melbourne email: damien.man...@unimelb.edu.au NSP Support please email: nsp-h...@nectar.org.au Mobile: +61 (0) 481 005 367
