Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Brian Candler
On Wed, Jun 27, 2012 at 05:28:43PM -0500, Nathan Stratton wrote: [root@virt01 ~]# dd if=/dev/zero of=foo bs=1M count=5k 5120+0 records in 5120+0 records out 5368709120 bytes (5.4 GB) copied, 26.8408 s, 200 MB/s But doing a dd if=/dev/zero bs=1024k within a VM, whose image was mounted on

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Fernando Frediani (Qube)
- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Nicolas Sebrecht Sent: 28 June 2012 10:31 To: Thomas Jackson Cc: 'gluster-users' Subject: [Gluster-users] Re: about HA infrastructure for hypervisors The 28/06/12, Thomas Jackson wrote: Why don't

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Fernando Frediani (Qube)
-users] about HA infrastructure for hypervisors On Thu, Jun 28, 2012 at 11:25:20AM +0200, Nicolas Sebrecht wrote: We excluded ethernet due to searches on the web. It appeared that ethernet has bad latency. I read it on the web, it must be true :-) As I said: don't use 10GE over CAT6/RJ45

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Tim Bell
-boun...@gluster.org [mailto:gluster-users- boun...@gluster.org] On Behalf Of Fernando Frediani (Qube) Sent: 28 June 2012 11:43 To: 'Nicolas Sebrecht'; 'Thomas Jackson' Cc: 'gluster-users' Subject: Re: [Gluster-users] about HA infrastructure for hypervisors You should indeed to use the same

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread David Coulson
' Subject: Re: [Gluster-users] about HA infrastructure for hypervisors You should indeed to use the same server running as a storage brick as a KVM host to maximize hardware and power usage. Only thing I am not sure is if you can limit the amount of host memory Gluster can eat so most of it gets

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Nathan Stratton
On Thu, 28 Jun 2012, Brian Candler wrote: On Wed, Jun 27, 2012 at 05:28:43PM -0500, Nathan Stratton wrote: [root@virt01 ~]# dd if=/dev/zero of=foo bs=1M count=5k 5120+0 records in 5120+0 records out 5368709120 bytes (5.4 GB) copied, 26.8408 s, 200 MB/s But doing a dd if=/dev/zero bs=1024k

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Nathan Stratton
On Thu, 28 Jun 2012, Brian Candler wrote: On Thu, Jun 28, 2012 at 11:25:20AM +0200, Nicolas Sebrecht wrote: We excluded ethernet due to searches on the web. It appeared that ethernet has bad latency. I read it on the web, it must be true :-) As I said: don't use 10GE over CAT6/RJ45

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Nathan Stratton
On Thu, 28 Jun 2012, Brian Candler wrote: As I said: don't use 10GE over CAT6/RJ45 (10Gbase-T). That does indeed have poor latency. As I understand it: in order to get such high data rates over copper, it has to employ mechanisms similar to DSL lines, like interleaving, which means 10G has

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-28 Thread Brian Candler
On Thu, Jun 28, 2012 at 10:40:43AM -0500, Nathan Stratton wrote: But wait, yes, I have 16 physical disks, but I am running distribute + replicate so the 8 physical boxes are broken up into 4 pairs of redundant boxes. When I do a write, I am writing on two servers, or 4 physical disks. So in my

[Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Nicolas Sebrecht
Hi, We are going to try glusterfs for our new HA servers. To get full HA, I'm thinking of building it this way: ++ ++ || || | KVM hypervisor |-++---| KVM hypervisor | |

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Gerald Brandt
- Original Message - From: Nicolas Sebrecht nsebre...@piing.fr To: gluster-users gluster-users@gluster.org Sent: Wednesday, June 27, 2012 3:06:30 AM Subject: [Gluster-users] about HA infrastructure for hypervisors Hi, We are going to try glusterfs for our new HA servers

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Dan Cyr
] On Behalf Of Nicolas Sebrecht Sent: Wednesday, June 27, 2012 4:13 AM To: Gerald Brandt Cc: gluster-users Subject: [Gluster-users] Re: about HA infrastructure for hypervisors The 27/06/12, Gerald Brandt wrote: Hi, If your switch breaks, you are done. Put each Gluster server on it's own

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Brian Candler
On Wed, Jun 27, 2012 at 10:06:30AM +0200, Nicolas Sebrecht wrote: We are going to try glusterfs for our new HA servers. To get full HA, I'm thinking of building it this way: ++ ++ || ||

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Brian Candler
On Wed, Jun 27, 2012 at 03:07:21PM -0500, Nathan Stratton wrote: I've made a test setup like this, but unfortunately I haven't yet been able to get half-decent performance out of glusterfs 3.3 as a KVM backend. It may work better if you use local disk for the VM images, and within the VM

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Nathan Stratton
On Wed, 27 Jun 2012, Brian Candler wrote: For a 16-disk array, your IOPS is not bad. But are you actually storing a VM image on it, and then doing lots of I/O within that VM (as opposed to mounting the volume form within the VM)? If so, can you specify your exact configuration, including OS

Re: [Gluster-users] about HA infrastructure for hypervisors

2012-06-27 Thread Thomas Jackson
, Thomas -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Nicolas Sebrecht Sent: Wednesday, 27 June 2012 9:13 PM To: Gerald Brandt Cc: gluster-users Subject: [Gluster-users] Re: about HA infrastructure for hypervisors The 27