Re: [PVE-User] Ceph or Gluster

2016-04-22 Thread Lindsay Mathieson
Also, what sort of iowait percentages are you seeing? On 23/04/2016 7:50 AM, Brian :: wrote: Hi Lindsay, With NVME journals on a 3 node 4 OSD cluster if I do a quick dd of a 1GB file on a VM I can see 2.34Gbps on the storage network straight away so if I was only using 1Gbps here the network

Re: [PVE-User] Upgrade from pve-manager 4.1-22 to 4.1-33

2016-04-22 Thread Dietmar Maurer
> On April 22, 2016 at 5:01 PM maks wrote: > > > Thomas, > > Thank you I'll keep that in mind. Should I keep the main debian repo in > my sources.list? Sure - we all keep the debian main repository. > I had removed it in the past due to sometimes pulling >

Re: [PVE-User] Upgrade from pve-manager 4.1-22 to 4.1-33

2016-04-22 Thread maks
Thomas, Thank you I'll keep that in mind. Should I keep the main debian repo in my sources.list? I had removed it in the past due to sometimes pulling incompatible packages (like OVS). My sources.list # debian jessie main deb http://ftp.us.debian.org/debian jessie main contrib # proxmox

Re: [PVE-User] Ceph or Gluster

2016-04-22 Thread Lindsay Mathieson
On 22/04/2016 11:31 PM, Brian :: wrote: 10Gbps or faster at a minimum or you will have pain. Even using 4 nodes with 4 spinner disks in each node and you will be maxing out 1Gbps network. Can't say I saw that on our cluster. - 3 Nodes - 3 OSD's per Node - SSD journals for each OSD. - 2*1G

Re: [PVE-User] Ceph or Gluster

2016-04-22 Thread Brian ::
Hi Mohamed 10Gbps or faster at a minimum or you will have pain. Even using 4 nodes with 4 spinner disks in each node and you will be maxing out 1Gbps network. For any backfills or adding new OSDs you don't want to be waiting on 1Gbps ethernet speeds. Dedicated 10Gbps network for ceph

Re: [PVE-User] Ceph or Gluster

2016-04-22 Thread Mohamed Sadok Ben Jazia
Thank you Eneko, I read in proxmox forum that distributed storage needs 10GBit or faster on the local network and a dedicated network. Could you detail your used infrastructure to see if it matches those conditions? On 22 April 2016 at 12:06, Eneko Lacunza wrote: > Hi