Hello List,
I'm going to build a build a rbd cluster this year, with 5 nodes
I would like to have this kind of configuration for each node:
- 2U
- 2,5inch drives
os : 2 disk sas drive
journal : 2 x ssd intel dc s3700 100GB
osd : 10 or 12 x sas Seagate Savvio 10K.6 900GB
I see on the
Hi Alexandre,
Are you going with a 10Gb network? It’s not an issue for IOPS but more for the
bandwidth. If so read the following:
I personally won’t go with a ratio of 1:6 for the journal. I guess 1:5 (or even
1:4) is preferable.
SAS 10K gives you around 140MB/sec for sequential writes.
So if
Hi Sebastian,
Am 15.01.2014 13:55, schrieb Sebastien Han:
Hi Alexandre,
Are you going with a 10Gb network? It’s not an issue for IOPS but more for the
bandwidth. If so read the following:
I personally won’t go with a ratio of 1:6 for the journal. I guess 1:5 (or even
1:4) is preferable.
SAS
aderum...@odiso.com
Cc: ceph-users ceph-users@lists.ceph.com
Envoyé: Mercredi 15 Janvier 2014 13:55:39
Objet: Re: [ceph-users] servers advise (dell r515 or supermicro )
Hi Alexandre,
Are you going with a 10Gb network? It’s not an issue for IOPS but more for the
bandwidth. If so read
Le 15/01/2014 14:15, Stefan Priebe a écrit :
THe DC S3700 isn't good as squential but the 520 or 525 series has the
problem that it doesn't have a capicator. We've used Intel SSDs since
the 160 series but for ceph we now go for Crucial m500 (has capicitor).
Curcial m500 has capacitor, could
I would like to have this kind of configuration for each node:
- 2U
- 2,5inch drives
os : 2 disk sas drive
journal : 2 x ssd intel dc s3700 100GB
osd : 10 or 12 x sas Seagate Savvio 10K.6 900GB
Another option could be to use supermicro server,
they have some 2U - 16 disks chassis + one
Am 15.01.2014 14:33, schrieb Cedric Lemarchand:
Le 15/01/2014 14:15, Stefan Priebe a écrit :
THe DC S3700 isn't good as squential but the 520 or 525 series has the
problem that it doesn't have a capicator. We've used Intel SSDs since
the 160 series but for ceph we now go for Crucial m500 (has
15 Janvier 2014 14:52:18
Objet: Re: [ceph-users] servers advise (dell r515 or supermicro )
Am 15.01.2014 14:33, schrieb Cedric Lemarchand:
Le 15/01/2014 14:15, Stefan Priebe a écrit :
THe DC S3700 isn't good as squential but the 520 or 525 series has the
problem that it doesn't
Power-Loss Protection: In the rare event that power fails while the
drive is operating, power-loss protection helps ensure that data isn’t
corrupted.
Seems that not all power protected SSDs are created equal:
http://lkcl.net/reports/ssd_analysis.html
The m500 is not tested but the m4 is.
Up
] servers advise (dell r515 or supermicro )
I would like to have this kind of configuration for each node:
- 2U
- 2,5inch drives
os : 2 disk sas drive
journal : 2 x ssd intel dc s3700 100GB
osd : 10 or 12 x sas Seagate Savvio 10K.6 900GB
Another option could be to use supermicro
Am 15.01.2014 15:03, schrieb Robert van Leeuwen:
Power-Loss Protection: In the rare event that power fails while the
drive is operating, power-loss protection helps ensure that data isn’t
corrupted.
Seems that not all power protected SSDs are created equal:
It's also good to note that the m500 has built in RAIN protection
(basically, diagonal parity at the nand level). Should be very good for
journal consistency.
Sent from my mobile device. Please excuse brevity and typographical errors.
On Jan 15, 2014 9:07 AM, Stefan Priebe
On 01/15/2014 08:03 AM, Robert van Leeuwen wrote:
Power-Loss Protection: In the rare event that power fails while the
drive is operating, power-loss protection helps ensure that data isn’t
corrupted.
Seems that not all power protected SSDs are created equal:
Hum the Crucial m500 is pretty slow. The biggest one doesn’t even reach 300MB/s.
Intel DC S3700 100G showed around 200MB/sec for us.
Actually, I don’t know the price difference between the crucial and the intel
but the intel looks more suitable for me. Especially after Mark’s comment.
Am 15.01.2014 15:34, schrieb Sebastien Han:
Hum the Crucial m500 is pretty slow. The biggest one doesn’t even reach 300MB/s.
Intel DC S3700 100G showed around 200MB/sec for us.
where did you get this values from? I've some 960GB and they all have
450Mb/s write speed. Also in tests like here
I use H700 on Dell R815, 4 nodes. No problem performance.
Configuration:
1 SSD Intel 530 - OS and Journal.
5 OSD HDD 600G: certified DELL - WD/HITACHI/SEAGATE.
Size replication=2. Iops ~ 4k no VM.
15 янв. 2014 г. 15:47 пользователь Alexandre DERUMIER aderum...@odiso.com
написал:
Hello List,
Am 15.01.2014 15:44, schrieb Mark Nelson:
On 01/15/2014 08:39 AM, Stefan Priebe wrote:
Am 15.01.2014 15:34, schrieb Sebastien Han:
Hum the Crucial m500 is pretty slow. The biggest one doesn’t even
reach 300MB/s.
Intel DC S3700 100G showed around 200MB/sec for us.
where did you get this
On 01/15/2014 08:39 AM, Stefan Priebe wrote:
Am 15.01.2014 15:34, schrieb Sebastien Han:
Hum the Crucial m500 is pretty slow. The biggest one doesn’t even
reach 300MB/s.
Intel DC S3700 100G showed around 200MB/sec for us.
where did you get this values from? I've some 960GB and they all have
Sorry I was only looking at the 4K aligned results.
Sébastien Han
Cloud Engineer
Always give 100%. Unless you're giving blood.”
Phone: +33 (0)1 49 70 99 72
Mail: sebastien@enovance.com
Address : 10, rue de la Victoire - 75009 Paris
Web : www.enovance.com - Twitter : @enovance
Kernel Patch for Intel S3700, Intel 530...
diff --git a/drivers/scsi/sd.c b/drivers//scsi/sd.c
--- a/drivers/scsi/sd.c 2013-09-14 12:53:21.0 +0400
+++ b/drivers//scsi/sd.c2013-12-19 21:43:29.0 +0400
@@ -137,6 +137,7 @@
char *buffer_data;
struct
The S3700 does not need stuff like this. It internally ignores flushes.
Also there is an upstream one:
https://git.kernel.org/cgit/linux/kernel/git/stable/linux-stable.git/commit/?id=39c60a0948cc06139e2fbfe084f83cb7e7deae3b
Stefan
Am 15.01.2014 15:47, schrieb Ирек Фасихов:
Kernel Patch for
Am 15.01.2014 15:50, schrieb Sebastien Han:
However you have to get 480GB which ridiculously large for a journal. I
believe they are pretty expensive too.
that's correct it just them instead of SATA or SAS disks in ceph ;-) so
960GB makes sense.
Sébastien Han
Cloud Engineer
actually, they're very inexpensive as far as SSD's go. The 960gb m500 can
be had on Amazon for $499 US on prime (as of yesterday anyway).
Sent from my mobile device. Please excuse brevity and typographical errors.
On Jan 15, 2014 9:50 AM, Sebastien Han sebastien@enovance.com wrote:
On 01/15/2014 08:50 AM, Sebastien Han wrote:
However you have to get 480GB which ridiculously large for a journal. I
believe they are pretty expensive too.
Looks like the M500 in 480GB capacity is around $300 on amazon right now
VS about $300 for a 200GB DC S3700. The M500 has more
However you have to get 480GB which ridiculously large for a journal. I
believe they are pretty expensive too.
Sébastien Han
Cloud Engineer
Always give 100%. Unless you're giving blood.”
Phone: +33 (0)1 49 70 99 72
Mail: sebastien@enovance.com
Address : 10, rue de la Victoire -
do you use ?
For the system disk, do you use some kind of internal flash memory disk ?
- Mail original -
De: Mark Nelson mark.nel...@inktank.com
À: ceph-users@lists.ceph.com
Envoyé: Mercredi 15 Janvier 2014 15:40:12
Objet: Re: [ceph-users] servers advise (dell r515 or supermicro
to see how well these do!
Mark
- Mail original -
De: Mark Nelson mark.nel...@inktank.com
À: ceph-users@lists.ceph.com
Envoyé: Mercredi 15 Janvier 2014 15:40:12
Objet: Re: [ceph-users] servers advise (dell r515 or supermicro )
On 01/15/2014 08:04 AM, Alexandre DERUMIER wrote:
We
: Mark Nelson mark.nel...@inktank.com
À: ceph-users@lists.ceph.com
Envoyé: Mercredi 15 Janvier 2014 15:40:12
Objet: Re: [ceph-users] servers advise (dell r515 or supermicro )
On 01/15/2014 08:04 AM, Alexandre DERUMIER wrote:
We are using Supermicro 2uTwin nodes.
These have 2 nodes in 2u
À: ceph-users@lists.ceph.com
Envoyé: Mercredi 15 Janvier 2014 15:40:12
Objet: Re: [ceph-users] servers advise (dell r515 or supermicro )
On 01/15/2014 08:04 AM, Alexandre DERUMIER wrote:
We are using Supermicro 2uTwin nodes.
These have 2 nodes in 2u with each 12 disks.
We use X9DRT-HF
Le 15/01/2014 16:25, Mark Nelson a écrit :
On 01/15/2014 09:22 AM, Cedric Lemarchand wrote:
Hello guys,
What about arm hardware ? did someone already use some like Viridis ?
http://www.boston.co.uk/solutions/viridis/viridis-4u.aspx
Afaik, the boston solution was based on Calxeda gear...
On 01/15/2014 09:35 AM, Cedric Lemarchand wrote:
Le 15/01/2014 16:25, Mark Nelson a écrit :
On 01/15/2014 09:22 AM, Cedric Lemarchand wrote:
Hello guys,
What about arm hardware ? did someone already use some like Viridis ?
http://www.boston.co.uk/solutions/viridis/viridis-4u.aspx
Afaik,
On 1/15/2014 9:16 AM, Mark Nelson wrote:
On 01/15/2014 09:14 AM, Alexandre DERUMIER wrote:
For the system disk, do you use some kind of internal flash memory disk ?
We probably should have, but ended up with I think just a 500GB 7200rpm
disk, whatever was cheapest. :)
If your system has
32 matches
Mail list logo
