Re: [ceph-users] SSD MTBF

2014-11-03 Thread Emmanuel Lacour
On Mon, Sep 29, 2014 at 10:31:03AM +0200, Emmanuel Lacour wrote: > > Dear ceph users, > > > we are managing ceph clusters since 1 year now. Our setup is typically > made of Supermicro servers with OSD sata drives and journal on SSD. > > Those SSD are all failing one after the other after one ye

Re: [ceph-users] SSD MTBF

2014-10-07 Thread Emmanuel Lacour
On Tue, Oct 07, 2014 at 05:24:40PM +0200, Martin B Nielsen wrote: > >I don't disagree with the above - but the table assumes you'll wear out >your SSD. Adjust the wear level and the price will change proportionally - >if you're only writing 50-100TB/year pr ssd then the value will heav

Re: [ceph-users] SSD MTBF

2014-10-07 Thread Martin B Nielsen
A bit late getting back on this one. On Wed, Oct 1, 2014 at 5:05 PM, Christian Balzer wrote: > > smartctl states something like > > Wear = 092%, Hours = 12883, Datawritten = 15321.83 TB avg on those. I > > think that is ~30TB/day if I'm doing the calc right. > > > Something very much does not ad

Re: [ceph-users] SSD MTBF

2014-10-02 Thread Emmanuel Lacour
Le 02/10/2014 17:50, Massimiliano Cuttini a écrit : > I don't think this is true. > > If you have a SSD disk of 60Gb or 100GB then your TBW/day is really > limited (the disk is small then will wrote always on same sectors). > The bigger is the SSD the longer will be alive, you have limited write >

Re: [ceph-users] SSD MTBF

2014-10-02 Thread Emmanuel Lacour
Le 02/10/2014 17:58, Adam Boyhan a écrit : > What about the Intel DC S3500 instead of the DC S3700? > A matter of x10 for TBW supported between the two. See the small analysis I made previously in this thread regarding the cost per TBW. -- Easter-eggs Spécialist

Re: [ceph-users] SSD MTBF

2014-10-02 Thread Adam Boyhan
What about the Intel DC S3500 instead of the DC S3700? - Original Message - From: "Emmanuel Lacour" To: ceph-users@lists.ceph.com Sent: Thursday, October 2, 2014 11:48:26 AM Subject: Re: [ceph-users] SSD MTBF Le 02/10/2014 17:14, Ron Allred a écrit : > One thing

Re: [ceph-users] SSD MTBF

2014-10-02 Thread Massimiliano Cuttini
I don't think this is true. If you have a SSD disk of 60Gb or 100GB then your TBW/day is really limited (the disk is small then will wrote always on same sectors). The bigger is the SSD the longer will be alive, you have limited write per day then if your disk is bigger you have more sectors to

Re: [ceph-users] SSD MTBF

2014-10-02 Thread Emmanuel Lacour
Le 02/10/2014 17:14, Ron Allred a écrit : > One thing being missed, > > Samsung 850 Pro has only been available for about 1-2 months. > > The OP, noted that drives are failing after approx 1 year. This would > probably mean the SSDs are actually Samsung 840 Pro. The > write-durabilities of 850

Re: [ceph-users] SSD MTBF

2014-10-02 Thread Ron Allred
One thing being missed, Samsung 850 Pro has only been available for about 1-2 months. The OP, noted that drives are failing after approx 1 year. This would probably mean the SSDs are actually Samsung 840 Pro. The write-durabilities of 850 and 840 are quite different. That being said, Sams

Re: [ceph-users] SSD MTBF

2014-10-01 Thread Christian Balzer
Hello, On Wed, 1 Oct 2014 13:31:38 +0200 Martin B Nielsen wrote: > Hi, > > We settled on Samsung pro 840 240GB drives 1½ year ago and we've been > happy so far. We've over-provisioned them a lot (left 120GB > unpartitioned). > > We have 16x 240GB and 32x 500GB - we've lost 1x 500GB so far. >

Re: [ceph-users] SSD MTBF

2014-10-01 Thread Emmanuel Lacour
On Wed, Oct 01, 2014 at 01:31:38PM +0200, Martin B Nielsen wrote: >Hi, > >We settled on Samsung pro 840 240GB drives 1½ year ago and we've been >happy so far. We've over-provisioned them a lot (left 120GB >unpartitioned). > >We have 16x 240GB and 32x 500GB - we've lost 1x 500G

Re: [ceph-users] SSD MTBF

2014-10-01 Thread Martin B Nielsen
Hi, We settled on Samsung pro 840 240GB drives 1½ year ago and we've been happy so far. We've over-provisioned them a lot (left 120GB unpartitioned). We have 16x 240GB and 32x 500GB - we've lost 1x 500GB so far. smartctl states something like Wear = 092%, Hours = 12883, Datawritten = 15321.83 TB

Re: [ceph-users] SSD MTBF

2014-10-01 Thread Christian Balzer
On Wed, 1 Oct 2014 09:28:12 +0200 Kasper Dieter wrote: > On Tue, Sep 30, 2014 at 04:38:41PM +0200, Mark Nelson wrote: > > On 09/29/2014 03:58 AM, Dan Van Der Ster wrote: > > > Hi Emmanuel, > > > This is interesting, because we?ve had sales guys telling us that > > > those Samsung drives are defini

Re: [ceph-users] SSD MTBF

2014-10-01 Thread Kasper Dieter
On Tue, Sep 30, 2014 at 04:38:41PM +0200, Mark Nelson wrote: > On 09/29/2014 03:58 AM, Dan Van Der Ster wrote: > > Hi Emmanuel, > > This is interesting, because we?ve had sales guys telling us that those > > Samsung drives are definitely the best for a Ceph journal O_o ! > > Our sales guys or Sam

Re: [ceph-users] SSD MTBF

2014-10-01 Thread Dan Van Der Ster
> On 30 Sep 2014, at 16:38, Mark Nelson wrote: > > On 09/29/2014 03:58 AM, Dan Van Der Ster wrote: >> Hi Emmanuel, >> This is interesting, because we’ve had sales guys telling us that those >> Samsung drives are definitely the best for a Ceph journal O_o ! > > Our sales guys or Samsung sales gu

Re: [ceph-users] SSD MTBF

2014-09-30 Thread Mark Nelson
On 09/29/2014 03:58 AM, Dan Van Der Ster wrote: Hi Emmanuel, This is interesting, because we’ve had sales guys telling us that those Samsung drives are definitely the best for a Ceph journal O_o ! Our sales guys or Samsung sales guys? :) If it was ours, let me know. The conventional wisdom

Re: [ceph-users] SSD MTBF

2014-09-30 Thread Christian Balzer
On Tue, 30 Sep 2014 15:26:31 +0100 Kingsley Tart wrote: > On Tue, 2014-09-30 at 00:30 +0900, Christian Balzer wrote: > > On Mon, 29 Sep 2014 11:15:21 +0200 Emmanuel Lacour wrote: > > > > > On Mon, Sep 29, 2014 at 05:57:12PM +0900, Christian Balzer wrote: > > > > > > > > Given your SSDs, are they

Re: [ceph-users] SSD MTBF

2014-09-30 Thread Kingsley Tart
On Tue, 2014-09-30 at 00:30 +0900, Christian Balzer wrote: > On Mon, 29 Sep 2014 11:15:21 +0200 Emmanuel Lacour wrote: > > > On Mon, Sep 29, 2014 at 05:57:12PM +0900, Christian Balzer wrote: > > > > > > Given your SSDs, are they failing after more than 150TB have been > > > written? > > > > betw

Re: [ceph-users] SSD MTBF

2014-09-29 Thread Christian Balzer
On Mon, 29 Sep 2014 11:15:21 +0200 Emmanuel Lacour wrote: > On Mon, Sep 29, 2014 at 05:57:12PM +0900, Christian Balzer wrote: > > > > Given your SSDs, are they failing after more than 150TB have been > > written? > > between 30 and 40 TB ... > That's low. One wonders what is going on here, Sams

Re: [ceph-users] SSD MTBF

2014-09-29 Thread Emmanuel Lacour
On Mon, Sep 29, 2014 at 08:58:38AM +, Dan Van Der Ster wrote: > Hi Emmanuel, > This is interesting, because we’ve had sales guys telling us that those > Samsung drives are definitely the best for a Ceph journal O_o ! > The conventional wisdom has been to use the Intel DC S3700 because of its

Re: [ceph-users] SSD MTBF

2014-09-29 Thread Emmanuel Lacour
On Mon, Sep 29, 2014 at 05:57:12PM +0900, Christian Balzer wrote: > > Given your SSDs, are they failing after more than 150TB have been written? between 30 and 40 TB ... > > > Thought, statistics gives 60GB (option 2) to 100 GB (option 1) writes > > per day on SSD on a not really over loaded cl

Re: [ceph-users] SSD MTBF

2014-09-29 Thread Dan Van Der Ster
Hi Emmanuel, This is interesting, because we’ve had sales guys telling us that those Samsung drives are definitely the best for a Ceph journal O_o ! The conventional wisdom has been to use the Intel DC S3700 because of its massive durability. Anyway, I’m curious what do the SMART counters say o

Re: [ceph-users] SSD MTBF

2014-09-29 Thread Christian Balzer
Hello, On Mon, 29 Sep 2014 10:31:03 +0200 Emmanuel Lacour wrote: > > Dear ceph users, > > > we are managing ceph clusters since 1 year now. Our setup is typically > made of Supermicro servers with OSD sata drives and journal on SSD. > > Those SSD are all failing one after the other after one

[ceph-users] SSD MTBF

2014-09-29 Thread Emmanuel Lacour
Dear ceph users, we are managing ceph clusters since 1 year now. Our setup is typically made of Supermicro servers with OSD sata drives and journal on SSD. Those SSD are all failing one after the other after one year :( We used Samsung 850 pro (120Go) with two setup (small nodes with 2 ssd, 2