Re: Convert from RAID 5 to 10

2016-12-06 Thread Florian Lindner
Thanks a lot to all who replied! I learned a lot from this thread. However, what I learned has made me even more doubtful that a btrfs RAID is the right choice for me at this moment. There seems to be much uncertainty about the real state (experimental, stable, production-ready, mature, ...) of

Re: Convert from RAID 5 to 10

2016-12-01 Thread Tomasz Kusmierz
FYI. There is an old saying in embedded circles that I revolve that evolved from Arthur C Clarke "Any sufficiently advanced technology is indistinguishable from magic." Engineering version states "Any sufficiently advanced incompetence is indistinguishable from malice" Also I'll quote you on

Re: Convert from RAID 5 to 10

2016-12-01 Thread Chris Murphy
On Wed, Nov 30, 2016 at 1:29 PM, Tomasz Kusmierz wrote: > Please, I beg you add another column to man and wiki stating clearly > how many devices every profile can withstand to loose. I frequently > have to explain how btrfs profiles work and show quotes from this >

Re: Convert from RAID 5 to 10

2016-12-01 Thread Niccolò Belli
On giovedì 1 dicembre 2016 10:37:13 CET, Wilson Meier wrote: The only thing i have asked for is to document the *known* problems/flaws/limitations of all raid profiles and link to them from the stability matrix. +1 Do someone mind if I ask for an account and I start copy-pasting any relevant

Re: Convert from RAID 5 to 10

2016-12-01 Thread Wilson Meier
Am 30/11/16 um 17:48 schrieb Austin S. Hemmelgarn: > On 2016-11-30 10:49, Wilson Meier wrote: >> Am 30/11/16 um 15:37 schrieb Austin S. Hemmelgarn: >> >> Transferring this to car analogy, just to make it a bit more funny: >> The airbag (raid level whatever) itself is ok but the micro controller >>

Re: Convert from RAID 5 to 10

2016-11-30 Thread Duncan
Austin S. Hemmelgarn posted on Wed, 30 Nov 2016 11:48:57 -0500 as excerpted: > On 2016-11-30 10:49, Wilson Meier wrote: >> Do you also have all home users in mind, which go to vacation (sometime >>> 3 weeks) and don't have a 24/7 support team to replace monitored disks >> which do report SMART

Re: Convert from RAID 5 to 10

2016-11-30 Thread Tomasz Kusmierz
On 30 November 2016 at 19:09, Chris Murphy wrote: > On Wed, Nov 30, 2016 at 7:37 AM, Austin S. Hemmelgarn > wrote: > >> The stability info could be improved, but _absolutely none_ of the things >> mentioned as issues with raid1 are specific to

Re: Convert from RAID 5 to 10

2016-11-30 Thread Martin Steigerwald
Am Mittwoch, 30. November 2016, 12:09:23 CET schrieb Chris Murphy: > On Wed, Nov 30, 2016 at 7:37 AM, Austin S. Hemmelgarn > > wrote: > > The stability info could be improved, but _absolutely none_ of the things > > mentioned as issues with raid1 are specific to raid1. And

Re: Convert from RAID 5 to 10

2016-11-30 Thread Chris Murphy
On Wed, Nov 30, 2016 at 7:37 AM, Austin S. Hemmelgarn wrote: > The stability info could be improved, but _absolutely none_ of the things > mentioned as issues with raid1 are specific to raid1. And in general, in > the context of a feature stability matrix, 'OK' generally

Re: Convert from RAID 5 to 10

2016-11-30 Thread Chris Murphy
On Wed, Nov 30, 2016 at 7:04 AM, Roman Mamedov wrote: > On Wed, 30 Nov 2016 07:50:17 -0500 > Also I don't know what is particularly insane about copying a 4-8 GB file onto > a storage array. I'd expect both disks to write at the same time (like they > do in pretty much any

Re: Convert from RAID 5 to 10

2016-11-30 Thread Austin S. Hemmelgarn
On 2016-11-30 10:49, Wilson Meier wrote: Am 30/11/16 um 15:37 schrieb Austin S. Hemmelgarn: On 2016-11-30 08:12, Wilson Meier wrote: Am 30/11/16 um 11:41 schrieb Duncan: Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: Am 30/11/16 um 09:06 schrieb Martin Steigerwald:

Re: Convert from RAID 5 to 10

2016-11-30 Thread Martin Steigerwald
Am Mittwoch, 30. November 2016, 16:49:59 CET schrieb Wilson Meier: > Am 30/11/16 um 15:37 schrieb Austin S. Hemmelgarn: > > On 2016-11-30 08:12, Wilson Meier wrote: > >> Am 30/11/16 um 11:41 schrieb Duncan: > >>> Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: > Am

Re: Convert from RAID 5 to 10

2016-11-30 Thread Niccolò Belli
I completely agree, the whole wiki status is simply *FRUSTRATING*. Niccolò Belli On mercoledì 30 novembre 2016 14:12:36 CET, Wilson Meier wrote: Am 30/11/16 um 11:41 schrieb Duncan: Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: ... Hi Duncan, i understand your

Re: Convert from RAID 5 to 10

2016-11-30 Thread Wilson Meier
Am 30/11/16 um 15:37 schrieb Austin S. Hemmelgarn: > On 2016-11-30 08:12, Wilson Meier wrote: >> Am 30/11/16 um 11:41 schrieb Duncan: >>> Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: >>> Am 30/11/16 um 09:06 schrieb Martin Steigerwald: > Am Mittwoch, 30. November

Re: Convert from RAID 5 to 10

2016-11-30 Thread Austin S. Hemmelgarn
On 2016-11-30 09:04, Roman Mamedov wrote: On Wed, 30 Nov 2016 07:50:17 -0500 "Austin S. Hemmelgarn" wrote: *) Read performance is not optimized: all metadata is always read from the first device unless it has failed, data reads are supposedly balanced between devices per

Re: Convert from RAID 5 to 10

2016-11-30 Thread Austin S. Hemmelgarn
On 2016-11-30 08:12, Wilson Meier wrote: Am 30/11/16 um 11:41 schrieb Duncan: Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: Am 30/11/16 um 09:06 schrieb Martin Steigerwald: Am Mittwoch, 30. November 2016, 10:38:08 CET schrieb Roman Mamedov: [snip] So the stability

Re: Convert from RAID 5 to 10

2016-11-30 Thread Roman Mamedov
On Wed, 30 Nov 2016 07:50:17 -0500 "Austin S. Hemmelgarn" wrote: > > *) Read performance is not optimized: all metadata is always read from the > > first device unless it has failed, data reads are supposedly balanced > > between > > devices per PID of the process reading.

Re: Convert from RAID 5 to 10

2016-11-30 Thread Wilson Meier
Am 30/11/16 um 11:41 schrieb Duncan: > Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: > >> Am 30/11/16 um 09:06 schrieb Martin Steigerwald: >>> Am Mittwoch, 30. November 2016, 10:38:08 CET schrieb Roman Mamedov: [snip] >>> So the stability matrix would need to be updated

Re: Convert from RAID 5 to 10

2016-11-30 Thread Austin S. Hemmelgarn
On 2016-11-30 00:38, Roman Mamedov wrote: On Wed, 30 Nov 2016 00:16:48 +0100 Wilson Meier wrote: That said, btrfs shouldn't be used for other then raid1 as every other raid level has serious problems or at least doesn't work as the expected raid level (in terms of

Re: Convert from RAID 5 to 10

2016-11-30 Thread Duncan
Wilson Meier posted on Wed, 30 Nov 2016 09:35:36 +0100 as excerpted: > Am 30/11/16 um 09:06 schrieb Martin Steigerwald: >> Am Mittwoch, 30. November 2016, 10:38:08 CET schrieb Roman Mamedov: >>> On Wed, 30 Nov 2016 00:16:48 +0100 >>> >>> Wilson Meier wrote: That

Re: Convert from RAID 5 to 10

2016-11-30 Thread Wilson Meier
Am 30/11/16 um 09:06 schrieb Martin Steigerwald: > Am Mittwoch, 30. November 2016, 10:38:08 CET schrieb Roman Mamedov: >> On Wed, 30 Nov 2016 00:16:48 +0100 >> >> Wilson Meier wrote: >>> That said, btrfs shouldn't be used for other then raid1 as every other >>> raid

Re: Convert from RAID 5 to 10

2016-11-30 Thread Martin Steigerwald
Am Mittwoch, 30. November 2016, 10:38:08 CET schrieb Roman Mamedov: > On Wed, 30 Nov 2016 00:16:48 +0100 > > Wilson Meier wrote: > > That said, btrfs shouldn't be used for other then raid1 as every other > > raid level has serious problems or at least doesn't work as the

Re: Convert from RAID 5 to 10

2016-11-29 Thread Roman Mamedov
On Wed, 30 Nov 2016 00:16:48 +0100 Wilson Meier wrote: > That said, btrfs shouldn't be used for other then raid1 as every other > raid level has serious problems or at least doesn't work as the expected > raid level (in terms of failure recovery). RAID1 shouldn't be used

Re: Convert from RAID 5 to 10

2016-11-29 Thread Wilson Meier
On 30.11.2016 00:49, Chris Murphy wrote: > On Tue, Nov 29, 2016 at 4:16 PM, Wilson Meier wrote: >> >> >> On 29.11.2016 23:52, Chris Murphy wrote: >>> On Tue, Nov 29, 2016 at 3:34 PM, Wilson Meier >>> wrote: On 29.11.2016 18:54, Austin S.

Re: Convert from RAID 5 to 10

2016-11-29 Thread Chris Murphy
On Tue, Nov 29, 2016 at 4:16 PM, Wilson Meier wrote: > > > On 29.11.2016 23:52, Chris Murphy wrote: >> On Tue, Nov 29, 2016 at 3:34 PM, Wilson Meier wrote: >>> On 29.11.2016 18:54, Austin S. Hemmelgarn wrote: On 2016-11-29 12:20, Florian

Re: Convert from RAID 5 to 10

2016-11-29 Thread Wilson Meier
On 29.11.2016 23:52, Chris Murphy wrote: > On Tue, Nov 29, 2016 at 3:34 PM, Wilson Meier wrote: >> On 29.11.2016 18:54, Austin S. Hemmelgarn wrote: >>> On 2016-11-29 12:20, Florian Lindner wrote: Hello, I have 4 harddisks with 3TB capacity each. They are

Re: Convert from RAID 5 to 10

2016-11-29 Thread Chris Murphy
On Tue, Nov 29, 2016 at 3:34 PM, Wilson Meier wrote: > On 29.11.2016 18:54, Austin S. Hemmelgarn wrote: >> On 2016-11-29 12:20, Florian Lindner wrote: >>> Hello, >>> >>> I have 4 harddisks with 3TB capacity each. They are all used in a >>> btrfs RAID 5. It has come to my

Re: Convert from RAID 5 to 10

2016-11-29 Thread Wilson Meier
On 29.11.2016 18:54, Austin S. Hemmelgarn wrote: > On 2016-11-29 12:20, Florian Lindner wrote: >> Hello, >> >> I have 4 harddisks with 3TB capacity each. They are all used in a >> btrfs RAID 5. It has come to my attention, that there >> seem to be major flaws in btrfs' raid 5 implementation.

Re: Convert from RAID 5 to 10

2016-11-29 Thread Austin S. Hemmelgarn
On 2016-11-29 14:03, Lionel Bouton wrote: Hi, Le 29/11/2016 à 18:20, Florian Lindner a écrit : [...] * Any other advice? ;-) Don't rely on RAID too much... The degraded mode is unstable even for RAID10: you can corrupt data simply by writing to a degraded RAID10. I could reliably reproduce

Re: Convert from RAID 5 to 10

2016-11-29 Thread Lionel Bouton
Hi, Le 29/11/2016 à 18:20, Florian Lindner a écrit : > [...] > > * Any other advice? ;-) Don't rely on RAID too much... The degraded mode is unstable even for RAID10: you can corrupt data simply by writing to a degraded RAID10. I could reliably reproduce this on a 6 devices RAID10 BTRFS

Re: Convert from RAID 5 to 10

2016-11-29 Thread Austin S. Hemmelgarn
On 2016-11-29 12:20, Florian Lindner wrote: Hello, I have 4 harddisks with 3TB capacity each. They are all used in a btrfs RAID 5. It has come to my attention, that there seem to be major flaws in btrfs' raid 5 implementation. Because of that, I want to convert the the raid 5 to a raid 10 and

Convert from RAID 5 to 10

2016-11-29 Thread Florian Lindner
Hello, I have 4 harddisks with 3TB capacity each. They are all used in a btrfs RAID 5. It has come to my attention, that there seem to be major flaws in btrfs' raid 5 implementation. Because of that, I want to convert the the raid 5 to a raid 10 and I have several questions. * Is that possible