Re: What if TRIM issued a wipe on devices that don't TRIM?

2018-12-06 Thread ronnie sahlberg
an be used and which does providde an overwrite/wipe guarantee. Maybe ATA has something equivalent to WRITESAME10/16. I just want to say: be careful, sometimes these commands do not provide a guarantee that they will actually make the data overwritten/unretrievable. ronnie sahlberg On Thu, Dec 6,

Re: Parity-based redundancy (RAID5/6/triple parity and beyond) on BTRFS and MDADM (Dec 2014) – Ronny Egners Blog

2017-11-02 Thread ronnie sahlberg
I think it is just a matter of lack of resources. The very few paid resources to work on btrfs probably does not have priority to work on parity raid. (And honestly, parity raid is probably much better implemented below the filesystem in any case, i.e. in say the md driver or the array itself).

Re: Encountered kernel bug#72811. Advice on recovery?

2017-04-14 Thread ronnie sahlberg
On Thu, Apr 13, 2017 at 8:47 PM, Duncan <1i5t5.dun...@cox.net> wrote: > Ank Ular posted on Thu, 13 Apr 2017 14:49:41 -0400 as excerpted: ... > OK, I'm one of the ones that's going to "go off" on you, but FWIW, I > expect pretty much everyone else would pretty much agree. At least you > do have

Re: Is it possible to speed up unlink()?

2016-10-20 Thread ronnie sahlberg
On Thu, Oct 20, 2016 at 7:44 AM, Austin S. Hemmelgarn wrote: > On 2016-10-20 09:47, Timofey Titovets wrote: >> >> 2016-10-20 15:09 GMT+03:00 Austin S. Hemmelgarn : >>> >>> On 2016-10-20 05:29, Timofey Titovets wrote: Hi, i use btrfs for

Re: RAID system with adaption to changed number of disks

2016-10-11 Thread ronnie sahlberg
On Tue, Oct 11, 2016 at 8:14 AM, Philip Louis Moetteli wrote: > > Hello, > > > I have to build a RAID 6 with the following 3 requirements: You should under no circumstances use RAID5/6 for anything other than test and throw-away data. It has several known issues that

Re: [BUG] Btrfs scrub sometime recalculate wrong parity in raid5

2016-06-26 Thread ronnie sahlberg
On Sat, Jun 25, 2016 at 7:53 PM, Duncan <1i5t5.dun...@cox.net> wrote: > Chris Murphy posted on Sat, 25 Jun 2016 11:25:05 -0600 as excerpted: > >> Wow. So it sees the data strip corruption, uses good parity on disk to >> fix it, writes the fix to disk, recomputes parity for some reason but >> does

Re: Trying to rescue my data :(

2016-06-24 Thread ronnie sahlberg
What I would do in this situation : 1, Immediately stop writing to these disks/filesystem. ONLY access it in read-only mode until you have salvaged what can be salvaged. 2, get a new 5T UDB drive (they are cheap) and copy file by file off the array. 3, when you hit files that cause panics, make a

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
in a loop. It is fairly trivial to trigger dataloss when devices are bounced like this. You have to run the script as root due to the calls to [u]mount and iscsiadm On Thu, Dec 31, 2015 at 1:23 PM, ronnie sahlberg <ronniesahlb...@gmail.com> wrote: > On Thu, Dec 31, 2015 at 12:11 PM, Chris M

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
On Thu, Dec 31, 2015 at 12:11 PM, Chris Murphy wrote: > This is a torture test, no data is at risk. > > Two devices, btrfs raid1 with some stuff on them. > Copy from that array, elsewhere. > During copy, yank the active device. > > dmesg shows many of these: > > [

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
On Thu, Dec 31, 2015 at 5:27 PM, Chris Murphy <li...@colorremedies.com> wrote: > On Thu, Dec 31, 2015 at 6:09 PM, ronnie sahlberg > <ronniesahlb...@gmail.com> wrote: >> Here is a kludge I hacked up. >> Someone that cares could clean this up and start building a pro

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
On Thu, Dec 31, 2015 at 5:27 PM, Chris Murphy <li...@colorremedies.com> wrote: > On Thu, Dec 31, 2015 at 6:09 PM, ronnie sahlberg > <ronniesahlb...@gmail.com> wrote: >> Here is a kludge I hacked up. >> Someone that cares could clean this up and start building a pro

Re: Timeouts copying large files to a Samba server with Btrfs

2015-12-26 Thread ronnie sahlberg
That does not look good. See if you can find something in the samba logs on the server. Look for messages about long running VFS operations and/or client disconnecting wile a file is open for writing. The CIFS/SMB protocol has hard real-time requirements in the windows client redirector which

Re: Btrfs/RAID5 became unmountable after SATA cable fault

2015-10-21 Thread ronnie sahlberg
If it is for mostly archival storage, I would suggest you take a look at snapraid. On Wed, Oct 21, 2015 at 9:09 AM, Janos Toth F. wrote: > I went through all the recovery options I could find (starting from > read-only to "extraordinarily dangerous"). Nothing seemed to

Re: Btrfs/RAID5 became unmountable after SATA cable fault

2015-10-21 Thread ronnie sahlberg
Maybe hold off erasing the drives a little in case someone wants to collect some extra data for diagnosing how/why the filesystem got into this unrecoverable state. A single device having issues should not cause the whole filesystem to become unrecoverable. On Wed, Oct 21, 2015 at 9:09 AM, Janos

Re: Can BTRFS handle XATTRs larger than 4K?

2014-12-22 Thread ronnie sahlberg
On Mon, Dec 22, 2014 at 2:52 PM, Robert White rwh...@pobox.com wrote: On 12/22/2014 12:44 PM, Austin S Hemmelgarn wrote: On 2014-12-22 15:06, Richard Sharpe wrote: On Mon, Dec 22, 2014 at 10:43 AM, Chris Murphy li...@colorremedies.com wrote: On Mon, Dec 22, 2014 at 11:09 AM, Austin S

Re: ENOSPC with mkdir and rename

2014-08-05 Thread ronnie sahlberg
On Tue, Aug 5, 2014 at 5:20 AM, Russell Coker russ...@coker.com.au wrote: Based on what I've read on this list it seems that BTRFS is less stable in 3.15 than in 3.14. Even 3.14 isn't something I'd recommend to random people who want something to just work. The Debian installer has BTRFS

Re: 1 week to rebuid 4x 3TB raid10 is a long time!

2014-07-21 Thread ronnie sahlberg
On Sun, Jul 20, 2014 at 7:48 PM, Duncan 1i5t5.dun...@cox.net wrote: ashford posted on Sun, 20 Jul 2014 12:59:21 -0700 as excerpted: If you assume a 12ms average seek time (normal for 7200RPM SATA drives), an 8.3ms rotational latency (half a rotation), an average 64kb write and a 100MB/S

Testing with flaky disk

2014-07-21 Thread ronnie sahlberg
. I am more than happy to add additional features that would make it even more useful for filesystem-error-path-and-recovery-testing regards ronnie sahlberg -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo

Re: btrfs on software RAID0

2014-05-05 Thread ronnie sahlberg
start-btrfs-dmcrypt : ... echo $pwd | ... Hmmm. This makes the plaintext password visible in ps output. It is probably better to pass this in by redirecting a file to stdin. On Mon, May 5, 2014 at 2:25 PM, Marc MERLIN m...@merlins.org wrote: On Mon, May 05, 2014 at 10:51:46PM +0200, john

Re: Which companies are using Btrfs in production?

2014-04-25 Thread ronnie sahlberg
On Fri, Apr 25, 2014 at 8:20 AM, Marc MERLIN m...@merlins.org wrote: On Fri, Apr 25, 2014 at 04:47:04PM +0200, David Sterba wrote: On Thu, Apr 24, 2014 at 04:14:56PM -0700, Marc MERLIN wrote: Netgear uses BTRFS as the filesystem in their refreshed ReadyNAS line. They apparently use

Re: How to handle a RAID5 arrawy with a failing drive?

2014-03-16 Thread ronnie sahlberg
On Sun, Mar 16, 2014 at 4:17 PM, Marc MERLIN m...@merlins.org wrote: On Sun, Mar 16, 2014 at 05:12:10PM -0600, Chris Murphy wrote: On Mar 16, 2014, at 4:55 PM, Chris Murphy li...@colorremedies.com wrote: Then use btrfs replace start. Looks like in 3.14rc6 replace isn't yet supported. I get

Re: What to do about df and btrfs fi df

2014-02-10 Thread ronnie sahlberg
On Mon, Feb 10, 2014 at 7:13 PM, cwillu cwi...@cwillu.com wrote: On Mon, Feb 10, 2014 at 7:02 PM, Roger Binns rog...@rogerbinns.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/02/14 10:24, cwillu wrote: The regular df data used number should be the amount of space required to

Re: Scrubbing with BTRFS Raid 5

2014-01-22 Thread ronnie sahlberg
On Wed, Jan 22, 2014 at 12:45 PM, Chris Mason c...@fb.com wrote: On Tue, 2014-01-21 at 17:08 +, Duncan wrote: Graham Fleming posted on Tue, 21 Jan 2014 01:06:37 -0800 as excerpted: Thanks for all the info guys. I ran some tests on the latest 3.12.8 kernel. I set up 3 1GB files and

Re: Scrubbing with BTRFS Raid 5

2014-01-22 Thread ronnie sahlberg
On Wed, Jan 22, 2014 at 1:16 PM, Chris Mason c...@fb.com wrote: On Wed, 2014-01-22 at 13:06 -0800, ronnie sahlberg wrote: On Wed, Jan 22, 2014 at 12:45 PM, Chris Mason c...@fb.com wrote: On Tue, 2014-01-21 at 17:08 +, Duncan wrote: Graham Fleming posted on Tue, 21 Jan 2014 01:06:37 -0800

Re: Unmountable Array After Drive Failure During Device Deletion

2013-12-21 Thread ronnie sahlberg
Similar things happened to me. (See my unanswered posts ~1Sep, this fs is not really ready for production I think) When you get wrong transid errors and reports that you have checksums being repaired, that is all bad news and no one can help you. Unfortunately there are, I think, no real tools

Re: Triple parity and beyond

2013-11-26 Thread ronnie sahlberg
This is great stuff. Now, how can we get this into btrfs and md? On Wed, Nov 20, 2013 at 1:23 PM, Andrea Mazzoleni amadva...@gmail.com wrote: Hi, First, create a 3 by 6 cauchy matrix, using x_i = 2^-i, and y_i = 0 for i=0, and y_i = 2^i for other i. In this case: x = { 1, 142, 71, 173,

Re: btrfs.h and btrfs-progs licensing

2013-09-10 Thread ronnie sahlberg
For crc32c you can use this one which is lgpl: https://github.com/sahlberg/libiscsi/blob/master/lib/crc32c.c You can use the generator at : http://www.ross.net/crc/download/crc_v3.txt to generate this (and others) On Mon, Sep 9, 2013 at 3:50 PM, David Sterba dste...@suse.cz wrote: On Mon,

Unmountable filesystem parent transid verify failed

2013-09-01 Thread ronnie sahlberg
eventually fails with : btrfs-zero-log: ctree.c:342: __btrfs_cow_block: Assertion `!(btrfs_header_generation(buf) trans-transid)' failed. Aborted What should I try next? regards ronnie sahlberg -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord

Unmountable BTRFS with parent transid verify failed

2013-08-31 Thread ronnie sahlberg
complete the filesystem remains unmountable. Any advice ? regards ronnie sahlberg -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

RADI6 questions

2013-06-01 Thread ronnie sahlberg
the spindles in the filesystem, not just 2 in RAID1 or n in RAID6. Im running a 3.8.0 kernel. regards ronnie sahlberg -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo