Re: What if TRIM issued a wipe on devices that don't TRIM?

2018-12-06 Thread ronnie sahlberg
an be used and which does providde an overwrite/wipe guarantee. Maybe ATA has something equivalent to WRITESAME10/16. I just want to say: be careful, sometimes these commands do not provide a guarantee that they will actually make the data overwritten/unretrievable. ronnie sahlberg On Thu, Dec 6,

Re: Parity-based redundancy (RAID5/6/triple parity and beyond) on BTRFS and MDADM (Dec 2014) – Ronny Egners Blog

2017-11-02 Thread ronnie sahlberg
I think it is just a matter of lack of resources. The very few paid resources to work on btrfs probably does not have priority to work on parity raid. (And honestly, parity raid is probably much better implemented below the filesystem in any case, i.e. in say the md driver or the array itself). Al

Re: Encountered kernel bug#72811. Advice on recovery?

2017-04-14 Thread ronnie sahlberg
On Thu, Apr 13, 2017 at 8:47 PM, Duncan <1i5t5.dun...@cox.net> wrote: > Ank Ular posted on Thu, 13 Apr 2017 14:49:41 -0400 as excerpted: ... > OK, I'm one of the ones that's going to "go off" on you, but FWIW, I > expect pretty much everyone else would pretty much agree. At least you > do have bac

Re: Is it possible to speed up unlink()?

2016-10-20 Thread ronnie sahlberg
On Thu, Oct 20, 2016 at 7:44 AM, Austin S. Hemmelgarn wrote: > On 2016-10-20 09:47, Timofey Titovets wrote: >> >> 2016-10-20 15:09 GMT+03:00 Austin S. Hemmelgarn : >>> >>> On 2016-10-20 05:29, Timofey Titovets wrote: Hi, i use btrfs for NFS VM replica storage and for NFS shared VM >

Re: RAID system with adaption to changed number of disks

2016-10-11 Thread ronnie sahlberg
On Tue, Oct 11, 2016 at 8:14 AM, Philip Louis Moetteli wrote: > > Hello, > > > I have to build a RAID 6 with the following 3 requirements: You should under no circumstances use RAID5/6 for anything other than test and throw-away data. It has several known issues that will eat your data. Total da

Re: [BUG] Btrfs scrub sometime recalculate wrong parity in raid5

2016-06-26 Thread ronnie sahlberg
On Sat, Jun 25, 2016 at 7:53 PM, Duncan <1i5t5.dun...@cox.net> wrote: > Chris Murphy posted on Sat, 25 Jun 2016 11:25:05 -0600 as excerpted: > >> Wow. So it sees the data strip corruption, uses good parity on disk to >> fix it, writes the fix to disk, recomputes parity for some reason but >> does i

Re: Trying to rescue my data :(

2016-06-24 Thread ronnie sahlberg
What I would do in this situation : 1, Immediately stop writing to these disks/filesystem. ONLY access it in read-only mode until you have salvaged what can be salvaged. 2, get a new 5T UDB drive (they are cheap) and copy file by file off the array. 3, when you hit files that cause panics, make a

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
On Thu, Dec 31, 2015 at 5:27 PM, Chris Murphy wrote: > On Thu, Dec 31, 2015 at 6:09 PM, ronnie sahlberg > wrote: >> Here is a kludge I hacked up. >> Someone that cares could clean this up and start building a proper >> test suite or something. >> >> Thi

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
On Thu, Dec 31, 2015 at 5:27 PM, Chris Murphy wrote: > On Thu, Dec 31, 2015 at 6:09 PM, ronnie sahlberg > wrote: >> Here is a kludge I hacked up. >> Someone that cares could clean this up and start building a proper >> test suite or something. >> >> Thi

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
loop. It is fairly trivial to trigger dataloss when devices are bounced like this. You have to run the script as root due to the calls to [u]mount and iscsiadm On Thu, Dec 31, 2015 at 1:23 PM, ronnie sahlberg wrote: > On Thu, Dec 31, 2015 at 12:11 PM, Chris Murphy > wrote: >> This

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread ronnie sahlberg
On Thu, Dec 31, 2015 at 12:11 PM, Chris Murphy wrote: > This is a torture test, no data is at risk. > > Two devices, btrfs raid1 with some stuff on them. > Copy from that array, elsewhere. > During copy, yank the active device. > > dmesg shows many of these: > > [ 7179.373245] BTRFS error (device

Re: Timeouts copying large files to a Samba server with Btrfs

2015-12-26 Thread ronnie sahlberg
That does not look good. See if you can find something in the samba logs on the server. Look for messages about long running VFS operations and/or client disconnecting wile a file is open for writing. The CIFS/SMB protocol has hard real-time requirements in the windows client redirector which le

Re: Btrfs/RAID5 became unmountable after SATA cable fault

2015-10-21 Thread ronnie sahlberg
Maybe hold off erasing the drives a little in case someone wants to collect some extra data for diagnosing how/why the filesystem got into this unrecoverable state. A single device having issues should not cause the whole filesystem to become unrecoverable. On Wed, Oct 21, 2015 at 9:09 AM, Janos

Re: Btrfs/RAID5 became unmountable after SATA cable fault

2015-10-21 Thread ronnie sahlberg
If it is for mostly archival storage, I would suggest you take a look at snapraid. On Wed, Oct 21, 2015 at 9:09 AM, Janos Toth F. wrote: > I went through all the recovery options I could find (starting from > read-only to "extraordinarily dangerous"). Nothing seemed to work. > > A Windows based

Re: Can BTRFS handle XATTRs larger than 4K?

2014-12-22 Thread ronnie sahlberg
On Mon, Dec 22, 2014 at 2:52 PM, Robert White wrote: > On 12/22/2014 12:44 PM, Austin S Hemmelgarn wrote: >> >> On 2014-12-22 15:06, Richard Sharpe wrote: >>> >>> On Mon, Dec 22, 2014 at 10:43 AM, Chris Murphy >>> wrote: On Mon, Dec 22, 2014 at 11:09 AM, Austin S Hemmelgarn wrote:

Re: ENOSPC with mkdir and rename

2014-08-05 Thread ronnie sahlberg
On Tue, Aug 5, 2014 at 5:20 AM, Russell Coker wrote: > > Based on what I've read on this list it seems that BTRFS is less stable in > 3.15 than in 3.14. Even 3.14 isn't something I'd recommend to random people > who want something to just work. > > The Debian installer has BTRFS in a list of fil

Testing with flaky disk

2014-07-21 Thread ronnie sahlberg
look. I am more than happy to add additional features that would make it even more useful for filesystem-error-path-and-recovery-testing regards ronnie sahlberg -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.k

Re: 1 week to rebuid 4x 3TB raid10 is a long time!

2014-07-21 Thread ronnie sahlberg
On Sun, Jul 20, 2014 at 7:48 PM, Duncan <1i5t5.dun...@cox.net> wrote: > ashford posted on Sun, 20 Jul 2014 12:59:21 -0700 as excerpted: > >> If you assume a 12ms average seek time (normal for 7200RPM SATA drives), >> an 8.3ms rotational latency (half a rotation), an average 64kb write and >> a 100M

Re: Also seeing full deadlocks with 3.15.1

2014-06-27 Thread ronnie sahlberg
On Fri, Jun 27, 2014 at 1:40 PM, Marc MERLIN wrote: > On Fri, Jun 27, 2014 at 11:50:09AM -0700, Marc MERLIN wrote: >> My laptop deadlocked some more times (everything works until it needs to >> touch the filesystem, and then it's deadlocked). >> Unfortunately, I can trigger sysrq, but it doesn't g

Re: [Question] Btrfs on iSCSI device

2014-06-27 Thread ronnie sahlberg
for linux. regards ronnie sahlberg On Fri, Jun 27, 2014 at 8:44 AM, Zhe Zhang wrote: > Hi, > > I setup 2 Linux servers to share the same device through iSCSI. Then I > created a btrfs on the device. Then I saw the problem that the 2 Linux > servers do not see a consistent file

Re: btrfs on software RAID0

2014-05-05 Thread ronnie sahlberg
start-btrfs-dmcrypt : ... echo "$pwd" | ... Hmmm. This makes the plaintext password visible in ps output. It is probably better to pass this in by redirecting a file to stdin. On Mon, May 5, 2014 at 2:25 PM, Marc MERLIN wrote: > On Mon, May 05, 2014 at 10:51:46PM +0200, john terragon wrote: >>

Re: Which companies are using Btrfs in production?

2014-04-25 Thread ronnie sahlberg
On Fri, Apr 25, 2014 at 8:20 AM, Marc MERLIN wrote: > On Fri, Apr 25, 2014 at 04:47:04PM +0200, David Sterba wrote: >> On Thu, Apr 24, 2014 at 04:14:56PM -0700, Marc MERLIN wrote: >> > > > Netgear uses BTRFS as the filesystem in their refreshed ReadyNAS line. >> > > > They apparently use Oracle's

Re: How to handle a RAID5 arrawy with a failing drive?

2014-03-16 Thread ronnie sahlberg
On Sun, Mar 16, 2014 at 4:17 PM, Marc MERLIN wrote: > On Sun, Mar 16, 2014 at 05:12:10PM -0600, Chris Murphy wrote: >> >> On Mar 16, 2014, at 4:55 PM, Chris Murphy wrote: >> >> > Then use btrfs replace start. >> >> Looks like in 3.14rc6 replace isn't yet supported. I get "dev_replace cannot >> y

Re: What to do about df and btrfs fi df

2014-02-10 Thread ronnie sahlberg
On Mon, Feb 10, 2014 at 7:13 PM, cwillu wrote: > On Mon, Feb 10, 2014 at 7:02 PM, Roger Binns wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> On 10/02/14 10:24, cwillu wrote: >>> The regular df data used number should be the amount of space required >>> to hold a backup of that c

Re: Scrubbing with BTRFS Raid 5

2014-01-22 Thread ronnie sahlberg
On Wed, Jan 22, 2014 at 1:16 PM, Chris Mason wrote: > On Wed, 2014-01-22 at 13:06 -0800, ronnie sahlberg wrote: >> On Wed, Jan 22, 2014 at 12:45 PM, Chris Mason wrote: >> > On Tue, 2014-01-21 at 17:08 +, Duncan wrote: >> >> Graham Fleming posted on Tue,

Re: Scrubbing with BTRFS Raid 5

2014-01-22 Thread ronnie sahlberg
On Wed, Jan 22, 2014 at 12:45 PM, Chris Mason wrote: > On Tue, 2014-01-21 at 17:08 +, Duncan wrote: >> Graham Fleming posted on Tue, 21 Jan 2014 01:06:37 -0800 as excerpted: >> >> > Thanks for all the info guys. >> > >> > I ran some tests on the latest 3.12.8 kernel. I set up 3 1GB files and >

Re: Unmountable Array After Drive Failure During Device Deletion

2013-12-21 Thread ronnie sahlberg
Similar things happened to me. (See my unanswered posts ~1Sep, this fs is not really ready for production I think) When you get wrong transid errors and reports that you have checksums being repaired, that is all bad news and no one can help you. Unfortunately there are, I think, no real tools to

Re: Triple parity and beyond

2013-11-26 Thread ronnie sahlberg
This is great stuff. Now, how can we get this into btrfs and md? On Wed, Nov 20, 2013 at 1:23 PM, Andrea Mazzoleni wrote: > Hi, > >> First, create a 3 by 6 cauchy matrix, using x_i = 2^-i, and y_i = 0 for i=0, >> and y_i = 2^i for other i. >> In this case: x = { 1, 142, 71, 173, 216, 108 } y

Re: btrfs.h and btrfs-progs licensing

2013-09-10 Thread ronnie sahlberg
For crc32c you can use this one which is lgpl: https://github.com/sahlberg/libiscsi/blob/master/lib/crc32c.c You can use the generator at : http://www.ross.net/crc/download/crc_v3.txt to generate this (and others) On Mon, Sep 9, 2013 at 3:50 PM, David Sterba wrote: > On Mon, Sep 09, 2013 at 0

Unmountable filesystem parent transid verify failed

2013-09-01 Thread ronnie sahlberg
v/sde eventually fails with : btrfs-zero-log: ctree.c:342: __btrfs_cow_block: Assertion `!(btrfs_header_generation(buf) > trans->transid)' failed. Aborted What should I try next? regards ronnie sahlberg -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" i

Unmountable BTRFS with parent transid verify failed

2013-08-31 Thread ronnie sahlberg
ually does complete the filesystem remains unmountable. Any advice ? regards ronnie sahlberg -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

RADI6 questions

2013-06-01 Thread ronnie sahlberg
irrored onto all the spindles in the filesystem, not just 2 in RAID1 or n in RAID6. Im running a 3.8.0 kernel. regards ronnie sahlberg -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at ht