Re: BTRFS Raid5 error during Scrub.

2019-10-04 Thread Robert Krig
.10.2019, 14:18 -0600 schrieb Chris Murphy: > On Thu, Oct 3, 2019 at 6:18 AM Robert Krig > wrote: > > By the way, how serious is the error I've encountered? > > I've run a second scrub in the meantime, it aborted when it came > > close > > to the end, just

Re: BTRFS Raid5 error during Scrub.

2019-10-03 Thread Robert Krig
By the way, how serious is the error I've encountered? I've run a second scrub in the meantime, it aborted when it came close to the end, just like the first time. If the files that are corrupt have been deleted is this error going to go away? On Mi, 2019-10-02 at 12:17 +0200, R

Re: BTRFS Raid5 error during Scrub.

2019-10-02 Thread Robert Krig
.10.2019, 12:10 -0600 schrieb Chris Murphy: > On Mon, Sep 30, 2019 at 3:37 AM Robert Krig > wrote: > > I've upgraded to btrfs-progs v5.2.1 > > Here is the output from btrfs check -p --readonly /dev/sda > > > > > > Opening filesystem to check... > > Che

Re: BTRFS Raid5 error during Scrub.

2019-09-30 Thread Robert Krig
+0300 schrieb Nikolay Borisov: > > On 30.09.19 г. 0:38 ч., Robert Krig wrote: > > Hi guys. First off, I've got backups so no worries there. I'm just > > trying to understand what's happening and which files are affected. > > I've got a scrub running and t

BTRFS Raid5 error during Scrub.

2019-09-29 Thread Robert Krig
Hi guys. First off, I've got backups so no worries there. I'm just trying to understand what's happening and which files are affected. I've got a scrub running and the kernel dmesg buffer spit out the following: BTRFS warning (device sda): checksum/header error at logical 48781340082176 on dev /de

Best Practices (or stuff to avoid) with Raid5/6 ?

2019-07-15 Thread Robert Krig
Hi guys. I was wondering, are there any recommended best practices when using Raid5/6 on BTRFS? I intend to build a 4 Disk BTRFS Raid5 array, but that's just going to be as a backup for my main ZFS Server. So the data on it is not important. I just want to see how RAID5 will behave over time. Th

Recover files from broken btrfs

2019-06-23 Thread Robert
logical 62139990016 len 4096 [Sat Jun 1 13:18:54 2019] BTRFS critical (device md127): unable to find logical 62139990016 len 4096 [Sat Jun 1 13:18:54 2019] BTRFS error (device md127): failed to read chunk root [Sat Jun 1 13:18:54 2019] BTRFS error (device md127): open_ctree failed -- regards Robert

Re: Unbootable root btrfs

2019-05-17 Thread Robert White
On 5/18/19 4:06 AM, Chris Murphy wrote: On Fri, May 17, 2019 at 2:18 AM Lee Fleming wrote: I didn't see that particular warning. I did see a warning that it could cause damage and should be tried after trying some other things which I did. The data on this drive isn't important. I just wante

Feature Request: Directory property to upconvert mkdir/rmdir to subvol create/delete

2019-05-17 Thread Robert White
Howdy, For several reasons it would be really convenient if there was a way to mark a btrfs directory such that the directories created in the marked directory would actually be automatically converted to subvolume creation and destruction. NFS4 particularly pivots on file system boundaries,

Re: [PATCH 00/10] btrfs: Support for DAX devices

2018-12-05 Thread Robert White
On 12/5/18 9:37 PM, Jeff Mahoney wrote: The high level idea that Jan Kara and I came up with in our conversation at Labs conf is pretty expensive.  We'd need to set a flag that pauses new page faults, set the WP bit on affected ranges, do the snapshot, commit, clear the flag, and wake up the wa

What if TRIM issued a wipe on devices that don't TRIM?

2018-12-05 Thread Robert White
(1) Automatic and selective wiping of unused and previously used disk blocks is a good security measure, particularly when there is an encryption layer beneath the file system. (2) USB attached devices _never_ support TRIM and they are the most likely to fall into strangers hands. (3) I vagu

Theoretical Question about commit=n

2017-11-12 Thread Robert White
Is the commit interval monotonic, or is it seconds after sync? What I mean is that if I manually call sync(2) does the commit timer reset? I'm thinking it does not, but I can imagine a workload where it ideally would. (Again, this is purely theoretical, I have no such workload as I am about to de

Re: Btrfs Raid5 issue.

2017-08-22 Thread Robert LeBlanc
at box with nvme rather than MX200. If you have any other questions, feel free to ask. Thanks Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Btrfs Raid5 issue.

2017-08-21 Thread Robert LeBlanc
't get to any data. Thank you again. Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Btrfs Raid5 issue.

2017-08-21 Thread Robert LeBlanc
has given me more options than may have otherwise been available. What are your or others suggestions about moving forward? Thanks, Robert Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 btrfs_check.txt.xz Description: application/xz

Btrfs Raid5 issue.

2017-08-20 Thread Robert LeBlanc
Aborted Please let me know if there is any other information I can provide that would be helpful. Thank you, Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in

Qgroup reserved space like in ZFS?

2017-05-11 Thread Robert Mader
nce and regards, Robert signature.asc Description: OpenPGP digital signature

Re: Need some help: "BTRFS critical (device sda): corrupt leaf, slot offset bad: block"

2017-04-04 Thread Robert Krig
On 04.04.2017 18:55, Chris Murphy wrote: > On Tue, Apr 4, 2017 at 10:52 AM, Chris Murphy wrote: > > >> Mounting -o ro,degraded is probably permitted by the file system, but >> chunks of the file system and certainly your data, will be missing. So >> it's just a matter of time before copying data

Re: Need some help: "BTRFS critical (device sda): corrupt leaf, slot offset bad: block"

2017-04-03 Thread Robert Krig
On 03.04.2017 16:25, Robert Krig wrote: > > I'm gonna run a extensive memory check once I get home, since you > mentioned corrupt memory might be an issue here. > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the body of a mes

Re: Need some help: "BTRFS critical (device sda): corrupt leaf, slot offset bad: block"

2017-04-03 Thread Robert Krig
On 03.04.2017 16:20, Robert Krig wrote: > > On 03.04.2017 16:08, Hans van Kranenburg wrote: >> On 04/03/2017 12:11 PM, Robert Krig wrote: >> The corruption is at item 157. Can you attach all of the output, or >> pastebin it? >> > > I've attached the

Re: Need some help: "BTRFS critical (device sda): corrupt leaf, slot offset bad: block"

2017-04-03 Thread Robert Krig
On 03.04.2017 16:08, Hans van Kranenburg wrote: > On 04/03/2017 12:11 PM, Robert Krig wrote: > The corruption is at item 157. Can you attach all of the output, or > pastebin it? > I've attached the entire log of btrfs-debug-tree. This was generated with btrfs-progs 4.7

Re: Need some help: "BTRFS critical (device sda): corrupt leaf, slot offset bad: block"

2017-04-03 Thread Robert Krig
On 03.04.2017 12:11, Robert Krig wrote: > Hi guys, I seem to have run into a spot of trouble with my btrfs partition. > > I've got 4 x 8TB in a RAID1 BTRFS configuration. > > I'm running Debian Jessie 64 Bit, 4.9.0-0.bpo.2-amd64 kernel. Btrfs > progs version v4.7

Need some help: "BTRFS critical (device sda): corrupt leaf, slot offset bad: block"

2017-04-03 Thread Robert Krig
Hi guys, I seem to have run into a spot of trouble with my btrfs partition. I've got 4 x 8TB in a RAID1 BTRFS configuration. I'm running Debian Jessie 64 Bit, 4.9.0-0.bpo.2-amd64 kernel. Btrfs progs version v4.7.3 Server has 8GB of Ram. I was running duperemove using a hashfile, which seemed t

Re: Announcing btrfs-dedupe 1.1.0

2017-01-26 Thread Robert Krig
ssume you have git installed: > > git clone > https://gitlab.wellbehavedsoftware.com/well-behaved-software/btrfs-dedupe.git > > Then cd in and build using cargo: > > cd btrfs-dedupe > cargo build --release > > There is basically just one binary which will end up in &

Re: Announcing btrfs-dedupe 1.1.0

2017-01-13 Thread Robert Krig
Hi, could you include some build instructions for people that are unfamiliar with compiling rust code? On 08.01.2017 17:57, James Pharaoh wrote: > Hi everyone, > > I'm pleased to announce a new version of my btrfs-dedupe tool, written > in rust, available here: > > http://btrfs-dedupe.com/ > > Bi

Re: btrfs partition fails to mount - kernel BUG at ../fs/btrfs/extent-tree.c:1872

2016-08-25 Thread Robert Munteanu
On Thu, Aug 25, 2016 at 1:19 AM, Robert Munteanu wrote: > I've managed to capture one of the error messages, > but via screenshot only. And here's the full output below, via netconsole [ 2806.245627] BTRFS error (device sda1): Duplicate entries in free space cache, dumpi

Re: btrfs partition fails to mount - kernel BUG at ../fs/btrfs/extent-tree.c:1872

2016-08-24 Thread Robert Munteanu
ntouched for further investigation. Thanks, Robert -- http://robert.muntea.nu/ -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

btrfs partition fails to mount - kernel BUG at ../fs/btrfs/extent-tree.c:1872

2016-08-24 Thread Robert Munteanu
e to show that nothing of interest changes between the two. My way out is simply transferring the data out ( mount -o ro works ) and creating a new partition, but it would be interesting to fix it, and if there's any information I can offer to help prepare a bug fix please let me kn

Attention Beneficially

2016-08-21 Thread Robert David
Attention Beneficially WESTERN UNION This is very urgent Our Operation manager has sent your first payment of $5000.00 to you. Here is what we need from you to complete the transfer, Your Name, Your Address,A Copy Of Your ID and Your Telephone Number: Noted That Only Fee Request from You Is to

BTRFS warnings in dmesg / scrub errors - Transaction aborted ( error -95 )

2016-04-05 Thread Robert Munteanu
lp It would be great if anyone can suggest a workaround or provide a fix. Thanks, Robert -- http://robert.muntea.nu/ -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

RE: RE

2016-03-19 Thread Robert
Please confirm receipt of my previous mail..When can i call you -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

A good "Boot Maintenance" scheme (WAS: New file system with same issue)

2016-03-18 Thread Robert White
On 03/14/2016 01:13 PM, Marc Haber wrote: This was not asked, and I didn't try. Since this is an encrypted root filesystem, is it a workable way to add clear_cache to /etc/fstab, rebuild initramfs and reboot? Or do you recommend using a rescue system? You should be able to boot to single user

Stupid (?) Idea about extent lifetimes.

2016-03-15 Thread Robert White
It occurs to me that it would be desirable to mark extents as "least favoured nations" and so all new writes would like to not be written there and any data written there would have a desire to be somewhere else. So lets say the wholly unallocated space has a natural status of 100. Allocated b

Re: btrfs raid1 filesystem on sdcard corrupted

2016-02-25 Thread Hegner Robert
real industrial grade SDcards in our device... Am 25.02.2016 um 20:18 schrieb Hegner Robert: Thanks Lionel for your explanations! I just noticed that a second device with the same setup (which has been working only some hours ago) failed as well. So two systems which were running with a non-raid1 an

Re: btrfs raid1 filesystem on sdcard corrupted

2016-02-25 Thread Hegner Robert
. But since you seem to have some experience with this (and because I'm quite desperate now that I found out that my allegedly good solution is actually worse than what we had before) I would really appreciate your inputs. Robert Am 25.02.2016 um 19:08 schrieb Lionel Bouton: Hi, Le 25/02

Re: btrfs raid1 filesystem on sdcard corrupted

2016-02-25 Thread Hegner Robert
Am 25.02.2016 um 18:34 schrieb Hegner Robert: Hi all! I'm working on a embedded system (ARM) running from a SDcard. Recently I switched to a btrfs-raid1 configuration, hoping to make my system more resistant against power failures and flash-memory specific problems. However today one

btrfs raid1 filesystem on sdcard corrupted

2016-02-25 Thread Hegner Robert
t? (I'm not a very experienced linux user). Best regards Robert -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: btrfs crashing the kernel with Seagate 8TB SMR drives.

2015-12-04 Thread Robert Krig
As Chris mentioned, check out the Bug report here: https://bugzilla.kernel.org/show_bug.cgi?id=93581 I have a 8TB SMR Drive and the kernel was reporting drive errors. Switching to Kernel 3.16 (Standard Debian Jessie kernel) fixed it for me ( for the moment). >From what I read in that kernel bug

Re: btrfs-balance convert from raid1 to single on specific device?

2015-11-10 Thread Robert Krig
a while for patches to the mailing list to be merged into one of the repos. What would be the easiest way for me to compile that specific patch? Which kernel version sources do I ideally need? Is there a git repo that already has that patch included? Thank you for your help. On 10.11.2015 11

btrfs-balance convert from raid1 to single on specific device?

2015-11-10 Thread Robert Krig
Hi, I'm running Kernel 4.3 and Btrfs-tools 4.3 on Debian Jessie. I compiled the tools and kernel myself. Recently I added a new disk to my btrfs volume and wanted to proceed to convert from single to raid1. Unfortunately the new disk seems to be faulty and started throwing a lot of errors. The b

RE: mkfs.btrfs cannot find rotational file for SSD detection for a pmem device

2015-09-08 Thread Elliott, Robert (Persistent Memory)
> -Original Message- > From: Austin S Hemmelgarn [mailto:ahferro...@gmail.com] > Sent: Tuesday, September 8, 2015 7:56 AM > Subject: Re: mkfs.btrfs cannot find rotational file for SSD detection for > a pmem device > > On 2015-09-06 13:51, Elliott, Robert (Per

mkfs.btrfs cannot find rotational file for SSD detection for a pmem device

2015-09-06 Thread Elliott, Robert (Persistent Memory)
mkfs.btrfs does not detect pmem devices as being SSDs in kernel 4.2. Label: (null) UUID: 46603efe-728c-43fe-8241-ffc125e1a7ed Node size: 16384 Sector size:4096 Filesystem size:8.00GiB Block group profiles: Data: single8.00Mi

Re: [PATCH 0/3] Fix for infinite loop on non-empty inode but with no file extent

2015-08-07 Thread Robert Munteanu
On Fri, Aug 7, 2015 at 5:19 PM, David Sterba wrote: > On Fri, Aug 07, 2015 at 05:17:34PM +0300, Robert Munteanu wrote: >> Thanks for the update. Reading it looks to me like the patches should be at >> >> >> http://repo.or.cz/w/btrfs-progs-unstable/devel.git/shortlog

Re: [PATCH 0/3] Fix for infinite loop on non-empty inode but with no file extent

2015-08-07 Thread Robert Munteanu
On Fri, Aug 7, 2015 at 5:00 PM, David Sterba wrote: > On Fri, Aug 07, 2015 at 04:05:44PM +0300, Robert Munteanu wrote: >> >> Qu Wenruo (3): >> >> btrfs-progs: fsck: Print correct file hole >> >> btrfs-progs: fsck: Fix a infinite loop on discount file

Re: [PATCH 0/3] Fix for infinite loop on non-empty inode but with no file extent

2015-08-07 Thread Robert Munteanu
trfsprogs with these patches applied? Thanks, Robert [0]: https://btrfs.wiki.kernel.org/index.php/Btrfs_source_repositories#btrfs-progs_git_repository -- http://robert.muntea.nu/ -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to ma

btrfs raid1 metadata, single data

2015-08-07 Thread Robert Krig
Hi, I was wondering. What exactly is contained in btrfs metadata? I've read about some users setting up their btrfs volumes as data=single, but metadata=raid1 Is there any actual benefit to that? I mean, if you keep your data as single, but have multiple copies of metadata, does that still allow

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-08-03 Thread Robert Munteanu
above aren't enough I will provide the more comprehensive output. > > Alternatively, if "btrfs-image -c9 " works without problem, it will > also helps a lot for debugging. This one is also quite large ( 332MB ) -> https://dl.dropboxusercontent.com/u/3160732/sda1-

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-07-31 Thread Robert Munteanu
progress. > Not sure if it real loops, but maybe the inode number changed in later > output? Looks to me like it's the same inode $ awk '/ for inode/ { print $7 } ' screenlog.0 | sort | uniq 14214570 Thanks, Robert -- http://robert.muntea.nu/ screenlog.0.gz Description: GNU Zip compressed data

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-07-30 Thread Robert Munteanu
cue disk and boot from a read-only snapshot. Cheers, Robert -- http://robert.muntea.nu/ -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-07-26 Thread Robert Munteanu
wn the source of the errors. Alternatively, if there's an easy and safe fix and debugging is not worth it, I'm happy to apply that fix as well. At any rate, looking forward to your replies. Thanks, Robert -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs&qu

Recreate Snapshots and their Parent Relationships on a second Server.

2015-07-14 Thread Robert Krig
Hi. I have an Old Server with a bunch of btrfs Snapshots. I'm setting up a new server and I would like to transfer those Snapshots as efficiently as possible, while still maintaining their parent<->child relationships for space efficient storage. Apart from manually using "btrfs send" and "btrfs

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-06-18 Thread Robert Munteanu
On Wed, Jun 17, 2015 at 9:48 PM, Jeff Mahoney wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 6/12/15 8:19 AM, Robert Munteanu wrote: >> Hi, >> >> I have converted my root ext4 partition to btrfs. I used an USB >> stick to boot and used btrfs

Re: btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-06-18 Thread Robert Munteanu
On Wed, Jun 17, 2015 at 8:46 PM, Marc MERLIN wrote: > On Fri, Jun 12, 2015 at 03:19:06PM +0300, Robert Munteanu wrote: >> Hi, > > Note to others: kernel 4.0.4 > > Reply to you: > I tried ext4 to btrfs once a year ago and it severely mangled my > filesystem. > I looke

[PATCH] check: check so offset is not bigger then the leaf

2015-06-17 Thread Robert Marklund
This could crash before because of dangerous dangling offset of pointer. Signed-off-by: Robert Marklund --- cmds-check.c | 10 ++ 1 file changed, 10 insertions(+) diff --git a/cmds-check.c b/cmds-check.c index 778f141..da36758 100644 --- a/cmds-check.c +++ b/cmds-check.c @@ -8906,6

btrfs partition converted from ext4 becomes read-only minutes after booting: WARNING: CPU: 2 PID: 2777 at ../fs/btrfs/super.c:260 __btrfs_abort_transaction+0x4b/0x120

2015-06-12 Thread Robert Munteanu
ed=2.05GiB GlobalReserve, single: total=512.00MiB, used=0.00B Is there a way out? I still have the old ext4 image and can revert, but I'm keeping the btrfs one for now, in case I can extract some useful debugging information from it. Thanks, Robert -- http://robert.muntea.nu/ -- To unsubscribe

Any Arguments for/against --bind mounts?

2015-03-13 Thread Robert White
Is there any practical reason to prefer bind mounts or separately mounting a subvolume? e.g. assuming /locationA and /locationB are arbitrarily far apart in the file system tree, is there any reason to prefer one of the following over the other mount -t btrfs -o subvolume=/thing /dev/sdN1 /l

Re: Documenting MS_LAZYTIME

2015-02-22 Thread Robert White
On 02/20/2015 12:50 AM, Michael Kerrisk wrote: * As at Linux 3.20, this option is supported only on ext4. "As of Linux 3.20" is more correct. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordo

Re: scrub problem

2015-02-22 Thread Robert White
On 02/20/2015 01:03 PM, Bob Williams wrote: /var/lib/btrfs/scrub.status.0b07b829-9a0e-44ab-89ee-14b36a45199e (the last bit of the filename is the filesystem uuid) Look for a line that ends with "finished:0" and change it to say "finished:1" Why does this data item even exist? The filesystem/k

Kernel bug when deleting snapshot?

2015-02-13 Thread Robert Mucina
mesg output, it just hangs although I can see that mountpoint is empty. Thoughts anyone? Regards Robert -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Segfault when deleting device

2015-02-08 Thread Robert Mucina
y fixed... Any other thoughts? Regards, Robert -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Btrfs subvolume question

2015-02-04 Thread Robert White
On 02/04/2015 06:27 PM, Chris Murphy wrote: On Wed, Feb 4, 2015 at 3:54 PM, Markus Moeller wrote: Hi , I am new to btrfs and wonder what I need to do to move subvolumes to the right filesystem. I see the following: df -h Filesystem Size Used Avail Use% Mounted on /d

Re: fstrim not working on one of three BTRFS filesystems

2014-12-28 Thread Robert White
On 12/28/2014 08:58 AM, Martin Steigerwald wrote: Hi! After my recent tests with my /home filesystem and the up and downsizing of it I get: merkaba:~> LANG=C fstrim -v /home /home: 0 B (0 bytes) trimmed merkaba:~> LANG=C fstrim -v / /: 24.5 GiB (26257555456 bytes) trimmed merkaba:~> LANG=C fst

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-28 Thread Robert White
On 12/28/2014 07:42 AM, Martin Steigerwald wrote: Am Sonntag, 28. Dezember 2014, 06:52:41 schrieb Robert White: On 12/28/2014 04:07 AM, Martin Steigerwald wrote: Am Samstag, 27. Dezember 2014, 20:03:09 schrieb Robert White: Now: The complaining party has verified the minimum, repeatable case

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-28 Thread Robert White
On 12/28/2014 04:07 AM, Martin Steigerwald wrote: Am Samstag, 27. Dezember 2014, 20:03:09 schrieb Robert White: Now: The complaining party has verified the minimum, repeatable case of simple file allocation on a very fragmented system and the responding party and several others have understood

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 05:01 PM, Bardur Arantsson wrote: On 2014-12-28 01:25, Robert White wrote: On 12/27/2014 08:01 AM, Martin Steigerwald wrote: From how you write I get the impression that you think everyone else beside you is just silly and dumb. Please stop this assumption. I may not always get

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 08:01 AM, Martin Steigerwald wrote: From how you write I get the impression that you think everyone else beside you is just silly and dumb. Please stop this assumption. I may not always get terms right, and I may make a mistake as with the wrong df figure. But I also highly dislike

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
Semi off-topic questions... On 12/27/2014 08:26 AM, Hugo Mills wrote: This is... badly mistaken, at best. The problem of where to write a file into a set of free extents is definitely *not* an NP-hard problem. It's a P problem, with an O(n log n) solution, where n is the number of free exten

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 06:21 AM, Martin Steigerwald wrote: Am Samstag, 27. Dezember 2014, 15:14:05 schrieb Martin Steigerwald: Am Samstag, 27. Dezember 2014, 06:00:48 schrieb Robert White: On 12/27/2014 05:16 AM, Martin Steigerwald wrote: It can easily be reproduced without even using Virtualbox, just

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
Virtualbox for reproducing the issue. Next I will try to reproduce with a freshly creating filesystem. Am Samstag, 27. Dezember 2014, 09:30:43 schrieb Hugo Mills: On Sat, Dec 27, 2014 at 10:01:17AM +0100, Martin Steigerwald wrote: Am Freitag, 26. Dezember 2014, 14:48:38 schrieb Robert White: On

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 06:00 AM, Robert White wrote: On 12/27/2014 05:16 AM, Martin Steigerwald wrote: It can easily be reproduced without even using Virtualbox, just by a nice simple fio job. TL;DR: If you want a worst-case example of consuming a BTRFS filesystem with one single file... #!/bin/bash

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 05:16 AM, Martin Steigerwald wrote: It can easily be reproduced without even using Virtualbox, just by a nice simple fio job. TL;DR: If you want a worst-case example of consuming a BTRFS filesystem with one single file... #!/bin/bash # not tested, so correct any syntax errors

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 05:16 AM, Martin Steigerwald wrote: Am Samstag, 27. Dezember 2014, 03:52:56 schrieb Robert White: My theory from watching the Windows XP defragmentation case is this: - For writing into the file BTRFS needs to actually allocate and use free space in the current tree allocation

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 03:11 AM, Martin Steigerwald wrote: Am Samstag, 27. Dezember 2014, 09:30:43 schrieb Hugo Mills: I only see the lockups of BTRFS is the trees *occupy* all space on the device. No, "the trees" occupy 3.29 GiB of your 5 GiB of mirrored metadata space. What's more, balance does

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-27 Thread Robert White
On 12/27/2014 02:54 AM, Martin Steigerwald wrote: Am Samstag, 27. Dezember 2014, 09:30:43 schrieb Hugo Mills: On Sat, Dec 27, 2014 at 10:01:17AM +0100, Martin Steigerwald wrote: Am Freitag, 26. Dezember 2014, 14:48:38 schrieb Robert White: On 12/26/2014 05:37 AM, Martin Steigerwald wrote

Re: Standards Problems [Was: [PATCH v2 1/3] Btrfs: get more accurate output in df command.]

2014-12-26 Thread Robert White
On 12/23/2014 04:31 AM, Dongsheng Yang wrote: On 12/18/2014 12:07 PM, Robert White wrote: I don't disagree with the _ideal_ of your patch. I just think that it's impossible to implement it without lying to the user or making things just as bad in a different way. I would _like_ you t

Re: BTRFS free space handling still needs more work: Hangs again

2014-12-26 Thread Robert White
On 12/26/2014 05:37 AM, Martin Steigerwald wrote: Hello! First: Have a merry christmas and enjoy a quiet time in these days. Second: At a time you feel like it, here is a little rant, but also a bug report: I have this on 3.18 kernel on Debian Sid with BTRFS Dual SSD RAID with space_cache, ski

Re: Can BTRFS handle XATTRs larger than 4K?

2014-12-22 Thread Robert White
On 12/22/2014 03:58 PM, Richard Sharpe wrote: On Mon, Dec 22, 2014 at 3:55 PM, Robert White wrote: So I'll ask again... On 12/22/2014 03:15 PM, ronnie sahlberg wrote: On Mon, Dec 22, 2014 at 2:52 PM, Robert White wrote: So skipping the full ADS, what's the current demand/payoff

Re: Can BTRFS handle XATTRs larger than 4K?

2014-12-22 Thread Robert White
On 12/22/2014 02:55 PM, Richard Sharpe wrote: On Mon, Dec 22, 2014 at 2:52 PM, Robert White wrote: So skipping the full ADS, what's the current demand/payoff for large XATTR space? Windows Security Descriptors (sometimes incorrectly called ACLs) stored by Samba. Ah. I know that

Re: Can BTRFS handle XATTRs larger than 4K?

2014-12-22 Thread Robert White
So I'll ask again... On 12/22/2014 03:15 PM, ronnie sahlberg wrote: On Mon, Dec 22, 2014 at 2:52 PM, Robert White wrote: So skipping the full ADS, what's the current demand/payoff for large XATTR space? So skipping the full ADS, what is the current demand/payoff

Re: Can BTRFS handle XATTRs larger than 4K?

2014-12-22 Thread Robert White
On 12/22/2014 12:44 PM, Austin S Hemmelgarn wrote: On 2014-12-22 15:06, Richard Sharpe wrote: On Mon, Dec 22, 2014 at 10:43 AM, Chris Murphy wrote: On Mon, Dec 22, 2014 at 11:09 AM, Austin S Hemmelgarn wrote: Personally, I'd love to see unlimited length xattr's like NTFS and HFS+ do, as tha

Re: Oddly slow read performance with near-full largish FS

2014-12-21 Thread Robert White
On 12/21/2014 02:53 PM, Charles Cazabon wrote: Hi, Robert, My performance issues with btrfs are more-or-less resolved now -- the performance under btrfs still seems quite variable compared to other filesystems -- my rsync speed is now varying between 40MB and ~90MB/s, with occasional intervals

Re: Uncorrectable errors on RAID-1?

2014-12-21 Thread Robert White
On 12/21/2014 11:34 AM, constantine wrote: Some months ago I had 6 uncorrectable errors. I deleted the files that contained them and then after scrubbing I had 0 uncorrectable errors. After some weeks I encountered new uncorrectable errors. Question 1: Why do I have uncorrectable errors on a RAI

Re: Oddly slow read performance with near-full largish FS

2014-12-21 Thread Robert White
On 12/21/2014 08:32 AM, Charles Cazabon wrote: Hi, Robert, Thanks for the response. Many of the things you mentioned I have tried, but for completeness: Have you taken SMART (smartmotools etc) to these disks There are no errors or warnings from SMART for the disks. Do make sure you are

Re: btrfs is using 25% more disk than it should

2014-12-20 Thread Robert White
On 12/19/2014 01:10 PM, Josef Bacik wrote: On 12/18/2014 09:59 AM, Daniele Testa wrote: Hey, I am hoping you guys can shed some light on my issue. I know that it's a common question that people see differences in the "disk used" when running different calculations, but I still think that my iss

Re: btrfs is using 25% more disk than it should

2014-12-20 Thread Robert White
On 12/20/2014 03:39 AM, Josef Bacik wrote: On 12/20/2014 06:23 AM, Robert White wrote: On 12/19/2014 01:17 PM, Josef Bacik wrote: tl;dr: Cow means you can in the worst case end up using 2 * filesize - blocksize of data on disk and the file will appear to be filesize. Thanks, Doesn'

Re: btrfs is using 25% more disk than it should

2014-12-20 Thread Robert White
On 12/19/2014 01:17 PM, Josef Bacik wrote: tl;dr: Cow means you can in the worst case end up using 2 * filesize - blocksize of data on disk and the file will appear to be filesize. Thanks, Doesn't the worst case more like N^log(N) (when N is file in blocksize) in the pernicious case? Stagge

Re: Oddly slow read performance with near-full largish FS

2014-12-20 Thread Robert White
On 12/16/2014 06:42 PM, Charles Cazabon wrote: Hi, I've been running btrfs for various filesystems for a few years now, and have recently run into problems with a large filesystem becoming *really* slow for basic reading. None of the debugging/testing suggestions I've come across in the wiki or

Re: Oddly slow read performance with near-full largish FS

2014-12-20 Thread Robert White
On 12/19/2014 09:33 AM, Duncan wrote: Charles Cazabon posted on Fri, 19 Dec 2014 10:58:49 -0600 as excerpted: This configuration is one I've been using for many years. It's only recently that I've noticed it being particularly slow with btrfs -- I don't know if that's because the filesystem ha

Re: [PATCH 6/7] Print the summary

2014-12-17 Thread Robert White
On 12/16/2014 01:05 AM, Hugo Mills wrote: On Mon, Dec 15, 2014 at 07:47:06PM -0800, Robert White wrote: I prefer "slice", not that I am totally happy with that word either. But by the time you get through loopback devices, memory map devices, the "device files" tha

Re: Standards Problems [Was: [PATCH v2 1/3] Btrfs: get more accurate output in df command.]

2014-12-17 Thread Robert White
I don't disagree with the _ideal_ of your patch. I just think that it's impossible to implement it without lying to the user or making things just as bad in a different way. I would _like_ you to be right. But my thing is finding and quantifying failure cases and the entire question is full of

Re: Standards Problems [Was: [PATCH v2 1/3] Btrfs: get more accurate output in df command.]

2014-12-16 Thread Robert White
On 12/16/2014 03:30 AM, Dongsheng Yang wrote: Hi Robert, thanx for your proposal about this. IMHO, output of df command shoud be more friendly to user. Well, I think we have a disagreement on this point, let's take a look at what the zfs is doing. /dev/sda7- 10G /dev/sda8- 10G # zpool c

Re: Standards Problems [Was: [PATCH v2 1/3] Btrfs: get more accurate output in df command.]

2014-12-15 Thread Robert White
On 12/15/2014 07:30 PM, Robert White wrote: The above would be ideal. But POSIX says "no". f_blocks is defined (only Correction the linux kernel says "total data blocks", POSIX says "total blocks" -- it was a mental typo... 8-) in the comments) as "total data

Re: [PATCH 6/7] Print the summary

2014-12-15 Thread Robert White
On 12/15/2014 05:58 PM, Duncan wrote: * Please s/disk/device/, here and possibly elsewhere. I know I'm not the only one who is trying to make the switch in my own usage, as it looks a bit foolish (and/or marks the user as an old fogey who's likely to start lecturing about how a GiB isn't "small"

Standards Problems [Was: [PATCH v2 1/3] Btrfs: get more accurate output in df command.]

2014-12-15 Thread Robert White
On 12/15/2014 01:36 AM, Robert White wrote: So we don't just hand-wave over statfs(). We include the dev_item.bytes_excluded in the superblock and we decide once-and-for-all (with any geometry creation, or completed conversion) how many bytes just _can't_ be reached but only once we _

Re: [PATCH v2 1/3] Btrfs: get more accurate output in df command.

2014-12-15 Thread Robert White
On 12/15/2014 12:26 AM, Dongsheng Yang wrote: On 12/15/2014 03:49 PM, Robert White wrote: On 12/14/2014 10:06 PM, Robert White wrote: On 12/14/2014 05:21 PM, Dongsheng Yang wrote: Anyone have some suggestion about it? (... strong advocacy for raw numbers...) Hi Robert, thanx for your so

Re: btrfs receive being very slow

2014-12-15 Thread Robert White
On 12/14/2014 11:41 PM, Nick Dimov wrote: Hi, thanks for the answer, I will answer between the lines. On 15.12.2014 08:45, Robert White wrote: On 12/14/2014 08:50 PM, Nick Dimov wrote: Hello everyone! First, thanks for amazing work on btrfs filesystem! Now the problem: I use a ssd as my

Re: [PATCH v2 1/3] Btrfs: get more accurate output in df command.

2014-12-14 Thread Robert White
On 12/14/2014 10:06 PM, Robert White wrote: On 12/14/2014 05:21 PM, Dongsheng Yang wrote: Anyone have some suggestion about it? (... strong advocacy for raw numbers...) Concise Example to attempt to be clearer: /dev/sda == 1TiB /dev/sdb == 2TiB /dev/sdc == 3TiB /dev/sdd == 3TiB mkfs.btrfs

Re: btrfs receive being very slow

2014-12-14 Thread Robert White
On 12/14/2014 08:50 PM, Nick Dimov wrote: Hello everyone! First, thanks for amazing work on btrfs filesystem! Now the problem: I use a ssd as my system drive (/dev/sda2) and use daily snapshots on it. Then, from time to time, i sync those on HDD (/dev/sdb4) by using btrfs send / receive like th

Re: [PATCH v2 1/3] Btrfs: get more accurate output in df command.

2014-12-14 Thread Robert White
On 12/14/2014 05:21 PM, Dongsheng Yang wrote: Does it make sense to you? I understood what you were saying but it didn't make sense to me... As there are 2 complaints for the same change of @size in df, I have to say it maybe not so easy to understand. Anyone have some suggestion about it

Re: 3.18.0: kernel BUG at fs/btrfs/relocation.c:242!

2014-12-14 Thread Robert White
On 12/13/2014 03:56 PM, Robert White wrote: ... Dangit... On re-reading I think I was still less than optimally clear. I kept using the word "resent" when I should have been using a word like "re-written" or "re-stored" (as opposed to "restored"). On

  1   2   3   >