Re: 40TB volume taking over 16 hours to mount, any ideas?

2014-08-10 Thread Duncan
Mitch Harder posted on Sat, 09 Aug 2014 23:57:19 -0500 as excerpted: On Sat, Aug 9, 2014 at 11:21 PM, Duncan 1i5t5.dun...@cox.net wrote: So by the time of actual .0 release, [the kernel] really is quite stable, and no longer development kernel. I can't say I've observed that to be the case

Re: 40TB volume taking over 16 hours to mount, any ideas?

2014-08-10 Thread Duncan
Jose Ildefonso Camargo Tolosa posted on Sat, 09 Aug 2014 22:58:37 -0500 as excerpted: Do you think I will have better luck with 3.16? or maybe it is that this filesystem has so many errors (remember the btrfs check output) that it will take a really long time to mount because it is trying to

Re: 40TB volume taking over 16 hours to mount, any ideas?

2014-08-10 Thread Timofey Titovets
Jose, I add my 50 cents, i know, what you want backup data from raid through network and what you have only 11 TB data from 40 TB fs As i now, you can safety resize btrfs fs, without btrfs fi resize, something like that: $ btrfs fi df / Data, single: total=81.00GiB, used=60.33GiB System, DUP:

Re: 40TB volume taking over 16 hours to mount, any ideas?

2014-08-10 Thread Duncan
Timofey Titovets posted on Sun, 10 Aug 2014 11:50:39 +0300 as excerpted: Jose, I add my 50 cents, i know, what you want backup data from raid through network and what you have only 11 TB data from 40 TB fs As i now, you can safety resize btrfs fs, without btrfs fi resize, something like that:

Re: Fixing the btrfs deadlocks

2014-08-10 Thread Marc MERLIN
On Sun, Aug 10, 2014 at 12:43:31PM +, Holger Hoffstätte wrote: On Sat, 09 Aug 2014 11:21:13 -0700, Marc MERLIN wrote: I sure hope that deadlock patch is going to be added to the 3.16.x tree, I'm not super stocked with being stuck at 3.14. Let me try to re-stoke your enthusiasm a bit

Re: [PATCH] Btrfs: fix compressed write corruption on enospc

2014-08-10 Thread Liu Bo
On Thu, Aug 07, 2014 at 10:02:15AM -0400, Chris Mason wrote: On 08/07/2014 04:20 AM, Miao Xie wrote: On Thu, 7 Aug 2014 15:50:30 +0800, Liu Bo wrote: [90496.156016] kworker/u8:14 D 880044e38540 0 21050 2 0x [90496.157683] Workqueue: btrfs-delalloc

Re: Fixing the btrfs deadlocks

2014-08-10 Thread Marc MERLIN
On Sun, Aug 10, 2014 at 03:42:09PM +, Holger Hoffstätte wrote: On Sun, 10 Aug 2014 07:39:00 -0700, Marc MERLIN wrote: My apologies if I missed some Emails, but I'm a bit confused. The deadlocks happen reliably with 3.15+, but those patches are marked as being for 3.14 in your URL, but

Re: ENOSPC with mkdir and rename

2014-08-10 Thread Martin Steigerwald
Am Dienstag, 5. August 2014, 14:58:34 schrieb Clemens Eisserer: Hi Russel, The Debian installer has BTRFS in a list of filesystems to choose with no special notice about it. I'm thinking of filing a Debian bug requesting that they put a warning against it. As long as it is not

Re: ENOSPC with mkdir and rename

2014-08-10 Thread Martin Steigerwald
Am Montag, 4. August 2014, 11:09:23 schrieb Peter Waller: On 4 August 2014 10:39, Chris Samuel ch...@csamuel.org wrote: On Mon, 4 Aug 2014 09:14:19 AM Peter Waller wrote: All of this is *very* surprising. Hmm, it shouldn't be, the ENOSPC issues are well known and have been discussed

Ideas for a feature implementation

2014-08-10 Thread Vimal A R
Hello, I came across the to-do list at https://btrfs.wiki.kernel.org/index.php/Project_ideas and would like to know if this list is updated and recent. I am looking for a project idea for my under graduate degree which can be completed in around 3-4 months. Are there any suggestions and ideas

Re: [BUG] btrfs send/receive, page allocation failure

2014-08-10 Thread Chris Murphy
On Aug 7, 2014, at 9:31 AM, Chris Murphy li...@colorremedies.com wrote: # btrfs send /mnt/320G/2012april_HDD_fullbackup.ro.0/ | btrfs receive /mnt/500G/ At subvol /mnt/320G/2012april_HDD_fullbackup.ro.0/ At subvol 2012april_HDD_fullbackup.ro.0 ERROR: send ioctl failed with -12: Cannot

[PATCH] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Filipe Manana
Maximum xattr size can be up to nearly the leaf size. For an fs with a leaf size larger than the page size, using kmalloc requires allocating multiple pages that are contiguous, which might not be possible if there's heavy memory fragmentation. Therefore fallback to vmalloc if we fail to allocate

Re: [BUG] btrfs send/receive, page allocation failure

2014-08-10 Thread Filipe David Manana
On Sun, Aug 10, 2014 at 10:01 PM, Chris Murphy li...@colorremedies.com wrote: On Aug 7, 2014, at 9:31 AM, Chris Murphy li...@colorremedies.com wrote: # btrfs send /mnt/320G/2012april_HDD_fullbackup.ro.0/ | btrfs receive /mnt/500G/ At subvol /mnt/320G/2012april_HDD_fullbackup.ro.0/ At

Re: [PATCH] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Josef Bacik
Sigh I can only top post from my phone. Instead of using contig_bug just use is_vmalloc_addr. Thanks, Josef Filipe Manana fdman...@suse.com wrote: Maximum xattr size can be up to nearly the leaf size. For an fs with a leaf size larger than the page size, using kmalloc requires allocating

Re: [PATCH] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Filipe David Manana
On Mon, Aug 11, 2014 at 12:52 AM, Josef Bacik jba...@fb.com wrote: Sigh I can only top post from my phone. Instead of using contig_bug just use is_vmalloc_addr. Thanks, Thanks Josef, I wasn't aware of that helper function. Josef Filipe Manana fdman...@suse.com wrote: Maximum xattr

[RFC PATCH] btrfs-progs: Move btrfstune to btrfs device tune

2014-08-10 Thread Timofey Titovets
Good time of day, According to https://btrfs.wiki.kernel.org/index.php/Project_ideas#btrfs Quote: merge functionality of btrfstune, eg. under btrfs dev set-seed /dev/ (discuss the command name though) This patch is just code move After, user can tune btrfs parameters through: btrfs dev tune

[PATCH v2] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Filipe Manana
Maximum xattr size can be up to nearly the leaf size. For an fs with a leaf size larger than the page size, using kmalloc requires allocating multiple pages that are contiguous, which might not be possible if there's heavy memory fragmentation. Therefore fallback to vmalloc if we fail to allocate

Re: [PATCH v2] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Josef Bacik
Sorry one more thing, just do krealloc instead of the kfrww+kmalloc. Thanks, Josef Filipe Manana fdman...@suse.com wrote: Maximum xattr size can be up to nearly the leaf size. For an fs with a leaf size larger than the page size, using kmalloc requires allocating multiple pages that are

[PATCH v3] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Filipe Manana
Maximum xattr size can be up to nearly the leaf size. For an fs with a leaf size larger than the page size, using kmalloc requires allocating multiple pages that are contiguous, which might not be possible if there's heavy memory fragmentation. Therefore fallback to vmalloc if we fail to allocate

[PATCH v4] Btrfs: send, lower mem requirements for processing xattrs

2014-08-10 Thread Filipe Manana
Maximum xattr size can be up to nearly the leaf size. For an fs with a leaf size larger than the page size, using kmalloc requires allocating multiple pages that are contiguous, which might not be possible if there's heavy memory fragmentation. Therefore fallback to vmalloc if we fail to allocate

btrfs-progs: random fixes for usage string of btrfs scrub

2014-08-10 Thread Satoru Takeuchi
From: Satoru Takeuchi takeuchi_sat...@jp.fujitsu.com - Add missing description about -R option in the command usage of btrfs scrub resume. - Add missing comma to avoid the following misformatted command usage of btrfs scrub start. See the line of -R option. === usage: btrfs scrub start

btrfs-progs: add missing descriptions of '--max-errors' in btrfs-receive documentation

2014-08-10 Thread Satoru Takeuchi
From: Satoru Takeuchi takeuchi_sat...@jp.fujitsu.com Fix the lack of description of --max-erros option in both man and command usage of btrfs receive. Signed-off-by: Satoru Takeuchi takeuchi_sat...@jp.fujitsu.com --- Documentation/btrfs-receive.txt | 2 +- cmds-receive.c | 4

Re: Ideas for a feature implementation

2014-08-10 Thread Austin S Hemmelgarn
On 08/10/2014 03:21 PM, Vimal A R wrote: Hello, I came across the to-do list at https://btrfs.wiki.kernel.org/index.php/Project_ideas and would like to know if this list is updated and recent. I am looking for a project idea for my under graduate degree which can be completed in

Re: [BUG] btrfs send/receive, page allocation failure

2014-08-10 Thread Chris Murphy
Can you try the following patch and confirm if it helps? https://patchwork.kernel.org/patch/4705171/ This one applies without problems, I didn't build it because I saw v4. The v4 patch I get: + patch -p1 -F1 -s 4 out of 4 hunks FAILED -- saving rejects to file fs/btrfs/send.c.rej Should