Aw: Re: Metadata size limitations of btrfs

2015-06-01 Thread Conchúr Navid
[...] Here the requested information of my fs (after removing a lot of build directories): franzbroetchen# uname -a Linux franzbroetchen 4.0.0-1-amd64 #1 SMP Debian 4.0.2-1 (2015-05-11) x86_64 GNU/Linux franzbroetchen# btrfs --version btrfs-progs v4.0 franzbroetchen# btrfs fi

Metadata size limitations of btrfs

2015-05-28 Thread conchur
=0 but it didn't help. The metadata size stayed at 10G and was filled up to nearly 10G. My question is: Can this metadata size limit be changed to allow more small files on the filesystem? And if yes, how? According to the kernel btrfs documentation, metadata_ratio= is currently off by default. So

Re: Metadata size limitations of btrfs

2015-05-28 Thread Hugo Mills
is the metadata. I've tried to run the balance command with -dusage=0 but it didn't help. The metadata size stayed at 10G and was filled up to nearly 10G. Try with -dusage=5, or with -dlimit=3. The kernel should be automatically freeing up completely empty chunks (i.e. usage=0), so

Btrfs performance problem; metadata size to blame?

2013-04-28 Thread John .
Hi guys, My Btrfs fs has a performance problem which I hope you can help me solve. I have a dataset of around 3.15 TiB, that has lived on a ZFS volume for almost two years (ZRAID1, 4 2TiB disks). In order to move to Btrfs I bought myself a 4TiB disk with the idea of buying a new one next week and

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread John .
I use Ubuntu with kernel 3.8.0-19-generic. I also tested with the latest live disk of Arch Linux; write performance was the same (bad). My mount options: rw,compress=lzo. Iotop does not show any strange disk activity. 2013/4/28 Harald Glatt m...@hachre.de: On Sun, Apr 28, 2013 at 9:10 PM, John

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread Harald Glatt
On Sun, Apr 28, 2013 at 9:18 PM, John . btrfsp...@gmail.com wrote: I use Ubuntu with kernel 3.8.0-19-generic. I also tested with the latest live disk of Arch Linux; write performance was the same (bad). My mount options: rw,compress=lzo. Iotop does not show any strange disk activity.

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread John .
and the metadata size also grew. No problems in that department either. ;-) 2013/4/28 Harald Glatt m...@hachre.de: On Sun, Apr 28, 2013 at 9:18 PM, John . btrfsp...@gmail.com wrote: I use Ubuntu with kernel 3.8.0-19-generic. I also tested with the latest live disk of Arch Linux; write performance

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread Harald Glatt
Because performance was good again I was able to spam the volume with data and the metadata size also grew. No problems in that department either. ;-) 2013/4/28 Harald Glatt m...@hachre.de: On Sun, Apr 28, 2013 at 9:18 PM, John . btrfsp...@gmail.com wrote: I use Ubuntu with kernel 3.8.0-19

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/04/13 12:57, Harald Glatt wrote: If you want better answers ... There is a lot of good information at the wiki and it does see regular updates. For example the performance mount options are on this page:

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread cwillu
On Sun, Apr 28, 2013 at 2:17 PM, Roger Binns rog...@rogerbinns.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/04/13 12:57, Harald Glatt wrote: If you want better answers ... There is a lot of good information at the wiki and it does see regular updates. For example the

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread cwillu
[how'd that send button get there] space_cache is the default, set by mkfs, for a year or so now. It's sticky, so even if it wasn't, you'd only need to mount with it once. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to

Re: Massive metadata size increase after upgrade from 3.2.18 to 3.4.1

2012-06-17 Thread Roman Mamedov
On Thu, 14 Jun 2012 13:33:16 +0200 David Sterba d...@jikos.cz wrote: On Sat, Jun 09, 2012 at 01:38:22AM +0600, Roman Mamedov wrote: Before the upgrade (on 3.2.18): Metadata, DUP: total=9.38GB, used=5.94GB After the FS has been mounted once with 3.4.1: Data: total=3.44TB,

Re: Massive metadata size increase after upgrade from 3.2.18 to 3.4.1

2012-06-14 Thread David Sterba
On Sat, Jun 09, 2012 at 01:38:22AM +0600, Roman Mamedov wrote: Before the upgrade (on 3.2.18): Metadata, DUP: total=9.38GB, used=5.94GB After the FS has been mounted once with 3.4.1: Data: total=3.44TB, used=2.67TB System, DUP: total=8.00MB, used=412.00KB System: total=4.00MB,

Re: Massive metadata size increase after upgrade from 3.2.18 to 3.4.1

2012-06-13 Thread Anand Jain
Did you try balance ? (also there is a balance option to pick the least utilized metadata chunks). in long run when you have the understanding of your files and sizes tuning using mount option metadata_ratio might help. but not sure how the metadata expanded to 84.38G was there any

Re: Massive metadata size increase after upgrade from 3.2.18 to 3.4.1

2012-06-12 Thread Calvin Walton
On Sat, 2012-06-09 at 01:38 +0600, Roman Mamedov wrote: Hello, Before the upgrade (on 3.2.18): Metadata, DUP: total=9.38GB, used=5.94GB After the FS has been mounted once with 3.4.1: Data: total=3.44TB, used=2.67TB System, DUP: total=8.00MB, used=412.00KB System: total=4.00MB,

Massive metadata size increase after upgrade from 3.2.18 to 3.4.1

2012-06-08 Thread Roman Mamedov
Hello, Before the upgrade (on 3.2.18): Metadata, DUP: total=9.38GB, used=5.94GB After the FS has been mounted once with 3.4.1: Data: total=3.44TB, used=2.67TB System, DUP: total=8.00MB, used=412.00KB System: total=4.00MB, used=0.00 Metadata, DUP: total=84.38GB, used=5.94GB Where did my 75 GB

Metadata size

2010-10-14 Thread Hugo Mills
I'm a little concerned about the size of my metadata. I'm doing raid10 on both data and metadata, and: h...@vlad:mnt $ sudo btrfs fi df /mnt Data: total=488.01GB, used=487.23GB Metadata: total=3.01GB, used=677.73MB System: total=11.88MB, used=52.00KB h...@vlad:mnt $ find /mnt | wc -l 20137