Re: btrfs performance, sudden drop to 0 IOPs

2015-02-13 Thread P. Remek
Yes, it was implemented for the purpose of allowing an application to implement its own caching - probably for the sole purpose of doing it better or more efficient. But it simply does not work out that well, at least with COW fs. The original idea performance is more or less eaten away in a

Re: btrfs performance, sudden drop to 0 IOPs

2015-02-13 Thread P. Remek
We did benchmark Btrfs aio/dio performance before, we noticed one big differences from COW and nocow is not only checksum but checksum cost more metadata, which will make Btrfs performance drop suddenly for a while, because of metadata reservation. I mounted the filesystem with nodatacow

btrfs performance, sudden drop to 0 IOPs

2015-02-09 Thread P. Remek
Hello, I am benchmarking Btrfs and when benchmarking random writes with fio utility, I noticed following two things: 1) On first run when target file doesn't exist yet, perfromance is about 8000 IOPs. On second, and every other run, performance goes up to 7 IOPs. Its massive difference. The

Re: btrfs performance, sudden drop to 0 IOPs

2015-02-09 Thread P. Remek
=563.72MiB Metadata, single: total=8.00MiB, used=0.00 unknown, single: total=192.00MiB, used=0.00 On Mon, Feb 9, 2015 at 8:56 PM, Kai Krakow hurikha...@gmail.com wrote: P. Remek p.rem...@googlemail.com schrieb: Hello, I am benchmarking Btrfs and when benchmarking random writes with fio utility

Re: btrfs performance - ssd array

2015-01-15 Thread P. Remek
Hello, Could you check how many extents with BTRFS and Ext4: # filefrag test1 So my findings are odd: On BTRFS when I run fio with a single worker thread (target file is 12GB large,and its 100% random write of 4kb blocks), then number of extents reported by filefrag is around 3. However when

btrfs performance - ssd array

2015-01-12 Thread P. Remek
Hello, we are currently investigating possiblities and performance limits of the Btrfs filesystem. Now it seems we are getting pretty poor performance for the writes and I would like to ask, if our results makes sense and if it is a result of some well known performance bottleneck. Our setup:

Re: btrfs performance - ssd array

2015-01-12 Thread P. Remek
also that we did some performance tuning ( queue scheduling set to noop, irq affinity distribution and pinning to specific numa nodes and cores etc.) Regards, Premek On Mon, Jan 12, 2015 at 3:54 PM, Austin S Hemmelgarn ahferro...@gmail.com wrote: On 2015-01-12 08:51, P. Remek wrote: Hello, we