Re: write corruption due to bio cloning on raid5/6

2017-07-29 Thread Duncan
Janos Toth F. posted on Sun, 30 Jul 2017 03:39:10 +0200 as excerpted: [OT but related topic continues...] > I still get shivers if I need to resize a filesystems due to the > memories of those early tragic experiences when I never won the lottery > on the "trial and error" runs but lost filesyste

[PATCH v2] btrfs: preserve i_mode if __btrfs_set_acl() fails

2017-07-29 Thread Ernesto A . Fernández
When changing a file's acl mask, btrfs_set_acl() will first set the group bits of i_mode to the value of the mask, and only then set the actual extended attribute representing the new acl. If the second part fails (due to lack of space, for example) and the file had no acl attribute to begin with,

Re: write corruption due to bio cloning on raid5/6

2017-07-29 Thread Janos Toth F.
Reply to the TL;DR part, so TL;DR marker again... Well, I live on the other extreme now. I want as few filesystems as possible and viable (it's obviously impossible to have a real backup within the same fs and/or device and with the current size/performance/price differences between HDD and SSD, i

Re: 4.11.6 / more corruption / root 15455 has a root item with a more recent gen (33682) compared to the found root node (0)

2017-07-29 Thread Duncan
Imran Geriskovan posted on Sat, 29 Jul 2017 21:29:46 +0200 as excerpted: > On 7/9/17, Duncan <1i5t5.dun...@cox.net> wrote: >> I have however just upgraded to new ssds then wiped and setup the old >> ones as another backup set, so everything is on brand new filesystems on >> fast ssds, no possibil

Re: write corruption due to bio cloning on raid5/6

2017-07-29 Thread Duncan
Janos Toth F. posted on Sat, 29 Jul 2017 05:02:48 +0200 as excerpted: > The read-only scrub finished without errors/hangs (with kernel > 4.12.3). So, I guess the hangs were caused by: > 1: other bug in 4.13-RC1 > 2: crazy-random SATA/disk-controller issue > 3: interference between various btrfs to

Re: Best Practice: Add new device to RAID1 pool (Summary)

2017-07-29 Thread Cloud Admin
Am Montag, den 24.07.2017, 18:40 +0200 schrieb Cloud Admin: > Am Montag, den 24.07.2017, 10:25 -0400 schrieb Austin S. Hemmelgarn: > > On 2017-07-24 10:12, Cloud Admin wrote: > > > Am Montag, den 24.07.2017, 09:46 -0400 schrieb Austin S. > > > Hemmelgarn: > > > > On 2017-07-24 07:27, Cloud Admin wr

Re: [PATCH] btrfs-progs: eliminate bogus IOC_DEV_INFO call

2017-07-29 Thread Hans van Kranenburg
On 28/07/2017 11:49, Henk Slager wrote: On Thu, Jul 27, 2017 at 9:24 PM, Hans van Kranenburg wrote: Device ID numbers always start at 1, not at 0. The first IOC_DEV_INFO call does not make sense, since it will always return ENODEV. When there is a btrfs-replace ongoing, there is a Device ID 0

Re: 4.11.6 / more corruption / root 15455 has a root item with a more recent gen (33682) compared to the found root node (0)

2017-07-29 Thread Imran Geriskovan
On 7/9/17, Duncan <1i5t5.dun...@cox.net> wrote: > I have however just upgraded to new ssds then wiped and setup the old > ones as another backup set, so everything is on brand new filesystems on > fast ssds, no possibility of old undetected corruption suddenly > triggering problems. > > Also, all m

[PATCH v3 3/3] Btrfs: heuristic add byte core set calculation

2017-07-29 Thread Timofey Titovets
Calculate byte core set for data sample: Sort bucket's numbers in decreasing order Count how many numbers use 90% of sample If core set are low (<=25%), data are easily compressible If core set high (>=80%), data are not compressible Signed-off-by: Timofey Titovets --- fs/btrfs/compression.c | 5

[PATCH v3 2/3] Btrfs: heuristic add byte set calculation

2017-07-29 Thread Timofey Titovets
Calculate byte set size for data sample: Calculate how many unique bytes has been in sample By count all bytes in bucket with count > 0 If byte set low (~25%), data are easily compressible Signed-off-by: Timofey Titovets --- fs/btrfs/compression.c | 27 +++ fs/btrfs/compr

[PATCH v3 0/3] Btrfs: populate heuristic with detection logic

2017-07-29 Thread Timofey Titovets
Based on kdave for-next As heuristic skeleton already merged Populate heuristic with basic code. First patch: add simple sampling code It's get 16 byte samples with 256 bytes shifts over input data. Collect info about how many different bytes (symbols) has been found in sample data Second patch:

[PATCH v3 1/3] Btrfs: heuristic add simple sampling logic

2017-07-29 Thread Timofey Titovets
Get small sample from input data and calculate byte type count for that sample into bucket. Bucket will store info about which bytes and how many has been detected in sample Signed-off-by: Timofey Titovets --- fs/btrfs/compression.c | 24 ++-- fs/btrfs/compression.h | 10

Re: [PATCH v2 3/3] Btrfs: heuristic add byte core set calculation

2017-07-29 Thread Timofey Titovets
t; > url: > https://github.com/0day-ci/linux/commits/Timofey-Titovets/Btrfs-populate-heuristic-with-detection-logic/20170729-061208 > config: arm-arm5 (attached as .config) > compiler: arm-linux-gnueabi-gcc (Debian 6.1.1-9) 6.1.1 20160705 > reproduce: > wget > h

Re: [PATCH v2 3/3] Btrfs: heuristic add byte core set calculation

2017-07-29 Thread kbuild test robot
-populate-heuristic-with-detection-logic/20170729-061208 config: arm-arm5 (attached as .config) compiler: arm-linux-gnueabi-gcc (Debian 6.1.1-9) 6.1.1 20160705 reproduce: wget https://raw.githubusercontent.com/01org/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin

[PATCH v2] btrfs: use appropriate define for the fsid

2017-07-29 Thread Anand Jain
Though BTRFS_FSID_SIZE and BTRFS_UUID_SIZE or of same size, for the purpose of doing it correctly use BTRFS_FSID_SIZE instead. Signed-off-by: Anand Jain --- v2: Fix this for all remaining files. fs/btrfs/check-integrity.c | 2 +- fs/btrfs/disk-io.c | 6 +++--- fs/btrfs/scrub.c