Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Bill Kenworthy
On 19/01/15 22:08, Marc Stuermer wrote:
> Am 19.01.2015 um 12:02 schrieb Bill Kenworthy:
> 
>> Brilliant, you have hit on the answer! - The ancient 300GB system disk
>> was sda at one point and moved to sdb - possibly at the time I changed
>> to using UUID's.  Ive just resized all the disks and its now moved past
>> 300G for the first time as well as the other two falling in step with
>> the data moving.
> 
> Actually this is not my doing, I am not touching Btrfs at the moment
> with a ten foot pole yet because yet.
> 
> Russel Coker wrote about the problem you had, just take a look at it
> here and also mentioned the solution:
> 
> http://etbe.coker.com.au/2014/12/05/btrfs-status-dec-2014/
> 
> He had the same problem with a bigger drive. His Btrfs status updates
> are something I do follow indeed.
> 

Yes, I read those but failed to "connect the dots" :)

Balance almost done:

rattus backups # btrfs fi usage -T /mnt/btrfs-root/
Overall:
Device size:   5.46TiB
Device allocated:  3.81TiB
Device unallocated:1.65TiB
Used:  3.80TiB
Free (estimated):843.92GiB  (min: 843.92GiB)
Data ratio:   2.00
Metadata ratio:   2.00
Global reserve:  512.00MiB  (used: 97.84MiB)

   DataMetadata System
 singleRAID1   RAID1RAID1 Unallocated

/dev/sda - 1.26TiB  6.00GiB  32.00MiB   562.99GiB
/dev/sdc - 1.26TiB  8.00GiB -   562.02GiB
/dev/sdd - 1.27TiB  4.00GiB  32.00MiB   561.99GiB
 = ===  = ===
Total512.00MiB 1.90TiB  9.00GiB  32.00MiB 1.65TiB
Used  97.84MiB 1.90TiB  6.42GiB 304.00KiB
rattus backups #



Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Marc Stuermer
Am 19.01.2015 um 12:02 schrieb Bill Kenworthy:

> Brilliant, you have hit on the answer! - The ancient 300GB system disk
> was sda at one point and moved to sdb - possibly at the time I changed
> to using UUID's.  Ive just resized all the disks and its now moved past
> 300G for the first time as well as the other two falling in step with
> the data moving.

Actually this is not my doing, I am not touching Btrfs at the moment
with a ten foot pole yet because yet.

Russel Coker wrote about the problem you had, just take a look at it
here and also mentioned the solution:

http://etbe.coker.com.au/2014/12/05/btrfs-status-dec-2014/

He had the same problem with a bigger drive. His Btrfs status updates
are something I do follow indeed.



Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Bill Kenworthy
On 19/01/15 18:45, Marc Stürmer wrote:
> Am 19.01.2015 um 09:32 schrieb Bill Kenworthy:
> 
>> Can someone suggest what is causing a balance on this raid 1, 3 disk
>> volume to successfully complete but leave the data unevenly distributed?
>>   Content is mostly VM images.
>>
>> sdc and sdd are 2TB WD greens, and sda is a 2TB WD red.
> 
> Question: was /dev/sda a smaller HDD before the 2 TB WD red?
> 
> If your sda was around 250 GB before you changed it with 2 TB, did you
> just issue a "btrfs balance" after that? If so, Btrfs just configured
> itself for 2*2 TB + 1*250 GB, that's why.
> 
> The proper Btrfs way if replacing a smaller hdd for a bigger one in Raid
> 1 is to issue "btrfs filesystem resize" to make it use all of the
> available space.
> 
> This would be one possible explanation for the behaviour of your array.
> 

Brilliant, you have hit on the answer! - The ancient 300GB system disk
was sda at one point and moved to sdb - possibly at the time I changed
to using UUID's.  Ive just resized all the disks and its now moved past
300G for the first time as well as the other two falling in step with
the data moving.

I moved to UUID's as the machine has a number of sata ports and a PCI-e
sata adaptor and the sd* drive numbering kept moving around when I added
the WD red.

BillK





Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Bill Kenworthy
On 19/01/15 17:46, Marc Stürmer wrote:
> 
> Zitat von Bill Kenworthy :
> 
>> Can someone suggest what is causing a balance on this raid 1, 3 disk
>> volume to successfully complete but leave the data unevenly distributed?
>>  Content is mostly VM images.
> 
> On which kernel version are you?
> 

3.17.7 ... will move to 3.18 tomorrow as there are some brtfs fixes, but
nothing that would relate to this problem which I think has been present
for quite awhile.

BillK




Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Marc Stürmer

Am 19.01.2015 um 09:32 schrieb Bill Kenworthy:


Can someone suggest what is causing a balance on this raid 1, 3 disk
volume to successfully complete but leave the data unevenly distributed?
  Content is mostly VM images.

sdc and sdd are 2TB WD greens, and sda is a 2TB WD red.


Question: was /dev/sda a smaller HDD before the 2 TB WD red?

If your sda was around 250 GB before you changed it with 2 TB, did you 
just issue a "btrfs balance" after that? If so, Btrfs just configured 
itself for 2*2 TB + 1*250 GB, that's why.


The proper Btrfs way if replacing a smaller hdd for a bigger one in Raid 
1 is to issue "btrfs filesystem resize" to make it use all of the 
available space.


This would be one possible explanation for the behaviour of your array.



Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Marc Stürmer


Zitat von Bill Kenworthy :


Can someone suggest what is causing a balance on this raid 1, 3 disk
volume to successfully complete but leave the data unevenly distributed?
 Content is mostly VM images.


On which kernel version are you?



Re: [gentoo-user] btrfs fails to balance

2015-01-19 Thread Marc Joliet
Am Mon, 19 Jan 2015 16:32:53 +0800
schrieb Bill Kenworthy :

> Can someone suggest what is causing a balance on this raid 1, 3 disk
> volume to successfully complete but leave the data unevenly distributed?
>  Content is mostly VM images.
> 
> sdc and sdd are 2TB WD greens, and sda is a 2TB WD red.
>
>
> rattus backups # btrfs fi sh
> Label: none  uuid: 04d8ff4f-fe19-4530-ab45-d82fcd647515
> Total devices 1 FS bytes used 8.25GiB
> devid1 size 271.36GiB used 23.04GiB path /dev/sdb3
> 
> Label: none  uuid: f5a284b6-442f-4b3d-aa1a-8d6296f517b1
> Total devices 3 FS bytes used 1.90TiB
> devid1 size 1.82TiB used 1.77TiB path /dev/sdc
> devid2 size 1.82TiB used 1.77TiB path /dev/sdd
> devid4 size 1.82TiB used 270.03GiB path /dev/sda
> 
> Btrfs v3.18
> rattus backups #  btrfs fi df /mnt/btrfs-root/
> Data, RAID1: total=1.90TiB, used=1.89TiB
> System, RAID1: total=32.00MiB, used=464.00KiB
> Metadata, RAID1: total=8.00GiB, used=6.53GiB
> GlobalReserve, single: total=512.00MiB, used=0.00B
> rattus backups # btrfs fi usage /mnt/btrfs-root/
> Overall:
> Device size:   5.46TiB
> Device allocated:  3.81TiB
> Device unallocated:1.65TiB
> Used:  3.80TiB
> Free (estimated):845.00GiB  (min: 845.00GiB)
> Data ratio:   2.00
> Metadata ratio:   2.00
> Global reserve:  512.00MiB  (used: 154.42MiB)
> 
> Data,RAID1: Size:1.90TiB, Used:1.89TiB
>/dev/sda  265.00GiB
>/dev/sdc1.77TiB
>/dev/sdd1.77TiB


OK, that is odd.  While my experience with BTRFS RAID1 was that the FS is never
perfectly balanced, this is just... weird.

If I were you, I would ask on the BTRFS ML.

> Metadata,RAID1: Size:9.00GiB, Used:6.96GiB
>/dev/sda6.00GiB
>/dev/sdc7.00GiB
>/dev/sdd5.00GiB

This I would see as perfectly possible with BTRFS RAID1.

> System,RAID1: Size:32.00MiB, Used:464.00KiB
>/dev/sda   32.00MiB
>/dev/sdd   32.00MiB
> 
> Unallocated:
>/dev/sda1.55TiB
>/dev/sdc   47.02GiB
>/dev/sdd   47.99GiB
> rattus backups #

HTH
-- 
Marc Joliet
--
"People who think they know everything really annoy those of us who know we
don't" - Bjarne Stroustrup


pgp7pIeqKAaqm.pgp
Description: Digitale Signatur von OpenPGP