Re: [PATCH] btrfs: raid56: Use correct stolen pages to calculate P/Q

On Fri, Nov 25, 2016 at 3:31 PM, Zygo Blaxell wrote: > > This risk mitigation measure does rely on admins taking a machine in this > state down immediately, and also somehow knowing not to start a scrub > while their RAM is failing...which is kind of an annoying

Drive Replacement

) DD the contents of one of the 750G drives to a new 3T drive C) Remove the 750G from the system D) btrfs scan E) Mount array F) Run a balance I know that not physically removing the old copy of the drive will cause massive issues, but if I do that everything should be fine right? -- Gareth Pye

Re: Recommendation on raid5 drive error resolution

rro...@gmail.com> wrote: > On 2016-08-31 19:04, Gareth Pye wrote: >> >> ro,degraded has mounted it nicely and my rsync of the more useful data >> is progressing at the speed of WiFi. >> >> There are repeated read errors from one drive still but the rsync >> hasn't ba

Re: Recommendation on raid5 drive error resolution

right or is their likely to be corrupt data in the files I've synced off? On Wed, Aug 31, 2016 at 7:46 AM, Gareth Pye <gar...@cerberos.id.au> wrote: > Or I could just once again select the right boot device in the bios. I > think I want some new hardware :) > > On Wed, Aug 3

Re: Recommendation on raid5 drive error resolution

Or I could just once again select the right boot device in the bios. I think I want some new hardware :) On Wed, Aug 31, 2016 at 7:23 AM, Gareth Pye <gar...@cerberos.id.au> wrote: > On Wed, Aug 31, 2016 at 4:28 AM, Chris Murphy <li...@colorremedies.com> wrote: >> But I'd try

Re: Recommendation on raid5 drive error resolution

reluctant to fix that before at least confirming the things I at least partially care about have a recent backup. -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Australia -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to

Re: Recommendation on raid5 drive error resolution

Okay, things aren't looking good. The FS wont mount for me: http://pastebin.com/sEEdRxsN On Tue, Aug 30, 2016 at 9:01 AM, Gareth Pye <gar...@cerberos.id.au> wrote: > When I can get this stupid box to boot from an external drive I'll > have some idea of what is going on --

Re: Recommendation on raid5 drive error resolution

When I can get this stupid box to boot from an external drive I'll have some idea of what is going on -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at

Re: Recommendation on raid5 drive error resolution

Am I right that the wr: 0 means that the disks should at least be in a nice consistent state? I know that overlapping read fails can still cause everything to fail. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More

Re: Recommendation on raid5 drive error resolution

Current status: Knowing things were bad I did set the scterc values sanely, but the box was getting less stable so I thought a reboot was a good idea. That reboot failed to mount the partition at all and eveything triggered my 'is this a psu issue' sense so I've left the box off till I've got

Recommendation on raid5 drive error resolution

I only saw one disk having troubles I was concerned. Now I notice both sda and sdc having issues I'm thinking I might be about to have a bad time. What else should I provide? -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Australia -- To unsubscribe from this list: send

Re: checksum error in metadata node - best way to move root fs to new drive?

program, he is your master." Richard Stallman > > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the body of a message to majord...@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- Gareth Pye

Re: Question: raid1 behaviour on failure

PDF doc info dates it at 23/1/2013, which is the best guess that can easily be found. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Scrub priority, am I using it wrong?

scrub >> start -c3 /p >> >> CPU bound, 0% IOWait even at idle IO priority, in addition to the >> hundreds of M/s values per thread/device, here. You OTOH are showing >> under 20 M/s per thread/device on spinning rust, with an IOWait near 90%, >> thus making it IO bou

Re: Scrub priority, am I using it wrong?

ear 90%, > thus making it IO bound. And yes I'd love to switch to SSD, but 12 2TB drives is a bit pricey still -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Australia -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message

Re: Scrub priority, am I using it wrong?

now the idle class listed in iotop is idle, so I hope that means it will be more friendly to other processes. -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Australia -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to maj

Scrub priority, am I using it wrong?

upgrading, that is my usual kernel update strategy. # cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=14.04 DISTRIB_CODENAME=trusty DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS" Any other details that people would like to see that are relevant to this question? -- Gareth Pye - blog.cerb

Re: RAID 6 full, but there is still space left on some devices

ts, cancels, profile converts etc, worked >>> surprisingly well, compared to my experience a year back with RAID5 >>> (hitting bugs, crashes). >>> >>> A RAID6 full balance with this setup might be very slow, even if the >>> fs would be not so full. The VMs I use

Re: utils version and convert crash

block (6x1Gig=5Gig capacity). Meaning that the disks are likely to hit full during the convert. To avoid that I'm looping a convert with a block limit with a balance to target those blocks. The balance is pretty quick, but it does slow the process down. On Thu, Dec 3, 2015 at 9:14 AM, Gareth Pye

Re: Missing half of available space (resend)

created the btrfs partition, not the MythBuntu > installer. I don't remember if that was even an option. > > David > > > On Wed, 2015-12-09 at 14:28 -0700, Chris Murphy wrote: >> On Wed, Dec 9, 2015 at 12:56 PM, Gareth Pye <gar...@cerberos.id.au> wrote: >> > I wouldn'

Re: Missing half of available space (resend)

> > > -- > Chris Murphy > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the body of a message to majord...@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- Gareth Pye - blog.cerber

Re: utils version and convert crash

yet again... and again if there's a third scan required, >> etc. >> >> I'd say just make it automatic on corrected metadata errors as I can't >> think of a reason people wouldn't want it, given the time it would save >> over rerunning a full scrub over and over again, but

Re: utils version and convert crash

Thanks for that info, ram appears to be checking out fine and smartctl reported that the drives are old but one had some form of elevated error. Looks like I might be buying a new drive. On Wed, Dec 2, 2015 at 9:01 PM, Duncan <1i5t5.dun...@cox.net> wrote: > Gareth Pye posted on Wed, 02

Re: utils version and convert crash

log that looks like it's up to date but isn't that's awkward :( Building now from the github you mentioned. Also running a scrub, but I'm starting to suspect something else is responsible. It ran fine overnight but crashed in less than a minute after I logged back in on ssh this morning . . .

Re: utils version and convert crash

Looks like I have some issues. Going to confirm cables are all secure and run a memtest. On Wed, Dec 2, 2015 at 9:22 AM, Gareth Pye <gar...@cerberos.id.au> wrote: > Will do that once the scrub finishes/I get home from work. > > On Wed, Dec 2, 2015 at 7:30 AM, Austin S Hemmel

Re: utils version and convert crash

Poking around I just noticed that btrfs de stats /data points out that 3 of my drives have some read_io_errors. I'm guessing that is a bad thing. I assume this would indicate bad hardware and would be a likely cause of system crashes. :( On Tue, Dec 1, 2015 at 11:38 PM, Gareth Pye <

utils version and convert crash

obvious in them. -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Australia "Dear God, I would like to file a bug report" -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More maj

Re: BTRFS raid 5/6 status

hile that might be the intended final functionality I don't think balances are anywhere near that optimised currently. Starting with a relatively green format isn't a great option for a file system you intend to use for ever. -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Austral

Re: RAID1 storage server won't boot with one disk missing

> Duncan - List replies preferred. No HTML msgs. > "Every nonfree program has a lord, a master -- > and if you use the program, he is your master." Richard Stallman > > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the

Re: RAID0 wrong (raw) device?

mirrored across a local network, this is done with DRBD. At any one time only a single server has the 6 drives mounted with btrfs. Is this a ticking time bomb? -- Gareth Pye - blog.cerberos.id.au Level 2 MTG Judge, Melbourne, Australia Dear God, I would like to file a bug report -- To unsubscribe

Re: RAID0 wrong (raw) device?

lucky doesn't sound likely. On Fri, Aug 14, 2015 at 8:54 AM, Hugo Mills h...@carfax.org.uk wrote: On Fri, Aug 14, 2015 at 08:32:46AM +1000, Gareth Pye wrote: On Thu, Aug 13, 2015 at 9:44 PM, Austin S Hemmelgarn ahferro...@gmail.com wrote: 3. See the warnings about doing block level copies and LVM

Re: raid 1 to 10 conversion

://vger.kernel.org/majordomo-info.html -- Gareth Pye Level 2 MTG Judge, Melbourne, Australia Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http

Re: Did convert do anything?

converted filesystem were allocated, although many were empty. The reverted commit removed an allocation attempt in btrfs_set_block_group_ro(), but that fix wasn't right. After the reverted commit, the balance succeeds, but the data/metadata profiles aren't actually updated: -- Gareth Pye Level 2

Did convert do anything?

here? -- Gareth Pye Level 2 MTG Judge, Melbourne, Australia Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Did convert do anything?

1. # btrfs fi sh /data Label: none uuid: b2986e1a-0891-4779-960c-e01f7534c6eb Total devices 6 FS bytes used 4.41TiB devid1 size 1.81TiB used 1.48TiB path /dev/drbd0 devid2 size 1.81TiB used 1.48TiB path /dev/drbd1 devid3 size 1.81TiB used 1.48TiB path

Re: Did convert do anything?

I guess it might be relevant that this array was originally created as raid5 back in the early days of raid5 and converted to raid1 over a year ago. On Mon, May 25, 2015 at 2:00 PM, Gareth Pye gar...@cerberos.id.au wrote: 1. # btrfs fi sh /data Label: none uuid: b2986e1a-0891-4779-960c

Re: Did convert do anything?

Marheine Don't Panic -- Gareth Pye Level 2 MTG Judge, Melbourne, Australia Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo

Re: BTRFS crash after flac tag writing

unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- Gareth Pye Level 2 MTG Judge, Melbourne, Australia Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line

Re: btrfs convert running out of space

: Gareth Pye posted on Tue, 27 Jan 2015 14:24:03 +1100 as excerpted: Have gone with the move stuff off then finish convert plan. Convert has now finished and I'm 60% of the way through moving all the big files back on. Thanks for the help guys. Glad the big-file-move-off seems to have worked

Re: btrfs convert running out of space

Duncan 1i5t5.dun...@cox.net: Marc Joliet posted on Fri, 23 Jan 2015 08:54:41 +0100 as excerpted: Am Fri, 23 Jan 2015 04:34:19 + (UTC) schrieb Duncan 1i5t5.dun...@cox.net: Gareth Pye posted on Fri, 23 Jan 2015 08:58:08 +1100 as excerpted: What are the chances that splitting all

Re: btrfs convert running out of space

What are the chances that splitting all the large files up into sub gig pieces, finish convert, then recombine them all will work? On Wed, Jan 21, 2015 at 3:03 PM, Chris Murphy li...@colorremedies.com wrote: On Tue, Jan 20, 2015 at 4:04 PM, Gareth Pye gar...@cerberos.id.au wrote: Yeah, we don't

Re: btrfs convert running out of space

PS: the only snapshots are of apt-mirror, which doesn't have large files. On Fri, Jan 23, 2015 at 8:58 AM, Gareth Pye gar...@cerberos.id.au wrote: What are the chances that splitting all the large files up into sub gig pieces, finish convert, then recombine them all will work? On Wed, Jan 21

Re: btrfs convert running out of space

% usage (Plus presumably 3 mostly full blocks). That sounds like a bug. On Tue, Jan 20, 2015 at 10:45 AM, Gareth Pye gar...@cerberos.id.au wrote: Hi, I'm attempting to convert a btrfs filesystem from raid10 to raid1. Things had been going well through a couple of pauses and resumes, but last night

btrfs convert running out of space

that there is just lots of not particularly different relocating block group messages. Any ideas on what is going on here? -- Gareth Pye Level 2 MTG Judge, Melbourne, Australia Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body

Re: unfinished convert to raid6, enospc

to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- Gareth Pye Level 2 Judge, Melbourne, Australia Australian MTG Forum: mtgau.com gar...@cerberos.id.au - www.rockpaperdynamite.wordpress.com Dear God, I would like to file a bug report

Re: Impossible or Possible to Securely Erase File on Btrfs?

...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- Gareth Pye Level 2 Judge, Melbourne, Australia Australian MTG Forum: mtgau.com gar...@cerberos.id.au - www.rockpaperdynamite.wordpress.com Dear God, I would like to file a bug report -- To unsubscribe from this list

Re: Hybrid Storage proposal

benefit to putting one stripe of a raid0/5/6 into the SSD device without the rest of that data reaching the same level. Not that additional reasons to do this work in btrfs were needed it does need to be thought about how this implementation interacts with those features. -- Gareth Pye Level 2

Re: experimental raid5/6 code in git

from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- Gareth Pye Level 2 Judge, Melbourne, Australia Australian MTG Forum: mtgau.com gar...@cerberos.id.au

Re: experimental raid5/6 code in git

pretty sure you've compiled just the master branch of both linux-btrfs and btrfs-progs. On Mon, Feb 4, 2013 at 8:59 PM, Gareth Pye gar...@cerberos.id.au wrote: I felt like having a small play with this stuff, as I've been wanting it for so long :) But apparently I've made some incredibly newb

Re: RAID-[56]?

More testing usually means more bugs found etc… Yes, but releasing code before it's somewhat polished just generates a mountain of bug reports. Back in 2010 when I set up a server at work I was eagerly awaiting the RAID5 implementation that was just a couple of months away. Don't worry it

Upgrading from 2.6.38, how?

to confirm things look good B - mount read only, confirm that I can read files well C - mount read write, confirm working Install latest OS, upgrade to latest kernel, then repeat above steps. Any likely hiccups with the above procedure and suggested alternatives? -- Gareth Pye Level 2 Judge

Re: Feature request: true RAID-1 mode

:( -- Gareth Pye Level 2 Judge, Melbourne, Australia Australian MTG Forum: mtgau.com gar...@cerberos.id.au - www.rockpaperdynamite.wordpress.com Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord

Re: COW a file from snapshot

-- Gareth Pye Level 2 Judge, Melbourne, Australia Australian MTG Forum: mtgau.com gar...@cerberos.id.au - www.rockpaperdynamite.wordpress.com Dear God, I would like to file a bug report -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord