Re: Replicate snapshot to second machine fails

2015-02-08 Thread cwillu
This isn't a btrfs-send or a btrfs-receive question: $ echo hi | ssh machine.local sudo echo test sudo: no tty present and no askpass program specified How were you planning on providing credentials to sudo? On Sun, Feb 8, 2015 at 9:17 AM, Thomas Schneider wrote: > > > Hi, > > I want to replica

Re: [RFC][PATCH v2] mount.btrfs helper

2014-11-30 Thread cwillu
M, Dimitri John Ledkov wrote: > On 30 November 2014 at 22:31, cwillu wrote: >> >> In ubuntu, the initfs runs a btrfs dev scan, which should catch >> anything that would be missed there. >> > > I'm sorry, udev rule(s) is not sufficient in the initramfs-less

Re: [RFC][PATCH v2] mount.btrfs helper

2014-11-30 Thread cwillu
In ubuntu, the initfs runs a btrfs dev scan, which should catch anything that would be missed there. On Sun, Nov 30, 2014 at 4:11 PM, Dimitri John Ledkov wrote: > Hello, > > On 30 November 2014 at 17:43, Goffredo Baroncelli wrote: >> Hi all, >> >> this patch provides a "mount.btrfs" helper for t

Re: TEST PING

2014-10-12 Thread cwillu
On Sun, Oct 12, 2014 at 2:45 PM, royy walls wrote: > > -- http://www.tux.org/lkml/#s3 "Test" messages are very, very inappropriate on the lkml or any other list, for that matter. If you want to know whether the subscribe succeeded, wait for a couple of hours after you get a reply from the mailin

Re: What is the vision for btrfs fs repair?

2014-10-10 Thread cwillu
If -o recovery is necessary, then you're either running into a btrfs bug, or your hardware is lying about when it has actually written things to disk. The first case isn't unheard of, although far less common than it used to be, and it should continue to improve with time. In the second case, you

Re: [PATCH RFC] btrfs-progs: Add simple python front end to the search ioctl

2014-09-23 Thread cwillu
Damn you gmail... -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH RFC] btrfs-progs: Add simple python front end to the search ioctl

2014-09-23 Thread cwillu
On Tue, Sep 23, 2014 at 10:39 AM, Chris Mason wrote: > > This is a starting point for a debugfs style python interface using > the search ioctl. For now it can only do one thing, which is to > print out all the extents in a file and calculate the compression ratio. > > Over time it will grow more

Re: [systemd-devel] Slow startup of systemd-journal on BTRFS

2014-06-16 Thread cwillu
It's not a mmap problem, it's a small writes with an msync or fsync after each one problem. For the case of sequential writes (via write or mmap), padding writes to page boundaries would help, if the wasted space isn't an issue. Another approach, again assuming all other writes are appends, would

Re: [systemd-devel] Slow startup of systemd-journal on BTRFS

2014-06-15 Thread cwillu
ch write, with or without fallocating the file first. Looking at the fiemap output while doing either of those, you'll see a new 4k extent being made, and then the physical location of that extent will increment until the writes move on to the next 4k extent. cwillu@cwillu-home:~/work/btrfs/e2fs$ tou

Re: [PATCH 24/27] btrfs-progs: Convert man page for btrfs-zero-log

2014-04-05 Thread cwillu
On Fri, Apr 4, 2014 at 12:46 PM, Marc MERLIN wrote: > On Wed, Apr 02, 2014 at 04:29:35PM +0800, Qu Wenruo wrote: >> Convert man page for btrfs-zero-log >> >> Signed-off-by: Qu Wenruo >> --- >> Documentation/Makefile | 2 +- >> Documentation/btrfs-zero-log.txt | 39 >>

Re: Building a brtfs filesystem < 70M?

2014-03-10 Thread cwillu
Have you tried the -M option to mkfs.btrfs? I'm not sure if we select it automatically (or if we do, whether you have recent enough tools to have that). -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo in

Re: [Repost] Is BTRFS "bedup" maintained ?

2014-03-05 Thread cwillu
Bedup was/is a third-party project, not sure if its developer follows this list. Might be worth filing a bug or otherwise poking the author on https://github.com/g2p/bedup On Wed, Mar 5, 2014 at 2:43 PM, Marc MERLIN wrote: > On Wed, Mar 05, 2014 at 06:24:40PM +0100, Swāmi Petaramesh wrote: >> H

Re: No space left on device (again)

2014-02-25 Thread cwillu
Try btrfs filesystem balance start -dusage=15 /home, and gradually increase it until you see it relocate at least one chunk. On Tue, Feb 25, 2014 at 2:27 PM, Marcus Sundman wrote: > On 25.02.2014 22:19, Hugo Mills wrote: >> >> On Tue, Feb 25, 2014 at 01:05:51PM -0500, Jim Salter wrote: >>> >>> 37

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
On Mon, Feb 10, 2014 at 7:02 PM, Roger Binns wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 10/02/14 10:24, cwillu wrote: >> The regular df data used number should be the amount of space required >> to hold a backup of that content (assuming that the back

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
> In the past [1] I proposed the following approach. > > $ sudo btrfs filesystem df /mnt/btrfs1/ > Disk size: 400.00GB > Disk allocated:8.04GB > Disk unallocated:391.97GB > Used: 11.29MB > Free (Estimated):250.45GB (Max: 396.99GB,

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
>> IMO, used should definitely include metadata, especially given that we >> inline small files. >> >> I can convince myself both that this implies that we should roll it >> into b_avail, and that we should go the other way and only report the >> actual used number for metadata as well, so I might

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
insanity here. On Mon, Feb 10, 2014 at 12:28 PM, Josef Bacik wrote: > > > On 02/10/2014 01:24 PM, cwillu wrote: >> >> I concur. >> >> The regular df data used number should be the amount of space required >> to hold a backup of that content (assuming th

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
I concur. The regular df data used number should be the amount of space required to hold a backup of that content (assuming that the backup maintains reflinks and compression and so forth). There's no good answer for available space; the statfs syscall isn't rich enough to cover all the bases eve

Re: Provide a better free space estimate on RAID1

2014-02-08 Thread cwillu
Everyone who has actually looked at what the statfs syscall returns and how df (and everyone else) uses it, keep talking. Everyone else, go read that source code first. There is _no_ combination of values you can return in statfs which will not be grossly misleading in some common scenario that s

Re: Are nocow files snapshot-aware

2014-02-06 Thread cwillu
On Thu, Feb 6, 2014 at 6:32 PM, Kai Krakow wrote: > Duncan <1i5t5.dun...@cox.net> schrieb: > >>> Ah okay, that makes it clear. So, actually, in the snapshot the file is >>> still nocow - just for the exception that blocks being written to become >>> unshared and relocated. This may introduce a lot

Re: BTRFS corrupted by combination of mistreatment of hiberantion and accidental power loss.

2014-01-29 Thread cwillu
You'd have been better off to just throw away the hiberated image: mounting the filesystem would look like any other recovery from a crash, and would have replayed the log and committed a new transaction, in addition to whatever other disk writes happened due to boot logs and so forth. In this cas

Re: btrfs and ECC RAM

2014-01-17 Thread cwillu
On Fri, Jan 17, 2014 at 6:23 PM, Ian Hinder wrote: > Hi, > > I have been reading a lot of articles online about the dangers of using ZFS > with non-ECC RAM. Specifically, the fact that when good data is read from > disk and compared with its checksum, a RAM error can cause the read data to > b

Re: Subvolume creation returns file exists

2013-11-15 Thread cwillu
On Fri, Nov 15, 2013 at 9:27 AM, Hugo Mills wrote: > On Fri, Nov 15, 2013 at 02:33:58PM +, Alin Dobre wrote: >> We are using btrfs filesystems in our infrastructure and, at some >> point of time, they start refusing to create new subvolumes. >> >> Each file system is being quota initialized im

Re: Odp: Re: Odp: Btrfs might be gradually slowing the boot process

2013-11-08 Thread cwillu
On Fri, Nov 8, 2013 at 1:46 PM, Hugo Mills wrote: > On Fri, Nov 08, 2013 at 08:37:37PM +0100, y...@wp.pl wrote: >> Sure; >> >> the kernel line from grub.cfg: >> linux /boot/vmlinuz-linux root=UUID=c26e6d9a-0bbb-436a-a217-95c738b5b9c6 >> rootflags=noatime,space_cache rw quiet > >OK, this may

Re: btrfs and default directory link count

2013-11-08 Thread cwillu
On Fri, Nov 8, 2013 at 5:07 AM, Andreas Schneider wrote: > Hello, > > I did run the Samba testsuite and have a failing test > (samba.vfstest.stream_depot). It revealed that it only fails on btrfs. The > reason is that a simple check fails: > > if (smb_fname_base->st.st_ex_nlink == 2) > > If you cr

Re: btrfsck errors is it save to fix?

2013-11-04 Thread cwillu
On Mon, Nov 4, 2013 at 3:14 PM, Hendrik Friedel wrote: > Hello, > > the list was quite full with patches, so this might have been hidden. > Here the complete Stack. > Does this help? Is this what you needed? >> [95764.899294] CPU: 1 PID: 21798 Comm: umount Tainted: GFCIO >> 3.11.0-031100rc

Re: btrfsck errors is it save to fix?

2013-11-02 Thread cwillu
> Now that I am searching, I see this in dmesg: > [95764.899359] [] free_fs_root+0x99/0xa0 [btrfs] > [95764.899384] [] btrfs_drop_and_free_fs_root+0x93/0xc0 > [btrfs] > [95764.899408] [] del_fs_roots+0xcf/0x130 [btrfs] > [95764.899433] [] close_ctree+0x146/0x270 [btrfs] > [95764.899461] [] btr

Re: kernel BUG at fs/btrfs/relocation.c:1060 during rebalancing

2013-10-06 Thread cwillu
Another user has just reported this in irc on 3.11.2 kernel BUG at fs/btrfs/relocation.c:1055! invalid opcode: [#1] SMP Modules linked in: ebtable_nat nf_conntrack_netbios_ns nf_conntrack_broadcast ipt_MASQUERADE ip6table_nat nf_nat_ipv6 ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag

Re: [PATCH] Drop unused parameter from btrfs_item_nr

2013-09-17 Thread cwillu
On Mon, Sep 16, 2013 at 8:58 AM, Ross Kirk wrote: > Unused parameter cleanup > > Ross Kirk (1): > btrfs: drop unused parameter from btrfs_item_nr > > fs/btrfs/backref.c|2 +- > fs/btrfs/ctree.c | 34 +- > fs/btrfs/ctree.h | 13 ++---

Re: Manual deduplication would be useful

2013-07-23 Thread cwillu
On Tue, Jul 23, 2013 at 9:47 AM, Rick van Rein wrote: > Hello, > > For over a year now, I've been experimenting with stacked filesystems as a > way to save on resources. A basic OS layer is shared among Containers, each > of which stacks a layer with modifications on top of it. This approach m

Re: raid 10 corruption from single drive failure

2013-06-29 Thread cwillu
> Making this with all 6 devices from the beginning and btrfsck doesn't > segfault. But it also doesn't repair the system enough to make it > mountable. ( nether does -o recover, however -o degraded works, and > files > are then accessible ) Not sure I entirely follow: mounting with -o degraded (n

Re: My multi-device btrfs (3*2TB) won't mount anymore.

2013-06-18 Thread cwillu
Does anything show up in dmesg when you mount? If mount just hangs, do an alt-sysrq-w, and then post what that sends to dmesg. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.

Re: raid0, raid1, raid5, what to choose?

2013-06-13 Thread cwillu
On Thu, Jun 13, 2013 at 3:21 PM, Hugo Mills wrote: > On Thu, Jun 13, 2013 at 11:09:00PM +0200, Hendrik Friedel wrote: >> Hello, >> >> I'd appreciate your recommendation on this: >> >> I have three hdd with 3TB each. I intend to use them as raid5 eventually. >> currently I use them like this: >> >>

Re: Recommended settings for SSD

2013-05-26 Thread cwillu
On Sun, May 26, 2013 at 9:16 AM, Harald Glatt wrote: > I don't know a better way to check than doing df -h before and > after... If you use space_cache you have to clear_cache though to make > the numbers be current for sure each time before looking at df. Not sure what you're thinking of; space_

Re: Recommended settings for SSD

2013-05-24 Thread cwillu
> At the moment I am using: > defaults,noatime,nodiratime,ssd,subvol=@home No need to specify ssd, it's automatically detected. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel

Re: hard freezes with 3.9.0 during io-intensive loads

2013-05-05 Thread cwillu
ened. I wonder if it is useful to >> you and where to send it. I just don't want to upload jpegs right here to >> the list without asking first. >> >> The big plus is: Altough I had to hard-reset the frozen system several >> times now, btrfs survived the procedure

Re: Panic while running defrag

2013-04-29 Thread cwillu
On Mon, Apr 29, 2013 at 9:20 PM, Stephen Weinberg wrote: > I ran into a panic while running find -xdev | xargs brtfs fi defrag '{}'. I > don't remember the exact command because the history was not saved. I also > started and stopped it a few times however. > > The kernel logs were on a different

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread cwillu
[how'd that send button get there] space_cache is the default, set by mkfs, for a year or so now. It's sticky, so even if it wasn't, you'd only need to mount with it once. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.o

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread cwillu
On Sun, Apr 28, 2013 at 2:17 PM, Roger Binns wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 28/04/13 12:57, Harald Glatt wrote: >> If you want better answers ... > > There is a lot of good information at the wiki and it does see regular > updates. For example the performance moun

Re: scrub "correcting" tons of errors ?

2013-03-29 Thread cwillu
> Actually instead of netconsole we have an awesome service provided by Carey, > you > can just do > > nc cwillu.com 10101 < /dev/kmsg ... at a root prompt. > after you've run sysrq+w and then reply with the URL it spits out. Thanks, -- To unsubscribe from this list: send the line "unsubscribe

Re: minimum kernel version for btrfsprogs.0.20?

2013-03-28 Thread cwillu
On Thu, Mar 28, 2013 at 11:41 PM, Chris Murphy wrote: > Creating a btrfs file system using > btrfs-progs-0.20.rc1.20130308git704a08c-1.fc19, and either kernel > 3.6.10-4.fc18 or 3.9.0-0.rc3.git0.3.fc19, makes a file system that cannot be > mounted by kernel 3.6.10-4.fc18. It can be mounted by k

Re: question about replacing a drive in raid10

2013-03-28 Thread cwillu
On Thu, Mar 28, 2013 at 1:54 AM, Joeri Vanthienen wrote: > Hi all, > > I have a question about replacing a drive in raid10 (and linux kernel 3.8.4). > A bad disk was physical removed from the server. After this a new disk > was added with "btrfs device add /dev/sdg /btrfs" to the raid10 btrfs > FS

Re: No space left on device (28)

2013-03-21 Thread cwillu
On Fri, Mar 22, 2013 at 12:39 AM, Stefan Priebe - Profihost AG wrote: > Already tried with value 5 did not help ;-( and it also happens with plain cp > copying a 15gb file and aborts at about 80% You tried -musage=5? Your original email said -dusage=5. -- To unsubscribe from this list: send the

Re: No space left on device (28)

2013-03-21 Thread cwillu
On Fri, Mar 22, 2013 at 12:13 AM, Roman Mamedov wrote: > On Thu, 21 Mar 2013 20:42:28 +0100 > Stefan Priebe wrote: > > I might be wrong here, but doesn't this > >> rsync: rename >> "/mnt/.software/kernel/linux-3.9-rc3/drivers/infiniband/hw/amso1100/"" >> -> >> ".software/kernel/linux-3.9-rc3/driv

Re: How to recover uncorrectable errors ?

2013-03-20 Thread cwillu
>> # rm -rf * >> rm: cannot remove 'drivers/misc/lis3lv02d/lis3lv02d.c': Stale NFS file handle >> rm: cannot remove 'drivers/misc/lis3lv02d/lis3lv02d.c': Stale NFS file handle >> rm: cannot remove 'drivers/misc/lis3lv02d/lis3lv02d.c': Stale NFS file handle >> rm: cannot remove 'drivers/misc/lis3lv0

Re: Btrfs in multiple different disc -d sigle -m raid1 one drive failure...

2013-03-18 Thread cwillu
On Mon, Mar 18, 2013 at 12:32 PM, Jan Beranek wrote: > Hi all, > I'm preparing a strorage pool for large data with quite low importance > - there will be at least 3 hdd in "-d single" and "-m raid1" > configuration. > > mkfs.btrfs -d single -m raid1 /dev/sda /dev/sdb /dec/sdc > > What happen if on

Re: multiple btrfsck runs

2013-03-16 Thread cwillu
On Sat, Mar 16, 2013 at 6:44 AM, Marc MERLIN wrote: > On Sat, Mar 16, 2013 at 06:24:47AM -0600, cwillu wrote: >> On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker wrote: >> > Is it expected that running btrfsck more than once will keep reporting >> > errors? >> >

Re: multiple btrfsck runs

2013-03-16 Thread cwillu
On Sat, Mar 16, 2013 at 6:46 AM, Russell Coker wrote: > On Sat, 16 Mar 2013, cwillu wrote: >> On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker wrote: >> > Is it expected that running btrfsck more than once will keep reporting >> > errors? >> >> Without opti

Re: multiple btrfsck runs

2013-03-16 Thread cwillu
On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker wrote: > Is it expected that running btrfsck more than once will keep reporting errors? Without options, btrfsck does not write to the disk. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord.

Re: Drive low space / huge performance hit.

2013-03-07 Thread cwillu
On Thu, Mar 7, 2013 at 11:05 AM, Steve Heyns wrote: > hi > > I am using compression lzo on my 350GB partition, I have 2 subvolumes > on this partition. My kernel is 3.7 BTRFS v0.19 - > > According to my system (df -h) that partition has 75Gb available. > According to btrfs > > btrfs fi df /mnt/Dev

Re: Does defragmenting even work

2013-02-28 Thread cwillu
On Thu, Feb 28, 2013 at 8:35 AM, Swâmi Petaramesh wrote: > BTW... > > I'm not even sure that "btrfs filesystem defrag " actually > does anything... > > If I run "filefrag " afterwards, it typically shows the same > number of fragments that it did prior to running defrag... > > I'm not sure about h

Re: copy on write misconception

2013-02-22 Thread cwillu
On Fri, Feb 22, 2013 at 11:41 AM, Mike Power wrote: > On 02/22/2013 09:16 AM, Hugo Mills wrote: >> >> On Fri, Feb 22, 2013 at 09:11:28AM -0800, Mike Power wrote: >>> >>> I think I have a misconception of what copy on write in btrfs means >>> for individual files. >>> >>> I had originally thought t

Re: copy on write misconception

2013-02-22 Thread cwillu
> Then if I copied this file no blocks would be copied until they are written. > Hence the two files would use the same blocks underneath. But specifically > that copy would be fast. Since it would only need to write some metadata. > But when I copy the file: > time cp 10G 10G2 cp without argumen

Re: Fwd: Current State of BTRFS

2013-02-08 Thread cwillu
On Fri, Feb 8, 2013 at 4:56 PM, Florian Hofmann wrote: > Oh ... I should have mentioned that btrfs is running on top of LUKS. > > 2013/2/8 Florian Hofmann : >> $ btrfs fi df / >> Data: total=165.00GB, used=164.19GB >> System, DUP: total=32.00MB, used=28.00KB >> System: total=4.00MB, used=0.00 >> M

Re: System unmountable RW

2013-02-01 Thread cwillu
> then I do : mount -o rw,remount /backup/ > > Feb 1 22:32:38 frozen kernel: [ 65.780686] btrfs: force zlib compression > Feb 1 22:32:38 frozen kernel: [ 65.780700] btrfs: not using ssd allocation > scheme > Feb 1 22:32:38 frozen kernel: [ 65.780706] btrfs: disk space caching is > enable

Re: [RFC] Abort on memory allocation failure

2013-01-25 Thread cwillu
On Fri, Jan 25, 2013 at 4:55 PM, Ian Kumlien wrote: > Hi, > > Could someone do a sanity check of this, i have removed some of the > checking code that is no longer needed but i would prefer to have > reviewers. I haven't looked much at the code, mainly been focusing on > the grunt work ;) > > Anyw

Re: [PATCH] Btrfs-progs: Exit if not running as root

2013-01-25 Thread cwillu
going to > explore doing something for that case. And it also might be reasonable for > some situations to issue the message about root if something errors-out. Eh? That's one of the clearest cases where you _may not_ need root. cwillu@cwillu-home:~$ groups cwillu adm dialout cdr

Re: scrub questtion

2013-01-15 Thread cwillu
On Tue, Jan 15, 2013 at 8:21 AM, Gene Czarcinski wrote: > When you start btrfs scrub and point at one subvolume, what is "scrubbed"? > > Just that subvolume or the entire volume? The entire volume. -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message

Re: obscure out of space, df and fi df are way off

2013-01-11 Thread cwillu
>>> [root@localhost tmp]# df >>> Filesystem 1K-blocksUsed Available Use% Mounted on >>> /dev/sda33746816 3193172 1564 100% /mnt/sysimage >>> /dev/sda1 495844 31509438735 7% >>> /mnt/sysimage/boot >>> /dev/sda3

Re: obscure out of space, df and fi df are way off

2013-01-11 Thread cwillu
On Fri, Jan 11, 2013 at 11:50 PM, Chris Murphy wrote: > Very low priority. > No user data at risk. > 8GB virtual disk being installed to, and the installer is puking. I'm trying > to figure out why. > > I first get an rsync error 12, followed by the installer crashing. What's > interesting is th

Re: Option LABEL

2013-01-03 Thread cwillu
On Thu, Jan 3, 2013 at 11:57 AM, Helmut Hullen wrote: > But other filesystems don't put the label onto more than 1 device. > There's the problem for/with btrfs. Other filesystems don't exist on more than one device, so of course they don't put a label on more than one device. -- To unsubscribe fr

Re: parent transid verify failed on -- After moving btrfs closer to the beginning of drive with dd

2012-12-29 Thread cwillu
On Sat, Dec 29, 2012 at 7:14 AM, Jordan Windsor wrote: > Also here's the output of btrfs-find-root: > > ./btrfs-find-root /dev/sdb1 > Super think's the tree root is at 1229060866048, chunk root 1259695439872 > Went past the fs size, exiting > > Not sure where to go from here. I can't say for cert

Re: parent transid verify failed on -- After moving btrfs closer to the beginning of drive with dd

2012-12-28 Thread cwillu
On Fri, Dec 28, 2012 at 12:09 PM, Jordan Windsor wrote: > Hello, > I moved my btrfs to the beginning of my drive & updated the partition > table & also restarted, I'm currently unable to mount it, here's the > output in dmesg. > > [ 481.513432] device label Storage devid 1 transid 116023 /dev/sdb

Re: HIT WARN_ON WARNING: at fs/btrfs/extent-tree.c:6339 btrfs_alloc_free_block+0x126/0x330 [btrfs]()

2012-12-19 Thread cwillu
On Wed, Dec 19, 2012 at 9:12 AM, Rock Lee wrote: > Hi all, > > Did someone have met this problem before. When doing the tests, I hit > > the WARN_ON. Is this log make sense or someone had fixed the problem. > > If needed, I can supply the detail log and the testcase source file. That'd be go

Re: btrfs subvolume snapshot performance problem

2012-12-18 Thread cwillu
On Tue, Dec 18, 2012 at 7:06 AM, Sylvain Alain wrote: > So, if I don't use the discard command, how often do I need to run the > fstrim command ? If your ssd isn't a pile of crap, never. SSD's are always over-provisioned, and so every time an erase block fills up, the drive knows that there must

Re: unmountable partition and live distro (no space left)

2012-12-16 Thread cwillu
Try booting with bootflags=ro,recovery in grub (with the latest possible kernel), or mounting with -o recovery from the livecd (likewise). If it works, then you're done, you should be able to boot normally after a clean umount and shutdown. If it doesn't, post dmesg from the attempt. > I'v been

Re: Intel 120G SSD write performance with 3.2.0-4-amd64

2012-12-15 Thread cwillu
On Sat, Dec 15, 2012 at 5:23 PM, Russell Coker wrote: > I've got a system running Debian kernel 3.2.0-4-amd64 with root on a SSD that > identifies itself as "INTEL SSDSC2CT12 300i" (it's an Intel 120G device). 3.2 is massively old in btrfs terms, with lots of fun little stability and performance

Re: Encryption

2012-12-12 Thread cwillu
On Wed, Dec 12, 2012 at 2:06 PM, wrote: > On Wed, Dec 12, 2012, at 10:48, cwillu wrote: >> Sayeth the FAQ: > > Oh pardon me, it's BTRFS RAID that's a no-go, which is just as critical > to me as I have a 4 disk 8TB arra

Re: Encryption

2012-12-12 Thread cwillu
On Wed, Dec 12, 2012 at 12:38 PM, wrote: > > On Wed, Dec 12, 2012, at 10:31, Mitch Harder wrote: >> I run btrfs on top of LUKS encryption on my laptop. You should be able to >> do the same. >> >> You could then run rsync through ssh. However, rsync will have no knowledge >> of any blocks shar

Re: Can't mount luks partition after reboot

2012-12-03 Thread cwillu
On Mon, Dec 3, 2012 at 7:22 PM, Travis LaDuke wrote: > This is kind of silly, but may be salvageable... > I made a btrfs on top of luks partition and tried it for a couple days. Then > I made another luks partition on another drive then added and balanced that > new drive as btrfs raid1. A lot of

Re: High-sensitivity fs checker (not repairer) for btrfs

2012-11-10 Thread cwillu
On Sat, Nov 10, 2012 at 4:32 PM, Bob Marley wrote: > On 11/10/12 22:23, Hugo Mills wrote: >> >> The closest thing is btrfsck. That's about as picky as we've got to >> date. >> >> What exactly is your use-case for this requirement? > > > We need a decently-available system. We can rollback

Re: (late) REQUEST: Default mkfs.btrfs block size

2012-11-05 Thread cwillu
On Mon, Nov 5, 2012 at 10:06 AM, David Sterba wrote: > On Wed, Oct 31, 2012 at 12:20:39PM +, Alex wrote: >> As one 'stuck' with 4k leaves on my main machine for the moment, can I >> request >> the btrfs-progs v0.20 defaults to more efficient decent block sizes before >> release. Most distro i

Re: [PATCH][BTRFS-PROGS] Enhance btrfs fi df

2012-11-03 Thread cwillu
> do you have more information about raid ? When it will land on the btrfs > earth ? :-) An unnamed source recently said "today I'm fixing parity rebuild in the middle of a read/modify/write. its one of my last blockers", at which point several gags about progress meters were made. -- To unsubscri

Re: What's the minimum size I can shrink my FS to?

2012-11-02 Thread cwillu
Run "btrfs balance start -musage=1 -dusage=1", and then try it again. This may require update btrfs tools however. On Fri, Nov 2, 2012 at 10:09 PM, Jordan Windsor wrote: > Hello, > I'm trying to shrink my Btrfs filesystem to the smallest size it can > go, here's the information: > > failed to rea

Re: [Request for review] [RFC] Add label support for snapshots and subvols

2012-11-01 Thread cwillu
> Below is a demo of this new feature. > > btrfs fi label -t /btrfs/sv1 "Prod-DB" > > btrfs fi label -t /btrfs/sv1 > Prod-DB > > btrfs su snap /btrfs/sv1 /btrfs/snap1-sv1 > Create a snapshot of '/btrfs/sv1' in '/btrfs/snap1-sv1' > btrfs fi label -t /btrfs/snap1-sv1 > > btrfs fi la

Re: Why btrfs inline small file by default?

2012-10-31 Thread cwillu
On Wed, Oct 31, 2012 at 4:48 AM, Ahmet Inan wrote: >>> i also dont see any benefit from inlining small files: > >>> with defaults (inlining small files): >>> real4m39.253s >>> Data: total=10.01GB, used=9.08GB >>> Metadata, DUP: total=2.00GB, used=992.48MB > >>> without inline: >>> real4m42

Re: Why btrfs inline small file by default?

2012-10-31 Thread cwillu
On Wed, Oct 31, 2012 at 2:48 AM, Ahmet Inan wrote: > i also dont see any benefit from inlining small files: > with defaults (inlining small files): > real4m39.253s > Data: total=10.01GB, used=9.08GB > Metadata, DUP: total=2.00GB, used=992.48MB > without inline: > real4m42.085s > Data: to

Re: Why btrfs inline small file by default?

2012-10-30 Thread cwillu
On Tue, Oct 30, 2012 at 5:47 PM, ching wrote: > On 10/31/2012 06:19 AM, Hugo Mills wrote: >> On Tue, Oct 30, 2012 at 10:14:12PM +, Hugo Mills wrote: >>> On Wed, Oct 31, 2012 at 05:40:25AM +0800, ching wrote: >>>> On 10/30/2012 08:17 PM, cwillu wrote: >>&g

Re: Why btrfs inline small file by default?

2012-10-30 Thread cwillu
On Tue, Oct 30, 2012 at 3:40 PM, ching wrote: > On 10/30/2012 08:17 PM, cwillu wrote: >>>> If there is a lot of small files, then the size of metadata will be >>>> undesirable due to deduplication >>> >>> Yes, that is a fact, but if that really matters

Re: Why btrfs inline small file by default?

2012-10-30 Thread cwillu
>> If there is a lot of small files, then the size of metadata will be >> undesirable due to deduplication > > > Yes, that is a fact, but if that really matters depends on the use-case > (e.g., the small files to large files ratio, ...). But as btrfs is designed > explicitly as a general purpose fi

Re: btrfs defrag problem

2012-10-30 Thread cwillu
On Tue, Oct 30, 2012 at 5:47 AM, ching wrote: > Hi all, > > I try to defrag my btrfs root partition (run by root privilege) > > find / -type f -o -type d -print0 | xargs --null --no-run-if-empty btrfs > filesystem defragment -t $((32*1024*1024)) > > > 1. This kind of error messages is prompted: >

Re: Naming of subvolumes

2012-10-26 Thread cwillu
On Fri, Oct 26, 2012 at 9:54 AM, Chris Murphy wrote: > > On Oct 26, 2012, at 2:27 AM, Richard Hughes wrote: > > >>> And if you're going to apply the upgrade to the snapshot, or to the top >>> level file system? >> >> That's a very good question. I was going to apply the upgrade to the >> top lev

Re: [RFC] New attempt to a better "btrfs fi df"

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 8:33 PM, Chris Murphy wrote: > So what's the intended distinction between 'fi df' and 'fi show'? Because for > months using btrfs I'd constantly be confused which command was going to show > me what information I wanted, and that tells me there should be some better > di

Re: [RFC] New attempt to a better "btrfs fi df"

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 2:36 PM, Chris Murphy wrote: > My suggestion is that by default a summary similar to the existing df command > be mimicked, where it makes sense, for btrfs fi df. > > - I like the Capacity %. If there is a reliable equivalent, it need not be > inode based, that would be

Re: [RFC] New attempt to a better "btrfs fi df"

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 2:03 PM, Chris Murphy wrote: > > On Oct 25, 2012, at 1:21 PM, Goffredo Baroncelli wrote: >> >> Moreover I still didn't understand how btrfs was using the disks. > > This comment has less to do with the RFC, and more about user confusion in a > specific case of the existin

Re: [RFC] New attempt to a better "btrfs fi df"

2012-10-25 Thread cwillu
>>> Allocated_area: >>> Data,RAID0: Size:921.75MB, Used:256.00KB >>> /dev/vdc 307.25MB >>> /dev/vdb 307.25MB >>> /dev/vdd 307.25MB >>> >>> Data,Single: Size:8.00MB, Used:0.00 >>> /dev/vdb 8.00MB >>> >>> System,RAID1: Size:8.00MB, Used:4.00KB >>> /dev

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 1:58 PM, Marc MERLIN wrote: > Howdy, > > I can wait a day or maybe 2 before I have to wipe and restore from backup. > Please let me know if you have a patch against 3.6.3 you'd like me to try > to mount/recover this filesystem, or whether you'd like me to try btrfsck. > > >

Re: [RFC] New attempt to a better "btrfs fi df"

2012-10-25 Thread cwillu
> I don't publish the patched because aren't in a good shape. However I > really like the output. The example is a filesystem based on three > disks of 3GB. > > It is clear that: > - - RAID0 uses all the disks > - - RAID1 uses two different disks > > Comments are welcome. > > Known bugs: > - - if a

Re: btrfs seems to do COW while inode has NODATACOW set

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 12:35 PM, Alex Lyakas wrote: > Hi everybody, > I need some help understanding the nodatacow behavior. > > I have set up a large file (5GiB), which has very few EXTENT_DATAs > (all are real, not bytenr=0). The file has NODATASUM and NODATACOW > flags set (flags=0x3): >

Re: [PATCH 2/2] Btrfs: do not delete a subvolume which is in a R/O subvolume

2012-10-24 Thread cwillu
On Wed, Oct 24, 2012 at 4:03 AM, Miao Xie wrote: > On Mon, 22 Oct 2012 05:57:12 -0600, cwillu wrote: >> On Mon, Oct 22, 2012 at 5:39 AM, Miao Xie wrote: >>> Step to reproduce: >>> # mkfs.btrfs >>> # mount >>> # btrfs sub create /subv0 >

Re: [PATCH 2/2] Btrfs: do not delete a subvolume which is in a R/O subvolume

2012-10-22 Thread cwillu
On Mon, Oct 22, 2012 at 5:39 AM, Miao Xie wrote: > Step to reproduce: > # mkfs.btrfs > # mount > # btrfs sub create /subv0 > # btrfs sub snap /subv0/snap0 > # change /subv0 from R/W to R/O > # btrfs sub del /subv0/snap0 > > We deleted the snapshot successfully. I think we should not be a

Re: unrecognized mount option 'compression=lzo' and defragment -c errors

2012-10-20 Thread cwillu
> 1. I also added mount option 'compression=lzo' and 'io_cache' to /home at > first. Neither io_cache nor compression=lzo are options that exist. You probably meant compress=lzo for the first, but I really don't know what you wanted for io_cache (inode_cache? that's not really a performance thi

Re: Weird Warning

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 3:51 PM, Jérôme Poulin wrote: > After updating to 3.5.5, I get thi on boot and listing some dir freezes. > I don't have anything important on that volume but I'm willing to > debug the problem if needed. Would I need a more recent kernel? Probably worth trying 3.7-rc1, or

Re: Weird Warning

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 2:54 PM, Jérôme Poulin wrote: > I've got this weird WARNING in my system log on a freshly created FS, > I'm using ACL with Samba, this is the only difference I could tell > from any other FSes. It is also using Debian's Wheezy kernel which is > quite old. Should I just igno

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 1:02 PM, Marguerite Su wrote: > On Sat, Oct 20, 2012 at 2:35 AM, cwillu wrote: >> Without space_cache (once), btrfs has to repopulate that information >> the slow way every mount; with it, it can just load the data from the >> last unmount (modulo so

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 12:33 PM, Marguerite Su wrote: > On Sat, Oct 20, 2012 at 2:26 AM, cwillu wrote: >> That would work, but it's only necessary to mount with it once (and >> it's probably been done already with /home), hence the -o >> remount,space_cache

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 11:02 AM, Marguerite Su wrote: > On Sat, Oct 20, 2012 at 12:55 AM, cwillu wrote: >> It appears space_cache isn't enabled on your rootfs; can you do a >> "mount / -o remount,space_cache", sync a couple times, make some >> coffee, and

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 10:18 AM, Marguerite Su wrote: > On Fri, Oct 19, 2012 at 11:41 PM, cwillu wrote: >> Also, next time just put the output directly in the email, that way >> it's permanently around to look at and search for. > > Hi, > > I did it. here'

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 9:28 AM, Marguerite Su wrote: > On Thu, Oct 18, 2012 at 9:28 PM, Chris Mason wrote: >> If it isn't the free space cache, it'll be a fragmentation problem. The >> easiest way to tell the difference is to get a few sysrq-w snapshots >> during the boot. > > Hi, Chris, > > wi

Re: BTRFS filesystem is not mountable after crash

2012-10-13 Thread cwillu
On Sat, Oct 13, 2012 at 11:51 AM, Alfred Zastrow wrote: > Am 26.08.2012 08:17, schrieb Liu Bo: > >> On 08/26/2012 01:27 PM, Alfred Zastrow wrote: >> >> >> Hello, >> >> has realy nobody a hint for me? >> >> Is compiling chris's latest for-linus helpful? >> >> git://git.kernel.org/pub/scm/linux/kern

  1   2   3   >