Re: Replicate snapshot to second machine fails

2015-02-08 Thread cwillu
This isn't a btrfs-send or a btrfs-receive question: $ echo hi | ssh machine.local sudo echo test sudo: no tty present and no askpass program specified How were you planning on providing credentials to sudo? On Sun, Feb 8, 2015 at 9:17 AM, Thomas Schneider c.mo...@web.de wrote: Hi, I want

Re: [RFC][PATCH v2] mount.btrfs helper

2014-11-30 Thread cwillu
In ubuntu, the initfs runs a btrfs dev scan, which should catch anything that would be missed there. On Sun, Nov 30, 2014 at 4:11 PM, Dimitri John Ledkov x...@debian.org wrote: Hello, On 30 November 2014 at 17:43, Goffredo Baroncelli kreij...@libero.it wrote: Hi all, this patch provides a

Re: [RFC][PATCH v2] mount.btrfs helper

2014-11-30 Thread cwillu
wrote: On 30 November 2014 at 22:31, cwillu cwi...@cwillu.com wrote: In ubuntu, the initfs runs a btrfs dev scan, which should catch anything that would be missed there. I'm sorry, udev rule(s) is not sufficient in the initramfs-less case, as outlined. In case of booting with initramfs

Re: TEST PING EOM

2014-10-12 Thread cwillu
On Sun, Oct 12, 2014 at 2:45 PM, royy walls ckn...@gmail.com wrote: -- http://www.tux.org/lkml/#s3 Test messages are very, very inappropriate on the lkml or any other list, for that matter. If you want to know whether the subscribe succeeded, wait for a couple of hours after you get a reply

Re: What is the vision for btrfs fs repair?

2014-10-10 Thread cwillu
If -o recovery is necessary, then you're either running into a btrfs bug, or your hardware is lying about when it has actually written things to disk. The first case isn't unheard of, although far less common than it used to be, and it should continue to improve with time. In the second case,

Re: [PATCH RFC] btrfs-progs: Add simple python front end to the search ioctl

2014-09-23 Thread cwillu
On Tue, Sep 23, 2014 at 10:39 AM, Chris Mason c...@fb.com wrote: This is a starting point for a debugfs style python interface using the search ioctl. For now it can only do one thing, which is to print out all the extents in a file and calculate the compression ratio. Over time it will

Re: [PATCH RFC] btrfs-progs: Add simple python front end to the search ioctl

2014-09-23 Thread cwillu
Damn you gmail... -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [systemd-devel] Slow startup of systemd-journal on BTRFS

2014-06-16 Thread cwillu
It's not a mmap problem, it's a small writes with an msync or fsync after each one problem. For the case of sequential writes (via write or mmap), padding writes to page boundaries would help, if the wasted space isn't an issue. Another approach, again assuming all other writes are appends, would

Re: [systemd-devel] Slow startup of systemd-journal on BTRFS

2014-06-15 Thread cwillu
fallocating the file first. Looking at the fiemap output while doing either of those, you'll see a new 4k extent being made, and then the physical location of that extent will increment until the writes move on to the next 4k extent. cwillu@cwillu-home:~/work/btrfs/e2fs$ touch /tmp/test f=open('/tmp

Re: [PATCH 24/27] btrfs-progs: Convert man page for btrfs-zero-log

2014-04-05 Thread cwillu
On Fri, Apr 4, 2014 at 12:46 PM, Marc MERLIN m...@merlins.org wrote: On Wed, Apr 02, 2014 at 04:29:35PM +0800, Qu Wenruo wrote: Convert man page for btrfs-zero-log Signed-off-by: Qu Wenruo quwen...@cn.fujitsu.com --- Documentation/Makefile | 2 +-

Re: Building a brtfs filesystem 70M?

2014-03-10 Thread cwillu
Have you tried the -M option to mkfs.btrfs? I'm not sure if we select it automatically (or if we do, whether you have recent enough tools to have that). -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo

Re: [Repost] Is BTRFS bedup maintained ?

2014-03-05 Thread cwillu
Bedup was/is a third-party project, not sure if its developer follows this list. Might be worth filing a bug or otherwise poking the author on https://github.com/g2p/bedup On Wed, Mar 5, 2014 at 2:43 PM, Marc MERLIN m...@merlins.org wrote: On Wed, Mar 05, 2014 at 06:24:40PM +0100, Swāmi

Re: No space left on device (again)

2014-02-25 Thread cwillu
Try btrfs filesystem balance start -dusage=15 /home, and gradually increase it until you see it relocate at least one chunk. On Tue, Feb 25, 2014 at 2:27 PM, Marcus Sundman sund...@iki.fi wrote: On 25.02.2014 22:19, Hugo Mills wrote: On Tue, Feb 25, 2014 at 01:05:51PM -0500, Jim Salter wrote:

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
I concur. The regular df data used number should be the amount of space required to hold a backup of that content (assuming that the backup maintains reflinks and compression and so forth). There's no good answer for available space; the statfs syscall isn't rich enough to cover all the bases

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
insanity here. On Mon, Feb 10, 2014 at 12:28 PM, Josef Bacik jba...@fb.com wrote: On 02/10/2014 01:24 PM, cwillu wrote: I concur. The regular df data used number should be the amount of space required to hold a backup of that content (assuming that the backup maintains reflinks and compression

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
IMO, used should definitely include metadata, especially given that we inline small files. I can convince myself both that this implies that we should roll it into b_avail, and that we should go the other way and only report the actual used number for metadata as well, so I might just plead

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
In the past [1] I proposed the following approach. $ sudo btrfs filesystem df /mnt/btrfs1/ Disk size: 400.00GB Disk allocated:8.04GB Disk unallocated:391.97GB Used: 11.29MB Free (Estimated):250.45GB (Max: 396.99GB, min:

Re: What to do about df and btrfs fi df

2014-02-10 Thread cwillu
On Mon, Feb 10, 2014 at 7:02 PM, Roger Binns rog...@rogerbinns.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/02/14 10:24, cwillu wrote: The regular df data used number should be the amount of space required to hold a backup of that content (assuming that the backup maintains

Re: Provide a better free space estimate on RAID1

2014-02-08 Thread cwillu
Everyone who has actually looked at what the statfs syscall returns and how df (and everyone else) uses it, keep talking. Everyone else, go read that source code first. There is _no_ combination of values you can return in statfs which will not be grossly misleading in some common scenario that

Re: Are nocow files snapshot-aware

2014-02-06 Thread cwillu
On Thu, Feb 6, 2014 at 6:32 PM, Kai Krakow hurikhan77+bt...@gmail.com wrote: Duncan 1i5t5.dun...@cox.net schrieb: Ah okay, that makes it clear. So, actually, in the snapshot the file is still nocow - just for the exception that blocks being written to become unshared and relocated. This may

Re: BTRFS corrupted by combination of mistreatment of hiberantion and accidental power loss.

2014-01-29 Thread cwillu
You'd have been better off to just throw away the hiberated image: mounting the filesystem would look like any other recovery from a crash, and would have replayed the log and committed a new transaction, in addition to whatever other disk writes happened due to boot logs and so forth. In this

Re: btrfs and ECC RAM

2014-01-17 Thread cwillu
On Fri, Jan 17, 2014 at 6:23 PM, Ian Hinder ian.hin...@aei.mpg.de wrote: Hi, I have been reading a lot of articles online about the dangers of using ZFS with non-ECC RAM. Specifically, the fact that when good data is read from disk and compared with its checksum, a RAM error can cause the

Re: Subvolume creation returns file exists

2013-11-15 Thread cwillu
On Fri, Nov 15, 2013 at 9:27 AM, Hugo Mills h...@carfax.org.uk wrote: On Fri, Nov 15, 2013 at 02:33:58PM +, Alin Dobre wrote: We are using btrfs filesystems in our infrastructure and, at some point of time, they start refusing to create new subvolumes. Each file system is being quota

Re: btrfs and default directory link count

2013-11-08 Thread cwillu
On Fri, Nov 8, 2013 at 5:07 AM, Andreas Schneider a...@cryptomilk.org wrote: Hello, I did run the Samba testsuite and have a failing test (samba.vfstest.stream_depot). It revealed that it only fails on btrfs. The reason is that a simple check fails: if (smb_fname_base-st.st_ex_nlink == 2)

Re: Odp: Re: Odp: Btrfs might be gradually slowing the boot process

2013-11-08 Thread cwillu
On Fri, Nov 8, 2013 at 1:46 PM, Hugo Mills h...@carfax.org.uk wrote: On Fri, Nov 08, 2013 at 08:37:37PM +0100, y...@wp.pl wrote: Sure; the kernel line from grub.cfg: linux /boot/vmlinuz-linux root=UUID=c26e6d9a-0bbb-436a-a217-95c738b5b9c6 rootflags=noatime,space_cache rw quiet OK,

Re: btrfsck errors is it save to fix?

2013-11-04 Thread cwillu
On Mon, Nov 4, 2013 at 3:14 PM, Hendrik Friedel hend...@friedels.name wrote: Hello, the list was quite full with patches, so this might have been hidden. Here the complete Stack. Does this help? Is this what you needed? [95764.899294] CPU: 1 PID: 21798 Comm: umount Tainted: GFCIO

Re: btrfsck errors is it save to fix?

2013-11-02 Thread cwillu
Now that I am searching, I see this in dmesg: [95764.899359] [a00d9a59] free_fs_root+0x99/0xa0 [btrfs] [95764.899384] [a00dd653] btrfs_drop_and_free_fs_root+0x93/0xc0 [btrfs] [95764.899408] [a00dd74f] del_fs_roots+0xcf/0x130 [btrfs] [95764.899433]

Re: kernel BUG at fs/btrfs/relocation.c:1060 during rebalancing

2013-10-06 Thread cwillu
Another user has just reported this in irc on 3.11.2 kernel BUG at fs/btrfs/relocation.c:1055! invalid opcode: [#1] SMP Modules linked in: ebtable_nat nf_conntrack_netbios_ns nf_conntrack_broadcast ipt_MASQUERADE ip6table_nat nf_nat_ipv6 ip6table_mangle ip6t_REJECT nf_conntrack_ipv6

Re: [PATCH] Drop unused parameter from btrfs_item_nr

2013-09-17 Thread cwillu
On Mon, Sep 16, 2013 at 8:58 AM, Ross Kirk ross.k...@gmail.com wrote: Unused parameter cleanup Ross Kirk (1): btrfs: drop unused parameter from btrfs_item_nr fs/btrfs/backref.c|2 +- fs/btrfs/ctree.c | 34 +- fs/btrfs/ctree.h | 13

Re: Manual deduplication would be useful

2013-07-23 Thread cwillu
On Tue, Jul 23, 2013 at 9:47 AM, Rick van Rein r...@vanrein.org wrote: Hello, For over a year now, I've been experimenting with stacked filesystems as a way to save on resources. A basic OS layer is shared among Containers, each of which stacks a layer with modifications on top of it.

Re: raid 10 corruption from single drive failure

2013-06-29 Thread cwillu
Making this with all 6 devices from the beginning and btrfsck doesn't segfault. But it also doesn't repair the system enough to make it mountable. ( nether does -o recover, however -o degraded works, and files are then accessible ) Not sure I entirely follow: mounting with -o degraded (not

Re: My multi-device btrfs (3*2TB) won't mount anymore.

2013-06-18 Thread cwillu
Does anything show up in dmesg when you mount? If mount just hangs, do an alt-sysrq-w, and then post what that sends to dmesg. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at

Re: raid0, raid1, raid5, what to choose?

2013-06-13 Thread cwillu
On Thu, Jun 13, 2013 at 3:21 PM, Hugo Mills h...@carfax.org.uk wrote: On Thu, Jun 13, 2013 at 11:09:00PM +0200, Hendrik Friedel wrote: Hello, I'd appreciate your recommendation on this: I have three hdd with 3TB each. I intend to use them as raid5 eventually. currently I use them like this:

Re: Recommended settings for SSD

2013-05-26 Thread cwillu
On Sun, May 26, 2013 at 9:16 AM, Harald Glatt m...@hachre.de wrote: I don't know a better way to check than doing df -h before and after... If you use space_cache you have to clear_cache though to make the numbers be current for sure each time before looking at df. Not sure what you're

Re: Recommended settings for SSD

2013-05-24 Thread cwillu
At the moment I am using: defaults,noatime,nodiratime,ssd,subvol=@home No need to specify ssd, it's automatically detected. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at

Re: hard freezes with 3.9.0 during io-intensive loads

2013-05-05 Thread cwillu
to log-replays or something). So thumbs up for the developers on that point. Thanks to the great cwillu netcat service here's my backtrace: 4,1072,17508258745,-;[ cut here ] 2,1073,17508258772,-;kernel BUG at fs/btrfs/ctree.c:1144! 4,1074,17508258791,-;invalid opcode

Re: Panic while running defrag

2013-04-29 Thread cwillu
On Mon, Apr 29, 2013 at 9:20 PM, Stephen Weinberg step...@q5comm.com wrote: I ran into a panic while running find -xdev | xargs brtfs fi defrag '{}'. I don't remember the exact command because the history was not saved. I also started and stopped it a few times however. The kernel logs were

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread cwillu
On Sun, Apr 28, 2013 at 2:17 PM, Roger Binns rog...@rogerbinns.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/04/13 12:57, Harald Glatt wrote: If you want better answers ... There is a lot of good information at the wiki and it does see regular updates. For example the

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread cwillu
[how'd that send button get there] space_cache is the default, set by mkfs, for a year or so now. It's sticky, so even if it wasn't, you'd only need to mount with it once. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to

Re: minimum kernel version for btrfsprogs.0.20?

2013-03-29 Thread cwillu
On Thu, Mar 28, 2013 at 11:41 PM, Chris Murphy li...@colorremedies.com wrote: Creating a btrfs file system using btrfs-progs-0.20.rc1.20130308git704a08c-1.fc19, and either kernel 3.6.10-4.fc18 or 3.9.0-0.rc3.git0.3.fc19, makes a file system that cannot be mounted by kernel 3.6.10-4.fc18. It

Re: scrub correcting tons of errors ?

2013-03-29 Thread cwillu
Actually instead of netconsole we have an awesome service provided by Carey, you can just do nc cwillu.com 10101 /dev/kmsg ... at a root prompt. after you've run sysrq+w and then reply with the URL it spits out. Thanks, -- To unsubscribe from this list: send the line unsubscribe

Re: question about replacing a drive in raid10

2013-03-28 Thread cwillu
On Thu, Mar 28, 2013 at 1:54 AM, Joeri Vanthienen m...@joerivanthienen.be wrote: Hi all, I have a question about replacing a drive in raid10 (and linux kernel 3.8.4). A bad disk was physical removed from the server. After this a new disk was added with btrfs device add /dev/sdg /btrfs to the

Re: No space left on device (28)

2013-03-22 Thread cwillu
On Fri, Mar 22, 2013 at 12:13 AM, Roman Mamedov r...@romanrm.ru wrote: On Thu, 21 Mar 2013 20:42:28 +0100 Stefan Priebe s.pri...@profihost.ag wrote: I might be wrong here, but doesn't this rsync: rename /mnt/.software/kernel/linux-3.9-rc3/drivers/infiniband/hw/amso1100/ -

Re: No space left on device (28)

2013-03-22 Thread cwillu
On Fri, Mar 22, 2013 at 12:39 AM, Stefan Priebe - Profihost AG s.pri...@profihost.ag wrote: Already tried with value 5 did not help ;-( and it also happens with plain cp copying a 15gb file and aborts at about 80% You tried -musage=5? Your original email said -dusage=5. -- To unsubscribe from

Re: How to recover uncorrectable errors ?

2013-03-20 Thread cwillu
# rm -rf * rm: cannot remove 'drivers/misc/lis3lv02d/lis3lv02d.c': Stale NFS file handle rm: cannot remove 'drivers/misc/lis3lv02d/lis3lv02d.c': Stale NFS file handle rm: cannot remove 'drivers/misc/lis3lv02d/lis3lv02d.c': Stale NFS file handle rm: cannot remove

Re: Btrfs in multiple different disc -d sigle -m raid1 one drive failure...

2013-03-18 Thread cwillu
On Mon, Mar 18, 2013 at 12:32 PM, Jan Beranek jan233...@gmail.com wrote: Hi all, I'm preparing a strorage pool for large data with quite low importance - there will be at least 3 hdd in -d single and -m raid1 configuration. mkfs.btrfs -d single -m raid1 /dev/sda /dev/sdb /dec/sdc What

Re: multiple btrfsck runs

2013-03-16 Thread cwillu
On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker russ...@coker.com.au wrote: Is it expected that running btrfsck more than once will keep reporting errors? Without options, btrfsck does not write to the disk. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a

Re: multiple btrfsck runs

2013-03-16 Thread cwillu
On Sat, Mar 16, 2013 at 6:46 AM, Russell Coker russ...@coker.com.au wrote: On Sat, 16 Mar 2013, cwillu cwi...@cwillu.com wrote: On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker russ...@coker.com.au wrote: Is it expected that running btrfsck more than once will keep reporting errors? Without

Re: multiple btrfsck runs

2013-03-16 Thread cwillu
On Sat, Mar 16, 2013 at 6:44 AM, Marc MERLIN m...@merlins.org wrote: On Sat, Mar 16, 2013 at 06:24:47AM -0600, cwillu wrote: On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker russ...@coker.com.au wrote: Is it expected that running btrfsck more than once will keep reporting errors? Without

Re: Drive low space / huge performance hit.

2013-03-07 Thread cwillu
On Thu, Mar 7, 2013 at 11:05 AM, Steve Heyns notzi...@gmail.com wrote: hi I am using compression lzo on my 350GB partition, I have 2 subvolumes on this partition. My kernel is 3.7 BTRFS v0.19 - According to my system (df -h) that partition has 75Gb available. According to btrfs btrfs fi

Re: Does defragmenting even work

2013-02-28 Thread cwillu
On Thu, Feb 28, 2013 at 8:35 AM, Swâmi Petaramesh sw...@petaramesh.org wrote: BTW... I'm not even sure that btrfs filesystem defrag somefile actually does anything... If I run filefrag somefile afterwards, it typically shows the same number of fragments that it did prior to running

Re: copy on write misconception

2013-02-22 Thread cwillu
Then if I copied this file no blocks would be copied until they are written. Hence the two files would use the same blocks underneath. But specifically that copy would be fast. Since it would only need to write some metadata. But when I copy the file: time cp 10G 10G2 cp without arguments

Re: copy on write misconception

2013-02-22 Thread cwillu
On Fri, Feb 22, 2013 at 11:41 AM, Mike Power dodts...@gmail.com wrote: On 02/22/2013 09:16 AM, Hugo Mills wrote: On Fri, Feb 22, 2013 at 09:11:28AM -0800, Mike Power wrote: I think I have a misconception of what copy on write in btrfs means for individual files. I had originally thought

Re: Fwd: Current State of BTRFS

2013-02-08 Thread cwillu
On Fri, Feb 8, 2013 at 4:56 PM, Florian Hofmann fhofm...@techfak.uni-bielefeld.de wrote: Oh ... I should have mentioned that btrfs is running on top of LUKS. 2013/2/8 Florian Hofmann fhofm...@techfak.uni-bielefeld.de: $ btrfs fi df / Data: total=165.00GB, used=164.19GB System, DUP:

Re: System unmountable RW

2013-02-01 Thread cwillu
then I do : mount -o rw,remount /backup/ Feb 1 22:32:38 frozen kernel: [ 65.780686] btrfs: force zlib compression Feb 1 22:32:38 frozen kernel: [ 65.780700] btrfs: not using ssd allocation scheme Feb 1 22:32:38 frozen kernel: [ 65.780706] btrfs: disk space caching is enabled I

Re: [PATCH] Btrfs-progs: Exit if not running as root

2013-01-25 Thread cwillu
to explore doing something for that case. And it also might be reasonable for some situations to issue the message about root if something errors-out. Eh? That's one of the clearest cases where you _may not_ need root. cwillu@cwillu-home:~$ groups cwillu adm dialout cdrom audio video plugdev

Re: [RFC] Abort on memory allocation failure

2013-01-25 Thread cwillu
On Fri, Jan 25, 2013 at 4:55 PM, Ian Kumlien po...@vapor.com wrote: Hi, Could someone do a sanity check of this, i have removed some of the checking code that is no longer needed but i would prefer to have reviewers. I haven't looked much at the code, mainly been focusing on the grunt work

Re: scrub questtion

2013-01-15 Thread cwillu
On Tue, Jan 15, 2013 at 8:21 AM, Gene Czarcinski g...@czarc.net wrote: When you start btrfs scrub and point at one subvolume, what is scrubbed? Just that subvolume or the entire volume? The entire volume. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a

Re: obscure out of space, df and fi df are way off

2013-01-11 Thread cwillu
On Fri, Jan 11, 2013 at 11:50 PM, Chris Murphy li...@colorremedies.com wrote: Very low priority. No user data at risk. 8GB virtual disk being installed to, and the installer is puking. I'm trying to figure out why. I first get an rsync error 12, followed by the installer crashing. What's

Re: obscure out of space, df and fi df are way off

2013-01-11 Thread cwillu
[root@localhost tmp]# df Filesystem 1K-blocksUsed Available Use% Mounted on /dev/sda33746816 3193172 1564 100% /mnt/sysimage /dev/sda1 495844 31509438735 7% /mnt/sysimage/boot /dev/sda33746816

Re: Option LABEL

2013-01-03 Thread cwillu
On Thu, Jan 3, 2013 at 11:57 AM, Helmut Hullen hul...@t-online.de wrote: But other filesystems don't put the label onto more than 1 device. There's the problem for/with btrfs. Other filesystems don't exist on more than one device, so of course they don't put a label on more than one device. --

Re: parent transid verify failed on -- After moving btrfs closer to the beginning of drive with dd

2012-12-29 Thread cwillu
On Sat, Dec 29, 2012 at 7:14 AM, Jordan Windsor jorda...@gmail.com wrote: Also here's the output of btrfs-find-root: ./btrfs-find-root /dev/sdb1 Super think's the tree root is at 1229060866048, chunk root 1259695439872 Went past the fs size, exiting Not sure where to go from here. I can't

Re: parent transid verify failed on -- After moving btrfs closer to the beginning of drive with dd

2012-12-28 Thread cwillu
On Fri, Dec 28, 2012 at 12:09 PM, Jordan Windsor jorda...@gmail.com wrote: Hello, I moved my btrfs to the beginning of my drive updated the partition table also restarted, I'm currently unable to mount it, here's the output in dmesg. [ 481.513432] device label Storage devid 1 transid

Re: HIT WARN_ON WARNING: at fs/btrfs/extent-tree.c:6339 btrfs_alloc_free_block+0x126/0x330 [btrfs]()

2012-12-19 Thread cwillu
On Wed, Dec 19, 2012 at 9:12 AM, Rock Lee zim...@code-trick.com wrote: Hi all, Did someone have met this problem before. When doing the tests, I hit the WARN_ON. Is this log make sense or someone had fixed the problem. If needed, I can supply the detail log and the testcase source

Re: btrfs subvolume snapshot performance problem

2012-12-18 Thread cwillu
On Tue, Dec 18, 2012 at 7:06 AM, Sylvain Alain d2racing...@gmail.com wrote: So, if I don't use the discard command, how often do I need to run the fstrim command ? If your ssd isn't a pile of crap, never. SSD's are always over-provisioned, and so every time an erase block fills up, the drive

Re: unmountable partition and live distro (no space left)

2012-12-16 Thread cwillu
Try booting with bootflags=ro,recovery in grub (with the latest possible kernel), or mounting with -o recovery from the livecd (likewise). If it works, then you're done, you should be able to boot normally after a clean umount and shutdown. If it doesn't, post dmesg from the attempt. I'v been

Re: Intel 120G SSD write performance with 3.2.0-4-amd64

2012-12-15 Thread cwillu
On Sat, Dec 15, 2012 at 5:23 PM, Russell Coker russell+bt...@coker.com.au wrote: I've got a system running Debian kernel 3.2.0-4-amd64 with root on a SSD that identifies itself as INTEL SSDSC2CT12 300i (it's an Intel 120G device). 3.2 is massively old in btrfs terms, with lots of fun little

Re: Encryption

2012-12-12 Thread cwillu
On Wed, Dec 12, 2012 at 12:38 PM, merc1...@f-m.fm wrote: On Wed, Dec 12, 2012, at 10:31, Mitch Harder wrote: I run btrfs on top of LUKS encryption on my laptop. You should be able to do the same. You could then run rsync through ssh. However, rsync will have no knowledge of any blocks

Re: Encryption

2012-12-12 Thread cwillu
On Wed, Dec 12, 2012 at 2:06 PM, merc1...@f-m.fm wrote: On Wed, Dec 12, 2012, at 10:48, cwillu wrote: Sayeth the FAQ: Oh pardon me, it's BTRFS RAID that's a no-go, which is just as critical to me as I have a 4 disk 8TB array. The FAQ goeth on to Say

Re: Can't mount luks partition after reboot

2012-12-03 Thread cwillu
On Mon, Dec 3, 2012 at 7:22 PM, Travis LaDuke travislad...@gmail.com wrote: This is kind of silly, but may be salvageable... I made a btrfs on top of luks partition and tried it for a couple days. Then I made another luks partition on another drive then added and balanced that new drive as

Re: High-sensitivity fs checker (not repairer) for btrfs

2012-11-10 Thread cwillu
On Sat, Nov 10, 2012 at 4:32 PM, Bob Marley bobmar...@shiftmail.org wrote: On 11/10/12 22:23, Hugo Mills wrote: The closest thing is btrfsck. That's about as picky as we've got to date. What exactly is your use-case for this requirement? We need a decently-available system. We can

Re: (late) REQUEST: Default mkfs.btrfs block size

2012-11-05 Thread cwillu
On Mon, Nov 5, 2012 at 10:06 AM, David Sterba d...@jikos.cz wrote: On Wed, Oct 31, 2012 at 12:20:39PM +, Alex wrote: As one 'stuck' with 4k leaves on my main machine for the moment, can I request the btrfs-progs v0.20 defaults to more efficient decent block sizes before release. Most

Re: [PATCH][BTRFS-PROGS] Enhance btrfs fi df

2012-11-03 Thread cwillu
do you have more information about raid ? When it will land on the btrfs earth ? :-) An unnamed source recently said today I'm fixing parity rebuild in the middle of a read/modify/write. its one of my last blockers, at which point several gags about progress meters were made. -- To unsubscribe

Re: What's the minimum size I can shrink my FS to?

2012-11-02 Thread cwillu
Run btrfs balance start -musage=1 -dusage=1, and then try it again. This may require update btrfs tools however. On Fri, Nov 2, 2012 at 10:09 PM, Jordan Windsor jorda...@gmail.com wrote: Hello, I'm trying to shrink my Btrfs filesystem to the smallest size it can go, here's the information:

Re: [Request for review] [RFC] Add label support for snapshots and subvols

2012-11-01 Thread cwillu
Below is a demo of this new feature. btrfs fi label -t /btrfs/sv1 Prod-DB btrfs fi label -t /btrfs/sv1 Prod-DB btrfs su snap /btrfs/sv1 /btrfs/snap1-sv1 Create a snapshot of '/btrfs/sv1' in '/btrfs/snap1-sv1' btrfs fi label -t /btrfs/snap1-sv1 btrfs fi label -t

Re: Why btrfs inline small file by default?

2012-10-31 Thread cwillu
On Wed, Oct 31, 2012 at 2:48 AM, Ahmet Inan ai...@mathematik.uni-freiburg.de wrote: i also dont see any benefit from inlining small files: with defaults (inlining small files): real4m39.253s Data: total=10.01GB, used=9.08GB Metadata, DUP: total=2.00GB, used=992.48MB without inline:

Re: Why btrfs inline small file by default?

2012-10-31 Thread cwillu
On Wed, Oct 31, 2012 at 4:48 AM, Ahmet Inan ai...@mathematik.uni-freiburg.de wrote: i also dont see any benefit from inlining small files: with defaults (inlining small files): real4m39.253s Data: total=10.01GB, used=9.08GB Metadata, DUP: total=2.00GB, used=992.48MB without inline:

Re: btrfs defrag problem

2012-10-30 Thread cwillu
On Tue, Oct 30, 2012 at 5:47 AM, ching lschin...@gmail.com wrote: Hi all, I try to defrag my btrfs root partition (run by root privilege) find / -type f -o -type d -print0 | xargs --null --no-run-if-empty btrfs filesystem defragment -t $((32*1024*1024)) 1. This kind of error messages is

Re: Why btrfs inline small file by default?

2012-10-30 Thread cwillu
If there is a lot of small files, then the size of metadata will be undesirable due to deduplication Yes, that is a fact, but if that really matters depends on the use-case (e.g., the small files to large files ratio, ...). But as btrfs is designed explicitly as a general purpose file

Re: Why btrfs inline small file by default?

2012-10-30 Thread cwillu
On Tue, Oct 30, 2012 at 3:40 PM, ching lschin...@gmail.com wrote: On 10/30/2012 08:17 PM, cwillu wrote: If there is a lot of small files, then the size of metadata will be undesirable due to deduplication Yes, that is a fact, but if that really matters depends on the use-case (e.g

Re: Why btrfs inline small file by default?

2012-10-30 Thread cwillu
On Tue, Oct 30, 2012 at 5:47 PM, ching lschin...@gmail.com wrote: On 10/31/2012 06:19 AM, Hugo Mills wrote: On Tue, Oct 30, 2012 at 10:14:12PM +, Hugo Mills wrote: On Wed, Oct 31, 2012 at 05:40:25AM +0800, ching wrote: On 10/30/2012 08:17 PM, cwillu wrote: If there is a lot of small files

Re: Naming of subvolumes

2012-10-26 Thread cwillu
On Fri, Oct 26, 2012 at 9:54 AM, Chris Murphy li...@colorremedies.com wrote: On Oct 26, 2012, at 2:27 AM, Richard Hughes hughsi...@gmail.com wrote: And if you're going to apply the upgrade to the snapshot, or to the top level file system? That's a very good question. I was going to apply

Re: btrfs seems to do COW while inode has NODATACOW set

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 12:35 PM, Alex Lyakas alex.bt...@zadarastorage.com wrote: Hi everybody, I need some help understanding the nodatacow behavior. I have set up a large file (5GiB), which has very few EXTENT_DATAs (all are real, not bytenr=0). The file has NODATASUM and NODATACOW flags

Re: [RFC] New attempt to a better btrfs fi df

2012-10-25 Thread cwillu
I don't publish the patched because aren't in a good shape. However I really like the output. The example is a filesystem based on three disks of 3GB. It is clear that: - - RAID0 uses all the disks - - RAID1 uses two different disks Comments are welcome. Known bugs: - - if a filesystem

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 1:58 PM, Marc MERLIN m...@merlins.org wrote: Howdy, I can wait a day or maybe 2 before I have to wipe and restore from backup. Please let me know if you have a patch against 3.6.3 you'd like me to try to mount/recover this filesystem, or whether you'd like me to try

Re: [RFC] New attempt to a better btrfs fi df

2012-10-25 Thread cwillu
Allocated_area: Data,RAID0: Size:921.75MB, Used:256.00KB /dev/vdc 307.25MB /dev/vdb 307.25MB /dev/vdd 307.25MB Data,Single: Size:8.00MB, Used:0.00 /dev/vdb 8.00MB System,RAID1: Size:8.00MB, Used:4.00KB /dev/vdd 8.00MB /dev/vdc

Re: [RFC] New attempt to a better btrfs fi df

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 2:03 PM, Chris Murphy li...@colorremedies.com wrote: On Oct 25, 2012, at 1:21 PM, Goffredo Baroncelli kreij...@inwind.it wrote: Moreover I still didn't understand how btrfs was using the disks. This comment has less to do with the RFC, and more about user confusion in

Re: [RFC] New attempt to a better btrfs fi df

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 2:36 PM, Chris Murphy li...@colorremedies.com wrote: My suggestion is that by default a summary similar to the existing df command be mimicked, where it makes sense, for btrfs fi df. - I like the Capacity %. If there is a reliable equivalent, it need not be inode

Re: [RFC] New attempt to a better btrfs fi df

2012-10-25 Thread cwillu
On Thu, Oct 25, 2012 at 8:33 PM, Chris Murphy li...@colorremedies.com wrote: So what's the intended distinction between 'fi df' and 'fi show'? Because for months using btrfs I'd constantly be confused which command was going to show me what information I wanted, and that tells me there should

Re: [PATCH 2/2] Btrfs: do not delete a subvolume which is in a R/O subvolume

2012-10-24 Thread cwillu
On Wed, Oct 24, 2012 at 4:03 AM, Miao Xie mi...@cn.fujitsu.com wrote: On Mon, 22 Oct 2012 05:57:12 -0600, cwillu wrote: On Mon, Oct 22, 2012 at 5:39 AM, Miao Xie mi...@cn.fujitsu.com wrote: Step to reproduce: # mkfs.btrfs disk # mount disk mnt # btrfs sub create mnt/subv0 # btrfs sub

Re: [PATCH 2/2] Btrfs: do not delete a subvolume which is in a R/O subvolume

2012-10-22 Thread cwillu
On Mon, Oct 22, 2012 at 5:39 AM, Miao Xie mi...@cn.fujitsu.com wrote: Step to reproduce: # mkfs.btrfs disk # mount disk mnt # btrfs sub create mnt/subv0 # btrfs sub snap mnt mnt/subv0/snap0 # change mnt/subv0 from R/W to R/O # btrfs sub del mnt/subv0/snap0 We deleted the snapshot

Re: unrecognized mount option 'compression=lzo' and defragment -c errors

2012-10-20 Thread cwillu
1. I also added mount option 'compression=lzo' and 'io_cache' to /home at first. Neither io_cache nor compression=lzo are options that exist. You probably meant compress=lzo for the first, but I really don't know what you wanted for io_cache (inode_cache? that's not really a performance

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 9:28 AM, Marguerite Su i...@marguerite.su wrote: On Thu, Oct 18, 2012 at 9:28 PM, Chris Mason chris.ma...@fusionio.com wrote: If it isn't the free space cache, it'll be a fragmentation problem. The easiest way to tell the difference is to get a few sysrq-w snapshots

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 10:18 AM, Marguerite Su i...@marguerite.su wrote: On Fri, Oct 19, 2012 at 11:41 PM, cwillu cwi...@cwillu.com wrote: Also, next time just put the output directly in the email, that way it's permanently around to look at and search for. Hi, I did it. here's my dmesg

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 11:02 AM, Marguerite Su i...@marguerite.su wrote: On Sat, Oct 20, 2012 at 12:55 AM, cwillu cwi...@cwillu.com wrote: It appears space_cache isn't enabled on your rootfs; can you do a mount / -o remount,space_cache, sync a couple times, make some coffee, and then reboot

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 12:33 PM, Marguerite Su i...@marguerite.su wrote: On Sat, Oct 20, 2012 at 2:26 AM, cwillu cwi...@cwillu.com wrote: That would work, but it's only necessary to mount with it once (and it's probably been done already with /home), hence the -o remount,space_cache Now my

Re: initramfs take a long time to load[135s]

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 1:02 PM, Marguerite Su i...@marguerite.su wrote: On Sat, Oct 20, 2012 at 2:35 AM, cwillu cwi...@cwillu.com wrote: Without space_cache (once), btrfs has to repopulate that information the slow way every mount; with it, it can just load the data from the last unmount

Re: Weird Warning

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 2:54 PM, Jérôme Poulin jeromepou...@gmail.com wrote: I've got this weird WARNING in my system log on a freshly created FS, I'm using ACL with Samba, this is the only difference I could tell from any other FSes. It is also using Debian's Wheezy kernel which is quite old.

Re: Weird Warning

2012-10-19 Thread cwillu
On Fri, Oct 19, 2012 at 3:51 PM, Jérôme Poulin jeromepou...@gmail.com wrote: After updating to 3.5.5, I get thi on boot and listing some dir freezes. I don't have anything important on that volume but I'm willing to debug the problem if needed. Would I need a more recent kernel? Probably

Re: BTRFS filesystem is not mountable after crash

2012-10-13 Thread cwillu
On Sat, Oct 13, 2012 at 11:51 AM, Alfred Zastrow m...@zastrow4u.de wrote: Am 26.08.2012 08:17, schrieb Liu Bo: On 08/26/2012 01:27 PM, Alfred Zastrow wrote: Hello, has realy nobody a hint for me? Is compiling chris's latest for-linus helpful?

  1   2   3   >