Re: [zfs-discuss] 'du' is not accurate on zfs
On Tue, Feb 19, 2008 at 12:13:25PM -0800, Marion Hakanson wrote: > [EMAIL PROTECTED] said: > > It may not be relevant, but I've seen ZFS add weird delays to things too. I > > deleted a file to free up space, but when I checked no more space was > > reported. A second or two later the space appeared. > > Run the "sync" command before you do the "du". That flushes the ARC and/or > ZIL out to disk, after which you'll get accurate results. I do the same when > timing how long it takes to create a file -- time the file creation plus the > sync to see how long it takes to get the data to nonvolatile storage. When logging was first added to UFS, it had the same issue. But I believe statvfs was modified to take future removes (logged) into account. Can ZFS do the same? -- Darren Dunham [EMAIL PROTECTED] Senior Technical Consultant TAOShttp://www.taos.com/ Got some Dr Pepper? San Francisco, CA bay area < This line left intentionally blank to confuse you. > ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 'du' is not accurate on zfs
[EMAIL PROTECTED] said: > It may not be relevant, but I've seen ZFS add weird delays to things too. I > deleted a file to free up space, but when I checked no more space was > reported. A second or two later the space appeared. Run the "sync" command before you do the "du". That flushes the ARC and/or ZIL out to disk, after which you'll get accurate results. I do the same when timing how long it takes to create a file -- time the file creation plus the sync to see how long it takes to get the data to nonvolatile storage. Regards, Marion ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 'du' is not accurate on zfs
> On Sat, 16 Feb 2008, Richard Elling wrote: > > > "ls -l" shows the length. "ls -s" shows the size, > which may be > > different than the length. You probably want size > rather than du. > > That is true. Unfortunately 'ls -s' displays in > units of disk blocks > and does not also consider the 'h' option in order to > provide a value > suitable for humans. > > Bob ISTR someone already proposing to make ls -h -s work in a way one might hope for. This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 'du' is not accurate on zfs
On Sat, 16 Feb 2008, Richard Elling wrote: > "ls -l" shows the length. "ls -s" shows the size, which may be > different than the length. You probably want size rather than du. That is true. Unfortunately 'ls -s' displays in units of disk blocks and does not also consider the 'h' option in order to provide a value suitable for humans. Bob == Bob Friesenhahn [EMAIL PROTECTED], http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 'du' is not accurate on zfs
On Feb 16, 2008, at 06:43, Ross wrote: > It may not be relevant, but I've seen ZFS add weird delays to > things too. I deleted a file to free up space, but when I checked > no more space was reported. A second or two later the space appeared. This also happens on FreeBSD's UFS if you have SoftUpdates enabled. I forget exactly how it works (see McKusick's paper), but basically there is a slight delay in updating the meta-data on disk, which gives the system some time to coalesce several operations in memory before doing any disk I/O. It makes it very easy to do an 'rm -rf' on several hundred megabytes, which returns to the command line almost immediately; it's several seconds before you hear any disk thrashing. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 'du' is not accurate on zfs
Bob Friesenhahn wrote: > I have a script which generates a file and then immediately uses 'du > -h' to obtain its size. With Solaris 10 I notice that this often > returns an incorrect value of '0' as if ZFS is lazy about reporting > actual disk use. Meanwhile, 'ls -l' does report the correct size. > "ls -l" shows the length. "ls -s" shows the size, which may be different than the length. You probably want size rather than du. -- richard ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 'du' is not accurate on zfs
It may not be relevant, but I've seen ZFS add weird delays to things too. I deleted a file to free up space, but when I checked no more space was reported. A second or two later the space appeared. And I'm also seeing zpool status report that drives are ok when one is disconnected. I have to run it a second time to correctly show that one is now unavailable. They may not be related, but the end result is pretty similar - there's a noticable delay before ZFS gives you the correct, up to date information. This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] 'du' is not accurate on zfs
I have a script which generates a file and then immediately uses 'du -h' to obtain its size. With Solaris 10 I notice that this often returns an incorrect value of '0' as if ZFS is lazy about reporting actual disk use. Meanwhile, 'ls -l' does report the correct size. Bob == Bob Friesenhahn [EMAIL PROTECTED], http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
