[zfs-discuss] A simple script to measure SYNC writes

ain a copy of the license at Docs/cddl1.txt * or http://www.opensolaris.org/os/licensing. * See the License for the specific language governing permissions * and limitations under the License. * * CDDL HEADER END * * Author: Sanjeev Bagewadi [Bangalore, India] */ #pragma D option quiet

Re: [zfs-discuss] ZFS iSCSI (For VirtualBox target) and SMB

Kevin, Kevin Pattison wrote: > Hey all, > > I'm setting up a ZFS based fileserver to use both as a shared network drive > and separately to have an iSCSI target to be used as the "Hard disk" of a > windows based VM runninf on another machine. > > I've built the machine, installed the OS, created

Re: [zfs-discuss] Cannot remove a file on a GOOD ZFS filesystem

Marcelo, Thanks for the details. Comments inline... Marcelo Leal wrote: > execve("/usr/bin/rm", 0x08047DBC, 0x08047DC8) argc = 2 > mmap(0x, 4096, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_ANON, > -1, 0) = 0xFEFF > resolvepath("/usr/lib/ld.so.1", "/lib/ld.so.1", 1023) = 12 > re

Re: [zfs-discuss] Cannot remove a file on a GOOD ZFS filesystem

Marcelo, Thanks for the details ! This rules out a bug that I was suspecting : http://bugs.opensolaris.org/view_bug.do?bug_id=6664765 This needs more analysis. What does the "rm" command fail with ? We could probably run truss on the rm command like : "truss -o /tmp/rm.truss rm " You then pass o

Re: [zfs-discuss] Cannot remove a file on a GOOD ZFS filesystem

Marcelo, Marcelo Leal wrote: > Hello all... > Can that be caused by some cache on the LSI controller? > Some flush that the controller or disk did not honour? > More details on the problem would help. Can you please give the following details : - zpool status - zfs list -r - The details of

Re: [zfs-discuss] `zfs list` doesn't show my snapshot

Jel, Jens Elkner wrote: > On Fri, Nov 21, 2008 at 03:42:17PM -0800, David Pacheco wrote: > >> Pawel Tecza wrote: >> >>> But I still don't understand why `zfs list` doesn't display snapshots >>> by default. I saw it in the Net many times at the examples of zfs usage. >>> >> This was

Re: [zfs-discuss] How can i make my zpool as faulted.

Yuvraj, I see that you are using files as disks. You could write a few random bytes to one of the files and that would induce corruption. To make a particular disk faulty you could mv the file to a new name. Also, you can explore the zinject from zfs testsuite . Probably it has a way to induce

Re: [zfs-discuss] ARCSTAT Kstat Definitions

Ben, This looks good ! I Couple of points ; - You might want show whether ARC is throttled. (Although this is not available as a kstat). I think it is good indication of how stressed is the box. - I am not sure if 'anon_hits' make too much sense. : -- From arc.c -- * Anonymous buffers are b

Re: [zfs-discuss] resilver running for 35 trillion years

Mike, Indeed an interesting result :) ! This is a known problem with VirtualBox :) They have fixed it in the latest release -- snip -- #1639: Solaris Virtual box guest keeps getting its time reset after resuming VM from suspend +

Re: [zfs-discuss] ZFS fragmentation

Lance, This could be bug#*6596237 Stop looking and start ganging .* The fix is in progress and Victor Latushkin is working on it. We have an IDR based on the patches 127127-11/127128-11 which has the first cut of the fix. You could raise an escalation

Re: [zfs-discuss] ZFS space map causing slow performance

Scott, This looks more like " bug#*6596237 Stop looking and start ganging ". * What version of Solaris are the production servers running (S10 or Opensolaris) ? Thanks and regards, Sanjeev. Scott wrote: > Hello, > > I have several ~12TB storage server

Re: [zfs-discuss] ZFS Performance Issue

William, It should be fairly easy to find the record size using DTrace. Take an aggregation of the the writes happening (aggregate on size for all the write(2) system calls). This would give fair idea of the IO size pattern. Does RRD4J have a record size mentioned ? Usually if it is a database

Re: [zfs-discuss] zfs device busy

Carol, Probably "/mnt" is already in use ie. some other filesystem is mounted there. Can you please verify ? What is the original mountpoint of pool/zfs1 ? Regards, Sanjeev. Caroline Carol wrote: > Hi all, > > When i modify zfs FS propreties I get "device busy" > > -bash-3.00# zfs set moun

Re: [zfs-discuss] zfs won't import a pool automatically at boot

Thanks Robert ! I missed that part. -- Sanjeev. Michael Goff wrote: > Great, thanks Robert. That's what I was looking for. I was thinking > that I would have to transfer the state somehow from the temporary > jumpstart environment to /a so that it would be persistent. I'll test > it out tomorr

Re: [zfs-discuss] zfs won't import a pool automatically at boot

Michael, If you don't call "zpool export -f tank" it should work. However, it would be necessary to understand why you are using the above command after creation of the zpool. Can you avoid exporting after the creation ? Regards, Sanjeev Michael Goff wrote: > Hi, > > When jumpstarting s10x_u4

Re: [zfs-discuss] ZFS Directory

Kanishk, Directories are implemented as ZAP objects. Look at the routines in that order : - zfs_lookup() - zfs_dirlook() - zfs_dirent_lock() - zap_lookup Hope that helps. Regards, Sanjeev. kanishk wrote: i wanted to know how does ZFS finds an entry of a file from its dirctory object. anyli

Re: [zfs-discuss] ZFS + ISCSI + LINUX QUESTIONS

Nathan, Some answers inline... Nathan Huisman wrote: = PROBLEM To create a disk storage system that will act as an archive point for user data (Non-recoverable data), and also act as a back end storage unit for virtual machines at a block level. = BUDGET Currently I have about 25-30

Re: [zfs-discuss] Contents of transaction group?

Atul, Atul Vidwansa wrote: Hi, I have few questions about the way a transaction group is created. 1. Is it possible to group transactions related to multiple operations in same group? For example, an "rmdir foo" followed by "mkdir bar", can these end up in same transaction group? Each TXG is

Re: [zfs-discuss] Re: simple Raid-Z question

MC, If you originally had 4 * 500 GB disks configured in RAID-Z, you cannot add 1 single disk and grow the capacity of the pool (with same protection). This is not allowed. Regards, Sanjeev. MC wrote: Two conflicting answers to the same question? I guess we need someone to break the tie :)

Re: [zfs-discuss] ZFS and Kstats

Atul, libkstat(3LIB) is the library. "man -s 3KSTAT kstat" should give a good start. Regards, Sanjeev. Atul Vidwansa wrote: Peter, How do I get those stats programatically? Any clues? Regards, _Atul On 3/27/07, Peter Tribble <[EMAIL PROTECTED]> wrote: On 3/27/07, Atul Vidwansa <[EMAIL PRO

Re: [zfs-discuss] ZFS and Firewire/USB enclosures

Mike, We have used 4 disks (2X80GB disks and 2X250GB disks) on USB and things worked well. Hot plugging the disks was not all that smooth for us. Other than that we had no issues using the disks. We used this setup for demos at the FOSS 2007 conference at Bangalore and that went through sever

Re: [zfs-discuss] writes lost with zfs !

Ayaz, What does the panic stack look like ? Did you have DPM (Disk Path Monitoring) enabled in both the cases (UFS/ZFS) ? Also, from what I have seen pulling the FC cable (or similar fault) to simulate disk fault has caused ZFS to hang or panic. I don't think such a test is the right way t

Re: [zfs-discuss] DMU interfaces

Manoj, Welcome back on the alias :-) I don't think the interfaces are documented. However, refering to ZPL should be a good place to start. The ZPL code interacts with DMU and obviously it is using the DMU interfaces. However, I am not sure whether there is any gaurantee that they will not

Re: [zfs-discuss] suggestion: directory promotion to filesystem

Adrian, Seems like a cool idea to me :-) Not sure if there is anything of this kind being thought about... Would be a good idea to file an RFE. Regards, Sanjeev Adrian Saul wrote: Not sure how technically feasible it is, but something I thought of while shuffling some files around my home s

Re: [zfs-discuss] Meta data corruptions on ZFS.

Masthan, */dudekula mastan <[EMAIL PROTECTED]>/* wrote: Hi All, In my test set up, I have one zpool of size 1000M bytes. Is this the size given by zfs list ? Or is the amount of disk space that you had ? The reason I ask this is because ZFS/Zpool takes up some amount of

Re: [zfs-discuss] Re: Limit ZFS Memory Utilization

Richard, Richard L. Hamilton wrote: If I understand correctly, at least some systems claim not to guarantee consistency between changes to a file via write(2) and changes via mmap(2). But historically, at least in the case of regular files on local UFS, since Solaris used the page cache for bo

Re: [zfs-discuss] Limit ZFS Memory Utilization

Jason, Jason J. W. Williams wrote: Hi Robert, We've got the default ncsize. I didn't see any advantage to increasing it outside of NFS serving...which this server is not. For speed the X4500 is showing to be a killer MySQL platform. Between the blazing fast procs and the sheer number of spindle

Re: [zfs-discuss] Limit ZFS Memory Utilization

Robert, Comments inline... Robert Milkowski wrote: Hello Jason, Wednesday, January 10, 2007, 9:45:05 PM, you wrote: JJWW> Sanjeev & Robert, JJWW> Thanks guys. We put that in place last night and it seems to be doing JJWW> a lot better job of consuming less RAM. We set it to 4GB and each of JJ

Re: [zfs-discuss] Limit ZFS Memory Utilization

Jason, Robert is right... The point is ARC is the caching module of ZFS and majority of the memory is consumed through ARC. Hence by limiting the c_max of ARC we are limiting the amount ARC consumes. However, other modules of ZFS would consume more but that may not be as significant as ARC.

Re: [zfs-discuss] ZFS Hot Spare Behavior

Rob, It (hot-spare) should have kicked in. How long did you wait for it ? Was there any IO happening on the pool ? Try doing some IO to the disk and see if it kicks in. Also, another point to note is the size of the the hotspares. Please ensure that the hot-spares are of the same size as the

Re: [zfs-discuss] Limit ZFS Memory Utilization

-fno-exceptions -fno-rtti Best Regards, Jason On 1/7/07, Sanjeev Bagewadi <[EMAIL PROTECTED]> wrote: Jason, There is no documented way of limiting the memory consumption. The ARC section of ZFS tries to adapt to the memory pressure of the system. However, in your case probably it is not qui

Re: [zfs-discuss] Limit ZFS Memory Utilization

arc_min which seem to be tunables ! There is a detailed explaination at : http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6505658 Thanks and regards, Sanjeev. Best Regards, Jason On 1/7/07, Sanjeev Bagewadi <[EMAIL PROTECTED]> wrote: Jason, There is no documented way of limiti

Re: [zfs-discuss] Limit ZFS Memory Utilization

Jason, There is no documented way of limiting the memory consumption. The ARC section of ZFS tries to adapt to the memory pressure of the system. However, in your case probably it is not quick enough I guess. One way of limiting the memory consumption would be limit the arc.c_max This (arc.c_max

Re: [zfs-discuss] Re: zfs hot spare not automatically getting used

Jim, That is good news !! Let's us know how it goes. Regards, Sanjeev. PS : I am out of office a couple of days. Jim Hranicky wrote: OK, spun down the drives again. Here's that output: http://www.cise.ufl.edu/~jfh/zfs/threads I just realized that I changed the configuration, so that

Re: [zfs-discuss] zfs hot spare not automatically getting used

Jim, James F. Hranicky wrote: Sanjeev Bagewadi wrote: Jim, We did hit similar issue yesterday on build 50 and build 45 although the node did not hang. In one of the cases we saw that the hot spare was not of the same size... can you check if this true ? It looks like they'r

Re: [zfs-discuss] zfs hot spare not automatically getting used

Jim, We did hit similar issue yesterday on build 50 and build 45 although the node did not hang. In one of the cases we saw that the hot spare was not of the same size... can you check if this true ? Do you have a threadlist from the node when it was hung ? That would reveal some info. Tha

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

Tomas, Apologies for delayed response... Tomas Ögren wrote: Interesting ! So, it is not the ARC which is consuming too much memory It is some other piece (not sure if it belongs to ZFS) which is causing the crunch... Or the other possibility is that ARC ate up too much and caused a near

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

Tomas, comments inline... Tomas Ögren wrote: On 10 November, 2006 - Sanjeev Bagewadi sent me these 3,5K bytes: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs)

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

Comments in line... Neil Perrin wrote: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb said ncsize was about 68k and vmstat -s said we had a hitrate of ~30%, so I se

Re: [zfs-discuss] Solaris 10 / ZFS file system major/minor number

Hi Darren, Coments inline Darren Dunham wrote: ZFS creates a unique FSID for every filesystem (called a object set in ZFS terminology). The unique id is saved (ondisk) as part of dsl_dataset_phys_t in ds_fsid_guid. And this id is a random number generated when the FS is created. This i

Re: [zfs-discuss] Solaris 10 / ZFS file system major/minor number

Hi Luke, Luke Schwab wrote: Hi, In migrating from **VM to ZFS am I going to have an issue with Major/Minor numbers with NFS mounts? Take the following scenario. 1. NFS clients are connected to an active NFS server that has SAN shared storage between the active and standby nodes in a cluster

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

I think the original point of NFS being better WRT data making it to the disk was that : NFS follows the SYNC-ON-CLOSE semantics. You will not see an explicit fsync() being called by the tar... -- Sanjeev. Frank Batschulat (Home) wrote: On Tue, 10 Oct 2006 01:25:36 +0200, Roch <[EMAIL PROTECT

Re: [zfs-discuss] File level compression

Manoj Joseph wrote: Robert Milkowski wrote: Hello Sanjeev, Wednesday, August 30, 2006, 3:26:52 PM, you wrote: SB> Hi, SB> We were trying out the "compression=on" feature of ZFS and were SB> wondering if it would make SB> sense to have ZFS do compression only on a certain kind of files (or S

[zfs-discuss] File level compression

Hi, We were trying out the "compression=on" feature of ZFS and were wondering if it would make sense to have ZFS do compression only on a certain kind of files (or rather the otherway around). Our observation : - If ZFS finds that it cannot achieve a certain amount of compression it does not