Re: [zfs-discuss] Replacement disks for Sun X4500
I am bumping this thread because I too have the same question ... can I put modern 3TB disks (hitachi deskstars) into an old x4500 ? If not, would the x4540 accept them ? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] What is ZFS metadata in regard to caching and redundant storage policy?
I just found that I do not exactly know: What is ZFS metadata in regard to caching and redundant storage policy? What sort of blocks does it include and what - doesn't? I know that there is some metadata which can be prioritized in ARC with primarycache (or in L2ARC with secondarycache) attributes. There is some metadata which is reportedly stored in a mirrored way regardless of a raidzN layout used for data blocks, and this matches what I see in iostat output. But which data is it - only ZFS infrastructure (indirect blocks et al), or also the filesystem directory tree? The latter I am interested in particular: if I set caching to metadata, should I expect recursive directory walks to be crippled or boosted? :) Thanks, //Jim ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] Non-Global zone recovery
Can we recover non-global zone if Global zone is reimaged because of an OS issue and non-global zone OS is running on different pool which is on SAN. For ex: Global is running on rpool - Internal disk Non-Global zone is running on testpool - Which is on SAN. Thanks, Ram -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What is ZFS metadata in regard to caching and redundant storage policy?
Hi Jim,
Non-metadata is the level zero blocks (leaf blocks) of those zfs objects
that store user payload. (plain files, volumes and the like)
Everything else is metadata.
The place to look is dmu.c.
Any object type enumerated in dmu_ot that is flagged TRUE is metadata
in its entirety, including its payload ( ie its level zero blocks).
Example:
const dmu_object_type_info_t dmu_ot [ DMU_OT_NUMTYPES ] = { {
byteswap_uint8_array , TRUE , unallocated }, { zap_byteswap , TRUE , object
directory }, { zfs_oldacl_byteswap , TRUE , ZFS V0 ACL },
{ byteswap_uint8_array , FALSE , ZFS plain file }, { zap_byteswap , TRUE ,
ZFS directory }, { zap_byteswap , TRUE , ZFS master node },
{ zap_byteswap , TRUE , ZFS delete queue },
{ byteswap_uint8_array , FALSE , zvol object },
Cheers,
Steve Gonczi
- Original Message -
I just found that I do not exactly know: What is ZFS metadata in regard
to caching and redundant storage policy? What sort of blocks does it
include and what - doesn't?
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
On Thu, Jul 7, 2011 at 2:08 PM, Ram ram.kum...@gmail.com wrote:
Can we recover non-global zone if Global zone is reimaged because of an OS
issue
and non-global zone OS is running on different pool which is on SAN.
If the NG Zone is on a different zpool, and that zpool was not
over-written, then you can easily recover the NG Zone, but that is
more a question for the zones-discuss list :-) Once you can see the NG
Zone again (zpool import, probably with a -F), then you just recreate
the NG Zone using zonecfg but do NOT install it. Once it is created
you just attach it with zoneadm (and use the upgrade on attach option,
I forget the flag if the OS rev of the Global zone is now newer).
For ex: Global is running on rpool - Internal disk
Non-Global zone is running on testpool - Which is on SAN.
You are probably OK. What was the old OS version and what is the new
OS version ?
--
{1-2-3-4-5-6-7-}
Paul Kraus
- Senior Systems Architect, Garnet River ( http://www.garnetriver.com/ )
- Sound Coordinator, Schenectady Light Opera Company (
http://www.sloctheater.org/ )
- Technical Advisor, RPI Players
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
Hi Ram, Which Solaris release is this and how was the OS re-imaged? If this is a recent Solaris 10 release and you used Live Upgrade, then the answer is yes. I'm not so sure about zone behavior in the Oracle Solaris 11 Express release. You should just be able to import testpool and boot your zones. Thanks, Cindy On 07/07/11 12:08, Ram wrote: Can we recover non-global zone if Global zone is reimaged because of an OS issue and non-global zone OS is running on different pool which is on SAN. For ex: Global is running on rpool - Internal disk Non-Global zone is running on testpool - Which is on SAN. Thanks, Ram ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
Hi Cindy, Thanks for the email. We are using Solaris 10 with out Live Upgrade. Tested following in the sandbox environment: 1) We have one non-global zone (TestZone) which is running on Test zpool (SAN) 2) Don’t see zpool or non-global zone after re-image of Global zone. 3) Imported zpool Test Now I am trying to create Non-global zone and it is giving error bash-3.00# zonecfg -z Test Test: No such zone configured Use 'create' to begin configuring a new zone. zonecfg:Test create -a /zones/Test invalid path to detached zone Thanks, Ram On Thu, Jul 7, 2011 at 3:14 PM, Cindy Swearingen cindy.swearin...@oracle.com wrote: Hi Ram, Which Solaris release is this and how was the OS re-imaged? If this is a recent Solaris 10 release and you used Live Upgrade, then the answer is yes. I'm not so sure about zone behavior in the Oracle Solaris 11 Express release. You should just be able to import testpool and boot your zones. Thanks, Cindy On 07/07/11 12:08, Ram wrote: Can we recover non-global zone if Global zone is reimaged because of an OS issue and non-global zone OS is running on different pool which is on SAN. For ex: Global is running on rpool - Internal disk Non-Global zone is running on testpool - Which is on SAN. Thanks, Ram ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
It looks like it is looking for SUNWdetached.xml which will create when we deattch the zone but in my case, I didn't deattach the zone before reimage. Thanks, Ram Sent via BlackBerry from T-Mobile -Original Message- From: Ram kumar ram.kum...@gmail.com Date: Thu, 7 Jul 2011 15:41:17 To: Cindy Swearingencindy.swearin...@oracle.com Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] Non-Global zone recovery Hi Cindy, Thanks for the email. We are using Solaris 10 with out Live Upgrade. Tested following in the sandbox environment: 1) We have one non-global zone (TestZone) which is running on Test zpool (SAN) 2) Don’t see zpool or non-global zone after re-image of Global zone. 3) Imported zpool Test Now I am trying to create Non-global zone and it is giving error bash-3.00# zonecfg -z Test Test: No such zone configured Use 'create' to begin configuring a new zone. zonecfg:Test create -a /zones/Test invalid path to detached zone Thanks, Ram On Thu, Jul 7, 2011 at 3:14 PM, Cindy Swearingen cindy.swearin...@oracle.com wrote: Hi Ram, Which Solaris release is this and how was the OS re-imaged? If this is a recent Solaris 10 release and you used Live Upgrade, then the answer is yes. I'm not so sure about zone behavior in the Oracle Solaris 11 Express release. You should just be able to import testpool and boot your zones. Thanks, Cindy On 07/07/11 12:08, Ram wrote: Can we recover non-global zone if Global zone is reimaged because of an OS issue and non-global zone OS is running on different pool which is on SAN. For ex: Global is running on rpool - Internal disk Non-Global zone is running on testpool - Which is on SAN. Thanks, Ram ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
Okay, so which Solaris 10 release is this? It might also depend on how your zones are created. You can review the support zone configurations here: http://download.oracle.com/docs/cd/E18752_01/html/819-5461/ggpdm.html#gigek Using Oracle Solaris Live Upgrade to Migrate or Upgrade a System With Zones (at Least Solaris 10 5/09) Also see Example 5-6 When you import your test pool, do you see your file systems: # zfs list Can you see your zone information: # zoneadm list -v Thanks, Cindy On 07/07/11 13:41, Ram kumar wrote: Hi Cindy, Thanks for the email. We are using Solaris 10 with out Live Upgrade. Tested following in the sandbox environment: 1) We have one non-global zone (TestZone) which is running on Test zpool (SAN) 2) Don’t see zpool or non-global zone after re-image of Global zone. 3) Imported zpool Test Now I am trying to create Non-global zone and it is giving error bash-3.00# zonecfg -z Test Test: No such zone configured Use 'create' to begin configuring a new zone. zonecfg:Test create -a /zones/Test invalid path to detached zone Thanks, Ram On Thu, Jul 7, 2011 at 3:14 PM, Cindy Swearingen cindy.swearin...@oracle.com mailto:cindy.swearin...@oracle.com wrote: Hi Ram, Which Solaris release is this and how was the OS re-imaged? If this is a recent Solaris 10 release and you used Live Upgrade, then the answer is yes. I'm not so sure about zone behavior in the Oracle Solaris 11 Express release. You should just be able to import testpool and boot your zones. Thanks, Cindy On 07/07/11 12:08, Ram wrote: Can we recover non-global zone if Global zone is reimaged because of an OS issue and non-global zone OS is running on different pool which is on SAN. For ex: Global is running on rpool - Internal disk Non-Global zone is running on testpool - Which is on SAN. Thanks, Ram ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
On Thu, Jul 7, 2011 at 4:24 PM, Cindy Swearingen
cindy.swearin...@oracle.com wrote:
I missed that you're using s10 *without* Live Upgrade.
If so, I don't know what the resulting zone behavior would be.
Wouldn't it be the same as just copying (or moving) a zone root
without first detaching it ? I have successfully attached zones in
that state (shut down but not detached).
In answer to an earlier post, I'm not sure what checks have been
added to zonecfg and zoneadm to prevent accidentally over writing a
zone. But first you need to make sure that you can see the zoneroot
and it's data. You may have to force an operation since you did not
detach the zone.
--
{1-2-3-4-5-6-7-}
Paul Kraus
- Senior Systems Architect, Garnet River ( http://www.garnetriver.com/ )
- Sound Coordinator, Schenectady Light Opera Company (
http://www.sloctheater.org/ )
- Technical Advisor, RPI Players
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Non-Global zone recovery
On Thu, Jul 7, 2011 at 2:41 PM, Ram kumar ram.kum...@gmail.com wrote: Hi Cindy, Thanks for the email. We are using Solaris 10 with out Live Upgrade. Tested following in the sandbox environment: 1) We have one non-global zone (TestZone) which is running on Test zpool (SAN) 2) Don’t see zpool or non-global zone after re-image of Global zone. 3) Imported zpool Test Now I am trying to create Non-global zone and it is giving error bash-3.00# zonecfg -z Test Test: No such zone configured Use 'create' to begin configuring a new zone. zonecfg:Test create -a /zones/Test invalid path to detached zone If you use create -a, it requires that SUNWdetached.xml exist as a means for configuring the various properties (e.g. zonepath, brand, etc.) and resources (inherit-pkg-dir, net, fs, device, etc.) for the zone. Since you don't have the SUNWdetached.xml, you can't use it. Assuming you have a backup of the system, you could restore a copy of /etc/zones/zonename.xml to /etc/zones/restored-zonename.xml, then run: zonecfg -z zonename create -t restored-zonename If that's not an option or is just too inconvenient, use zonecfg to configure the zone just like you did initially. That is, do not use create -a, use create, create -b, or create -t whateverTemplateYouUsed followed by whatever property settings and added resources are appropriate. After you get past zonecfg, you should be able to: zoneadm -z zonename attach If the package and patch levels don't match up (the global zone perhaps was installed from a newer update or has newer patches): zoneadm -z zonename attach -U or zoneadm -z zonename attach -u Since you seem to be doing this in a test environment to prepare for bad things to happen, I'd suggest that you make it a standard practice when you are done configuring a zone to do: zonecfg -z zonename export zonepath/zonecfg.export Then if you need to recover the zone using only the things that are on the SAN, you can do: zpool import ... zonecfg -z zonename -f zonepath/zonecfg.export zoneadm -z zonename attach [-u|-U] Any follow-ups should probably go to Oracle Support or zones-discuss. Your problems are not related to zfs. -- Mike Gerdts http://mgerdts.blogspot.com/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Replacement disks for Sun X4500
On 7/07/2011 3:12 PM, X4 User wrote: I am bumping this thread because I too have the same question ... can I put modern 3TB disks (hitachi deskstars) into an old x4500 ? If not, would the x4540 accept them ? I'd expect they would *work* but whether it would be a good idea or not could be debated and could indeed be a variable answer. My recollection of those boxes is that they had to use enterprise SATA disks in them (as opposed to consumer SATA) to deal with the internal vibration that resulted from having so many disks so densely packed. I recall being involved in a performance issue or two that was related to certain disks in the box going slow as a result of said vibrations. For an amusing example of how vibrations can impact disks, google Brendan Gregg shouting in the datacentre. So - assuming the disks actually work (and I don't recall there being any specific limitations) on the controllers, and you keep an eye on the disk response times (so you are aware of any disks not performing optimally), you should be OK. Of course - not in a production sense - as doing that without support would just be asking for trouble. ;) Oh - and as a final point - if you are planning to run Solaris on this box, make sure they are not the 4KB sector disks, as at least in my experience, their performance with ZFS is profoundly bad. Particularly with all the metadata update stuff... 4KB sectors almost seem to me to be a stunt be HDD manufacturers to be able to claim more available space for the same device, and to be lazy in the CRC generation/checking arena. And to profoundly impact the time it takes to read or update anything less than 4K. But - then again, maybe I'm missing something. Cheers! Nathan. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Replacement disks for Sun X4500
On Jul 7, 2011, at 3:33 PM, nathan wrote: On 7/07/2011 3:12 PM, X4 User wrote: I am bumping this thread because I too have the same question ... can I put modern 3TB disks (hitachi deskstars) into an old x4500 ? X4500 uses the LSI 1068e. AFAIK, that HBA does not support disks 2TB for all possible firmware revs. YMMV, based on the firmware installed. If not, would the x4540 accept them ? I'd expect they would *work* but whether it would be a good idea or not could be debated and could indeed be a variable answer. My recollection of those boxes is that they had to use enterprise SATA disks in them (as opposed to consumer SATA) to deal with the internal vibration that resulted from having so many disks so densely packed. I recall being involved in a performance issue or two that was related to certain disks in the box going slow as a result of said vibrations. Not quite. The vibration problem was due to mechanical design and that was fixed prior to GA. As for enterprise vs consumer class drives, Sun was not in the consumer business and, to my knowledge, did not bother qualifying consumer-grade disks. For an amusing example of how vibrations can impact disks, google Brendan Gregg shouting in the datacentre. Different scenario, of course, but same root cause :-) -- richard ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] ZIL, L2ARC, rpool -- partitions and mirrors oh my!
Putting together a server for a friend's recording studio. He's planning to do audio editing off the server, so low latency is a big deal. My plan is to create a pool of two 8-drive RAIDZ2 vdevs and then accelerate them... But how? OS if going to be latest OpenIndiana. I have a pair of 40GB SSDs (Crucial) with good write speeds and a pair of 64GB SSDs ( with good read speeds. I'd like to mirror the root pool. My initial thought was mirror the 40GB SSDs for the ZIL and partition the two 64s; mirror two slices for the rpool and two slices for the L2ARC. If there's a smarter way to do it, suggestions gratefully accepted. My current ZFS storage servers are all built around sustained reads/sustained writes, so tuning the ZIL and L2ARC are still outside my experience. -- Dave Pooser Manager of Information Services Alford Media Services, Inc. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZIL, L2ARC, rpool -- partitions and mirrors oh my!
On Thu, 7 Jul 2011, Dave Pooser wrote: My initial thought was mirror the 40GB SSDs for the ZIL and partition the two 64s; mirror two slices for the rpool and two slices for the L2ARC. If there's a smarter way to do it, suggestions gratefully accepted. My current ZFS storage servers are all built around sustained reads/sustained writes, so tuning the ZIL and L2ARC are still outside my experience. Since you have been reading this forum for a long time, you should already know that the key issue for zfs will be when zfs writes a transaction group because it tends to freeze during the transaction. Otherwise zfs will perform well. The key will be to tune the maximum TXG group size down to a size that your devices can handle expediently. The tunable for this is zfs_write_limit_override. For example put something like this in /etc/system: * Set ZFS maximum TXG group size to 2684354560 set zfs:zfs_write_limit_override = 0xa000 You could also tune down zfs_vdev_max_pending: * Set device I/O maximum concurrency * http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Device_I.2FO_Queue_Size_.28I.2FO_Concurrency.29 set zfs:zfs_vdev_max_pending = 5 Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Replacement disks for Sun X4500
2011-07-08 2:48, Richard Elling ?: On Jul 7, 2011, at 3:33 PM, nathan wrote: On 7/07/2011 3:12 PM, X4 User wrote: I am bumping this thread because I too have the same question ... can I put modern 3TB disks (hitachi deskstars) into an old x4500 ? X4500 uses the LSI 1068e. I think this applies to X4540, and I read that //X4500 uses Marvell/ /88SX6081 (SATA) Mine certainly reports Marvell serial-ATA #1-#6 in prtdiag, but I failed to get any indication of the chip via command-line. And there was some marketing talk about ZFS being suitable, or even incepted, for commodity hardware, to get the inexpensive part back into ra*I*d. AFAIK, that HBA does not support disks 2TB for all possible firmware revs. YMMV, based on the firmware installed. And yes, this applies to any controller in general ;) //Jim ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
