I forgot to copy the alias on my response to Victors questions. I think some other people might find the information useful.
Octave *-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-* Octave J. Orgeron Solaris Systems Engineer http://www.opensolaris.org/os/community/sysadmin/ http://unixconsole.blogspot.com unixconsole at yahoo.com *-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-* ----- Forwarded Message ---- From: Octave Orgeron <[email protected]> To: Victor Engle <victor.engle at gmail.com> Sent: Sunday, October 28, 2007 8:58:06 AM Subject: Re: [ldoms-discuss] Booting split-config with a file..cfgadm problem Hi, First off, I doing a split-pcie config is not going to buy you much in redundancy. This has more to do with the hardware layout than LDoms. But here are the keypoints when you do this on a T2k: 1. You end up with one service/io domain with only one PCI-E slot and two GigE ports. The other service/io domain will have 2 PCI-E slots, 2 PCI-X slots, and two GigE ports. This limits your ability to have redundancy for SAN, networking, etc. 2. Only one of the service/io domains will have a SAS controller. Meaning that only one of them has direct access to the internal storage. 3. Even if you virtualize the internal storage from one service/io domain to the other for its boot environment. It's a point of failure. If the primary service/io domain goes down, the secondary won't have access to its boot drives! If the primary doesn't come backup up in a reasonable amount of time, you can probably guess what will happen. 4. If you install a SCSI controller and attached external storage to boot the second service/io domain, you consume a valuable slot. And if it's the domain that has only one PCI-E slot, you obviously can't have an SAN HBA. So that can affect your redundancy for SAN storage. So in the end, it's not something I would recommend as it doesn't buy you a lot. It just ends up consuming more resources (VCPU, mem, IO, etc.) that could be used by a guest domain. Perhaps when the hardware is layed out properly, it'll have some advantages. I have to see how the T5120/T5220 behaves in this area. As for doing flash archives, the more vanilla you make the source system, the more applicable it is across the board. So installing things like VxVM can complicate things. I have fairly generic flash archives with the OS and patches. This works well in all LDom types without any issues. You will run into problems with cfgadm, format command, and products like VxVM(doesn't know how to handle virtual disks). Some issues are already resolved in Solaris Express. And other issues, like VxVM will have to wait until the vendor releases a new version. *-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-* Octave J. Orgeron Solaris Systems Engineer http://www.opensolaris.org/os/community/sysadmin/ http://unixconsole.blogspot.com unixconsole at yahoo.com *-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-* ----- Original Message ---- From: Victor Engle <[email protected]> To: Alexandre Chartre <Alexandre.Chartre at sun.com> Cc: ldoms-discuss at opensolaris.org Sent: Sunday, October 28, 2007 5:40:10 AM Subject: Re: [ldoms-discuss] Booting split-config with a file..cfgadm problem On 10/26/07, Alexandre Chartre <Alexandre.Chartre at sun.com> wrote: > > Yes, that's normal. cfgadm is not supported with virtual disks. This is working now. The guest domain has an hba in pcie-0 and when I initially installed I did an initial_install jumpstart onto a physical disk which I had exported from the control domain. Then I reinstalled using a flash archive created on another T2000 which had not been configured with ldoms and this time I installed onto a disk backed by a file. That's when I ran into the cfgadm problem. I had the same problem when put that flash image on the physical disk. The flash image had VxVM installed and I noticed that at boot it was complaining about a bunch of stale disk links so I ran "devfsadm -C" and that fixed the cfgadm problem. I would have expected the device files to be created properly during the flash install. _______________________________________________ ldoms-discuss mailing list ldoms-discuss at opensolaris.org http://mail.opensolaris.org/mailman/listinfo/ldoms-discuss __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com
