Putting aside briefly trying to get grub installed onto an md0 on my sparc, I tried just getting it on a single device that would then load up the zfs filesystems. First, getting it running on sdd, is working. At least, it works until I try to install onto sda, which seems to (often, though maybe not 100% of the time) mess up the grub on sdd as well. :-/
I have sdd on thie T5120, which has 4 identical disks, and I got grub installed onto it. /boot is in sdd1, / in sdd2, and others. Model: SEAGATE ST914603SSUN146G (scsi) Disk /dev/sdd: 147GB Sector size (logical/physical): 512B/512B Partition Table: sun Disk Flags: Number Start End Size File system Flags 1 0.00B 312MB 312MB ext2 boot 2 313MB 12.3GB 12.0GB ext4 4 30.1GB 46.5GB 16.5GB linux-swap(v1) 5 46.5GB 147GB 100GB ext4 Then I broke down the md that I'd put across sda1 and sdb1, and just have those as ext2 filesystems. ZFS on the rest of the disk. Model: SEAGATE ST914603SSUN146G (scsi) Disk /dev/sda: 147GB Sector size (logical/physical): 512B/512B Partition Table: sun Disk Flags: Number Start End Size File system Flags 1 0.00B 502MB 502MB ext2 boot 2 502MB 147GB 146GB zfs And, the grub/grub.cfg in that /boot looks right when I built it. Booting off of disk3, sdd, has been working for a while. So, to try sda again, I ran (while booted up on my installation on sdd): grub-install --force --skip-fs-probe /dev/sda1 But, unlike the grub on sdd1, it doesn't boot. Trying to load up from OBP I see: ----- {0} ok boot disk0 Boot device: /pci@0/pci@0/pci@2/scsi@0/disk@0 File and args: GRUB Loading kernel.... error: unable to open /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/hub@4/device@ 4/st. error: unable to open /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/hub@4/device@ 4/st. error: unable to open /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/hub@4/device@ 4/st. error: unable to open /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/hub@4/device@ 4/st. UNKNOWN DEVICE: ieee1275//pci@0/pci@0/pci@2/scsi@0/disk@3\,0:a error: unable to open /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/hub@4/device@ 4/st. error: unable to open /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/hub@4/device@ 4/st. ERROR: /pci@0: Last Trap: Fast Data Access MMU Miss {0} ok ----- Now, if I then try to boot disk3 again, which has been working just fine since the last time I recovered it by reinstalling grub using the rescue CD, I see: ----- {0} ok boot disk3 Boot device: /pci@0/pci@0/pci@2/scsi@0/disk@3 File and args: GRUB ERROR: Last Trap: Illegal Instruction {0} ok ----- (tried consecutive "boot disk3", with same results each time.) Rebooting from a rescue cd and executing a shell in sdd2 (with sdd1), I can run: root@t5120:/# grub-install --force --skip-fs-probe /dev/sdd1 Installing for sparc64-ieee1275 platform. grub-install: warning: Discarding improperly nested partition (hostdisk//dev/sdd,sun1,sun2). grub-install: warning: Discarding improperly nested partition (hostdisk//dev/sdd,sun1,sun4). grub-install: warning: Discarding improperly nested partition (hostdisk//dev/sdd,sun1,sun5). grub-install: warning: Attempting to install GRUB to a disk with multiple partition labels. This is not supported yet.. grub-install: warning: Embedding is not possible. GRUB can only be installed in this setup by using blocklists. However, blocklists are UNRELIABLE and their use is discouraged.. Installation finished. No error reported. root@t5120:/# ..and then reboot, and it will load up fine from sdd/disk3. Any idea why grub-install onto sda1 isn't working for me? Or more, how an attempt there could be messing up the grub installation on sdd1? Appreciate any ideas or pointers. Thanks all. - Chris