Re: gmirror, sparc and SCSI problems
On Jul 9, 2005, at 9:36 AM, Chris Hodgins wrote: Danny, Thanks for the link. This was actually the first link we tried to get working and after it failed to work we followed the link on the page to http://people.freebsd.org/~rse/mirror/. Everything worked fine until we arrived at this step below. # mount /dev/mirror/gm0s1a /mnt It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? Thanks Chris ___ Chris, Based on my experience, it doesn't work to partition the underlying disk device da0, but rather the mirror device gm0. I've had a lot of success writing out new labels with # bsdlabel -w /dev/mirror/gm0 # bsdlabel -e /dev/mirror/gm0 Editing the partition table by hand is a bummer, but for now, since mirror devices don't show up in fdisk/disklabel tools in /stand/ sysinstall, this is the only way I know of to do it. -Stephen ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: gmirror, sparc and SCSI problems
Am Montag, 11. Juli 2005 15:49 CEST schrieb Chris Hodgins: On 7/10/05, Johannes Verwijnen [EMAIL PROTECTED] wrote: On Jul 9, 2005, at 19:36, Chris Hodgins wrote: It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? I remember (vaguely)) this kind of problem, where when trying to mirror a whole disk, you'd only get the first slice. Have you tried mirroring the slices (da0s1 etc) separately? -- duvin Firstly thanks for all the suggestions. We managed to build the mirrors by using the suggestion above mirroring the slices separately. Unfortunetly, although the mirrors were created properly the filesystems are constantly suffering from inconsistencies and fsck actually appears to be segfaulting. I can't help you with the fsck segfault, nor can I tell too much about SPARC but I saw that you use a gmirror for swap. Do you also have the problems when you use shutdown -r now instead of reeboot?. If I remember correctly 5.4 shouldn't need swapoff=YES to be set in /etc/rc.conf but maybe the reboot issue still exists. -Harry We have decided not to pursue this any further for the moment, however we are prepared to allow access to the machine should anyone wish to try and sort out this incompatibility with gmirror and sparc. Included below is a brief logfile of a reboot after fsck'ing all of the mirrored partitions. # reboot Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...0 0 done No buffers busy after final sync Uptime: 5m23s GEOM_MIRROR: Device gm0e: provider mirror/gm0e destroyed. GEOM_MIRROR: Device gm0e destroyed. GEOM_MIRROR: Device gm0d: provider mirror/gm0d destroyed. GEOM_MIRROR: Device gm0d destroyed. GEOM_MIRROR: Device gm0b: provider mirror/gm0b destroyed. GEOM_MIRROR: Device gm0b destroyed. GEOM_MIRROR: Device gm0a: provider mirror/gm0a destroyed. GEOM_MIRROR: Device gm0a destroyed. Rebooting... Resetti LOM event: +38d+3h37m11s host reset ng ... \u Processor Speed = 648 MHz Baud rate is 9600 8 Data bits, 1 stop bits, no parity (configured from lom) Firmware CORE Sun Microsystems, Inc. @(#) core 1.0.12 2002/01/08 13:00 Software Power ON Verifying NVRAM...Done Bootmode is 0 [New I2C DIMM address] MCR0 = 57b2ce06 MCR1 = 80008000 MCR2 = cf3000ff MCR3 = a0cf Ecache Size = 512 KB Clearing E$ Tags Done Clearing I/D TLBs Done Probing memory Done MEMBASE=0x4000 MEMSIZE=0x2000 Clearing memory...Done Turning ON MMUs Done Copy ROM to RAM (170040 bytes) Done Orig PC=0x1fff0007e44 New PC=0xf0f07e9c Processor Speed=648MHz Looking for Dropin FVM ... found Decompressing Client Done Transferring control to Client... ttya initialized Reset Control: BXIR:0 BPOR:0 SXIR:0 SPOR:1 POR:0 Probing upa at 1f,0 pci pci pci Probing upa at 0,0 SUNW,UltraSPARC-IIe SUNW,UltraSPARC-IIe (512 Kb) Loading Support Packages: kbd-translator Loading onboard drivers: ebus flashprom eeprom idprom SUNW,lomh Probing /[EMAIL PROTECTED],1 Device 3 pmu i2c temperature dimm dimm i2c-nvram idprom motherboard-fru fan-control lomp Sun Fire V120 (UltraSPARC-IIe 648MHz), No Keyboard OpenBoot 4.0, 1024 MB memory installed, Serial #53833010. Ethernet address 0:3:ba:35:6d:32, Host ID: 83356d32. Executing last command: boot /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a Boot device: /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a File and args: FreeBSD/sparc64 boot block Boot path: /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a Boot loader: /boot/loader Console: Open Firmware console FreeBSD/sparc64 bootstrap loader, Revision 1.0 ([EMAIL PROTECTED], Sun May 8 07:16:15 UTC 2005) bootpath=/[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a Loading /boot/defaults/loader.conf /boot/kernel/kernel data=0x3d8908+0x47c78 syms=[0x8+0x50b80+0x8+0x45260] /boot/kernel/geom_mirror.ko text=0x21558 data=0x5b0+0x18 syms=[0x8+0x1638+0x8+0x10da] Hit [Enter] to boot immediately, or any other key for command prompt. Booting [/boot/kernel/kernel]... nothing to autoload yet. jumping to kernel entry at 0xc004. Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.4-RELEASE #0: Sun May 8 22:21:34 UTC 2005 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/GENERIC Timecounter tick frequency 64800 Hz quality
Re: gmirror, sparc and SCSI problems
On 7/10/05, Johannes Verwijnen [EMAIL PROTECTED] wrote: On Jul 9, 2005, at 19:36, Chris Hodgins wrote: It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? I remember (vaguely)) this kind of problem, where when trying to mirror a whole disk, you'd only get the first slice. Have you tried mirroring the slices (da0s1 etc) separately? -- duvin Firstly thanks for all the suggestions. We managed to build the mirrors by using the suggestion above mirroring the slices separately. Unfortunetly, although the mirrors were created properly the filesystems are constantly suffering from inconsistencies and fsck actually appears to be segfaulting. We have decided not to pursue this any further for the moment, however we are prepared to allow access to the machine should anyone wish to try and sort out this incompatibility with gmirror and sparc. Included below is a brief logfile of a reboot after fsck'ing all of the mirrored partitions. # reboot Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...0 0 done No buffers busy after final sync Uptime: 5m23s GEOM_MIRROR: Device gm0e: provider mirror/gm0e destroyed. GEOM_MIRROR: Device gm0e destroyed. GEOM_MIRROR: Device gm0d: provider mirror/gm0d destroyed. GEOM_MIRROR: Device gm0d destroyed. GEOM_MIRROR: Device gm0b: provider mirror/gm0b destroyed. GEOM_MIRROR: Device gm0b destroyed. GEOM_MIRROR: Device gm0a: provider mirror/gm0a destroyed. GEOM_MIRROR: Device gm0a destroyed. Rebooting... Resetti LOM event: +38d+3h37m11s host reset ng ... \u Processor Speed = 648 MHz Baud rate is 9600 8 Data bits, 1 stop bits, no parity (configured from lom) Firmware CORE Sun Microsystems, Inc. @(#) core 1.0.12 2002/01/08 13:00 Software Power ON Verifying NVRAM...Done Bootmode is 0 [New I2C DIMM address] MCR0 = 57b2ce06 MCR1 = 80008000 MCR2 = cf3000ff MCR3 = a0cf Ecache Size = 512 KB Clearing E$ Tags Done Clearing I/D TLBs Done Probing memory Done MEMBASE=0x4000 MEMSIZE=0x2000 Clearing memory...Done Turning ON MMUs Done Copy ROM to RAM (170040 bytes) Done Orig PC=0x1fff0007e44 New PC=0xf0f07e9c Processor Speed=648MHz Looking for Dropin FVM ... found Decompressing Client Done Transferring control to Client... ttya initialized Reset Control: BXIR:0 BPOR:0 SXIR:0 SPOR:1 POR:0 Probing upa at 1f,0 pci pci pci Probing upa at 0,0 SUNW,UltraSPARC-IIe SUNW,UltraSPARC-IIe (512 Kb) Loading Support Packages: kbd-translator Loading onboard drivers: ebus flashprom eeprom idprom SUNW,lomh Probing /[EMAIL PROTECTED],1 Device 3 pmu i2c temperature dimm dimm i2c-nvram idprom motherboard-fru fan-control lomp Sun Fire V120 (UltraSPARC-IIe 648MHz), No Keyboard OpenBoot 4.0, 1024 MB memory installed, Serial #53833010. Ethernet address 0:3:ba:35:6d:32, Host ID: 83356d32. Executing last command: boot /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a Boot device: /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a File and args: FreeBSD/sparc64 boot block Boot path: /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a Boot loader: /boot/loader Console: Open Firmware console FreeBSD/sparc64 bootstrap loader, Revision 1.0 ([EMAIL PROTECTED], Sun May 8 07:16:15 UTC 2005) bootpath=/[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a Loading /boot/defaults/loader.conf /boot/kernel/kernel data=0x3d8908+0x47c78 syms=[0x8+0x50b80+0x8+0x45260] /boot/kernel/geom_mirror.ko text=0x21558 data=0x5b0+0x18 syms=[0x8+0x1638+0x8+0x10da] Hit [Enter] to boot immediately, or any other key for command prompt. Booting [/boot/kernel/kernel]... nothing to autoload yet. jumping to kernel entry at 0xc004. Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.4-RELEASE #0: Sun May 8 22:21:34 UTC 2005 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/GENERIC Timecounter tick frequency 64800 Hz quality 1000 real memory = 1073741824 (1024 MB) avail memory = 1025818624 (978 MB) cpu0: Sun Microsystems UltraSparc-IIe Processor (648.00 MHz CPU) nexus0: Open Firmware Nexus device pcib0: U2P UPA-PCI bridge on nexus0 pcib0: Sabre, impl 0, version 0, ign 0x7c0, bus A pcib0 dvma: DVMA map: 0xc000 to 0xc3ff pci0: OFW PCI bus on pcib0 pcib1: APB PCI-PCI bridge at device 1.1 on pci0 pci1: OFW PCI bus on pcib1 ebus0: PCI-EBus3 bridge mem 0xf100-0xf17f,0xf000-0xf0ff at device 12.0 on
Re: gmirror, sparc and SCSI problems
On Jul 9, 2005, at 19:36, Chris Hodgins wrote: It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? I remember (vaguely)) this kind of problem, where when trying to mirror a whole disk, you'd only get the first slice. Have you tried mirroring the slices (da0s1 etc) separately? -- duvin ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: gmirror, sparc and SCSI problems
On Sat, Jul 09, 2005 at 05:36:43PM +0100, Chris Hodgins wrote: On 7/9/05, Danny Howard [EMAIL PROTECTED] wrote: On Fri, Jul 08, 2005 at 03:48:52PM +0100, Chris Hodgins wrote: Hi all, Experiencing a few difficulties setting up raid mirroring across two SCSI disks on a sparc based server. Disk da0 contains a working and recent install of FreeBSD 5-4 RELEASE and da1 is blank. We have been following the guidance given in the first part of http://people.freebsd.org/~rse/mirror/ but have hit numerous problems. Chris, These instructions are useful if you don't want to boot into recovery console to set things up offline. You can save a lot of fancy footwork if you have physical access and a CD-ROM, and don't mind about 15 minutes of downtime. My crib sheet is at http://dannyman.toldme.com/2005/01/24/freebsd-howto-gmirror-system/ . If it does work for you, plesae let me know. I'd be plased to hear that it can handle Sparc. :) Sincerely, -danny Danny, Thanks for the link. This was actually the first link we tried to get working and after it failed to work we followed the link on the page to http://people.freebsd.org/~rse/mirror/. Everything worked fine until we arrived at this step below. # mount /dev/mirror/gm0s1a /mnt It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? Sparc and sparc64 don't use slices so instead of fdisk(8) and bsdlabel(8) one just uses sunlabel(8) on sparc64. This should also mean that instead of `mount /dev/mirror/gm0s1a /mnt` one would use e.g. `mount /dev/mirror/gm0a /mnt` on sparc64. I don't know though if gmirror(8) needs to be made aware of this for e.g. `gmirror label` to do the right thing or maybe already is, i.e. whether it needs further changes in order to make it work on sparc64. Marius ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: gmirror, sparc and SCSI problems
On 7/9/05, Danny Howard [EMAIL PROTECTED] wrote: On Fri, Jul 08, 2005 at 03:48:52PM +0100, Chris Hodgins wrote: Hi all, Experiencing a few difficulties setting up raid mirroring across two SCSI disks on a sparc based server. Disk da0 contains a working and recent install of FreeBSD 5-4 RELEASE and da1 is blank. We have been following the guidance given in the first part of http://people.freebsd.org/~rse/mirror/ but have hit numerous problems. Chris, These instructions are useful if you don't want to boot into recovery console to set things up offline. You can save a lot of fancy footwork if you have physical access and a CD-ROM, and don't mind about 15 minutes of downtime. My crib sheet is at http://dannyman.toldme.com/2005/01/24/freebsd-howto-gmirror-system/ . If it does work for you, plesae let me know. I'd be plased to hear that it can handle Sparc. :) Sincerely, -danny Danny, Thanks for the link. This was actually the first link we tried to get working and after it failed to work we followed the link on the page to http://people.freebsd.org/~rse/mirror/. Everything worked fine until we arrived at this step below. # mount /dev/mirror/gm0s1a /mnt It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? Thanks Chris ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: gmirror, sparc and SCSI problems
On Sat, Jul 09, 2005 at 05:36:43PM +0100, Chris Hodgins wrote: Everything worked fine until we arrived at this step below. # mount /dev/mirror/gm0s1a /mnt It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? Just a wild guess, maybe for Sparc hardware you still need to run MAKEDEV? -danny ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: gmirror, sparc and SCSI problems
On 7/9/05, Danny Howard [EMAIL PROTECTED] wrote: On Sat, Jul 09, 2005 at 05:36:43PM +0100, Chris Hodgins wrote: Everything worked fine until we arrived at this step below. # mount /dev/mirror/gm0s1a /mnt It seems that gmirror does not give us any partitions. A listing of the mirror directory shows only the gm0 node even though da0 is partitioned. When mounting the mirror it seems that /dev/mirror/gm0 only represents the root partition. How can we get the mirror to recognise the other partitions? Just a wild guess, maybe for Sparc hardware you still need to run MAKEDEV? -danny According to http://www.freebsd.org/releases/5.4R/migration-guide.html: MAKEDEV is no longer available, nor is it required. FreeBSD 5.X uses a device file system, which automatically creates device nodes on demand. Configuration of the entries in the device filesystem can be performed with the devfs(8) utility or with the /etc/devfs.conf mechanism. More information can be found in the devfs(5) manual page. Unfortunetly there is no MAKEDEV in 5.4, even for sparc. Is it possible it is some sort of compatibility problem with the partitions created and gmirror? Thanks Chris ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
gmirror, sparc and SCSI problems
Hi all, Experiencing a few difficulties setting up raid mirroring across two SCSI disks on a sparc based server. Disk da0 contains a working and recent install of FreeBSD 5-4 RELEASE and da1 is blank. We have been following the guidance given in the first part of http://people.freebsd.org/~rse/mirror/ but have hit numerous problems. The first problem is that the system is lacking fdisk. From reading around on various newsgroups, this appears to be due to the sparc architecture. It seems that we can probably miss this step out anyway though although it may be related to our next problem. The next step requires us to run bsdlabel (or in our case sunlabel) on /dev/mirror/gm0s1. In our /dev/mirror directory we only have a single gm0 node so we can't run these steps either. We managed to assemble da1 with the partitions we wanted using sysinstall and had thought that by creating the mirror on da1 it would generate the appropriate gm0a, gm0b...etc. Unfortunately this did not work. Here is the output of sunlabel: # sunlabel -c mirror/gm0 # /dev/mirror/gm0: text: FreeBSD34G cyl 4425 alt 2 hd 255 sec 63 bytes/sectors: 512 sectors/cylinder: 16065 sectors/unit: 71087625 8 partitions: # # Size is in cylinders. # Offset is in cylinders. #size offset #-- -- b:262131 c: 4425 0 d:131 0 e:653393 f:262 1046 Straight after we ran sysinstall we ran sunlabel -e da1 and added the offset of 16, as you can see from the above output our offset has now gone again. Now this also brings us onto another interesting problem. Our two scsi disks are identical. Same size, manufacturer and part number. However running sunlabel -c on both of them gives very different sizes in regards to cyclinders and sectors: # sunlabel -c da0 # /dev/da0: text: FreeBSD34G cyl 24620 alt 2 hd 27 sec 107 bytes/sectors: 512 sectors/cylinder: 2889 sectors/unit: 71127180 8 partitions: # # Size is in cylinders. # Offset is in cylinders. #size offset #-- -- a:726 0 b: 1452726 c: 24620 0 d: 3630 2178 e: 1452 5808 # sunlabel -c da1 # /dev/da1: text: FreeBSD34G cyl 4425 alt 2 hd 255 sec 63 bytes/sectors: 512 sectors/cylinder: 16065 sectors/unit: 71087625 8 partitions: # # Size is in cylinders. # Offset is in cylinders. #size offset #-- -- b:262131 c: 4425 0 d:131 0 e:653393 f:262 1046 dmesg shows our disks like this: da0 at sym0 bus 0 target 0 lun 0 da0: SEAGATE ST336607LSUN36G 0207 Fixed Direct Access SCSI-3 device da0: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabledda0: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) da1 at sym0 bus 0 target 1 lun 0 da1: SEAGATE ST336607LSUN36G 0207 Fixed Direct Access SCSI-3 device da1: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabledda1: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) dmesg also shows the mirror being completed: GEOM_MIRROR: Device gm0 created (id=2793795997). GEOM_MIRROR: Device gm0: provider da1 detected. GEOM_MIRROR: Device gm0: provider da1 activated. GEOM_MIRROR: Device gm0: provider mirror/gm0 launched. Does anyone have any information that may help us resolve any of these problems? Many thanks Chris ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: gmirror, sparc and SCSI problems
On Fri, Jul 08, 2005 at 03:48:52PM +0100, Chris Hodgins wrote: Hi all, Experiencing a few difficulties setting up raid mirroring across two SCSI disks on a sparc based server. Disk da0 contains a working and recent install of FreeBSD 5-4 RELEASE and da1 is blank. We have been following the guidance given in the first part of http://people.freebsd.org/~rse/mirror/ but have hit numerous problems. Chris, These instructions are useful if you don't want to boot into recovery console to set things up offline. You can save a lot of fancy footwork if you have physical access and a CD-ROM, and don't mind about 15 minutes of downtime. My crib sheet is at http://dannyman.toldme.com/2005/01/24/freebsd-howto-gmirror-system/ . If it does work for you, plesae let me know. I'd be plased to hear that it can handle Sparc. :) Sincerely, -danny ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
