Hey all, I'm not sure if this is a ZFS bug or a hardware issue I'm having - any pointers would be great!
Following contents include: - high-level info about my system - my first thought to debugging this - stack trace - format output - zpool status output - dmesg output High-Level Info About My System --------------------------------------------- - fresh install of b78 - first time trying to do anything IO-intensive with ZFS - command was `cp -r /cdrom /tank/sxce_b78_disk1` - but this also fails `cp -r /usr /tank/usr` - system has 24 sata/sas drive bays, but only 12 of them all populated - system has three AOC-SAT2-MV8 cards plugged into 6 mini-sas backplanes - card1 ("c3") - bp1 (c3t0d0, c3t1d0) - bp2 (c3t4d0, c3t5d0) - card2 ("c4") - bp1 (c4t0d0, c4t1d0) - bp2 (c4t4d0, c4t5d0) - card3 ("c5") - bp1 (c5t0d0, c5t1d0) - bp2 (c5t4d0, c5t5d0) - system has one Barcelona Opteron (step BA) - the one with the potential look-aside cache bug... - though its not clear this is related... My First Thought To Debugging This ------------------------------------------------ After crashing my system several times (using `cp -r /usr /tank/usr`) and comparing the outputs, I noticed that it stack trace always points to "device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1", which corresponds to all the drives connected to aoc-sat-mv8 card #3 (i.e. "c5") But looking at the `format` output, this device path only differs from the other devices in that there is a ",1" trailing the "/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]" part. Further, again looking at the `format` output, "c3" devices have "4/disk", "c4" devices have "6/disk", and "c5" devices also have "6/disk". The only other thing I can add to this is that if I boot a Xen kernel, which I was *not* using for all these tests, I the following IRQ errors are reported: SunOS Release 5.11 Version snv_78 64-bit Copyright 1983-2007 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. Hostname: san NOTICE: IRQ17 is shared Reading ZFS config: done Mounting ZFS filesystems: (1/1) NOTICE: IRQ20 is shared NOTICE: IRQ21 is shared NOTICE: IRQ22 is shared Any ideas? Stack Trace (note: I've done this a few times and its always "/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1") --------------- ATA UDMA data parity error SUNW-MSG-ID: SUNOS-8000-0G, TYPE: Error, VER: 1, SEVERITY: Major EVENT-TIME: 0x478f39ab.0x160dc688 (0x5344bb5958) PLATFORM: i86pc, CSN: -, HOSTNAME: san SOURCE: SunOS, REV: 5.11 snv_78 DESC: Errors have been detected that require a reboot to ensure system integrity. See http://www.sun.com/msg/SUNOS-8000-0G for more information. AUTO-RESPONSE: Solaris will attempt to save and diagnose the error telemetry IMPACT: The system will sync files, save a crash dump if needed, and reboot REC-ACTION: Save the error summary below in case telemetry cannot be saved panic[cpu3]/thread=ffffff000f7c2c80: pcie_pci-0: PCI(-X) Express Fatal Error ffffff000f7c2bc0 pcie_pci:pepb_err_msi_intr+d2 () ffffff000f7c2c20 unix:av_dispatch_autovect+78 () ffffff000f7c2c60 unix:dispatch_hardint+2f () ffffff000fd09fd0 unix:switch_sp_and_call+13 () ffffff000fd0a020 unix:do_interrupt+a0 () ffffff000fd0a030 unix:cmnint+ba () ffffff000fd0a130 genunix:avl_first+1e () ffffff000fd0a1f0 zfs:metaslab_group_alloc+d1 () ffffff000fd0a2c0 zfs:metaslab_alloc_dva+1b7 () ffffff000fd0a360 zfs:metaslab_alloc+82 () ffffff000fd0a3b0 zfs:zio_dva_allocate+8a () ffffff000fd0a3d0 zfs:zio_next_stage+b3 () ffffff000fd0a400 zfs:zio_checksum_generate+6e () ffffff000fd0a420 zfs:zio_next_stage+b3 () ffffff000fd0a490 zfs:zio_write_compress+239 () ffffff000fd0a4b0 zfs:zio_next_stage+b3 () ffffff000fd0a500 zfs:zio_wait_for_children+5d () ffffff000fd0a520 zfs:zio_wait_children_ready+20 () ffffff000fd0a540 zfs:zio_next_stage_async+bb () ffffff000fd0a560 zfs:zio_nowait+11 () ffffff000fd0a870 zfs:dbuf_sync_leaf+1ac () ffffff000fd0a8b0 zfs:dbuf_sync_list+51 () ffffff000fd0a900 zfs:dbuf_sync_indirect+cd () ffffff000fd0a940 zfs:dbuf_sync_list+5e () ffffff000fd0a9b0 zfs:dnode_sync+23b () ffffff000fd0a9f0 zfs:dmu_objset_sync_dnodes+55 () ffffff000fd0aa70 zfs:dmu_objset_sync+13d () ffffff000fd0aac0 zfs:dsl_dataset_sync+5d () ffffff000fd0ab30 zfs:dsl_pool_sync+b5 () ffffff000fd0abd0 zfs:spa_sync+208 () ffffff000fd0ac60 zfs:txg_sync_thread+19a () ffffff000fd0ac70 unix:thread_start+8 () syncing file systems... 1 1 done ereport.io.pciex.rc.fe-msg ena=5344b8176c00c01 detector=[ version=0 scheme= "dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]" ] rc-status=800007c source-id=201 source-valid=1 ereport.io.pciex.rc.mue-msg ena=5344b8176c00c01 detector=[ version=0 scheme= "dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]" ] rc-status=800007c ereport.io.pci.sec-rserr ena=5344b8176c00c01 detector=[ version=0 scheme="dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]" ] pci-sec-status=6000 pci-bdg-ctrl=3 ereport.io.pci.sec-ma ena=5344b8176c00c01 detector=[ version=0 scheme="dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]" ] pci-sec-status=6000 pci-bdg-ctrl=3 ereport.io.pciex.bdg.sec-perr ena=5344b8176c00c01 detector=[ version=0 scheme= "dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1" ] sue-status=1800 source-id=201 source-valid=1 ereport.io.pciex.bdg.sec-serr ena=5344b8176c00c01 detector=[ version=0 scheme= "dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1" ] sue-status=1800 ereport.io.pci.sec-rserr ena=5344b8176c00c01 detector=[ version=0 scheme="dev" device-path="/[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1" ] pci-sec-status=6420 pci-bdg-ctrl=7 dumping to /dev/dsk/c2t0d0s1, offset 215547904, content: kernel NOTICE: /[EMAIL PROTECTED],0/pci15d9,[EMAIL PROTECTED]: port 0: device reset 100% done: 114942 pages dumped, compression ratio 4.24, dump succeeded rebooting... Format output ------------------ # format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c2t0d0 <DEFAULT cyl 6527 alt 2 hd 255 sec 63> /[EMAIL PROTECTED],0/pci15d9,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 1. c2t1d0 <DEFAULT cyl 6527 alt 2 hd 255 sec 63> /[EMAIL PROTECTED],0/pci15d9,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 2. c3t0d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 3. c3t1d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 4. c3t4d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 5. c3t5d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 6. c4t0d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 7. c4t1d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 8. c4t4d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 9. c4t5d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 10. c5t0d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 11. c5t1d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 12. c5t4d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 13. c5t5d0 <ATA-ST31000340NS-SN03-931.51GB> /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Zpool Status Output ------------------------- # zpool status pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz2 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 c3t4d0 ONLINE 0 0 0 c4t0d0 ONLINE 0 0 0 c4t4d0 ONLINE 0 0 0 c5t0d0 ONLINE 0 0 0 c5t4d0 ONLINE 0 0 0 raidz2 ONLINE 0 0 0 c3t1d0 ONLINE 0 0 0 c3t5d0 ONLINE 0 0 0 c4t1d0 ONLINE 0 0 0 c4t5d0 ONLINE 0 0 0 c5t1d0 ONLINE 0 0 0 c5t5d0 ONLINE 0 0 0 errors: No known data errors Dmesg Output (sorry, it looks like the beginning of the dmesg output is missing) ------------------- # dmesg Thu Jan 17 06:42:37 EST 2008 Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd8 at marvell88sx0: target 4 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd8 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:19 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd8) online Jan 17 06:41:19 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:19 san sata: [ID 761595 kern.info] SATA disk device at port 5 Jan 17 06:41:19 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:19 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:19 san sata: [ID 163988 kern.info] serial number 5QJ0337Z Jan 17 06:41:19 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:19 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:19 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd10 at marvell88sx0: target 5 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd10 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:19 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd10) online Jan 17 06:41:19 san pcplusmp: [ID 444295 kern.info] pcplusmp: pci11ab,6081.9 (marvell88sx) instance #1 vector 0x1b ioapic 0xff intin 0xff is bound to cpu 1 Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 0 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 1 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 2 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 3 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 4 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 5 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 6 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx1: device on port 7 reset: initialization Jan 17 06:41:19 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:19 san sata: [ID 761595 kern.info] SATA disk device at port 0 Jan 17 06:41:19 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:19 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:19 san sata: [ID 163988 kern.info] serial number 9QJ00TE2 Jan 17 06:41:19 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:19 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:19 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd12 at marvell88sx1: target 0 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd12 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:19 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd12) online Jan 17 06:41:19 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:19 san sata: [ID 761595 kern.info] SATA disk device at port 1 Jan 17 06:41:19 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:19 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:19 san sata: [ID 163988 kern.info] serial number 5QJ02T3F Jan 17 06:41:19 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:19 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:19 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd13 at marvell88sx1: target 1 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd13 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:19 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd13) online Jan 17 06:41:19 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:19 san sata: [ID 761595 kern.info] SATA disk device at port 4 Jan 17 06:41:19 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:19 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:19 san sata: [ID 163988 kern.info] serial number 9QJ00PWQ Jan 17 06:41:19 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:19 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:19 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd14 at marvell88sx1: target 4 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd14 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:19 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd14) online Jan 17 06:41:19 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:19 san sata: [ID 761595 kern.info] SATA disk device at port 5 Jan 17 06:41:19 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:19 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:19 san sata: [ID 163988 kern.info] serial number 9QJ00QN7 Jan 17 06:41:19 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:19 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:19 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd15 at marvell88sx1: target 5 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd15 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:19 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd15) online Jan 17 06:41:19 san pcplusmp: [ID 444295 kern.info] pcplusmp: pci11ab,6081.9 (marvell88sx) instance #2 vector 0x1c ioapic 0xff intin 0xff is bound to cpu 1 Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 0 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 1 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 2 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 3 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 4 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 5 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 6 reset: initialization Jan 17 06:41:19 san marvell88sx: [ID 670675 kern.info] NOTICE: marvell88sx2: device on port 7 reset: initialization Jan 17 06:41:19 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:19 san sata: [ID 761595 kern.info] SATA disk device at port 0 Jan 17 06:41:19 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:19 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:19 san sata: [ID 163988 kern.info] serial number 9QJ00WQM Jan 17 06:41:19 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:19 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:19 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:19 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:19 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:19 san scsi: [ID 193665 kern.info] sd4 at marvell88sx2: target 0 lun 0 Jan 17 06:41:19 san genunix: [ID 936769 kern.info] sd4 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:20 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd4) online Jan 17 06:41:20 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:20 san sata: [ID 761595 kern.info] SATA disk device at port 1 Jan 17 06:41:20 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:20 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:20 san sata: [ID 163988 kern.info] serial number 9QJ00AWL Jan 17 06:41:20 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:20 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:20 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:20 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:20 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:20 san scsi: [ID 193665 kern.info] sd7 at marvell88sx2: target 1 lun 0 Jan 17 06:41:20 san genunix: [ID 936769 kern.info] sd7 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:20 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd7) online Jan 17 06:41:20 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:20 san sata: [ID 761595 kern.info] SATA disk device at port 4 Jan 17 06:41:20 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:20 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:20 san sata: [ID 163988 kern.info] serial number 9QJ00WBG Jan 17 06:41:20 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:20 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:20 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:20 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:20 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:20 san scsi: [ID 193665 kern.info] sd9 at marvell88sx2: target 4 lun 0 Jan 17 06:41:20 san genunix: [ID 936769 kern.info] sd9 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:20 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd9) online Jan 17 06:41:20 san sata: [ID 663010 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED] : Jan 17 06:41:20 san sata: [ID 761595 kern.info] SATA disk device at port 5 Jan 17 06:41:20 san sata: [ID 846691 kern.info] model ST31000340NS Jan 17 06:41:20 san sata: [ID 693010 kern.info] firmware SN03 Jan 17 06:41:20 san sata: [ID 163988 kern.info] serial number 9QJ026NE Jan 17 06:41:20 san sata: [ID 594940 kern.info] supported features: Jan 17 06:41:20 san sata: [ID 981177 kern.info] 48-bit LBA, DMA, Native Command Queueing, SMART, SMART self-test Jan 17 06:41:20 san sata: [ID 514995 kern.info] SATA Gen1 signaling speed (1.5Gbps) Jan 17 06:41:20 san sata: [ID 349649 kern.info] Supported queue depth 32 Jan 17 06:41:20 san sata: [ID 349649 kern.info] capacity = 1953525168 sectors Jan 17 06:41:20 san scsi: [ID 193665 kern.info] sd11 at marvell88sx2: target 5 lun 0 Jan 17 06:41:20 san genunix: [ID 936769 kern.info] sd11 is /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:20 san genunix: [ID 408114 kern.info] /[EMAIL PROTECTED],0/pci10de,[EMAIL PROTECTED]/pci1033,[EMAIL PROTECTED],1/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0 (sd11) online Jan 17 06:41:22 san pseudo: [ID 129642 kern.info] pseudo-device: pm0 Jan 17 06:41:22 san genunix: [ID 936769 kern.info] pm0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:41:22 san genunix: [ID 314293 kern.info] device pciclass,[EMAIL PROTECTED](display#0) keeps up device [EMAIL PROTECTED],0(disk#0), but the latter is not power managed Jan 17 06:41:22 san pseudo: [ID 129642 kern.info] pseudo-device: power0 Jan 17 06:41:22 san genunix: [ID 936769 kern.info] power0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:41:22 san pseudo: [ID 129642 kern.info] pseudo-device: srn0 Jan 17 06:41:22 san genunix: [ID 936769 kern.info] srn0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:41:22 san /usr/lib/power/powerd: [ID 387247 daemon.error] Able to open /dev/srn Jan 17 06:41:27 san pseudo: [ID 129642 kern.info] pseudo-device: dtrace0 Jan 17 06:41:27 san genunix: [ID 936769 kern.info] dtrace0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:41:29 san pcplusmp: [ID 803547 kern.info] pcplusmp: fdc (fdc) instance 0 vector 0x6 ioapic 0x4 intin 0x6 is bound to cpu 2 Jan 17 06:41:29 san isa: [ID 202937 kern.info] ISA-device: fdc0 Jan 17 06:41:29 san fdc: [ID 114370 kern.info] fd0 at fdc0 Jan 17 06:41:29 san genunix: [ID 936769 kern.info] fd0 is /isa/[EMAIL PROTECTED],3f0/[EMAIL PROTECTED],0 Jan 17 06:41:30 san pcplusmp: [ID 803547 kern.info] pcplusmp: ide (ata) instance 0 vector 0xe ioapic 0x4 intin 0xe is bound to cpu 3 Jan 17 06:41:30 san genunix: [ID 640982 kern.info] ATAPI device at targ 0, lun 0 lastlun 0xfeff Jan 17 06:41:30 san genunix: [ID 846691 kern.info] model DW-224E-V Jan 17 06:41:30 san genunix: [ID 479077 kern.info] ATA/ATAPI-7 supported, majver 0xfe minver 0x0 Jan 17 06:41:30 san npe: [ID 236367 kern.info] PCI Express-device: [EMAIL PROTECTED], ata0 Jan 17 06:41:30 san genunix: [ID 936769 kern.info] ata0 is /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED] Jan 17 06:41:30 san genunix: [ID 773945 kern.info] UltraDMA mode 2 selected Jan 17 06:41:30 san last message repeated 2 times Jan 17 06:41:30 san scsi: [ID 193665 kern.info] sd3 at ata0: target 0 lun 0 Jan 17 06:41:30 san genunix: [ID 936769 kern.info] sd3 is /[EMAIL PROTECTED],0/[EMAIL PROTECTED]/[EMAIL PROTECTED]/[EMAIL PROTECTED],0 Jan 17 06:41:30 san genunix: [ID 314293 kern.info] device pciclass,[EMAIL PROTECTED](display#0) keeps up device [EMAIL PROTECTED],0(sd#3), but the latter is not power managed Jan 17 06:41:31 san savecore: [ID 570001 auth.error] reboot after panic: pcie_pci-0: PCI(-X) Express Fatal Error Jan 17 06:41:31 san savecore: [ID 748169 auth.error] saving system crash dump in /var/crash/san/*.7 Jan 17 06:41:31 san pcplusmp: [ID 444295 kern.info] pcplusmp: asy (asy) instance #1 vector 0x3 ioapic 0x4 intin 0x3 is bound to cpu 3 Jan 17 06:41:31 san isa: [ID 202937 kern.info] ISA-device: asy1 Jan 17 06:41:31 san genunix: [ID 936769 kern.info] asy1 is /isa/[EMAIL PROTECTED],2f8 Jan 17 06:41:33 san sendmail[885]: [ID 702911 mail.crit] My unqualified host name (san) unknown; sleeping for retry Jan 17 06:41:33 san sendmail[884]: [ID 702911 mail.crit] My unqualified host name (san) unknown; sleeping for retry Jan 17 06:41:46 san rootnex: [ID 349649 kern.info] xsvc0 at root: space 0 offset 0 Jan 17 06:41:46 san genunix: [ID 936769 kern.info] xsvc0 is /[EMAIL PROTECTED],0 Jan 17 06:42:14 san pseudo: [ID 129642 kern.info] pseudo-device: devinfo0 Jan 17 06:42:14 san genunix: [ID 936769 kern.info] devinfo0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:42:15 san pseudo: [ID 129642 kern.info] pseudo-device: bmc0 Jan 17 06:42:15 san genunix: [ID 936769 kern.info] bmc0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:42:15 san fmd: [ID 441519 daemon.error] SUNW-MSG-ID: SUNOS-8000-1L, TYPE: Defect, VER: 1, SEVERITY: Minor Jan 17 06:42:15 san EVENT-TIME: Thu Jan 17 06:42:15 EST 2008 Jan 17 06:42:15 san PLATFORM: H8DM8-2, CSN: 1234567890, HOSTNAME: san Jan 17 06:42:15 san SOURCE: eft, REV: 1.16 Jan 17 06:42:15 san EVENT-ID: f74efc28-56c6-ed54-b894-f8ad62c31ba3 Jan 17 06:42:15 san DESC: The EFT Diagnosis Engine encountered telemetry for which it is unable to produce a diagnosis. Refer to http://sun.com/msg/SUNOS-8000-1L for more information. Jan 17 06:42:15 san AUTO-RESPONSE: Error reports from the component will be logged for examination by Sun. Jan 17 06:42:15 san IMPACT: Automated diagnosis and response for these events will not occur. Jan 17 06:42:15 san REC-ACTION: Run pkgchk -n SUNWfmd to ensure that fault management software is installed properly. Contact Sun for support. Jan 17 06:42:15 san fmd: [ID 441519 daemon.error] SUNW-MSG-ID: SUNOS-8000-1L, TYPE: Defect, VER: 1, SEVERITY: Minor Jan 17 06:42:15 san EVENT-TIME: Thu Jan 17 06:42:15 EST 2008 Jan 17 06:42:15 san PLATFORM: H8DM8-2, CSN: 1234567890, HOSTNAME: san Jan 17 06:42:15 san SOURCE: eft, REV: 1.16 Jan 17 06:42:15 san EVENT-ID: e6a90741-e722-e248-a250-b2ee3c00c284 Jan 17 06:42:15 san DESC: The EFT Diagnosis Engine encountered telemetry for which it is unable to produce a diagnosis. Refer to http://sun.com/msg/SUNOS-8000-1L for more information. Jan 17 06:42:15 san AUTO-RESPONSE: Error reports from the component will be logged for examination by Sun. Jan 17 06:42:15 san IMPACT: Automated diagnosis and response for these events will not occur. Jan 17 06:42:15 san REC-ACTION: Run pkgchk -n SUNWfmd to ensure that fault management software is installed properly. Contact Sun for support. Jan 17 06:42:17 san pseudo: [ID 129642 kern.info] pseudo-device: pool0 Jan 17 06:42:17 san genunix: [ID 936769 kern.info] pool0 is /pseudo/[EMAIL PROTECTED] Jan 17 06:42:34 san sendmail[885]: [ID 702911 mail.alert] unable to qualify my own domain name (san) -- using short name Jan 17 06:42:34 san sendmail[884]: [ID 702911 mail.alert] unable to qualify my own domain name (san) -- using short name # Thanks! Kent _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss