Hi, Sorry for not replying to one of the already open threads on this topic; I've just joined the list for the purposes of this discussion and have nothing in my client to reply to yet.
I have an x86_64 opensolaris machine running on a Core 2 Quad Q9650 platform with two LSI SAS3081E-R PCI-E 8 port SAS controllers, with 8 drives each. The LSI cards are flashed with IT firmware from Feb 2009 (I think, I can double check if it's important). The drives are Samsung HD154UI 1.5TB disks. I was using for quite awhile OpenSolaris 2009.06 with the opensolaris-provided mpt driver to operate a zfs raidz2 pool of about ~20T and this worked perfectly fine (no issues or device errors logged for several months, no hanging). A few days ago I decided to reinstall with the latest OpenSolaris in order to take advantage of raidz3. I hadn't known at the time about the current mpt issues, or I may have held off on upgrading. I installed Solaris Nevada build 127 from the DVD image. I then proceed to setup a raidz3 pool with the same disks as before, of a slightly smaller size (obviously) than the former raidz2 pool. I started a moderately long-running and heavy load rsync to copy my data back to the pool from another host. Several times during the day (sometimes a couple times an hour, or it could go up to a few hours with no errors), I get several syslog errors and warnings about mpt, similiar but not identical to what I've seen reported here by others. Also, iostat -en shows several hw and trn errors of varying amounts for all the drives (in OpenSolaris 2009.06 I never had any iostat errors). After awhile the machine will hang in a variety of ways. The first time it was pingable, and I could authenticate through ssh but it would never spawn a shell. The second time it crashed it was unpingable from the network, and the display was black, although the numlock key was still toggling properly the numlock light on the console. Here's a sample of my errors. I've included the complete series of errors from one timestampe, and a few lines from a subsequent series of errors a couple minutes later: (if there's any other info I can provide or more things to test just let me know. Thanks, --Chad ) Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 6. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 6. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 6. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 6. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 9. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 7. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 8. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 8. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 8. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 8. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 8. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:42:55 the-vault scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:42:55 the-vault Log info 0x31120200 received for target 8. Nov 29 04:42:55 the-vault scsi_status=0x0, ioc_status=0x804b, scsi_state=0xc Nov 29 04:44:25 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:44:25 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:44:25 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): Nov 29 04:44:25 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:44:25 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:44:25 the-vault mpt_handle_event_sync: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:44:25 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@1/pci1000,3...@0 (mpt1): Nov 29 04:44:25 the-vault mpt_handle_event: IOCStatus=0x8000, IOCLogInfo=0x31120200 Nov 29 04:44:25 the-vault scsi: [ID 243001 kern.warning] WARNING: /p...@0,0/pci8086,2...@3/pci111d,8...@0/pci111d,8...@0/pci1000,3...@0 (mpt0): _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
