https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=224496
--- Comment #12 from n...@nmc.dev --- Hi, We are seeing the same issue. Here is more information on our setup : FreeNAS-11.2-U5 FreeBSD 11.2-STABLE amd64 We use 2 x (6x 14TB seagate ironwolf drives ) We also have a 2 TB crucial SSD for L2ARC Issue always comes up after 10-14hours of heavy IO Disk Model : 14 TB Seagate ST14000VN0008 The drives are on 2 different LSI HBAs. Drive that fails are random on both those HBA. Please let us know if you need more information on this, it is impacting our production load. Thank you. Log output for our latest errors : > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 a8 00 > 00 00 10 00 00 length 8192 SMID 60 Aborting command 0xfffffe000171f640 > mpr1: Sending reset from mprsas_send_abort for target ID 20 > (da30:mpr1:0:20:0): READ(10). CDB: 28 00 b7 81 49 f0 00 00 08 00 length > 4096 SMID 332 terminated ioc 804b loginfo 31130000 scsi 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(10). CDB: 28 00 b7 81 49 e8 00 00 08 00 > length 4096 SMID 703 terminated ioc 804b loginfo 31130000 > sc(da30:mpr1:0:20:0): READ(10). CDB: 28 00 b7 81 49 f0 00 00 08 00 si 0 state > c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 77 b8 00 > 00 01 00 00 00 length 131072 SMID 510 terminated ioc > 804b(da30:mpr1:0:20:0): CAM status: CCB request completed with an > error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(10). CDB: 28 00 b7 81 49 e8 00 00 08 00 > loginfo 31130000 scsi 0 state c xfer 0 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 76 b8 00 00 > 01 00 00 00 length 131072 SMID 938 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 75 b8 00 00 > 01 00 00 00 length 131072 SMID 839 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 74 b8 00 00 > 01 00 00 00 length 131072 SMID 681 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 73 b8 00 00 > 01 00 00 00 length 131072 SMID 647 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 72 b8 00 00 > 01 00 00 00 length 131072 SMID 253 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 71 b8 00 00 > 01 00 00 00 length 131072 SMID 109 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 b8 00 00 > 01 00 00 00 length 131072 SMID 267 terminated ioc 804b loginfo 31130000 scsi > 0 state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 98 00 00 > 00 10 00 00 length 8192 SMID 506 terminated ioc 804b loginfo 31130000 scsi 0 > state c xfer 0 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 88 00 00 > 00 10 00 00 length 8192 SMID 774 terminated ioc 804b loginfo 31130000 scsi 0 > state c xfer 0 > (da30:mpr1:0:20:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 > 00 00 00 length 0 SMID 281 terminated ioc 804b loginfo 31140000 scsi 0 > state c xfer 0 > mpr1: Unfreezing devq for target ID 20 > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 77 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 76 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 75 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 74 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 73 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 72 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 71 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 b8 00 00 > 01 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 a8 00 00 > 00 10 00 00 > (da30:mpr1:0:20:0): CAM status: Command timeout > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 98 00 00 > 00 10 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(16). CDB: 88 00 00 00 00 01 05 1a 70 88 00 00 > 00 10 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 > 00 00 00 > (da30:mpr1:0:20:0): CAM status: CCB request completed with an error > (da30:mpr1:0:20:0): Retrying command > (da30:mpr1:0:20:0): READ(10). CDB: 28 00 b7 81 49 f0 00 00 08 00 > (da30:mpr1:0:20:0): CAM status: SCSI Status Error > (da30:mpr1:0:20:0): SCSI status: Check Condition > (da30:mpr1:0:20:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, > reset, or bus device reset occurred) > (da30:mpr1:0:20:0): Retrying command (per sense data) > ctl_datamove: tag 0x855ffd44 on (2:3:106) aborted > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 68 00 00 10 00 > length 8192 SMID 486 Aborting command 0xfffffe0001745aa0 > mpr1: Sending reset from mprsas_send_abort for target ID 22 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 c1 ae 62 38 00 00 08 00 length > 4096 SMID 105 terminated ioc 804b loginfo 31130000 scsi 0 state c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 6c 78 00 00 a0 00 > length 81920 SMID 467 terminated ioc 804b loginfo 31130000 > s(da32:mpr1:0:22:0): READ(10). CDB: 28 00 c1 ae 62 38 00 00 08 00 csi 0 state > c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 6b 78 00 01 00 00 > length 131072 SMID 959 terminated ioc 804b loginfo 31130000 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error scsi 0 > state c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 6a 78 00 01 00 00 > length 131072 SMID 346 terminated ioc 804b loginfo 31130000 (da32:scsi > 0 state c xfer 0 > mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 69 78 00 01 00 00 > length 131072 SMID 627 terminated ioc 804b loginfo 31130000 scsi 0 > state c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 6c 78 00 00 a0 00 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 68 78 00 01 00 00 > length 131072 SMID 455 terminated ioc 804b loginfo 31130000 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error scsi 0 > state c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 67 78 00 01 00 00 > length 131072 SMID 951 terminated ioc 804b loginfo 31130000 (da32:scsi > 0 state c xfer 0 > mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 66 78 00 01 00 00 > length 131072 SMID 822 terminated ioc 804b loginfo 31130000 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 6b 78 00 01 00 00 scsi 0 state > c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 78 00 01 00 00 > length 131072 SMID 155 terminated ioc 804b loginfo 31130000 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error scsi 0 > state c xfer 0 > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 58 00 00 10 00 > length 8192 SMID 495 terminated ioc 804b loginfo 31130000 sc(da32:si 0 > state c xfer 0 > mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 48 00 00 10 00 > length 8192 SMID 494 terminated ioc 804b loginfo 31130000 > sc(da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 6a 78 00 01 00 00 si 0 state > c xfer 0 > (da32:mpr1:0:22:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 > 00 00 00 length 0 SMID 726 terminated ioc 804b loginfo > 3(da32:mpr1:0:22:0): CAM status: CCB request completed with an error > 1140000 scsi 0 state c xfer 0 > mpr1: Unfreezing devq for target ID 22 > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 69 78 00 01 00 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 68 78 00 01 00 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 67 78 00 01 00 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 66 78 00 01 00 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 78 00 01 00 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 68 00 00 10 00 > (da32:mpr1:0:22:0): CAM status: Command timeout > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 58 00 00 10 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 ca 8b 65 48 00 00 10 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 > 00 00 00 > (da32:mpr1:0:22:0): CAM status: CCB request completed with an error > (da32:mpr1:0:22:0): Retrying command > (da32:mpr1:0:22:0): READ(10). CDB: 28 00 c1 ae 62 38 00 00 08 00 > (da32:mpr1:0:22:0): CAM status: SCSI Status Error > (da32:mpr1:0:22:0): SCSI status: Check Condition > (da32:mpr1:0:22:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, > reset, or bus device reset occurred) > (da32:mpr1:0:22:0): Retrying command (per sense data) -- You are receiving this mail because: You are the assignee for the bug. _______________________________________________ freebsd-bugs@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-bugs To unsubscribe, send any mail to "freebsd-bugs-unsubscr...@freebsd.org"
