On Sun, 13 Apr 2014, John Cox wrote:
> Hi
>
> I'm running OpenBSD 5.4 (dmesg below) with softraid in mirror mode.
> One of the drives failed so I replaced it - the first time that RAID
> has actually saved my data as opposed to simply making my life harder!
> Thank you softraid.
>
> They are 3T drives and it looks like the rebuild is going to take ~5
> days to do. Is this expected? Is there any config parameter that I
> should have set up to improve performance? 5 days = ~7MBytes / sec
> and I know the drives can run a lot faster than that.
The current code is designed to be robust rather than fast - it does a read
from one of the online chunks (in this case you presumably only have one of
those) and then does a write to all chunks (including both the online ones
and the rebuilding one). In order to speed things up you want to read from
one online chunk and only write to the chunk that needs rebuilding - the
problem with this is that you need to prevent changes to the blocks that you
are rebuilding until that write completes. Unfortunately that means some more
restructing and additional code, plus a whole bunch of testing...
> Can I reboot the system during the rebuild or if I do will it start at
> the beginning again? I could try it but I'm now about 3 days in and
> don't wish to waste it.
The rebuild progress is stored in the softraid metadata - if you reboot (or
even if the power goes out) it should pick up where it left off and complete
the rebuild.
> #dmesg
> OpenBSD 5.4 (GENERIC.MP) #41: Tue Jul 30 15:30:02 MDT 2013
> dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 16973672448 (16187MB)
> avail mem = 16514109440 (15749MB)
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xec420 (81 entries)
> bios0: vendor Intel Corp. version "MKQ7710H.86A.0065.2014.0318.1044"
> date 03/18/2014
> bios0: Intel Corporation DQ77MK
> acpi0 at bios0: rev 2
> acpi0: sleep states S0 S3 S4 S5
> acpi0: tables DSDT FACP APIC FPDT TCPA MCFG HPET SSDT SSDT SSDT DMAR
> ASF!
> acpi0: wakeup devices PS2K(S3) PS2M(S3) UAR1(S3) P0P1(S4) USB1(S3)
> USB2(S3) USB3(S3) USB4(S3) USB5(S3) USB6(S3) USB7(S3) PXSX(S4)
> RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Core(TM) i5-3470T CPU @ 2.90GHz, 2893.85 MHz
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFL
>USH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,
>VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLI
>NE,AES,XSAVE,AVX,F16C,RDRAND,NXE,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS
> cpu0: 256KB 64b/line 8-way L2 cache
> cpu0: smt 0, core 0, package 0
> cpu0: apic clock running at 99MHz
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) Core(TM) i5-3470T CPU @ 2.90GHz, 2893.43 MHz
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFL
>USH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,
>VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLI
>NE,AES,XSAVE,AVX,F16C,RDRAND,NXE,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS
> cpu1: 256KB 64b/line 8-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 1 (application processor)
> cpu2: Intel(R) Core(TM) i5-3470T CPU @ 2.90GHz, 2893.43 MHz
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFL
>USH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,
>VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLI
>NE,AES,XSAVE,AVX,F16C,RDRAND,NXE,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS
> cpu2: 256KB 64b/line 8-way L2 cache
> cpu2: smt 1, core 0, package 0
> cpu3 at mainbus0: apid 3 (application processor)
> cpu3: Intel(R) Core(TM) i5-3470T CPU @ 2.90GHz, 2893.43 MHz
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFL
>USH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,
>VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLI
>NE,AES,XSAVE,AVX,F16C,RDRAND,NXE,LONG,LAHF,PERF,ITSC,FSGSBASE,SMEP,ERMS
> cpu3: 256KB 64b/line 8-way L2 cache
> cpu3: smt 1, core 1, package 0
> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
> acpimcfg0 at acpi0 addr 0xf8000000, bus 0-63
> acpihpet0 at acpi0: 14318179 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 3 (P0P1)
> acpiprt2 at acpi0: bus 1 (RP01)
> acpiprt3 at acpi0: bus -1 (RP02)
> acpiprt4 at acpi0: bus -1 (RP03)
> acpiprt5 at acpi0: bus -1 (RP04)
> acpiprt6 at acpi0: bus -1 (RP05)
> acpiprt7 at acpi0: bus -1 (RP06)
> acpiprt8 at acpi0: bus 2 (RP07)
> acpiprt9 at acpi0: bus -1 (RP08)
> acpiprt10 at acpi0: bus -1 (PEG0)
> acpiprt11 at acpi0: bus -1 (PEG1)
> acpiprt12 at acpi0: bus -1 (PEG2)
> acpiprt13 at acpi0: bus -1 (PEG3)
> acpiec0 at acpi0: Failed to read resource settings
> acpicpu0 at acpi0: C2, C1, PSS
> acpicpu1 at acpi0: C2, C1, PSS
> acpicpu2 at acpi0: C2, C1, PSS
> acpicpu3 at acpi0: C2, C1, PSS
> acpipwrres0 at acpi0: FN00
> acpipwrres1 at acpi0: FN01
> acpipwrres2 at acpi0: FN02
> acpipwrres3 at acpi0: FN03
> acpipwrres4 at acpi0: FN04
> acpitz0 at acpi0: critical temperature is 92 degC
> acpitz1 at acpi0: critical temperature is 92 degC
> acpibat0 at acpi0: BAT0 not present
> acpibat1 at acpi0: BAT1 not present
> acpibat2 at acpi0: BAT2 not present
> acpibtn0 at acpi0: PWRB
> acpibtn1 at acpi0: LID0
> acpivideo0 at acpi0: GFX0
> acpivout0 at acpivideo0: DD01
> acpivout1 at acpivideo0: DD02
> acpivout2 at acpivideo0: DD03
> acpivout3 at acpivideo0: DD04
> acpivout4 at acpivideo0: DD05
> acpivout5 at acpivideo0: DD06
> acpivout6 at acpivideo0: DD07
> acpivout7 at acpivideo0: DD08
> cpu0: Enhanced SpeedStep 2893 MHz: speeds: 2901, 2900, 2800, 2700,
> 2600, 2500, 2400, 2300, 2200, 2100, 2000, 1900, 1800, 1700, 1600 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200v2 Host" rev 0x09
> vga1 at pci0 dev 2 function 0 "Intel HD Graphics 2500" rev 0x09
> intagp0 at vga1
> agp0 at intagp0: aperture at 0xe0000000, size 0x10000000
> inteldrm0 at vga1
> drm0 at inteldrm0
> inteldrm0: 1024x768
> wsdisplay0 at vga1 mux 1: console (std, vt100 emulation)
> wsdisplay0: screen 1-5 added (std, vt100 emulation)
> "Intel 7 Series xHCI" rev 0x04 at pci0 dev 20 function 0 not
> configured
> "Intel 7 Series MEI" rev 0x04 at pci0 dev 22 function 0 not configured
> puc0 at pci0 dev 22 function 3 "Intel 7 Series KT" rev 0x04: ports: 1
> com
> com4 at puc0 port 0 apic 2 int 19: ns16550a, 16 byte fifo
> com4: probed fifo depth: 0 bytes
> em0 at pci0 dev 25 function 0 "Intel 82579LM" rev 0x04: msi, address
> e8:40:f2:ec:b6:2a
> ehci0 at pci0 dev 26 function 0 "Intel 7 Series USB" rev 0x04: apic 2
> int 16
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
> azalia0 at pci0 dev 27 function 0 "Intel 7 Series HD Audio" rev 0x04:
> msi
> azalia0: codecs: Realtek/0x0892, Intel/0x2806, using Realtek/0x0892
> audio0 at azalia0
> ppb0 at pci0 dev 28 function 0 "Intel 7 Series PCIE" rev 0xc4: msi
> pci1 at ppb0 bus 1
> em1 at pci1 dev 0 function 0 "Intel 82571EB" rev 0x06: apic 2 int 16,
> address 68:05:ca:08:e7:b0
> em2 at pci1 dev 0 function 1 "Intel 82571EB" rev 0x06: apic 2 int 17,
> address 68:05:ca:08:e7:b1
> ppb1 at pci0 dev 28 function 6 "Intel 7 Series PCIE" rev 0xc4: msi
> pci2 at ppb1 bus 2
> em3 at pci2 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address
> e8:40:f2:ec:b6:2b
> ehci1 at pci0 dev 29 function 0 "Intel 7 Series USB" rev 0x04: apic 2
> int 23
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1
> ppb2 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa4
> pci3 at ppb2 bus 3
> "AT&T/Lucent FW322 1394" rev 0x70 at pci3 dev 3 function 0 not
> configured
> pcib0 at pci0 dev 31 function 0 vendor "Intel", unknown product 0x1e47
> rev 0x04
> ahci0 at pci0 dev 31 function 2 "Intel 7 Series AHCI" rev 0x04: msi,
> AHCI 1.3
> scsibus0 at ahci0: 32 targets
> sd0 at scsibus0 targ 0 lun 0: <ATA, INTEL SSDSC2CT06, 300i> SCSI3
> 0/direct fixed naa.5001517bb28e545f
> sd0: 57241MB, 512 bytes/sector, 117231408 sectors, thin
> sd1 at scsibus0 targ 1 lun 0: <ATA, ST3000DM001-1CH1, CC29> SCSI3
> 0/direct fixed naa.5000c50065c758df
> sd1: 2861588MB, 512 bytes/sector, 5860533168 sectors
> sd2 at scsibus0 targ 2 lun 0: <ATA, ST3000DM001-1CH1, CC43> SCSI3
> 0/direct fixed naa.5000c5004dc21f27
> sd2: 2861588MB, 512 bytes/sector, 5860533168 sectors
> cd0 at scsibus0 targ 3 lun 0: <TSSTcorp, CDDVDW SH-222BB, SB00> ATAPI
> 5/cdrom removable
> ichiic0 at pci0 dev 31 function 3 "Intel 7 Series SMBus" rev 0x04:
> apic 2 int 18
> iic0 at ichiic0
> spdmem0 at iic0 addr 0x50: 4GB DDR3 SDRAM PC3-10600
> spdmem1 at iic0 addr 0x51: 4GB DDR3 SDRAM PC3-10600
> spdmem2 at iic0 addr 0x52: 4GB DDR3 SDRAM PC3-10600
> spdmem3 at iic0 addr 0x53: 4GB DDR3 SDRAM PC3-10600
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5
> kbc: cmd word write error
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> wbsio0 at isa0 port 0x2e/2: NCT6776F rev 0x33
> lm1 at wbsio0 port 0xa00/8: NCT6776F
> mtrr: Pentium Pro MTRR support
> uhub2 at uhub0 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2
> uhidev0 at uhub2 port 1 configuration 1 interface 0 "CHESEN PS2 to USB
> Converter" rev 1.10/0.10 addr 3
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd0 at ukbd0 mux 1
> wskbd0: connecting to wsdisplay0
> uhidev1 at uhub2 port 1 configuration 1 interface 1 "CHESEN PS2 to USB
> Converter" rev 1.10/0.10 addr 3
> uhidev1: iclass 3/1, 3 report ids
> ums0 at uhidev1 reportid 1: 5 buttons, Z dir
> wsmouse0 at ums0 mux 0
> uhid0 at uhidev1 reportid 2: input=1, output=0, feature=0
> uhid1 at uhidev1 reportid 3: input=3, output=0, feature=0
> uhub3 at uhub1 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2
> vscsi0 at root
> scsibus1 at vscsi0: 256 targets
> softraid0 at root
> scsibus2 at softraid0: 256 targets
> softraid0: not all chunks were provided; attempting to bring volume 0
> online
> softraid0: trying to bring up sd3 degraded
> sd3 at scsibus2 targ 1 lun 0: <OPENBSD, SR RAID 1, 005> SCSI2 0/direct
> fixed
> sd3: 2861588MB, 512 bytes/sector, 5860532576 sectors
> root on sd0a (0bea3e62054691e0.a) swap on sd0b dump on sd0b
> softraid0: rebuild of sd3 started on sd1a
> wskbd0: disconnecting from wsdisplay0
> wskbd0 detached
> ukbd0 detached
> uhidev0 detached
> wsmouse0 detached
> ums0 detached
> uhid0 detached
> uhid1 detached
> uhidev1 detached
> #
--
"Action without study is fatal. Study without action is futile."
-- Mary Ritter Beard
