Re: Supermicro X11SSL-F freezes probing USB 3
On Thu, Mar 31, 2016 at 2:14 AM, Paul B. Henson wrote: > Eeew. We've got some HP gear that requires an extra cost license to make > the remote kvm gui head work past the bootloader which is ridiculous > (but technically, I don't think remote kvm is part of the base IPMI > standard), but the IPMI SOL serial port??? That's just crazy. I've never > used Dell and never will for servers; desktops/notebooks, sure, but > servers? Nah. Sun gear was pretty good until Oracle killed them off, we > used IBM for a while until they sold it off to Lenovo and policy > wouldn't let us buy from a non-US company (like the gear itself doesn't > come from China anyway). Right now we're using HP at my dayjob and it's > working out ok. I pretty much use supermicro for personal gear and > sidejobs, it's generally good stuff. At least my IPMI SOL port works :). Trade agreements with China are complicated (and the Chinese government has had *considerable* say in their structure and details - perhaps more say than our own government). I could go into some details on some of why things are this way, but that's getting too far off-topic for this mailing list. That said, I will say that there's some pretty good reasons (and some pretty bad reasons) for why things are the way they are - but also, that I expect things to change, and not all in ways that you might appreciate. Anyways, my point is, you might want to take advantage of the current relatively lax policies while you can. (Or, ok, maybe for your particular situation, things will actually get better - I don't actually know the details of how this will play out...) -- Raul
Re: Supermicro X11SSL-F freezes probing USB 3
On Wed, Mar 30, 2016 at 03:34:25PM -0400, Sonic wrote: > Ahha! Who would have thought... com0 was the ticket. Thanks much! Sweet, glad to hear you got it working. Usually the IPMI SOL comes after the physical serial ports, I've never seen it be the first one. But hey, it's Dell :). Maybe now that 5.9 is out (a month early, nice, just in time for my new box) one of the devs will have time to take a look at the skylake usb 3 issues.
Re: Supermicro X11SSL-F freezes probing USB 3
On Tue, Mar 29, 2016 at 10:46:15PM -0400, Sonic wrote: > The IPMI is part of Dell's iDRAC stuff and the only thing I've found [...] > may be the iDRAC license level as well, anything above the "basic" > level, providing a limited feature set, requires purchasing a license Eeew. We've got some HP gear that requires an extra cost license to make the remote kvm gui head work past the bootloader which is ridiculous (but technically, I don't think remote kvm is part of the base IPMI standard), but the IPMI SOL serial port??? That's just crazy. I've never used Dell and never will for servers; desktops/notebooks, sure, but servers? Nah. Sun gear was pretty good until Oracle killed them off, we used IBM for a while until they sold it off to Lenovo and policy wouldn't let us buy from a non-US company (like the gear itself doesn't come from China anyway). Right now we're using HP at my dayjob and it's working out ok. I pretty much use supermicro for personal gear and sidejobs, it's generally good stuff. At least my IPMI SOL port works :). Good luck :).
Re: Supermicro X11SSL-F freezes probing USB 3
On Tue, Mar 29, 2016 at 5:55 PM, Stuart Henderson wrote: > Make sure it's set to stop redirecting after boot in BIOS, then when > you hit the boot-loader, you should be able to 'stty com0 ' and > 'set tty com0'. Ahha! Who would have thought... com0 was the ticket. Thanks much! Chris
Re: Supermicro X11SSL-F freezes probing USB 3
On Tue, Mar 29, 2016 at 9:13 PM, Paul B. Henson wrote: > Hmm, that sounds broken. Are you sure you've got the right serial port > and baud rate? Once you switch the boot loader to serial, it's no longer > a matter of "forwarding", it's direct serial access as far as the > bootloader/OS is concerned. The BIOS forwarding piece is out of the > picture. Unless your IPMI serial port implementation is broken you've > probably got the wrong settings. The IPMI is part of Dell's iDRAC stuff and the only thing I've found on the net is that iDRAC 9 is needed for proper SOL access and this system has the previous generation - iDRAC 8. I actually had tried both serial ports for SOL which is why I think it's just broken. It may be the iDRAC license level as well, anything above the "basic" level, providing a limited feature set, requires purchasing a license key. All of my other firewalls are using Supermicro boxes and the IPMI works just fine on them. Unfortunately the client didn't listen to my purchase suggestions. I don't want to become an iDRAC guru, just want to install OpenBSD without wrestling alligators :-)
Re: Supermicro X11SSL-F freezes probing USB 3
On Tue, Mar 29, 2016 at 07:06:41PM -0400, Sonic wrote: > On Tue, Mar 29, 2016 at 6:15 PM, Paul B. Henson wrote: > > stty com1 115200 > > set tty com1 > > Yes, tried that with no luck, SOL still stops forwarding. The box does Hmm, that sounds broken. Are you sure you've got the right serial port and baud rate? Once you switch the boot loader to serial, it's no longer a matter of "forwarding", it's direct serial access as far as the bootloader/OS is concerned. The BIOS forwarding piece is out of the picture. Unless your IPMI serial port implementation is broken you've probably got the wrong settings. Double check in the BIOS what the IPMI serial port settings are (which port, speed, etc) and make sure they match what you tell the bootloader. > rely on ssh for everything. But there's always some possible problem > that it would be nice to be able to plug in a keyboard and monitor to > work with. Can't you use the IPMI virtual head? I can't remember the last time I used a physical anything with a server. Rack and forget... Unless a power supply blows.
Re: Supermicro X11SSL-F freezes probing USB 3
On Tue, Mar 29, 2016 at 6:15 PM, Paul B. Henson wrote: > stty com1 115200 > set tty com1 Yes, tried that with no luck, SOL still stops forwarding. The box does have a physical serial port, so I ordered a serial to USB adapter cable (don't have any other systems left with serial ports) that I'm hoping will work for the install. Once I'm installed I can probably rely on ssh for everything. But there's always some possible problem that it would be nice to be able to plug in a keyboard and monitor to work with. Chris
Re: Supermicro X11SSL-F freezes probing USB 3
On Tue, Mar 29, 2016 at 04:55:05PM -0400, Sonic wrote: > Unfortunately that option isn't available for me. The IPMI SOL on this > Dell stops forwarding the console once the system boots. The usb keyboard should still work when the bootloader is running, that's being handled by the BIOS. You just need to determine what port/baud rate the IPMI serial port is on your system, and when the bootloader shows up, just type for example: stty com1 115200 set tty com1 That will switch the bootloader to directly use the serial port, and when you boot the OS, it will do so as well. After these two commands, just 'boot -c' as usual to disable xhci, and continue on the serial port. Real servers don't need heads or keyboards ;). At least on my supermicro box, the default bios setting also allows me to type that on the IPMI serial console as well, in addition to the boot up messages it also forwards the bootloader by default, it doesn't stop forwarding until the OS itself loads. If you install over the serial console, the OS will by default be installed to use it too. So maybe you don't need that keyboard after all :).
Re: Supermicro X11SSL-F freezes probing USB 3
On 2016-03-29, Sonic wrote: > On Mon, Mar 28, 2016 at 9:48 PM, Paul B. Henson wrote: >> I'm installing via an IPMI virtual serial port so the lack >> of keyboard isn't really an issue for me, > > Unfortunately that option isn't available for me. The IPMI SOL on this > Dell stops forwarding the console once the system boots. Make sure it's set to stop redirecting after boot in BIOS, then when you hit the boot-loader, you should be able to 'stty com0 ' and 'set tty com0'.
Re: Supermicro X11SSL-F freezes probing USB 3
On Mon, Mar 28, 2016 at 9:48 PM, Paul B. Henson wrote: > I'm installing via an IPMI virtual serial port so the lack > of keyboard isn't really an issue for me, Unfortunately that option isn't available for me. The IPMI SOL on this Dell stops forwarding the console once the system boots. This problem was reported by another user to "bugs" back on Feb. 9th, but I don't know if any action was ever taken. Chris
Re: Supermicro X11SSL-F freezes probing USB 3
On Mon, Mar 28, 2016 at 9:48 PM, Paul B. Henson wrote: > Could I trouble you to be more specific as to the duration of "long > enough" :)? I think my patience ran out after about 15-20 minutes. I think it was just around that - 15 or 20 minutes, but I really didn't time it. I had given up earlier on previous attempts and then started to research the issue assuming the system would stay "frozen" and when I turned around it had booted. However the keyboard was dead so the install could not continue. > So it > eventually boots without disabling xhci, but the USB doesn't work in the > end anyway? I think that xhci is disabled (one way or the other). My guess is that attempting to load the driver eventually times out (or crashes) and the boot process finally continues. > I'm installing via an IPMI virtual serial port so the lack > of keyboard isn't really an issue for me, I can live without USB but as > the box won't be going live for a few weeks I thought I'd see if any > devs wanted me to try anything on it before I just moved forward without > USB support. I've got -current set up to ready to patch and compile to > test stuff on it if I can. It would be nice to get it working for > situations like yours where it's needed. Agreed :-) Would love to see this working! Chris
Re: Supermicro X11SSL-F freezes probing USB 3
On Mon, Mar 28, 2016 at 03:06:39PM -0400, Sonic wrote: > If I wait long enough the install will finally finish booting but the > keyboard (no ps2 ports) doesn't work. Could I trouble you to be more specific as to the duration of "long enough" :)? I think my patience ran out after about 15-20 minutes. So it eventually boots without disabling xhci, but the USB doesn't work in the end anyway? I'm installing via an IPMI virtual serial port so the lack of keyboard isn't really an issue for me, I can live without USB but as the box won't be going live for a few weeks I thought I'd see if any devs wanted me to try anything on it before I just moved forward without USB support. I've got -current set up to ready to patch and compile to test stuff on it if I can. It would be nice to get it working for situations like yours where it's needed. I booted a FreeBSD 10.2 livecd on it, and that initialized the xhci chipset fine and usb devices seem to work ok. I tried to compare the drivers, they share a bit in common but they're also quite different and it doesn't help that I'm not really a low level driver guy 8-/. I'm sure the new Skylake stuff just needs some minor tweak to make it happy. Thanks...
Re: Supermicro X11SSL-F freezes probing USB 3
On Mon, Mar 28, 2016 at 2:36 PM, Sonic wrote: > Exact same problem here with a Dell PowerEdge R230 and snapshot > downloaded today. If I wait long enough the install will finally finish booting but the keyboard (no ps2 ports) doesn't work. Disabling xhci via UKC on boot also kills the keyboard. Chris
Re: Supermicro X11SSL-F freezes probing USB 3
On Mon, Mar 7, 2016 at 12:48 AM, Paul B. Henson wrote: xhci probe won > xhci0 at pci0 dev 20 function 0 "Intel 100 Series xHCI" rev 0x31: msi probing for usb* usb probe returned 1 usb probe won > usb0 at xhci0: USB revision 3.0 probing for uhub* uhub probe returned 10 uhub probe won > uhub0 at usb0 "Intel xHCI root hub" rev 3.00/1.00 addr 1 > [system freezes here] Exact same problem here with a Dell PowerEdge R230 and snapshot downloaded today. Chris
Supermicro X11SSL-F freezes probing USB 3
I just put together a new server with a Supermicro X11SSL-F motherboard and a Xeon E3-1240L v5 processor, and was trying to install openbsd 5.8 on it. The install cd freezes while booting after it probes the USB 3 devices: >>> xhci probe won xhci0 at pci0 dev 20 function 0 "Intel 100 Series xHCI" rev 0x31: msi >>> probing for usb* >>> usb probe returned 1 >>> usb probe won usb0 at xhci0: USB revision 3.0 >>> probing for uhub* >>> uhub probe returned 10 >>> uhub probe won uhub0 at usb0 "Intel xHCI root hub" rev 3.00/1.00 addr 1 [system freezes here] I also tried the latest snapshot install cd, same problem. If I disable xhci, the installer boots successfully, although I haven't actually tried installing yet. I don't really need usb on this box, so I'm not really concerned if it's not going to work. It's not going into production for a few weeks though, so if anybody's interested in looking at why it's broken I could provide further details or test possible fixes. Here's a dmesg of the snapshot install kernel booted without xhci: OpenBSD 5.9-current (RAMDISK_CD) #1737: Sun Mar 6 19:18:13 MST 2016 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/RAMDISK_CD real mem = 16976416768 (16189MB) avail mem = 16460062720 (15697MB) User Kernel Config UKC> do\^H \^Hiso\^H \^Hable xhci 98 xhci* disabled UKC> quit Continuing... mainbus0 at root bios0 at mainbus0: SMBIOS rev. 3.0 @ 0x7fb95000 (59 entries) bios0: vendor American Megatrends Inc. version "1.0b" date 12/29/2015 bios0: Supermicro Super Server acpi0 at bios0: rev 2 acpi0: tables DSDT FACP APIC FPDT FIDT SPMI MCFG HPET SSDT LPIT SSDT SSDT SSDT DBGP DBG2 SSDT SSDT UEFI SSDT DMAR EINJ ERST BERT HEST acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU E3-1240L v5 @ 2.10GHz, 2100.73 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,SENSOR,ARAT cpu0: 256KB 64b/line 8-way L2 cache cpu0: apic clock running at 24MHz cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1, IBE cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 1 (PEG0) acpiprt2 at acpi0: bus -1 (PEG1) acpiprt3 at acpi0: bus -1 (PEG2) acpiprt4 at acpi0: bus 2 (RP09) acpiprt5 at acpi0: bus 3 (RP10)
