On Sat, Jun 23, 2018 at 3:54 PM, Ax0n <[email protected]> wrote:
>
> FWIW, that patch didn't apply cleanly to a fresh pull of the tree from
> GitHub. I know it's not OFFICIALLY -CURRENT for realsies but it's what I
> have been using on this laptop for months. It sounds like it was probably
> patched against -STABLE? I didn't read the entire thread on bugs@. I have
> tried with 3 daily snapshots in a row and I'm having the same problem. I
> haven't actually fired up vmm in a few weeks, so I'm not sure exactly when
> it quit working. I'm re-building with VMM_DEBUG first.
>
> Mike, I'll send all relevant info (dmesg, vmd -dvvv, vm.conf) to bugs@
> once I have it, unless this sounds like an ongoing thing you probably have
> on your radar already. I'm not in a huge rush, so I can wait a bit if you
> think you have something that'll make it into -CURRENT in a while.
>
Following up and cc bugs@ I built the system with VMM_DEBUG enabled.
>Synopsis: vmm(4) VMs fail to start: ioctl failed: Invalid argument
>Category: amd64
>Environment:
System : OpenBSD 6.3
Details : OpenBSD 6.3-current (GENERIC.MP) #49: Sat Jun 23
09:32:05 MDT 2018
[email protected]:
/usr/src/sys/arch/amd64/compile/GENERIC.MP
Architecture: OpenBSD.amd64
Machine : amd64
>Description:
VMs fail to boot.
[axon@transient ~]$ doas vmd -dvvv
startup
/etc/vm.conf:4: switch "local" registered
/etc/vm.conf:8: switch "internal" registered
/etc/vm.conf:12: switch "wired" registered
vm_register: registering vm 1
/etc/vm.conf:28: vm "OBSD-Stable.vm" registered (disabled)
vm_register: registering vm 2
/etc/vm.conf:41: vm "OBSD-Stable-alt.vm" registered (disabled)
vm_register: registering vm 3
/etc/vm.conf:53: vm "OBSDSnap64.vm" registered (disabled)
config_setconfig: setting config
vm_priv_brconfig: interface bridge0 description switch1-local
vm_priv_brconfig: interface bridge1 description switch2-internal
vm_priv_brconfig: interface bridge0 description switch3-wired
vmd_configure: not creating vm OBSD-Stable.vm (disabled)
vmd_configure: not creating vm OBSD-Stable-alt.vm (disabled)
vmd_configure: not creating vm OBSDSnap64.vm (disabled)
config_getconfig: priv retrieving config
config_getconfig: control retrieving config
config_getconfig: vmm retrieving config
vm_opentty: vm OBSDSnap64.vm tty /dev/ttyp3 uid 1000 gid 4 mode 620
vm_register: registering vm 3
vm_priv_ifconfig: interface tap0 description vm3-if0-OBSDSnap64.vm
vm_priv_ifconfig: switch "local" interface bridge0 add tap0
OBSDSnap64.vm: started vm 3 successfully, tty /dev/ttyp3
loadfile_bios: loaded BIOS image
run_vm: initializing hardware for vm OBSDSnap64.vm
pic_set_elcr: setting level triggered mode for irq 3
pic_set_elcr: setting level triggered mode for irq 5
pic_set_elcr: setting level triggered mode for irq 6
virtio_init: vm "OBSDSnap64.vm" vio0 lladdr fe:e1:ba:d0:eb:ac
pic_set_elcr: setting level triggered mode for irq 7
run_vm: starting vcpu threads for vm OBSDSnap64.vm
vcpu_reset: resetting vcpu 0 for vm 2
run_vm: waiting on events for VM OBSDSnap64.vm
vcpu_run_loop: vm 2 / vcpu 0 run ioctl failed: Invalid argument
vmm_sighdlr: handling signal 20
vmm_sighdlr: attempting to terminate vm 3
terminate_vm: terminating vmid 2
vmm_sighdlr: calling vm_remove
vm_remove: removing vm id 3 from running config
vm_remove: calling vm_stop
vm_stop: stopping vm 3
vmd_dispatch_vmm: handling TERMINATE_EVENT for vm id 3 ret 22
vmd_dispatch_vmm: about to stop vm id 3
vm_stop: stopping vm 3
vm_opentty: vm OBSDSnap64.vm tty /dev/ttyp4 uid 1000 gid 4 mode 620
vm_register: registering vm 3
vm_priv_ifconfig: interface tap0 description vm3-if0-OBSDSnap64.vm
vm_priv_ifconfig: switch "local" interface bridge0 add tap0
OBSDSnap64.vm: started vm 3 successfully, tty /dev/ttyp4
loadfile_bios: loaded BIOS image
run_vm: initializing hardware for vm OBSDSnap64.vm
pic_set_elcr: setting level triggered mode for irq 3
pic_set_elcr: setting level triggered mode for irq 5
pic_set_elcr: setting level triggered mode for irq 6
virtio_init: vm "OBSDSnap64.vm" vio0 lladdr fe:e1:ba:d0:eb:ac
pic_set_elcr: setting level triggered mode for irq 7
run_vm: starting vcpu threads for vm OBSDSnap64.vm
vcpu_reset: resetting vcpu 0 for vm 3
run_vm: waiting on events for VM OBSDSnap64.vm
vcpu_run_loop: vm 3 / vcpu 0 run ioctl failed: Invalid argument
vmm_sighdlr: handling signal 20
vmm_sighdlr: attempting to terminate vm 3
terminate_vm: terminating vmid 3
vmm_sighdlr: calling vm_remove
vm_remove: removing vm id 3 from running config
vm_remove: calling vm_stop
vm_stop: stopping vm 3
vmd_dispatch_vmm: handling TERMINATE_EVENT for vm id 3 ret 22
vmd_dispatch_vmm: about to stop vm id 3
vm_stop: stopping vm 3
############################
Contents of vm.conf:
############################
switch "local" {
interface bridge0
}
switch "internal" {
interface bridge1
}
switch "wired" {
interface bridge0
}
# OpenBSD Stable
vm "OBSD-Stable.vm" {
disable
owner axon
memory 512M
disk "/home/axon/vmm/obsd-stable.img"
interface {
switch "local"
lladdr fe:e1:ba:d0:eb:ab
}
# interface {
# switch "local"
# lladdr fe:e1:ba:d0:eb:0b
# }
}
# OpenBSD Stable alternate
vm "OBSD-Stable-alt.vm" {
disable
owner axon
memory 256M
disk "/home/axon/vmm/obsd-stable-alt.img"
interface {
switch "local"
lladdr fe:e1:ba:d0:eb:ad
}
}
# OpenBSD amd64 Snapshot
vm "OBSDSnap64.vm" {
disable
owner axon
memory 256M
disk "/home/axon/vmm/obsd-snap64.img"
interface {
switch "local"
lladdr fe:e1:ba:d0:eb:ac
}
}
>How-To-Repeat:
On this system (Acer Aspire 5733Z with upgrades), any attempt to
start a vm as a user or root will fail.
>Fix:
N/A
dmesg:
OpenBSD 6.3-current (GENERIC.MP) #49: Sat Jun 23 09:32:05 MDT 2018
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 8227655680 (7846MB)
avail mem = 7902208000 (7536MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xe9d90 (47 entries)
bios0: vendor Acer version "V1.07" date 11/07/2011
bios0: Acer Aspire 5733Z
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP ASF! HPET APIC MCFG SLIC BOOT ASPT DMAR SSDT SSDT
SSDT
acpi0: wakeup devices AZAL(S3) P0P1(S4) EHC1(S3) USB1(S3) USB2(S3) USB3(S3)
USB4(S3) USB5(S3) USB6(S3) USB7(S3) RP01(S4) PEG5(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i5 CPU M 540 @ 2.53GHz, 2527.85 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,AES,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT,MELTDOWN
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 133MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM) i5 CPU M 540 @ 2.53GHz, 2527.44 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,AES,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT,MELTDOWN
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 1, core 0, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Core(TM) i5 CPU M 540 @ 2.53GHz, 2527.44 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,AES,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT,MELTDOWN
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 5 (application processor)
cpu3: Intel(R) Core(TM) i5 CPU M 540 @ 2.53GHz, 2527.44 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,AES,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT,MELTDOWN
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 1, core 2, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
, remapped to apid 2
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (P0P2)
acpiprt2 at acpi0: bus 3 (P0P1)
acpiprt3 at acpi0: bus 1 (RP01)
acpiprt4 at acpi0: bus 2 (RP02)
acpiprt5 at acpi0: bus -1 (RP03)
acpiprt6 at acpi0: bus -1 (RP04)
acpiprt7 at acpi0: bus -1 (RP05)
acpiprt8 at acpi0: bus -1 (RP06)
acpiprt9 at acpi0: bus -1 (RP07)
acpiprt10 at acpi0: bus -1 (RP08)
acpiprt11 at acpi0: bus -1 (PEG5)
acpiec0 at acpi0
acpicpu0 at acpi0: C3(350@245 mwait.3@0x20), C1(1000@3 mwait.1), PSS
acpicpu1 at acpi0: C3(350@245 mwait.3@0x20), C1(1000@3 mwait.1), PSS
acpicpu2 at acpi0: C3(350@245 mwait.3@0x20), C1(1000@3 mwait.1), PSS
acpicpu3 at acpi0: C3(350@245 mwait.3@0x20), C1(1000@3 mwait.1), PSS
"pnp0c14" at acpi0 not configured
acpibat0 at acpi0: BAT0 model "Li_Ion_4000mA " serial 78da type Lion oem
"SANYO "
acpiac0 at acpi0: AC unit online
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: LID0
acpibtn2 at acpi0: SLPB
acpicmos0 at acpi0
"ETD0500" at acpi0 not configured
"PNP0C14" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD03
acpivideo1 at acpi0: VGA_
cpu0: Enhanced SpeedStep 2527 MHz: speeds: 2533, 2399, 2266, 2133, 1999,
1866, 1733, 1599, 1466, 1333, 1199 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Core Host" rev 0x02
inteldrm0 at pci0 dev 2 function 0 "Intel HD Graphics" rev 0x02
drm0 at inteldrm0
intagp0 at inteldrm0
agp0 at intagp0: aperture at 0xc0000000, size 0x10000000
inteldrm0: msi
inteldrm0: 1366x768, 32bpp
wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
"Intel 3400 MEI" rev 0x06 at pci0 dev 22 function 0 not configured
ehci0 at pci0 dev 26 function 0 "Intel 3400 USB" rev 0x05: apic 2 int 16
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
azalia0 at pci0 dev 27 function 0 "Intel 3400 HD Audio" rev 0x05: msi
azalia0: codecs: Realtek ALC272
audio0 at azalia0
ppb0 at pci0 dev 28 function 0 "Intel 3400 PCIE" rev 0x05: msi
pci1 at ppb0 bus 1
bge0 at pci1 dev 0 function 0 "Broadcom BCM57780" rev 0x01, BCM57780 A1
(0x57780001): msi, address dc:0e:a1:91:7a:b9
brgphy0 at bge0 phy 1: BCM57780 10/100/1000baseT PHY, rev. 1
ppb1 at pci0 dev 28 function 1 "Intel 3400 PCIE" rev 0x05: msi
pci2 at ppb1 bus 2
athn0 at pci2 dev 0 function 0 "Atheros AR9285" rev 0x01: apic 2 int 17
athn0: AR9285 rev 2 (1T1R), ROM rev 13, address 00:25:d3:f4:f8:4b
ehci1 at pci0 dev 29 function 0 "Intel 3400 USB" rev 0x05: apic 2 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb2 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xa5
pci3 at ppb2 bus 3
pcib0 at pci0 dev 31 function 0 "Intel HM55 LPC" rev 0x05
ahci0 at pci0 dev 31 function 2 "Intel 3400 AHCI" rev 0x05: msi, AHCI 1.3
ahci0: port 0: 3.0Gb/s
ahci0: port 1: 1.5Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, SanDisk SDSSDA12, Z320> SCSI3 0/direct
fixed naa.5001b444a668bf8d
sd0: 114473MB, 512 bytes/sector, 234441648 sectors, thin
cd0 at scsibus1 targ 1 lun 0: <HL-DT-ST, CDRW/DVD GCCT20N, A108> ATAPI
5/cdrom removable
ichiic0 at pci0 dev 31 function 3 "Intel 3400 SMBus" rev 0x05: apic 2 int 19
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 4GB DDR3 SDRAM PC3-10600 SO-DIMM
spdmem1 at iic0 addr 0x52: 4GB DDR3 SDRAM PC3-10600 SO-DIMM
itherm0 at pci0 dev 31 function 6 "Intel 3400 Thermal" rev 0x05
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
wsmouse0 at pms0 mux 0
pms0: Elantech Touchpad, version 2, firmware 0x40213
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
pci4 at mainbus0 bus 255
pchb1 at pci4 dev 0 function 0 "Intel QuickPath" rev 0x02
pchb2 at pci4 dev 0 function 1 "Intel QuickPath" rev 0x02
pchb3 at pci4 dev 2 function 0 "Intel QPI Link" rev 0x02
pchb4 at pci4 dev 2 function 1 "Intel QPI Physical" rev 0x02
pchb5 at pci4 dev 2 function 2 "Intel Reserved" rev 0x02
pchb6 at pci4 dev 2 function 3 "Intel Reserved" rev 0x02
vmm0 at mainbus0: VMX/EPT
uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching Hub"
rev 2.00/0.00 addr 2
uvideo0 at uhub2 port 1 configuration 1 interface 0 "SuYin 1.3M HD WebCam"
rev 2.00/1.02 addr 3
video0 at uvideo0
umass0 at uhub2 port 2 configuration 1 interface 0 "Generic USB2.0-CRW" rev
2.00/38.82 addr 4
umass0: using SCSI over Bulk-Only
scsibus2 at umass0: 2 targets, initiator 0
sd1 at scsibus2 targ 1 lun 0: <Generic-, Multi-Card, 1.00> SCSI0 0/direct
removable serial.0bda0138516388200000
uhub3 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub"
rev 2.00/0.00 addr 2
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on sd0a (7c4cada893c18112.a) swap on sd0b dump on sd0b
lock order reversal:
1st 0xffffff01f7778888 vmmaplk (&map->lock) @
/usr/src/sys/uvm/uvm_fault.c:1441
2nd 0xffff80000015c138 drmdevlk (&dev->struct_mutex) @
/usr/src/sys/dev/pci/drm/i915/i915_gem.c:1801
lock order "&dev->struct_mutex"(rwlock) -> "&map->lock"(rwlock) first seen
at:
#0 witness_checkorder+0x4c0
#1 _rw_enter+0x68
#2 vm_map_lock_ln+0xbc
#3 uvm_map+0x1a1
#4 km_alloc+0x16a
#5 bus_space_map+0x159
#6 i965_alloc_ifp+0xc1
#7 intel_gtt_chipset_setup+0x1b1
#8 intel_enable_gtt+0x26
#9 i915_gem_init_hw+0x43
#10 i915_gem_init+0x24e
#11 i915_driver_load+0xfc1
#12 inteldrm_attach+0x37f
#13 config_attach+0x20e
#14 pci_probe_device+0x501
#15 pci_enumerate_bus+0xb7
#16 config_attach+0x20e
#17 mainbus_attach+0x24a
#18 config_attach+0x20e
lock order "&map->lock"(rwlock) -> "&dev->struct_mutex"(rwlock) first seen
at:
#0 witness_checkorder+0x4c0
#1 _rw_enter_write+0x53
#2 i915_gem_object_wait_rendering__nonblocking+0x1fa
#3 i915_gem_fault+0x144
#4 drm_fault+0x18a
#5 uvm_fault+0x743
#6 pageflttrap+0x14c
#7 trap+0x2b2
#8 recall_trap+0x8
usbdevs:
Controller /dev/usb0:
addr 1: high speed, self powered, config 1, EHCI root hub(0x0000),
Intel(0x8086), rev 1.00
port 1 addr 2: high speed, self powered, config 1, Rate Matching
Hub(0x0020), Intel(0x8087), rev 0.00
port 1 addr 3: high speed, power 500 mA, config 1, 1.3M HD
WebCam(0xd250), SuYin(0x064e), rev 1.02, iSerialNumber
HF1316-A821-HN01-VA-R01.00.02
port 2 addr 4: high speed, power 500 mA, config 1, USB2.0-CRW(0x0138),
Generic(0x0bda), rev 38.82, iSerialNumber 20090516388200000
port 3 powered
port 4 powered
port 5 powered
port 6 powered
port 2 powered
Controller /dev/usb1:
addr 1: high speed, self powered, config 1, EHCI root hub(0x0000),
Intel(0x8086), rev 1.00
port 1 addr 2: high speed, self powered, config 1, Rate Matching
Hub(0x0020), Intel(0x8087), rev 0.00
port 1 powered
port 2 powered
port 3 powered
port 4 powered
port 5 powered
port 6 powered
port 7 powered
port 8 powered
port 2 powered
