Dear List,
I am experimenting with virtual machines (vmd) in recent OpenBSD
snapshots. Having gotten a few VMs working, I am eager to make many
more and also run them. I'm pleased to have an autoinstall process
running from a vmd instance.
However, when running more than 4 instances, I run into an error:
# /etc/rc.d/vmd stop
# ... /etc/vm.conf enable a fifth machine that is confirmed to run
# /etc/rc.d/vmd start
# vmctl status
vmctl: connect: /var/run/vmd.sock: Connection refused
# tail -4 /var/log/messages
Feb 9 11:21:44 air vmd[73442]: parent terminating
Feb 9 11:21:47 air vmd[73405]: config_setvm: can't open tap tap: No such file
or directory
Feb 9 11:21:47 air vmd[73405]: config_setvm: failed to start vm
mirror.ericcbrown.com
Feb 9 11:21:47 air vmd[73405]: parent: configuration failed
Some evidence that may help:
* I can make a bunch of tap's with ifconfig, many more than4.
(hostname.bridge0,hostname.bge0,and hostname.vether configured)
* I am using i7 2.0 Ghz with 2 cores and 4 hyperthreads that appear in
`top' (macbook air 2011)
* I confirm that each machine works in any combination of 4 vm's concurrently
I've tried to read the source, but I'm totally stuck here, and thought I
would ask whether anyone knows what could be the stopper here at running
many vm's.
Best regards,
Eric
PS Thank you very much to Mike Larkin and Reyk Floeter for authoring this.
It has been a very nice way to explore network and routing concepts
while making VM's that do very useful things for me.
-- dmesg of host machine --
OpenBSD 6.0-current (GENERIC.MP) #163: Sun Feb 5 13:55:12 MST 2017
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
RTC BIOS diagnostic error
f7<clock_battery,ROM_cksum,config_unit,memory_size,invalid_time>
real mem = 1836232704 (1751MB)
avail mem = 1775980544 (1693MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0000 (39 entries)
bios0: vendor Apple Inc. version "MB61.88Z.00C8.B00.0908271503" date 08/27/09
bios0: Apple Inc. MacBook6,1
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP HPET APIC APIC MCFG ASF! SBST ECDT SSDT SSDT SSDT SSDT
acpi0: wakeup devices ADP1(S3) LID0(S3) EC__(S3) OHC1(S3) EHC1(S3) OHC2(S3)
EHC2(S3) GIGE(S5) ARPT(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 25000000 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz, 2255.72 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF,SENSOR
cpu0: 3MB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 265MHz
cpu0: mwait min=64, max=64, C-substates=0.2.2.2.2.1.3, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz, 2255.35 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF,SENSOR
cpu1: 3MB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins
acpimcfg0 at acpi0 addr 0xf0000000, bus 0-255
acpiec0 at acpi0
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (IXVE)
acpicpu0 at acpi0: !C3(100@57 mwait.3@0x31), !C2(500@1 mwait@0x10), C1(1000@1
mwait), PSS
acpicpu1 at acpi0: !C3(100@57 mwait.3@0x31), !C2(500@1 mwait@0x10), C1(1000@1
mwait), PSS
acpiac0 at acpi0: AC unit online
acpibtn0 at acpi0: LID0
"APP0002" at acpi0 not configured
acpibtn1 at acpi0: PWRB
acpibtn2 at acpi0: SLPB
"APP0001" at acpi0 not configured
"APP0003" at acpi0 not configured
"ACPI0002" at acpi0 not configured
acpibat0 at acpi0: BAT0 model "3545797981023400290" type 3545797981528607052
oem "3545797981528608836"
cpu0: Enhanced SpeedStep 2255 MHz: speeds: 2261, 2128, 1862, 1596, 798 MHz
memory map conflict 0xffc00000/0x400000
pci0 at mainbus0 bus 0
0:3:5: mem address conflict 0x93300000/0x80000
pchb0 at pci0 dev 0 function 0 "NVIDIA MCP79 Host" rev 0xb1
"NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 0 function 1 not configured
pcib0 at pci0 dev 3 function 0 "NVIDIA MCP79 ISA" rev 0xb3
"NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 3 function 1 not configured
nviic0 at pci0 dev 3 function 2 "NVIDIA MCP79 SMBus" rev 0xb1
iic0 at nviic0
spdmem0 at iic0 addr 0x50: 2GB DDR3 SDRAM PC3-8500 SO-DIMM
iic1 at nviic0
iic1: addr 0x4c 00=47 01=5a 02=92 04=07 05=55 07=55 0a=07 0b=55 0d=55 10=e0
15=55 19=55 1a=55 20=55 21=0a 22=70 23=43 24=60 25=0b 26=0f 27=12 28=12 29=a0
35=02 37=02 60=06 70=06 71=03 72=07 8c=ff 8d=ff 8e=ff 8f=ff 90=ff 9a=ff 9b=ff
9c=ff 9d=ff 9e=ff 9f=ff a0=ff a1=ff a2=ff a3=ff a4=ff a5=ff a6=ff a7=ff a8=ff
a9=ff aa=ff ab=ff ac=ff ad=ff ae=ff af=ff b0=ff b1=ff b2=ff b3=ff b4=ff b5=ff
b6=ff b7=ff b8=ff b9=ff ba=ff bb=ff bc=ff bd=ff be=ff bf=ff c0=ff c1=ff c2=ff
c3=00 d2=ff d3=ff d4=ff d5=ff d6=ff d7=ff d8=ff d9=ff da=ff db=ff dc=ff dd=ff
de=ff df=ff e0=ff e1=ff e2=ff e3=ff e4=ff e5=ff e6=ff e7=ff e8=ff e9=ff ea=ff
eb=ff ec=ff ed=ff ee=ff ef=ff f0=ff f1=ff f2=ff f3=ff f4=ff f5=ff f6=ff f7=ff
f8=ff f9=ff fa=ff fb=ff fd=ff fe=5d ff=ff words 00=ffff 01=ffff 02=ffff 03=ffff
04=ffff 05=ffff 06=ffff 07=ffff
"NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 3 function 3 not configured
vendor "NVIDIA", unknown product 0x0a98 (class memory subclass RAM, rev 0xb1)
at pci0 dev 3 function 4 not configured
"NVIDIA MCP79 Co-processor" rev 0xb1 at pci0 dev 3 function 5 not configured
ohci0 at pci0 dev 4 function 0 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 11,
version 1.0, legacy support
ehci0 at pci0 dev 4 function 1 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 10
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "NVIDIA EHCI root hub" rev 2.00/1.00
addr 1
ohci1 at pci0 dev 6 function 0 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 7,
version 1.0, legacy support
ehci1 at pci0 dev 6 function 1 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 5
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "NVIDIA EHCI root hub" rev 2.00/1.00
addr 1
azalia0 at pci0 dev 8 function 0 "NVIDIA MCP79 HD Audio" rev 0xb1: apic 1 int 15
azalia0: codecs: Cirrus Logic CS4206
audio0 at azalia0
ppb0 at pci0 dev 9 function 0 "NVIDIA MCP79 PCIE" rev 0xb1
pci1 at ppb0 bus 1
nfe0 at pci0 dev 10 function 0 "NVIDIA MCP79 LAN" rev 0xb1: apic 1 int 14,
address 34:15:9e:08:d1:58
rgephy0 at nfe0 phy 1: RTL8169S/8110S/8211 PHY, rev. 2
pciide0 at pci0 dev 11 function 0 "NVIDIA MCP79 SATA" rev 0xb1: DMA
pciide0: using apic 1 int 11 for native-PCI interrupt
wd0 at pciide0 channel 0 drive 0: <TOSHIBA MK2555GSXF>
wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <MATSHITA, DVD-R UJ-898, HA07> ATAPI 5/cdrom
removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 5
ppb1 at pci0 dev 16 function 0 "NVIDIA MCP79 PCIE" rev 0xb1
pci2 at ppb1 bus 2
vga1 at pci2 dev 0 function 0 "NVIDIA GeForce 9400m" rev 0xb1
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ppb2 at pci0 dev 21 function 0 "NVIDIA MCP79 PCIE" rev 0xb1: msi
pci3 at ppb2 bus 3
"Broadcom BCM43224" rev 0x01 at pci3 dev 0 function 0 not configured
isa0 at pcib0
isadma0 at isa0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
asmc0 at isa0 port 0x300/32: rev 1.51f551, 285 keys
usb2 at ohci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "NVIDIA OHCI root hub" rev 1.00/1.00
addr 1
usb3 at ohci1: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "NVIDIA OHCI root hub" rev 1.00/1.00
addr 1
vmm0 at mainbus0: VMX
uvideo0 at uhub0 port 4 configuration 1 interface 0 "Apple Inc. Built-in
iSight" rev 2.00/4.30 addr 2
video0 at uvideo0
ugen0 at uhub0 port 4 configuration 1 "Apple Inc. Built-in iSight" rev
2.00/4.30 addr 2
axe0 at uhub1 port 2 configuration 1 interface 0 "ASIX Electronics AX88772" rev
2.00/0.01 addr 2
axe0: AX88772, address 00:50:b6:0f:82:1d
ukphy0 at axe0 phy 16: Generic IEEE 802.3u media interface, rev. 1: OUI
0x000ec6, model 0x0006
uhidev0 at uhub2 port 6 configuration 1 interface 0 "Apple Inc. Apple Internal
Keyboard / Trackpad" rev 2.00/0.81 addr 2
uhidev0: iclass 3/1, 9 report ids
ukbd0 at uhidev0 reportid 1: 8 variable keys, 6 key codes, country code 33
wskbd0 at ukbd0: console keyboard, using wsdisplay0
uhid0 at uhidev0 reportid 9: input=0, output=0, feature=3
uhidev1 at uhub2 port 6 configuration 1 interface 1 "Apple Inc. Apple Internal
Keyboard / Trackpad" rev 2.00/0.81 addr 2
uhidev1: iclass 3/0, 68 report ids
uhid1 at uhidev1 reportid 68: input=511, output=0, feature=0
ubcmtp0 at uhub2 port 6 configuration 1 interface 2 "Apple Inc. Apple Internal
Keyboard / Trackpad" rev 2.00/0.81 addr 2
wsmouse0 at ubcmtp0 mux 0
uhub4 at uhub3 port 1 configuration 1 interface 0 "Apple Inc. BRCM2070 Hub" rev
2.00/1.00 addr 2
uhidev2 at uhub4 port 1 configuration 1 interface 0 "Apple Computer product
0x820a" rev 2.00/1.00 addr 3
uhidev2: iclass 3/1, 1 report id
ukbd1 at uhidev2 reportid 1: 8 variable keys, 6 key codes
wskbd1 at ukbd1 mux 1
wskbd1: connecting to wsdisplay0
uhidev3 at uhub4 port 2 configuration 1 interface 0 "Apple Computer product
0x820b" rev 2.00/1.00 addr 4
uhidev3: iclass 3/1, 2 report ids
ums0 at uhidev3 reportid 2: 3 buttons
wsmouse1 at ums0 mux 0
ugen1 at uhub4 port 3 "Apple Inc. Bluetooth USB Host Controller" rev 2.00/0.42
addr 5
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
sd0 at scsibus3 targ 1 lun 0: <OPENBSD, SR CRYPTO, 006> SCSI2 0/direct fixed
sd0: 230275MB, 512 bytes/sector, 471603612 sectors
root on sd0a (10bab517be228490.a) swap on sd0b dump on sd0b
