OK, so just to be clear I'm not a terribly clever person. I have no
idea what I should be looking for to diagnose this issue. It's
entirely possible that I have something configured stupidly/wrong,
etc or that the answer is right in front of me, but I wouldn't know.
I've done a little googling and all I came up with was:
http://archives.neohapsis.com/archives/openbsd/2005-11/1349.html
which went completely un-answered (at least on-list).
The OP and I conversed off-list a few weeks ago and he mentioned that
the situation is still the same for him (same as I'm seeing). Summary:
- 64bit host OS (SLES 9) running on 2 dual-core Opteron 265s
- VMware Server 1.0.1 build 29996
- OpenBSD/i386 works fine
- OpenBSD/amd64 is slow as hell
- MP/UP kernel makes no difference
- one CPU or two CPUs makes no difference
I've tried 4.0-release, then a snapshot from a few weeks ago, now
running with -current GENERIC.MP kernel (as of last night). That
kernel took about 22 hours to build, BTW--that's slower than my
SPARCstation 5. Right now it's churning away on make depend for
GENERIC (UP) and it's been doing so for over 128 minutes.
Does anyone have *any* idea why compiling would be so slow on this
setup? Services respond fairly quickly (ssh, etc) but running make
or cc takes ages. Usually the load is around 1.3 or so when building
something, but on occasion it spikes to 16 or more for no apparent
reason.
I'd love to collect any relevant information that could help diagnose
the problem. What I got so far is some output from vmstat (system
has been up for about 3hrs, most of that trying to make depend for
amd64/GENERIC). I have no idea what I'm talking about, but should
syscalls be over 174 million in 3 hrs? What about over 1 million
interrupts?
vmstat -i
interrupt total rate
irq0/clock 2323579 198
irq0/ipi 659552 56
irq14/pciide0 9802 0
irq18/em0 7521 0
irq1/pckbc0 3274 0
Total 3003728 255
vmstat -s
4096 bytes per page
92994 pages managed
60024 pages free
12862 pages active
3646 pages inactive
0 pages being paged out
2 pages wired
0 pages zeroed
4 pages reserved for pagedaemon
6 pages reserved for kernel
131117 swap pages
0 swap pages in use
217870 total anon's in system
206486 free anon's
592955 page faults
625470 traps
14762 interrupts
177426 cpu context switches
17746 fpu context switches
1281121 software interrupts
174821427 syscalls
0 pagein operations
0 swap ins
0 swap outs
890 forks
9 forks where vmspace is shared
13 kernel map entries
0 number of times the pagedaemon woke up
0 revolutions of the clock hand
0 pages freed by pagedaemon
0 pages scanned by pagedaemon
0 pages reactivated by pagedaemon
0 busy pages found by pagedaemon
484013 total name lookups
cache hits (87% pos + 9% neg) system 0% per-directory
deletions 0%, falsehits 0%, toolong 0%
0 select collisions
dmesg:
OpenBSD 4.0-current (GENERIC.MP) #0: Tue Dec 12 19:00:05 PST 2006
[EMAIL PROTECTED]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 401141760 (391740K)
avail mem = 331026432 (323268K)
using 9844 buffers containing 40321024 bytes (39376K) of memory
mainbus0 (root)
bios0 at mainbus0: SMBIOS rev. 2.31 @ 0xe0010 (45 entries)
bios0: VMware, Inc. VMware Virtual Platform
acpi at mainbus0 not configured
mainbus0: Intel MP Specification (Version 1.4)
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Dual Core AMD Opteron(tm) Processor 265, 1985.19 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,
CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu0: apic clock running at 66MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Dual Core AMD Opteron(tm) Processor 265, 1838.56 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,
CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu1: ITLB 32 4KB entries fully associative, 8 4MB entries fully
associative
cpu1: DTLB 32 4KB entries fully associative, 8 4MB entries fully
associative
mpbios: bus 0 is type PCI
mpbios: bus 1 is type PCI
mpbios: bus 2 is type ISA
ioapic0 at mainbus0 apid 2 pa 0xfec00000, version 11, 24 pins
pci0 at mainbus0 bus 0: configuration mode 1
pchb0 at pci0 dev 0 function 0 "Intel 82443BX AGP" rev 0x01
ppb0 at pci0 dev 1 function 0 "Intel 82443BX AGP" rev 0x01
pci1 at ppb0 bus 1
pcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x08
pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA,
channel 0 configured to compatibility, channel 1 configured to
compatibility
wd0 at pciide0 channel 0 drive 0: <VMware Virtual IDE Hard Drive>
wd0: 64-sector PIO, LBA, 8192MB, 16777216 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <NECVMWar, VMware IDE CDR10, 1.00>
SCSI0 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
piixpm0 at pci0 dev 7 function 3 "Intel 82371AB Power" rev 0x08:
SMBus disabled
vga1 at pci0 dev 15 function 0 "VMware Virtual SVGA II" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
mpi0 at pci0 dev 16 function 0 "Symbios Logic 53c1030" rev 0x01: apic
2 int 17 (irq 9)
scsibus1 at mpi0: 16 targets
em0 at pci0 dev 17 function 0 "Intel PRO/1000MT (82545EM)" rev 0x01:
apic 2 int 18 (irq 11), address 00:0c:29:c4:24:5b
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pmsi0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pmsi0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
dkcsum: wd0 matches BIOS drive 0x80
root on wd0a
rootdev=0x0 rrootdev=0x300 rawdev=0x302
--
bk