Hi. I have a domU. Its params file has: vcpus = 8. It will start with
pv, but not type="pvh". It will not start (on pvh) with vcpus = 7 or 6
or 5. It does start with vcpus = 4.
I diffed the xl -v create logs, no difference there on either startup.
I grabbed the domU console output for a vcpus = 5 start (attached). It
dies right after:
[ 0.007110] cpu 3 spinlock event irq 23
[ 0.007336] installing Xen timer for CPU 4
I think this issue is only affecting some CPUs. So it might be related
to some CPU calculation/allocation code?
I see xl info reports nr_nodes to be 1. This is a server with two E5420
CPUs. I see other dual socket, dual CPU servers (e.g. E5410, E5310)
that report at nr_nodes 1 .
I also see one newer CPU that I'd expect to have nr_nodes 2.
nr_cpus : 20nr_nodes :
1cores_per_socket : 10threads_per_core : 2 model name :
Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz
I note that a v3 version of that CPU reports nr_nodes 2 as I would expect.
nr_cpus : 32nr_nodes :
2cores_per_socket : 8threads_per_core : 2 model name :
Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
# xl info
release : 4.14.12-2.el6xen.x86_64
version : #2 SMP Sat Jan 6 03:49:33 UTC 2018
machine : x86_64
nr_cpus : 8
max_cpu_id : 7
nr_nodes : 1
cores_per_socket : 4
threads_per_core : 1
cpu_mhz : 2500
hw_caps :
bfebfbff:040ce3bd:20100800:00000001:00000000:00000000:00000000:00000000
virt_caps : hvm
total_memory : 64766
free_memory : 15433
sharing_freed_memory : 0
sharing_used_memory : 0
outstanding_claims : 0
free_cpus : 0
xen_major : 4
xen_minor : 10
xen_extra : .0
xen_version : 4.10.0
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset :
xen_commandline : dom0_mem=2048M cpufreq=xen dom0_max_vcpus=2
dom0_vcpus_pin loglvl=info vcpu_migration_delay=1000
cc_compiler : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-18)
cc_compile_by : build
cc_compile_date : Sun Jan 7 23:45:02 UTC 2018
build_id : f61b02cac217640909b4c2d0f07ba50e0fe0f3d1
xend_config_format : 4
cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Xeon(R) CPU E5420 @ 2.50GHz
...
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Xeon(R) CPU E5420 @ 2.50GHz
Possibly related to
https://lists.xenproject.org/archives/html/xen-devel/2018-01/msg01471.html
https://lists.xen.org/archives/html/xen-users/2018-01/msg00031.html
https://xenbits.xen.org/gitweb/?p=xen.git;a=commit;h=7209b8bf08700b1ed3b7dd15c6ca0b76f537ddb3
"
x86: Don't use potentially incorrect CPUID values for topology information"
Regards, Peter
[ 0.000000] Command line: root=/dev/xvda1 ro console=hvc0 elevator=noop
xen-blkfront.max=64 init=/bin/bash
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point
registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Enabled xstate features 0x3, context size is 576 bytes,
using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000000a0000-0x00000000000fefff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000ff000-0x00000000000fffff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000800003ff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000fc007fff] ACPI data
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI not present or invalid.
[ 0.000000] Hypervisor detected: Xen HVM
[ 0.000000] Xen version 4.10.
[ 0.000000] Xen Platform PCI: unrecognised magic value
[ 0.000000] tsc: Fast TSC calibration failed
[ 0.000000] tsc: Unable to calibrate against PIT
[ 0.000000] tsc: No reference (HPET/PMTIMER) available
[ 0.000000] e820: last_pfn = 0x80000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR: Disabled
[ 0.000000] x86/PAT: MTRRs disabled, skipping PAT initialization too.
[ 0.000000] CPU MTRRs all blank - virtualized system.
[ 0.000000] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT UC- UC
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000FFFC0 000024 (v02 Xen )
[ 0.000000] ACPI: XSDT 0x00000000FC007F80 000034 (v01 Xen HVM
00000000 HVML 00000000)
[ 0.000000] ACPI: FACP 0x00000000FC007D70 00010C (v05 Xen HVM
00000000 HVML 00000000)
[ 0.000000] ACPI: DSDT 0x00000000FC001050 006C9B (v05 Xen HVM
00000000 INTL 20090123)
[ 0.000000] ACPI: FACS 0x00000000FC001010 000040
[ 0.000000] ACPI: FACS 0x00000000FC001010 000040
[ 0.000000] ACPI: APIC 0x00000000FC007E80 000054 (v02 Xen HVM
00000000 HVML 00000000)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000007fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x7fffc000-0x7fffffff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x000000007fffffff]
[ 0.000000] Normal empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009ffff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x000000007fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000007fffffff]
[ 0.000000] ACPI: No IOAPIC entries present
[ 0.000000] Using ACPI for processor (LAPIC) configuration information
[ 0.000000] smpboot: Allowing 5 CPUs, 0 hotplug CPUs
[ 0.000000] e820: [mem 0x80000400-0xfbffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen PVH
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 1910969940391419 ns
[ 0.000000] random: fast init done
[ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:5
nr_node_ids:1
[ 0.000000] percpu: Embedded 41 pages/cpu @ffff88007d000000 s138520 r0
d29416 u1048576
[ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 515991
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: root=/dev/xvda1 ro console=hvc0
elevator=noop xen-blkfront.max=64 init=/bin/bash
[ 0.000000] log_buf_len individual max cpu contribution: 65536 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 262144 bytes
[ 0.000000] log_buf_len min size: 65536 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 59888(91%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Memory: 2032236K/2096764K available (16396K kernel code, 1009K
rwdata, 3208K rodata, 1120K init, 652K bss, 64528K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=5, Nodes=1
[ 0.000000] Kernel/User page tables isolation: enabled
[ 0.001000] Hierarchical RCU implementation.
[ 0.001000] RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=5.
[ 0.001000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=5
[ 0.001000] Using NULL legacy PIC
[ 0.001000] NR_IRQS: 4352, nr_irqs: 96, preallocated irqs: 0
[ 0.001000] xen:events: Using FIFO-based ABI
[ 0.001000] xen:events: Xen HVM callback vector for event delivery is enabled
[ 0.001000] Console: colour dummy device 80x25
[ 0.001000] console [hvc0] enabled
[ 0.001000] tsc: Fast TSC calibration failed
[ 0.001000] tsc: Unable to calibrate against PIT
[ 0.001000] tsc: No reference (HPET/PMTIMER) available
[ 0.001000] tsc: Detected 2500.098 MHz processor
[ 0.001000] Calibrating delay loop (skipped), value calculated using timer
frequency.. 5000.19 BogoMIPS (lpj=2500098)
[ 0.001000] pid_max: default: 32768 minimum: 301
[ 0.001000] ACPI: Core revision 20170728
[ 0.001000] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 0.001000] ACPI: setting ELCR to 0200 (from ffff)
[ 0.001000] Security Framework initialized
[ 0.001000] AppArmor: AppArmor disabled by boot time parameter
[ 0.001000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.001000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.001000] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.001000] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.001000] CPU: Physical Processor ID: 0
[ 0.001000] CPU: Processor Core ID: 0
[ 0.001000] Last level iTLB entries: 4KB 128, 2MB 4, 4MB 4
[ 0.001000] Last level dTLB entries: 4KB 256, 2MB 0, 4MB 32, 1GB 0
[ 0.001000] Spectre V2 : kernel not compiled with retpoline; no mitigation
available!
[ 0.001000] Freeing SMP alternatives memory: 60K
[ 0.001000] smpboot: Max logical packages: 1
[ 0.001000] clocksource: xen: mask: 0xffffffffffffffff max_cycles:
0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[ 0.001000] installing Xen timer for CPU 0
[ 0.001000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz
(family: 0x6, model: 0x17, stepping: 0xa)
[ 0.001000] cpu 0 spinlock event irq 5
[ 0.001000] Performance Events: unsupported p6 CPU model 23 no PMU driver,
software events only.
[ 0.001000] Hierarchical SRCU implementation.
[ 0.001234] smp: Bringing up secondary CPUs ...
[ 0.001562] installing Xen timer for CPU 1
[ 0.001623] x86: Booting SMP configuration:
[ 0.001633] .... node #0, CPUs: #1
[ 0.003092] cpu 1 spinlock event irq 11
[ 0.003290] installing Xen timer for CPU 2
[ 0.003366] #2
[ 0.005167] cpu 2 spinlock event irq 17
[ 0.005300] installing Xen timer for CPU 3
[ 0.005360] #3
[ 0.007110] cpu 3 spinlock event irq 23
[ 0.007336] installing Xen timer for CPU 4
vm appears to be destroy at/after this point
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
