Summary Rackspace Xen 4.7 linux-image-4.19.0-26-cloud-amd64 works, linux-image-4.19.0-27-cloud-amd64 does not work.
I am running Buster on Rackspace inside a 1GB basic model VM At the end of June, linux-image-4.19.0-27-cloud-amd64 was added as a security update My unattended-upgrades script trusts security updates. Upon its first reboot, the machine failed. It is certain that: linux-image-4.19.0-26-cloud-amd64 work, linux-image-4.19.0-27-cloud-amd64 does not. choosing -27... (recovery mode) fails in an apparently identical fashion (a screen grab of the console is attached. another line is written before the crash, but I cannot read it) this screengrab ends with "Last level dTLB entries: 4kb 512, 2MB 128, 4MB 64, 1GB 0" I thought I should put a message here in case someone else suffers in the same way. I do not have the skills to burrow further into the issue. Here is dmesg for a -26- (working) boot, showing DMI: Xen HVM domU, BIOS 4.7 09/01/2021 and Xen version 4.7: I have snipped it half a second after the dTLB line. I feel pretty sure the -27- kernel fails within a few lines of th dTLB line, but of course, hypervisors, <shrug> who knows? [ 0.000000] Linux version 4.19.0-26-cloud-amd64 ( debian-ker...@lists.debian.org) (gcc version 8.3.0 (Debian 8.3.0-6)) #1 SMP Debian 4.19.304-1 (2024-01-09) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.19.0-26-cloud-amd64 root=/dev/xvda1 ro vsyscall=emulate nosplash text biosdevname=0 net.ifnames=0 console=tty0 console=ttyS0,115200 earlyprintk=ttyS0,115200 consoleblank=0 systemd.show_status=true [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fbfffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved [ 0.000000] bootconsole [earlyser0] enabled [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.4 present. [ 0.000000] DMI: Xen HVM domU, BIOS 4.7 09/01/2021 [ 0.000000] Hypervisor detected: Xen HVM [ 0.000000] Xen version 4.7. [ 0.000000] Xen Platform PCI: I/O protocol version 1 [ 0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs. [ 0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks. You might have to change the root device from /dev/hd[a-d] to /dev/xvd[a-d] in your root= kernel command line option [ 0.000014] HVMOP_pagetable_dying not supported [ 0.024709] tsc: Fast TSC calibration using PIT [ 0.029406] tsc: Detected 2099.892 MHz processor [ 0.032668] tsc: Detected 2100.028 MHz TSC [ 0.034456] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.039483] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.039489] last_pfn = 0x3fc00 max_arch_pfn = 0x400000000 [ 0.046720] MTRR default type: write-back [ 0.046723] MTRR fixed ranges enabled: [ 0.046726] 00000-9FFFF write-back [ 0.046727] A0000-BFFFF write-combining [ 0.046729] C0000-FFFFF write-back [ 0.046730] MTRR variable ranges enabled: [ 0.046732] 0 base 0000F0000000 mask FFFFF0000000 uncachable [ 0.046734] 1 disabled [ 0.046735] 2 disabled [ 0.046736] 3 disabled [ 0.046736] 4 disabled [ 0.046737] 5 disabled [ 0.046738] 6 disabled [ 0.046739] 7 disabled [ 0.046741] TOM2: 0000000840000000 aka 33792M [ 0.046841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.060062] Using GB pages for direct mapping [ 0.065871] RAMDISK: [mem 0x36375000-0x371b1fff] [ 0.069947] ACPI: Early table checksum verification disabled [ 0.073682] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen ) [ 0.091540] ACPI: XSDT 0x00000000FC00CF40 000044 (v01 Xen HVM 00000000 HVML 00000000) [ 0.100101] ACPI: FACP 0x00000000FC00CC80 0000F4 (v04 Xen HVM 00000000 HVML 00000000) [ 0.108466] ACPI: DSDT 0x00000000FC0042A0 008956 (v02 Xen HVM 00000000 INTL 20150619) [ 0.117871] ACPI: FACS 0x00000000FC004260 000040 [ 0.126807] ACPI: FACS 0x00000000FC004260 000040 [ 0.132844] ACPI: APIC 0x00000000FC00CD80 0000D8 (v02 Xen HVM 00000000 HVML 00000000) [ 0.148327] ACPI: HPET 0x00000000FC00CED0 000038 (v01 Xen HVM 00000000 HVML 00000000) [ 0.161005] ACPI: WAET 0x00000000FC00CF10 000028 (v01 Xen HVM 00000000 HVML 00000000) [ 0.175606] ACPI: Reserving FACP table memory at [mem 0xfc00cc80-0xfc00cd73] [ 0.186395] ACPI: Reserving DSDT table memory at [mem 0xfc0042a0-0xfc00cbf5] [ 0.190816] ACPI: Reserving FACS table memory at [mem 0xfc004260-0xfc00429f] [ 0.210849] ACPI: Reserving FACS table memory at [mem 0xfc004260-0xfc00429f] [ 0.248241] ACPI: Reserving APIC table memory at [mem 0xfc00cd80-0xfc00ce57] [ 0.272298] ACPI: Reserving HPET table memory at [mem 0xfc00ced0-0xfc00cf07] [ 0.300198] ACPI: Reserving WAET table memory at [mem 0xfc00cf10-0xfc00cf37] [ 0.310342] ACPI: Local APIC address 0xfee00000 [ 0.310477] No NUMA configuration found [ 0.314838] Faking a node at [mem 0x0000000000000000-0x000000003fbfffff] [ 0.322391] NODE_DATA(0) allocated [mem 0x3fbfb000-0x3fbfffff] [ 0.328086] Zone ranges: [ 0.330244] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.351274] DMA32 [mem 0x0000000001000000-0x000000003fbfffff] [ 0.365496] Normal empty [ 0.375285] Device empty [ 0.377134] Movable zone start for each node [ 0.383397] Early memory node ranges [ 0.385736] node 0: [mem 0x0000000000001000-0x000000000009dfff] [ 0.403322] node 0: [mem 0x0000000000100000-0x000000003fbfffff] [ 0.453759] Zeroed struct page in unavailable ranges: 1123 pages [ 0.453763] Initmem setup node 0 [mem 0x0000000000001000-0x000000003fbfffff] [ 0.492215] On node 0 totalpages: 261021 [ 0.492218] DMA zone: 64 pages used for memmap [ 0.492219] DMA zone: 21 pages reserved [ 0.492221] DMA zone: 3997 pages, LIFO batch:0 [ 0.492380] DMA32 zone: 4016 pages used for memmap [ 0.492382] DMA32 zone: 257024 pages, LIFO batch:63 [ 0.503823] ACPI: PM-Timer IO Port: 0xb008 [ 0.513460] ACPI: Local APIC address 0xfee00000 [ 0.513548] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47 [ 0.531033] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.545738] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level) [ 0.554169] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level) [ 0.565563] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level) [ 0.570982] ACPI: IRQ0 used by override. [ 0.570983] ACPI: IRQ5 used by override. [ 0.570985] ACPI: IRQ9 used by override. [ 0.570986] ACPI: IRQ10 used by override. [ 0.570986] ACPI: IRQ11 used by override. [ 0.570991] Using ACPI (MADT) for SMP configuration information [ 0.574401] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.581861] smpboot: Allowing 15 CPUs, 14 hotplug CPUs [ 0.594923] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.599173] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff] [ 0.613371] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.635928] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.698536] [mem 0x3fc00000-0xfbffffff] available for PCI devices [ 0.707417] Booting paravirtualized kernel on Xen HVM [ 0.710306] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.868012] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:15 nr_node_ids:1 [ 0.874762] percpu: Embedded 49 pages/cpu s162648 r8192 d29864 u262144 [ 0.879023] pcpu-alloc: s162648 r8192 d29864 u262144 alloc=1*2097152 [ 0.879025] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 -- [ 0.879072] xen: PV spinlocks enabled [ 0.879078] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.888265] Built 1 zonelists, mobility grouping on. Total pages: 256920 [ 0.902953] Policy zone: DMA32 [ 0.926090] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.19.0-26-cloud-amd64 root=/dev/xvda1 ro vsyscall=emulate nosplash text biosdevname=0 net.ifnames=0 console=tty0 console=ttyS0,115200 earlyprintk=ttyS0,115200 consoleblank=0 systemd.show_status=true [ 0.995296] Memory: 987396K/1044084K available (10252K kernel code, 1098K rwdata, 2624K rodata, 1504K init, 792K bss, 56688K reserved, 0K cma-reserved) [ 1.007799] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1 [ 1.052781] ftrace: allocating 27580 entries in 108 pages [ 1.091017] ftrace: allocated 108 pages with 4 groups [ 1.094501] rcu: Hierarchical RCU implementation. [ 1.097479] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=15. [ 1.102808] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=15 [ 1.127459] NR_IRQS: 33024, nr_irqs: 952, preallocated irqs: 16 [ 1.143887] xen:events: Using FIFO-based ABI [ 1.154216] xen:events: Xen HVM callback vector for event delivery is enabled [ 1.495327] Console: colour VGA+ 80x25 [ 1.778884] console [tty0] enabled [ 1.784585] console [ttyS0] enabled [ 1.792258] bootconsole [earlyser0] disabled [ 1.803917] ACPI: Core revision 20180810 [ 1.813230] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns [ 1.826760] hpet clockevent registered [ 1.826799] APIC: Switch to symmetric I/O mode setup [ 1.834186] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.841552] Switched APIC routing to physical flat. [ 1.849740] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0 [ 1.874780] tsc: Marking TSC unstable due to TSCs unsynchronized [ 1.882440] Calibrating delay loop (skipped), value calculated using timer frequency.. 4200.05 BogoMIPS (lpj=8400112) [ 1.910594] process: using AMD E400 aware idle routine [ 1.918428] Last level iTLB entries: 4KB 512, 2MB 16, 4MB 8 [ 1.926424] Last level dTLB entries: 4KB 512, 2MB 128, 4MB 64, 1GB 0 [ 1.934425] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.946426] Spectre V2 : Mitigation: Retpolines [ 1.954427] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.962424] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.970447] x86/fpu: x87 FPU will use FXSAVE [ 1.983631] pid_max: default: 32768 minimum: 301 [ 1.986578] Security Framework initialized [ 1.994429] Yama: disabled by default; enable with sysctl kernel.yama.* [ 2.006489] AppArmor: AppArmor initialized [ 2.022753] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes) [ 2.030619] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 2.038496] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes) [ 2.046438] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes) <snip>