Hi: I tried to upgrade our servers to SL 7.5. but one vpn box (intel j1900 cpu with 4 e1000 port) failed to boot. downgrade to 7.4 kernel 3.10.0-693.21.1 works fine. but with SL 7.5 kernel 3.10.0-862.2.3 or 3.10.0-862 the system will hang randomly during boot process. I have tried boot parameter "acpi_rev_override=1" and "maxcpus=1" but useless. are there other boot parameter worth to try?
one of the boot messages like below. sometimes I can see " NMI watchdog: BUG: soft lockup - CPU#0 stuck", sometimes there are no messages at all, just hang somewhere. [ 0.000000] Linux version 3.10.0-862.el7.x86_64 (mockbu...@sl7-uefisign.fnal.gov) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC) ) #1 SMP Thu Apr 12 09:09:37 CDT 2018 [ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.10.0-862.el7.x86_64 root=/dev/mapper/rootvg-root ro rd.lvm.lv=rootvg/swap video=1024x768@60 rd.lvm.lv=rootvg/root selinux=0 nodmraid c8 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000089bff] usable [ 0.000000] BIOS-e820: [mem 0x0000000000089c00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001effffff] usable [ 0.000000] BIOS-e820: [mem 0x000000001f000000-0x000000001f0fffff] reserved [ 0.000000] BIOS-e820: [mem 0x000000001f100000-0x000000001fffffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000020000000-0x00000000200fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000020100000-0x0000000079874fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079875000-0x00000000798a4fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a5000-0x00000000798b4fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000798b5000-0x0000000079a29fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079a2a000-0x0000000079b88fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000079b89000-0x0000000079b89fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079b8a000-0x0000000079bcbfff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000079bcc000-0x0000000079d3afff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079d3b000-0x0000000079ff9fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000079ffa000-0x0000000079ffffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed01000-0x00000000fed01fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed03000-0x00000000fed03fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed08000-0x00000000fed08fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed0c000-0x00000000fed0ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1cfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fef00000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ffb00000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] e820: last_pfn = 0x180000 max_arch_pfn = 0x400000000 [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] total RAM covered: 4008M [ 0.000000] Found optimal setting for mtrr clean up [ 0.000000] gran_size: 64K chunk_size: 128M num_reg: 5 lose cover RAM: 0G [ 0.000000] e820: last_pfn = 0x7a000 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fd700-0x000fd70f] mapped at [ffffffffff200700] [ 0.000000] RAMDISK: [mem 0x361bd000-0x370d6fff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f04a0 00024 (v02 ALASKA) [ 0.000000] ACPI: XSDT 00000000798a8078 00074 (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 00000000798b3708 0010C (v05 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 00000000798a8180 0B586 (v02 ALASKA A M I 01072009 INTL 20120913) [ 0.000000] ACPI: FACS 0000000079a29f80 00040 [ 0.000000] ACPI: APIC 00000000798b3818 00084 (v03 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 00000000798b38a0 00044 (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: LPIT 00000000798b38e8 00104 (v01 ALASKA A M I 00000003 VLV2 0100000D) [ 0.000000] ACPI: MCFG 00000000798b39f0 0003C (v01 ALASKA A M I 01072009 MSFT 00000097) [ 0.000000] ACPI: HPET 00000000798b3a30 00038 (v01 ALASKA A M I 01072009 AMI. 00000005) [ 0.000000] ACPI: SSDT 00000000798b3a68 00763 (v01 PmRef CpuPm 00003000 INTL 20061109) [ 0.000000] ACPI: SSDT 00000000798b41d0 00290 (v01 PmRef Cpu0Tst 00003000 INTL 20061109) [ 0.000000] ACPI: SSDT 00000000798b4460 0017A (v01 PmRef ApTst 00003000 INTL 20061109) [ 0.000000] ACPI: UEFI 00000000798b45e0 00042 (v01 ALASKA A M I 00000000 00000000) [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x17ffd8000-0x17fffefff] [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x17fffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x00088fff] [ 0.000000] node 0: [mem 0x00100000-0x1effffff] [ 0.000000] node 0: [mem 0x1f100000-0x1fffffff] [ 0.000000] node 0: [mem 0x20100000-0x79874fff] [ 0.000000] node 0: [mem 0x79b89000-0x79b89fff] [ 0.000000] node 0: [mem 0x79bcc000-0x79d3afff] [ 0.000000] node 0: [mem 0x79ffa000-0x79ffffff] [ 0.000000] node 0: [mem 0x100000000-0x17fffffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x17fffffff] [ 0.000000] x86/hpet: Will disable the HPET for this platform because it's not reliable [ 0.000000] Reserving Intel graphics memory at 0x000000007b000000-0x000000007effffff [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-86 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00089000-0x00089fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008a000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x1f000000-0x1f0fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x20000000-0x200fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x79875000-0x798a4fff] [ 0.000000] PM: Registered nosave memory: [mem 0x798a5000-0x798b4fff] [ 0.000000] PM: Registered nosave memory: [mem 0x798b5000-0x79a29fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79a2a000-0x79b88fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79b8a000-0x79bcbfff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d3b000-0x79ff9fff] [ 0.000000] PM: Registered nosave memory: [mem 0x7a000000-0x7affffff] [ 0.000000] PM: Registered nosave memory: [mem 0x7b000000-0x7effffff] [ 0.000000] PM: Registered nosave memory: [mem 0x7f000000-0xdfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfebfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed01000-0xfed01fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed02000-0xfed02fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed03000-0xfed03fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed04000-0xfed07fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed08000-0xfed08fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed09000-0xfed0bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed0c000-0xfed0ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed10000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1cfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1d000-0xfedfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xfeefffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfef00000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffafffff] [ 0.000000] PM: Registered nosave memory: [mem 0xffb00000-0xffffffff] [ 0.000000] e820: [mem 0x7f000000-0xdfffffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 35 pages/cpu @ffff8912ffc00000 s104856 r8192 d30312 u524288 [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 1005822 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.10.0-862.el7.x86_64 root=/dev/mapper/rootvg-root ro rd.lvm.lv=rootvg/swap video=1024x768@60 rd.lvm.lv=rootvg/root selinux=0 nod8 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] Memory: 3920468k/6291456k available (7324k kernel code, 2204212k absent, 166776k reserved, 6305k data, 1832k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] NR_IRQS:327936 nr_irqs:1024 0 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 16777216 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Maximum core-clock to bus-clock ratio: 0x18 [ 0.000000] Resolved frequency ID: 0, frequency: 83200 KHz [ 0.000000] TSC runs at 1996800 KHz [ 0.000000] lapic_timer_frequency = 83200 [ 0.000000] tsc: Detected 1996.800 MHz processor [ 0.000046] Calibrating delay loop (skipped), value calculated using timer frequency.. 3993.60 BogoMIPS (lpj=1996800) [ 0.010710] pid_max: default: 32768 minimum: 301 [ 0.015388] Security Framework initialized [ 0.019514] SELinux: Disabled at boot. [ 0.023376] Yama: becoming mindful. [ 0.027586] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.036820] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.044787] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.051538] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.059040] Initializing cgroup subsys memory [ 0.063441] Initializing cgroup subsys devices [ 0.067909] Initializing cgroup subsys freezer [ 0.072378] Initializing cgroup subsys net_cls [ 0.076841] Initializing cgroup subsys blkio [ 0.081128] Initializing cgroup subsys perf_event [ 0.085852] Initializing cgroup subsys hugetlb [ 0.090322] Initializing cgroup subsys pids [ 0.094531] Initializing cgroup subsys net_prio [ 0.099130] CPU: Physical Processor ID: 0 [ 0.103161] CPU: Processor Core ID: 0 [ 0.106854] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' [ 0.112882] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) [ 0.124746] mce: CPU supports 6 MCE banks [ 0.128782] CPU0: Thermal monitoring enabled (TM1) [ 0.133601] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.138933] Last level dTLB entries: 4KB 128, 2MB 0, 4MB 0 [ 0.144435] tlb_flushall_shift: 6 [ 0.147768] FEATURE SPEC_CTRL Not Present [ 0.151796] FEATURE IBPB_SUPPORT Not Present [ 0.156238] Spectre V2 : Vulnerable: Retpoline without IBPB [ 0.161964] Freeing SMP alternatives: 24k freed [ 0.169014] ACPI: Core revision 20130517 [ 0.187686] ACPI: All ACPI Tables successfully acquired [ 0.193508] ftrace: allocating 28047 entries in 110 pages [ 0.227017] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0 [ 0.242875] smpboot: CPU0: Intel(R) Celeron(R) CPU J1900 @ 1.99GHz (fam: 06, model: 37, stepping: 08) [ 0.252406] Performance Events: PEBS fmt2+, 8-deep LBR, Silvermont events, full-width counters, Intel PMU driver. [ 0.262828] ... version: 3 [ 0.266853] ... bit width: 40 [ 0.270966] ... generic registers: 2 [ 0.274987] ... value mask: 000000ffffffffff [ 0.280315] ... max period: 0000007fffffffff [ 0.285646] ... fixed-purpose events: 3 [ 0.289673] ... event mask: 0000000700000003 [ 0.297833] smpboot: Booting Node 0, Processors #1[ 0.307896] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. #2 #3 OK [ 0.327115] Brought up 4 CPUs [ 0.330102] smpboot: Max logical packages: 1 [ 0.334391] smpboot: Total of 4 processors activated (15974.40 BogoMIPS) [ 0.342216] devtmpfs: initialized [ 0.353215] EVM: security.selinux [ 0.356553] EVM: security.ima [ 0.359536] EVM: security.capability [ 0.363296] PM: Registering ACPI NVS region [mem 0x798b5000-0x79a29fff] (1527808 bytes) [ 0.373612] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.380513] pinctrl core: initialized pinctrl subsystem [ 0.385811] RTC time: 1:02:03, date: 05/14/18 [ 0.390450] NET: Registered protocol family 16 [ 0.395365] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.402949] ACPI: bus type PCI registered [ 0.406976] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.413560] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) [ 0.422884] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820 [ 0.429713] PCI: Using configuration type 1 for base access [ 0.442950] ACPI: Added _OSI(Module Device) [ 0.447154] ACPI: Added _OSI(Processor Device) [ 0.451613] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.456335] ACPI: Added _OSI(Processor Aggregator Device) [ 28.455616] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [swapper/0:1] [ 28.462935] Modules linked in: [ 28.466026] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 3.10.0-862.el7.x86_64 #1 [ 28.473254] Hardware name: To be filled by O.E.M. To be filled by O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015 [ 28.482832] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti: ffff8912f946c000 [ 28.490323] RIP: 0010:[<ffffffff86d0779a>] [<ffffffff86d0779a>] generic_exec_single+0xfa/0x1b0 [ 28.499063] RSP: 0000:ffff8912f946fc00 EFLAGS: 00000202 [ 28.504386] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000 [ 28.511528] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286 [ 28.518674] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00 [ 28.525816] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067 [ 28.532962] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14 [ 28.540108] FS: 0000000000000000(0000) GS:ffff8912ffc00000(0000) knlGS:0000000000000000 [ 28.548203] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 28.553959] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0 [ 28.561105] Call Trace: [ 28.563567] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 28.570020] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 28.576471] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 28.582919] [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0 [ 28.589286] [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50 [ 28.595132] [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270 [ 28.601498] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 28.607945] [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70 [ 28.613615] [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20 [ 28.619718] [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190 [ 28.625472] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 28.631924] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 28.638121] [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250 [ 28.643961] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 28.650154] [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12 [ 28.656004] [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d [ 28.662461] [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a [ 28.668738] [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd [ 28.673885] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 28.680074] [<ffffffff86c0210a>] do_one_initcall+0xba/0x240 [ 28.685744] [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f [ 28.691940] [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0 [ 28.697956] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 28.703190] [<ffffffff872fc6be>] kernel_init+0xe/0xf0 [ 28.708338] [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21 [ 28.714874] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 28.720108] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c [ 56.782218] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [swapper/0:1] [ 56.789540] Modules linked in: [ 56.792635] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1 [ 56.802301] Hardware name: To be filled by O.E.M. To be filled by O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015 [ 56.811878] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti: ffff8912f946c000 [ 56.819368] RIP: 0010:[<ffffffff86d0779a>] [<ffffffff86d0779a>] generic_exec_single+0xfa/0x1b0 [ 56.828100] RSP: 0000:ffff8912f946fc00 EFLAGS: 00000202 [ 56.833422] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000 [ 56.840567] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286 [ 56.847709] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00 [ 56.854855] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067 [ 56.862000] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14 [ 56.869144] FS: 0000000000000000(0000) GS:ffff8912ffc00000(0000) knlGS:0000000000000000 [ 56.877242] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 56.882998] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0 [ 56.890140] Call Trace: [ 56.892601] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 56.899058] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 56.905508] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 56.911959] [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0 [ 56.918322] [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50 [ 56.924162] [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270 [ 56.930524] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 56.936975] [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70 [ 56.942644] [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20 [ 56.948746] [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190 [ 56.954501] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 56.960952] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 56.967140] [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250 [ 56.972983] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 56.979172] [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12 [ 56.985015] [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d [ 56.991472] [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a [ 56.997749] [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd [ 57.002896] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 57.009084] [<ffffffff86c0210a>] do_one_initcall+0xba/0x240 [ 57.014753] [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f [ 57.020944] [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0 [ 57.026958] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 57.032192] [<ffffffff872fc6be>] kernel_init+0xe/0xf0 [ 57.037342] [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21 [ 57.043884] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 57.049117] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c [ 85.111036] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [swapper/0:1] [ 85.118352] Modules linked in: [ 85.121444] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1 [ 85.131106] Hardware name: To be filled by O.E.M. To be filled by O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015 [ 85.140680] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti: ffff8912f946c000 [ 85.148171] RIP: 0010:[<ffffffff86d0779a>] [<ffffffff86d0779a>] generic_exec_single+0xfa/0x1b0 [ 85.156905] RSP: 0000:ffff8912f946fc00 EFLAGS: 00000202 [ 85.162224] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000 [ 85.169369] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286 [ 85.176515] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00 [ 85.183657] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067 [ 85.190803] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14 [ 85.197946] FS: 0000000000000000(0000) GS:ffff8912ffc00000(0000) knlGS:0000000000000000 [ 85.206045] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 85.211800] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0 [ 85.218945] Call Trace: [ 85.221404] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 85.227860] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 85.234311] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 85.240761] [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0 [ 85.247124] [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50 [ 85.252964] [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270 [ 85.259329] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 85.265777] [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70 [ 85.271446] [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20 [ 85.277549] [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190 [ 85.283303] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 85.289754] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 85.295942] [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250 [ 85.301786] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 85.307974] [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12 [ 85.313818] [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d [ 85.320266] [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a [ 85.326543] [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd [ 85.331690] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 85.337881] [<ffffffff86c0210a>] do_one_initcall+0xba/0x240 [ 85.343547] [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f [ 85.349737] [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0 [ 85.355751] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 85.360986] [<ffffffff872fc6be>] kernel_init+0xe/0xf0 [ 85.366136] [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21 [ 85.372681] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 85.377920] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c [ 113.440071] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [swapper/0:1] [ 113.447391] Modules linked in: [ 113.450482] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1 [ 113.460141] Hardware name: To be filled by O.E.M. To be filled by O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015 [ 113.469716] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti: ffff8912f946c000 [ 113.477209] RIP: 0010:[<ffffffff86d0779a>] [<ffffffff86d0779a>] generic_exec_single+0xfa/0x1b0 [ 113.485941] RSP: 0000:ffff8912f946fc00 EFLAGS: 00000202 [ 113.491262] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000 [ 113.498407] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286 [ 113.505550] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00 [ 113.512695] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067 [ 113.519838] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14 [ 113.526983] FS: 0000000000000000(0000) GS:ffff8912ffc00000(0000) knlGS:0000000000000000 [ 113.535082] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 113.540838] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0 [ 113.547980] Call Trace: [ 113.550441] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 113.556898] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 113.563348] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 113.569798] [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0 [ 113.576161] [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50 [ 113.582001] [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270 [ 113.588364] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 113.594814] [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70 [ 113.600484] [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20 [ 113.606586] [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190 [ 113.612340] [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140 [ 113.618792] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 113.624979] [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250 [ 113.630823] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 113.637011] [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12 [ 113.642855] [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d [ 113.649311] [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a [ 113.655588] [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd [ 113.660735] [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a [ 113.666924] [<ffffffff86c0210a>] do_one_initcall+0xba/0x240 [ 113.672592] [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f [ 113.678783] [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0 [ 113.684797] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 113.690032] [<ffffffff872fc6be>] kernel_init+0xe/0xf0 [ 113.695181] [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21 [ 113.701717] [<ffffffff872fc6b0>] ? rest_init+0x80/0x80 [ 113.706950] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c