Hi. We're having some trouble making the native rdma driver work in vpp 21.06 on centos 7.9 installed inside an azure VM with accelerated NICs. We followed the instructions explained in the vpp wiki but when trying to create an interface it returns the error: "Cannot allocate memory".
Has anyone managed to make vpp+rdma (no-dpdk) work in centos 7.9 inside a VM on azure? Below is some platform info attached and some of the steps we followed. --- We upgraded the kernel (just in case), thou it fails with the same error in the original kernel 3.X that's included by default with centos 7.9 *[root@testvm ~]# uname -r* *5.13.2-1.el7.elrepo.x86_64* --- We made sure ulimits memlock is set to unlimited *[root@testvm ~]# ulimit -a* *core file size (blocks, -c) 0* *data seg size (kbytes, -d) unlimited* *scheduling priority (-e) 0* *file size (blocks, -f) unlimited* *pending signals (-i) 63951* *max locked memory (kbytes, -l) unlimited* *max memory size (kbytes, -m) unlimited* *open files (-n) 1024* *pipe size (512 bytes, -p) 8* *POSIX message queues (bytes, -q) 819200* *real-time priority (-r) 0* *stack size (kbytes, -s) 8192* *cpu time (seconds, -t) unlimited* *max user processes (-u) 63951* *virtual memory (kbytes, -v) unlimited* *file locks (-x) unlimited* --- We disabled selinux (we want to make it work first) *[root@testvm ~]# getenforce* *Disabled* --- We loaded ib_uverbs *[root@testvm ~]# modprobe ib_uverbs* *[root@testvm ~]# lsmod | grep ib_uverbs* *ib_uverbs 147456 1 mlx5_ib* *ib_core 356352 2 ib_uverbs,mlx5_ib* --- We checked the accelerated network cards were actually there and had a compatible mellanox driver (network 0 is the management interface and it's not accelerated) *[root@testvm ~]# lshw -c network* * *-network:0* * description: Ethernet interface* * product: MT27710 Family [ConnectX-4 Lx Virtual Function]* * vendor: Mellanox Technologies* * physical id: 1* * bus info: pci@731a:00:02.0* * logical name: eth4* * version: 80* * serial: 00:0d:3a:be:ab:34* * width: 64 bits* * clock: 33MHz* * capabilities: pciexpress msix bus_master cap_list ethernet physical autonegotiation* * configuration: autonegotiation=off broadcast=yes driver=mlx5_core driverversion=5.13.2-1.el7.elrepo.x86_64 firmware=14.25.8368 (MSF0010110035) latency=0 link=yes multicast=yes slave=yes* * resources: iomemory:f0-ef irq:0 memory:fe0100000-fe01fffff* * *-network:1* * description: Ethernet interface* * product: MT27710 Family [ConnectX-4 Lx Virtual Function]* * vendor: Mellanox Technologies* * physical id: 2* * bus info: pci@ebc3:00:02.0* * logical name: eth3* * version: 80* * serial: 00:0d:3a:be:aa:e5* * width: 64 bits* * clock: 33MHz* * capabilities: pciexpress msix bus_master cap_list ethernet physical autonegotiation* * configuration: autonegotiation=off broadcast=yes driver=mlx5_core driverversion=5.13.2-1.el7.elrepo.x86_64 firmware=14.25.8368 (MSF0010110035) latency=0 link=yes multicast=yes slave=yes* * resources: iomemory:f0-ef irq:0 memory:fe0000000-fe00fffff* * *-network:0* * description: Ethernet interface* * physical id: 1* * logical name: eth0* * serial: 00:0d:3a:29:31:01* * capabilities: ethernet physical* * configuration: autonegotiation=off broadcast=yes driver=hv_netvsc driverversion=5.13.2-1.el7.elrepo.x86_64 duplex=full firmware=N/A ip=10.99.4.4 link=yes multicast=yes* * *-network:1* * description: Ethernet interface* * physical id: 2* * logical name: eth1* * serial: 00:0d:3a:be:aa:e5* * capabilities: ethernet physical autonegotiation* * configuration: autonegotiation=off broadcast=yes driver=hv_netvsc driverversion=5.13.2-1.el7.elrepo.x86_64 firmware=N/A ip=10.99.6.4 link=yes multicast=yes* * *-network:2* * description: Ethernet interface* * physical id: 3* * logical name: eth2* * serial: 00:0d:3a:be:ab:34* * capabilities: ethernet physical autonegotiation* * configuration: autonegotiation=off broadcast=yes driver=hv_netvsc driverversion=5.13.2-1.el7.elrepo.x86_64 firmware=N/A ip=10.99.9.4 link=yes multicast=yes* --- We checked there's plenty of free memory *[root@testvm ~]# cat /proc/meminfo | grep MemTotal* *MemTotal: 16396568 kB* --- This is our very simple vpp test configuration *[root@testvm ~]# nano /etc/vpp/startup.conf* *unix {* * interactive* * log /var/log/vpp/vpp.log* * full-coredump* * cli-listen /run/vpp/cli.sock* * gid vpp* *}* *api-trace {* * on* *}* *api-segment {* * gid vpp* *}* *socksvr {* * default* *}* *cpu {* * workers 2* *}* *ethernet {* * default-mtu 1500* *}* *plugins {* * plugin default { disable }* * plugin ping_plugin.so { enable }* * plugin rdma_plugin.so { enable }* *}* --- This is our vpp debug execution (i've highlighted what i believe is the most relevant information) *[root@testvm ~]# /usr/bin/vpp -c /etc/vpp/startup.conf* *0: vlib_sort_init_exit_functions:160: order constraint fcn 'dns_init' not found* *0: vnet_feature_arc_init:271: feature node 'acl-plugin-out-ip6-fa' not found (before 'ip6-dvr-reinject', arc 'ip6-output')* *0: vnet_feature_arc_init:271: feature node 'nat44-in2out-output' not found (before 'ip4-dvr-reinject', arc 'ip4-output')* *0: vnet_feature_arc_init:271: feature node 'acl-plugin-out-ip4-fa' not found (before 'ip4-dvr-reinject', arc 'ip4-output')* *vat-plug/load [error ]: vat_plugin_register: acl plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: adl plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: arping plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: avf plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: builtinurl plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: cdp plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: ct6 plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: dhcp plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: dns plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: flowprobe plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: geneve plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: gtpu plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: http_static plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: ikev2 plugin not loaded...* *vat-plug/load [error ]: pot_vat_plugin_register: pot plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: l2tp plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: lacp plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: lb plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register_gpe: lisp_gpe plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: lldp plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: mactime plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: mdata plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: memif plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: nsh plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: nsim plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: oddbuf plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: pppoe plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: stn plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: tracedump plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: vmxnet3 plugin not loaded...* *vat-plug/load [error ]: vat_plugin_register: vrrp plugin not loaded...* * _______ _ _ _____ ___* * __/ __/ _ \ (_)__ | | / / _ \/ _ \* * _/ _// // / / / _ \ | |/ / ___/ ___/* * /_/ /____(_)_/\___/ |___/_/ /_/* *vpp# show version* *vpp v21.06-release built by root on 02f49c7c33ac at 2021-07-19T09:21:28* *vpp# show pci* *Address Sock VID:PID Link Speed Driver Product Name Vital Product Data* *731a:00:02.0 0 15b3:1016 unknown mlx5_core* *ebc3:00:02.0 0 15b3:1016 unknown mlx5_core* *vpp# create int rdma host-if eth3 name N3* *rdma [error ]: N3: Cannot allocate memory (12): ibv_create_flow() failed* *rdma [error ]: N3: Cannot allocate memory (12): ibv_create_flow() failed* *rdma [error ]: rdma_rxq_finalize: Set unicast mode failed: Cannot allocate memory* *create interface rdma: Set unicast mode failed: Cannot allocate memory* *vpp# show log* *2021/07/19 12:46:42:705 notice plugin/load Plugin disabled (default): abf_plugin.so* *2021/07/19 12:46:42:707 notice plugin/load Plugin disabled (default): acl_plugin.so* *2021/07/19 12:46:42:707 notice plugin/load Plugin disabled (default): adl_plugin.so* *2021/07/19 12:46:42:707 notice plugin/load Plugin disabled (default): arping_plugin.so* *2021/07/19 12:46:42:708 notice plugin/load Plugin disabled (default): avf_plugin.so* *2021/07/19 12:46:42:708 notice plugin/load Plugin disabled (default): builtinurl_plugin.so* *2021/07/19 12:46:42:708 notice plugin/load Plugin disabled (default): cdp_plugin.so* *2021/07/19 12:46:42:709 notice plugin/load Plugin disabled (default): cnat_plugin.so* *2021/07/19 12:46:42:765 notice plugin/load Plugin disabled (default): crypto_ipsecmb_plugin.so* *2021/07/19 12:46:42:768 notice plugin/load Plugin disabled (default): crypto_native_plugin.so* *2021/07/19 12:46:42:769 notice plugin/load Plugin disabled (default): crypto_openssl_plugin.so* *2021/07/19 12:46:42:769 notice plugin/load Plugin disabled (default): crypto_sw_scheduler_plugin.so* *2021/07/19 12:46:42:769 notice plugin/load Plugin disabled (default): ct6_plugin.so* *2021/07/19 12:46:42:769 notice plugin/load Plugin disabled (default): det44_plugin.so* *2021/07/19 12:46:42:769 notice plugin/load Plugin disabled (default): dhcp_plugin.so* *2021/07/19 12:46:42:770 notice plugin/load Plugin disabled (default): dispatch_trace_plugin.so* *2021/07/19 12:46:42:770 notice plugin/load Plugin disabled (default): dns_plugin.so* *2021/07/19 12:46:42:781 notice plugin/load Plugin disabled (default): dpdk_plugin.so* *2021/07/19 12:46:42:781 notice plugin/load Plugin disabled (default): dslite_plugin.so* *2021/07/19 12:46:42:781 notice plugin/load Plugin disabled (default): flowprobe_plugin.so* *2021/07/19 12:46:42:782 notice plugin/load Plugin disabled (default): gbp_plugin.so* *2021/07/19 12:46:42:782 notice plugin/load Plugin disabled (default): geneve_plugin.so* *2021/07/19 12:46:42:782 notice plugin/load Plugin disabled (default): gtpu_plugin.so* *2021/07/19 12:46:42:783 notice plugin/load Plugin disabled (default): hs_apps_plugin.so* *2021/07/19 12:46:42:783 notice plugin/load Plugin disabled (default): http_static_plugin.so* *2021/07/19 12:46:42:783 notice plugin/load Plugin disabled (default): igmp_plugin.so* *2021/07/19 12:46:42:783 notice plugin/load Plugin disabled (default): ikev2_plugin.so* *2021/07/19 12:46:42:783 notice plugin/load Plugin disabled (default): ila_plugin.so* *2021/07/19 12:46:42:784 notice plugin/load Plugin disabled (default): ioam_plugin.so* *2021/07/19 12:46:42:823 notice plugin/load Plugin disabled (default): l2e_plugin.so* *2021/07/19 12:46:42:825 notice plugin/load Plugin disabled (default): l2tp_plugin.so* *2021/07/19 12:46:42:825 notice plugin/load Plugin disabled (default): l3xc_plugin.so* *2021/07/19 12:46:42:826 notice plugin/load Plugin disabled (default): lacp_plugin.so* *2021/07/19 12:46:42:826 notice plugin/load Plugin disabled (default): lb_plugin.so* *2021/07/19 12:46:42:826 notice plugin/load Plugin disabled (default): linux_cp_plugin.so* *2021/07/19 12:46:42:826 notice plugin/load Plugin disabled (default): linux_cp_unittest_plugin.so* *2021/07/19 12:46:42:827 notice plugin/load Plugin disabled (default): lisp_plugin.so* *2021/07/19 12:46:42:827 notice plugin/load Plugin disabled (default): lisp_unittest_plugin.so* *2021/07/19 12:46:42:827 notice plugin/load Plugin disabled (default): lldp_plugin.so* *2021/07/19 12:46:42:827 notice plugin/load Plugin disabled (default): mactime_plugin.so* *2021/07/19 12:46:42:827 notice plugin/load Plugin disabled (default): map_plugin.so* *2021/07/19 12:46:42:827 notice plugin/load Plugin disabled (default): mdata_plugin.so* *2021/07/19 12:46:42:828 notice plugin/load Plugin disabled (default): memif_plugin.so* *2021/07/19 12:46:42:828 notice plugin/load Plugin disabled (default): mss_clamp_plugin.so* *2021/07/19 12:46:42:829 notice plugin/load Plugin disabled (default): nat44_ei_plugin.so* *2021/07/19 12:46:42:829 notice plugin/load Plugin disabled (default): nat64_plugin.so* *2021/07/19 12:46:42:829 notice plugin/load Plugin disabled (default): nat66_plugin.so* *2021/07/19 12:46:42:830 notice plugin/load Plugin disabled (default): nat_plugin.so* *2021/07/19 12:46:42:831 notice plugin/load Plugin disabled (default): nsh_plugin.so* *2021/07/19 12:46:42:831 notice plugin/load Plugin disabled (default): nsim_plugin.so* *2021/07/19 12:46:42:831 notice plugin/load Plugin disabled (default): oddbuf_plugin.so* *2021/07/19 12:46:42:831 notice plugin/load Plugin disabled (default): perfmon_plugin.so* *2021/07/19 12:46:42:831 notice plugin/load Loaded plugin: ping_plugin.so (Ping (ping))* *2021/07/19 12:46:42:831 notice plugin/load Plugin disabled (default): pnat_plugin.so* *2021/07/19 12:46:42:832 notice plugin/load Plugin disabled (default): pppoe_plugin.so* *2021/07/19 12:46:42:832 notice plugin/load Plugin disabled (default): quic_plugin.so* *2021/07/19 12:46:42:833 notice plugin/load Loaded plugin: rdma_plugin.so (RDMA IBverbs Device Driver)* *2021/07/19 12:46:42:833 notice plugin/load Plugin disabled (default): srv6ad_plugin.so* *2021/07/19 12:46:42:833 notice plugin/load Plugin disabled (default): srv6adflow_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): srv6am_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): srv6as_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): srv6mobile_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): stn_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): svs_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): tlsmbedtls_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): tlspicotls_plugin.so* *2021/07/19 12:46:42:834 notice plugin/load Plugin disabled (default): tracedump_plugin.so* *2021/07/19 12:46:42:835 notice plugin/load Plugin disabled (default): unittest_plugin.so* *2021/07/19 12:46:42:835 notice plugin/load Plugin disabled (default): urpf_plugin.so* *2021/07/19 12:46:42:836 notice plugin/load Plugin disabled (default): vmxnet3_plugin.so* *2021/07/19 12:46:42:836 notice plugin/load Plugin disabled (default): vrrp_plugin.so* *2021/07/19 12:46:42:910 error vat-plug/load vat_plugin_register: acl plugin not loaded...* *2021/07/19 12:46:42:910 error vat-plug/load vat_plugin_register: adl plugin not loaded...* *2021/07/19 12:46:42:910 error vat-plug/load vat_plugin_register: arping plugin not loaded...* *2021/07/19 12:46:42:910 error vat-plug/load vat_plugin_register: avf plugin not loaded...* *2021/07/19 12:46:42:910 error vat-plug/load vat_plugin_register: builtinurl plugin not loaded...* *2021/07/19 12:46:42:910 error vat-plug/load vat_plugin_register: cdp plugin not loaded...* *2021/07/19 12:46:42:911 error vat-plug/load vat_plugin_register: ct6 plugin not loaded...* *2021/07/19 12:46:42:911 error vat-plug/load vat_plugin_register: dhcp plugin not loaded...* *2021/07/19 12:46:42:911 error vat-plug/load vat_plugin_register: dns plugin not loaded...* *2021/07/19 12:46:42:911 error vat-plug/load vat_plugin_register: flowprobe plugin not loaded...* *2021/07/19 12:46:42:911 error vat-plug/load vat_plugin_register: geneve plugin not loaded...* *2021/07/19 12:46:42:912 error vat-plug/load vat_plugin_register: gtpu plugin not loaded...* *2021/07/19 12:46:42:912 error vat-plug/load vat_plugin_register: http_static plugin not loaded...* *2021/07/19 12:46:42:913 error vat-plug/load vat_plugin_register: ikev2 plugin not loaded...* *2021/07/19 12:46:42:913 error vat-plug/load pot_vat_plugin_register: pot plugin not loaded...* *2021/07/19 12:46:42:913 error vat-plug/load vat_plugin_register: l2tp plugin not loaded...* *2021/07/19 12:46:42:914 error vat-plug/load vat_plugin_register: lacp plugin not loaded...* *2021/07/19 12:46:42:914 error vat-plug/load vat_plugin_register: lb plugin not loaded...* *2021/07/19 12:46:42:914 error vat-plug/load vat_plugin_register_gpe: lisp_gpe plugin not loaded...* *2021/07/19 12:46:42:915 error vat-plug/load vat_plugin_register: lldp plugin not loaded...* *2021/07/19 12:46:42:915 error vat-plug/load vat_plugin_register: mactime plugin not loaded...* *2021/07/19 12:46:42:915 error vat-plug/load vat_plugin_register: mdata plugin not loaded...* *2021/07/19 12:46:42:915 error vat-plug/load vat_plugin_register: memif plugin not loaded...* *2021/07/19 12:46:42:915 error vat-plug/load vat_plugin_register: nsh plugin not loaded...* *2021/07/19 12:46:42:916 error vat-plug/load vat_plugin_register: nsim plugin not loaded...* *2021/07/19 12:46:42:916 error vat-plug/load vat_plugin_register: oddbuf plugin not loaded...* *2021/07/19 12:46:42:916 error vat-plug/load vat_plugin_register: pppoe plugin not loaded...* *2021/07/19 12:46:42:916 notice vat-plug/load Loaded plugin: rdma_test_plugin.so* *2021/07/19 12:46:42:917 error vat-plug/load vat_plugin_register: stn plugin not loaded...* *2021/07/19 12:46:42:917 error vat-plug/load vat_plugin_register: tracedump plugin not loaded...* *2021/07/19 12:46:42:917 error vat-plug/load vat_plugin_register: vmxnet3 plugin not loaded...* *2021/07/19 12:46:42:917 error vat-plug/load vat_plugin_register: vrrp plugin not loaded...* *2021/07/19 12:47:31:535 error rdma N3: Cannot allocate memory (12): ibv_create_flow() failed* *2021/07/19 12:47:31:548 error rdma N3: Cannot allocate memory (12): ibv_create_flow() failed* *2021/07/19 12:47:31:576 error rdma rdma_rxq_finalize: Set unicast mode failed: Cannot allocate memory* --- This is the output of dmesg *[root@testvm ~]# dmesg* *[ 0.000000] Linux version 5.13.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc (GCC) 9.3.1 20200408 (Red Hat 9.3.1-2), GNU ld version 2.32-16.el7) #1 SMP Wed Jul 14 12:18:11 EDT 2021* *[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-5.13.2-1.el7.elrepo.x86_64 root=UUID=40a878b6-3fe8-4336-820a-951a19f79a76 ro console=tty1 console=ttyS0,115200n8 earlyprintk=ttyS0,115200 rootdelay=300 net.ifnames=0 scsi_mod.use_blk_mq=y crashkernel=auto* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'* *[ 0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'* *[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256* *[ 0.000000] x86/fpu: xstate_offset[3]: 832, xstate_sizes[3]: 64* *[ 0.000000] x86/fpu: xstate_offset[4]: 896, xstate_sizes[4]: 64* *[ 0.000000] x86/fpu: xstate_offset[5]: 960, xstate_sizes[5]: 64* *[ 0.000000] x86/fpu: xstate_offset[6]: 1024, xstate_sizes[6]: 512* *[ 0.000000] x86/fpu: xstate_offset[7]: 1536, xstate_sizes[7]: 1024* *[ 0.000000] x86/fpu: Enabled xstate features 0xff, context size is 2560 bytes, using 'compacted' format.* *[ 0.000000] BIOS-provided physical RAM map:* *[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable* *[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved* *[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved* *[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ffeffff] usable* *[ 0.000000] BIOS-e820: [mem 0x000000003fff0000-0x000000003fffefff] ACPI data* *[ 0.000000] BIOS-e820: [mem 0x000000003ffff000-0x000000003fffffff] ACPI NVS* *[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000004bfffffff] usable* *[ 0.000000] printk: bootconsole [earlyser0] enabled* *[ 0.000000] NX (Execute Disable) protection: active* *[ 0.000000] SMBIOS 2.3 present.* *[ 0.000000] DMI: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090008 12/07/2018* *[ 0.000000] Hypervisor detected: Microsoft Hyper-V* *[ 0.000000] Hyper-V: privilege flags low 0x2e7f, high 0x3880b0, hints 0x64c2c, misc 0xed7b2* *[ 0.000000] Hyper-V Host Build:18362-10.0-3-0.3294* *[ 0.000000] Hyper-V: LAPIC Timer Frequency: 0x30d40* *[ 0.000000] tsc: Marking TSC unstable due to running on Hyper-V* *[ 0.000000] Hyper-V: Using hypercall for remote TLB flush* *[ 0.000000] clocksource: hyperv_clocksource_tsc_page: mask: 0xffffffffffffffff max_cycles: 0x24e6a1710, max_idle_ns: 440795202120 ns* *[ 0.000004] tsc: Detected 2593.907 MHz processor* *[ 0.008831] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved* *[ 0.008837] e820: remove [mem 0x000a0000-0x000fffff] usable* *[ 0.008841] last_pfn = 0x4c0000 max_arch_pfn = 0x400000000* *[ 0.011505] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT* *[ 0.015027] e820: update [mem 0x40000000-0xffffffff] usable ==> reserved* *[ 0.016661] last_pfn = 0x3fff0 max_arch_pfn = 0x400000000* *[ 0.025568] found SMP MP-table at [mem 0x000ff780-0x000ff78f]* *[ 0.028525] Using GB pages for direct mapping* *[ 0.030846] RAMDISK: [mem 0x35b1d000-0x36d86fff]* *[ 0.033172] ACPI: Early table checksum verification disabled* *[ 0.035882] ACPI: RSDP 0x00000000000F5C00 000014 (v00 ACPIAM)* *[ 0.038947] ACPI: RSDT 0x000000003FFF0000 000040 (v01 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.043328] ACPI: FACP 0x000000003FFF0200 000081 (v02 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.047104] ACPI: DSDT 0x000000003FFF1D24 003CD5 (v01 MSFTVM MSFTVM02 00000002 INTL 02002026)* *[ 0.051291] ACPI: FACS 0x000000003FFFF000 000040* *[ 0.053615] ACPI: WAET 0x000000003FFF1A80 000028 (v01 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.057925] ACPI: SLIC 0x000000003FFF1AC0 000176 (v01 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.062052] ACPI: OEM0 0x000000003FFF1CC0 000064 (v01 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.066340] ACPI: SRAT 0x000000003FFF0800 0001A0 (v02 VRTUAL MICROSFT 00000001 MSFT 00000001)* *[ 0.070618] ACPI: APIC 0x000000003FFF0300 000092 (v01 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.075052] ACPI: OEMB 0x000000003FFFF040 000064 (v01 VRTUAL MICROSFT 12001807 MSFT 00000097)* *[ 0.079399] ACPI: Reserving FACP table memory at [mem 0x3fff0200-0x3fff0280]* *[ 0.084863] ACPI: Reserving DSDT table memory at [mem 0x3fff1d24-0x3fff59f8]* *[ 0.088992] ACPI: Reserving FACS table memory at [mem 0x3ffff000-0x3ffff03f]* *[ 0.093221] ACPI: Reserving WAET table memory at [mem 0x3fff1a80-0x3fff1aa7]* *[ 0.099415] ACPI: Reserving SLIC table memory at [mem 0x3fff1ac0-0x3fff1c35]* *[ 0.109733] ACPI: Reserving OEM0 table memory at [mem 0x3fff1cc0-0x3fff1d23]* *[ 0.113888] ACPI: Reserving SRAT table memory at [mem 0x3fff0800-0x3fff099f]* *[ 0.117525] ACPI: Reserving APIC table memory at [mem 0x3fff0300-0x3fff0391]* *[ 0.121478] ACPI: Reserving OEMB table memory at [mem 0x3ffff040-0x3ffff0a3]* *[ 0.125254] ACPI: Local APIC address 0xfee00000* *[ 0.125319] SRAT: PXM 0 -> APIC 0x00 -> Node 0* *[ 0.127574] SRAT: PXM 0 -> APIC 0x01 -> Node 0* *[ 0.129739] SRAT: PXM 0 -> APIC 0x02 -> Node 0* *[ 0.132007] SRAT: PXM 0 -> APIC 0x03 -> Node 0* *[ 0.134239] SRAT: PXM 0 -> APIC 0x04 -> Node 0* *[ 0.136632] SRAT: PXM 0 -> APIC 0x05 -> Node 0* *[ 0.138787] SRAT: PXM 0 -> APIC 0x06 -> Node 0* *[ 0.140948] SRAT: PXM 0 -> APIC 0x07 -> Node 0* *[ 0.149032] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x3fffffff] hotplug* *[ 0.152583] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x4bfffffff] hotplug* *[ 0.155859] ACPI: SRAT: Node 0 PXM 0 [mem 0x4c0200000-0xfdfffffff] hotplug* *[ 0.159569] ACPI: SRAT: Node 0 PXM 0 [mem 0x1000000000-0xffffffffff] hotplug* *[ 0.163332] ACPI: SRAT: Node 0 PXM 0 [mem 0x10000200000-0x1ffffffffff] hotplug* *[ 0.167631] ACPI: SRAT: Node 0 PXM 0 [mem 0x20000200000-0x3ffffffffff] hotplug* *[ 0.171397] NUMA: Node 0 [mem 0x00000000-0x3fffffff] + [mem 0x100000000-0x4bfffffff] -> [mem 0x00000000-0x4bfffffff]* *[ 0.176994] NODE_DATA(0) allocated [mem 0x4bffd6000-0x4bfffffff]* *[ 0.180625] crashkernel: memory value expected* *[ 0.182949] Zone ranges:* *[ 0.184426] DMA [mem 0x0000000000001000-0x0000000000ffffff]* *[ 0.187677] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]* *[ 0.190883] Normal [mem 0x0000000100000000-0x00000004bfffffff]* *[ 0.194063] Device empty* *[ 0.195477] Movable zone start for each node* *[ 0.197682] Early memory node ranges* *[ 0.199601] node 0: [mem 0x0000000000001000-0x000000000009efff]* *[ 0.203256] node 0: [mem 0x0000000000100000-0x000000003ffeffff]* *[ 0.212161] node 0: [mem 0x0000000100000000-0x00000004bfffffff]* *[ 0.215515] Initmem setup node 0 [mem 0x0000000000001000-0x00000004bfffffff]* *[ 0.219239] On node 0 totalpages: 4194190* *[ 0.219241] DMA zone: 64 pages used for memmap* *[ 0.219243] DMA zone: 158 pages reserved* *[ 0.219244] DMA zone: 3998 pages, LIFO batch:0* *[ 0.219245] DMA32 zone: 4032 pages used for memmap* *[ 0.219246] DMA32 zone: 258032 pages, LIFO batch:63* *[ 0.219247] Normal zone: 61440 pages used for memmap* *[ 0.219248] Normal zone: 3932160 pages, LIFO batch:63* *[ 0.219252] On node 0, zone DMA: 1 pages in unavailable ranges* *[ 0.219284] On node 0, zone DMA: 97 pages in unavailable ranges* *[ 0.258038] On node 0, zone Normal: 16 pages in unavailable ranges* *[ 0.263212] ACPI: PM-Timer IO Port: 0x408* *[ 0.269172] ACPI: Local APIC address 0xfee00000* *[ 0.269179] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])* *[ 0.272523] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23* *[ 0.276164] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)* *[ 0.279489] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)* *[ 0.282963] ACPI: IRQ0 used by override.* *[ 0.282964] ACPI: IRQ9 used by override.* *[ 0.282966] Using ACPI (MADT) for SMP configuration information* *[ 0.286141] smpboot: Allowing 8 CPUs, 0 hotplug CPUs* *[ 0.288783] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]* *[ 0.292604] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff]* *[ 0.295796] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000dffff]* *[ 0.299648] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff]* *[ 0.304579] PM: hibernation: Registered nosave memory: [mem 0x3fff0000-0x3fffefff]* *[ 0.315336] PM: hibernation: Registered nosave memory: [mem 0x3ffff000-0x3fffffff]* *[ 0.318688] PM: hibernation: Registered nosave memory: [mem 0x40000000-0xffffffff]* *[ 0.322352] [mem 0x40000000-0xffffffff] available for PCI devices* *[ 0.325501] Booting paravirtualized kernel on Hyper-V* *[ 0.328179] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns* *[ 0.333322] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1* *[ 0.337547] percpu: Embedded 55 pages/cpu s187288 r8192 d29800 u262144* *[ 0.340732] pcpu-alloc: s187288 r8192 d29800 u262144 alloc=1*2097152* *[ 0.340735] pcpu-alloc: [0] 0 1 2 3 4 5 6 7* *[ 0.340753] Hyper-V: PV spinlocks enabled* *[ 0.342665] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)* *[ 0.351993] Built 1 zonelists, mobility grouping on. Total pages: 4128496* *[ 0.355586] Policy zone: Normal* *[ 0.357104] Kernel command line: BOOT_IMAGE=/vmlinuz-5.13.2-1.el7.elrepo.x86_64 root=UUID=40a878b6-3fe8-4336-820a-951a19f79a76 ro console=tty1 console=ttyS0,115200n8 earlyprintk=ttyS0,115200 rootdelay=300 net.ifnames=0 scsi_mod.use_blk_mq=y crashkernel=auto* *[ 0.370981] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)* *[ 0.376155] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)* *[ 0.380545] mem auto-init: stack:off, heap alloc:off, heap free:off* *[ 0.428866] Memory: 16371220K/16776760K available (12296K kernel code, 4102K rwdata, 4564K rodata, 2584K init, 3432K bss, 405280K reserved, 0K cma-reserved)* *[ 0.436195] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1* *[ 0.439417] Kernel/User page tables isolation: enabled* *[ 0.441917] ftrace: allocating 41956 entries in 164 pages* *[ 0.458348] ftrace: allocated 164 pages with 3 groups* *[ 0.461082] rcu: Hierarchical RCU implementation.* *[ 0.463405] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8.* *[ 0.466683] Rude variant of Tasks RCU enabled.* *[ 0.468670] Tracing variant of Tasks RCU enabled.* *[ 0.470666] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.* *[ 0.473939] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8* *[ 0.480331] NR_IRQS: 524544, nr_irqs: 488, preallocated irqs: 16* *[ 0.483967] random: get_random_bytes called from start_kernel+0x3a5/0x577 with crng_init=0* *[ 0.491814] Console: colour VGA+ 80x25* *[ 0.618053] printk: console [tty1] enabled* *[ 0.621119] printk: console [ttyS0] enabled* *[ 0.626338] printk: bootconsole [earlyser0] disabled* *[ 0.632148] ACPI: Core revision 20210331* *[ 0.635075] APIC: Switch to symmetric I/O mode setup* *[ 0.638323] Hyper-V: Using IPI hypercalls* *[ 0.641034] Hyper-V: Using enlightened APIC (xapic mode)* *[ 0.655694] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1* *[ 0.664007] Calibrating delay loop (skipped), value calculated using timer frequency.. 5187.81 BogoMIPS (lpj=2593907)* *[ 0.665006] pid_max: default: 32768 minimum: 301* *[ 0.666027] LSM: Security Framework initializing* *[ 0.667020] SELinux: Initializing.* *[ 0.669030] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)* *[ 0.670038] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)* *[ 0.677127] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8* *[ 0.678005] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4* *[ 0.679008] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization* *[ 0.680006] Spectre V2 : Mitigation: Full generic retpoline* *[ 0.681005] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch* *[ 0.682010] Speculative Store Bypass: Vulnerable* *[ 0.683010] TAA: Mitigation: Clear CPU buffers* *[ 0.684005] MDS: Mitigation: Clear CPU buffers* *[ 0.707115] Freeing SMP alternatives memory: 32K* *[ 0.708238] smpboot: CPU0: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (family: 0x6, model: 0x55, stepping: 0x7)* *[ 0.709119] Performance Events: unsupported p6 CPU model 85 no PMU driver, software events only.* *[ 0.710034] rcu: Hierarchical SRCU implementation.* *[ 0.711357] NMI watchdog: Perf NMI watchdog permanently disabled* *[ 0.712167] smp: Bringing up secondary CPUs ...* *[ 0.713104] x86: Booting SMP configuration:* *[ 0.714009] .... node #0, CPUs: #1* *[ 0.714498] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html <https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html> for more details.* *[ 0.716007] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html <https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html> for more details.* *[ 0.717108] #2 #3 #4 #5 #6 #7* *[ 0.720108] smp: Brought up 1 node, 8 CPUs* *[ 0.722012] smpboot: Max logical packages: 1* *[ 0.723012] smpboot: Total of 8 processors activated (41502.51 BogoMIPS)* *[ 0.725181] devtmpfs: initialized* *[ 0.726051] x86/mm: Memory block size: 128MB* *[ 0.728031] PM: Registering ACPI NVS region [mem 0x3ffff000-0x3fffffff] (4096 bytes)* *[ 0.729049] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns* *[ 0.730010] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)* *[ 0.731078] pinctrl core: initialized pinctrl subsystem* *[ 0.732251] NET: Registered protocol family 16* *[ 0.733093] audit: initializing netlink subsys (disabled)* *[ 0.734022] audit: type=2000 audit(1626697248.072:1): state=initialized audit_enabled=0 res=1* *[ 0.734104] thermal_sys: Registered thermal governor 'fair_share'* *[ 0.735011] thermal_sys: Registered thermal governor 'bang_bang'* *[ 0.736008] thermal_sys: Registered thermal governor 'step_wise'* *[ 0.737008] thermal_sys: Registered thermal governor 'user_space'* *[ 0.738042] cpuidle: using governor menu* *[ 0.740077] ACPI: bus type PCI registered* *[ 0.741008] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5* *[ 0.742342] PCI: Using configuration type 1 for base access* *[ 0.744243] Kprobes globally optimized* *[ 0.745039] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages* *[ 0.746009] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages* *[ 0.781009] random: fast init done* *[ 0.928218] wait_for_initramfs() called before rootfs_initcalls* *[ 0.935144] ACPI: Added _OSI(Module Device)* *[ 0.938012] ACPI: Added _OSI(Processor Device)* *[ 0.941009] ACPI: Added _OSI(3.0 _SCP Extensions)* *[ 0.945007] ACPI: Added _OSI(Processor Aggregator Device)* *[ 0.954012] ACPI: Added _OSI(Linux-Dell-Video)* *[ 0.957008] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)* *[ 0.960008] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)* *[ 0.965089] ACPI: 1 ACPI AML tables successfully acquired and loaded* *[ 0.970632] ACPI: Interpreter enabled* *[ 0.973020] ACPI: (supports S0 S5)* *[ 0.976008] ACPI: Using IOAPIC for interrupt routing* *[ 0.979031] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug* *[ 0.985221] ACPI: Enabled 1 GPEs in block 00 to 0F* *[ 1.002118] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])* *[ 1.012014] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3]* *[ 1.017020] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.* *[ 1.024148] PCI host bridge to bus 0000:00* *[ 1.027008] pci_bus 0000:00: root bus resource [mem 0xfe0000000-0xfffffffff window]* *[ 1.032008] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]* *[ 1.036008] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]* *[ 1.040007] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]* *[ 1.045009] pci_bus 0000:00: root bus resource [mem 0x40000000-0xfffbffff window]* *[ 1.055018] pci_bus 0000:00: root bus resource [bus 00-ff]* *[ 1.059173] pci 0000:00:00.0: [8086:7192] type 00 class 0x060000* *[ 1.065207] pci 0000:00:07.0: [8086:7110] type 00 class 0x060100* *[ 1.071463] pci 0000:00:07.1: [8086:7111] type 00 class 0x010180* *[ 1.076903] pci 0000:00:07.1: reg 0x20: [io 0xffa0-0xffaf]* *[ 1.081776] pci 0000:00:07.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]* *[ 1.086008] pci 0000:00:07.1: legacy IDE quirk: reg 0x14: [io 0x03f6]* *[ 1.091007] pci 0000:00:07.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]* *[ 1.095007] pci 0000:00:07.1: legacy IDE quirk: reg 0x1c: [io 0x0376]* *[ 1.099584] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,* ** this clock source is slow. Consider trying other clock sources* *[ 1.114010] pci 0000:00:07.3: acpi_pm_check_blacklist+0x0/0x20 took 13671 usecs* *[ 1.119009] pci 0000:00:07.3: [8086:7113] type 00 class 0x068000* *[ 1.125244] pci 0000:00:07.3: quirk: [io 0x0400-0x043f] claimed by PIIX4 ACPI* *[ 1.129903] pci 0000:00:08.0: [1414:5353] type 00 class 0x030000* *[ 1.134565] pci 0000:00:08.0: reg 0x10: [mem 0xf8000000-0xfbffffff]* *[ 1.159565] ACPI: PCI: Interrupt link LNKA configured for IRQ 11* *[ 1.163190] ACPI: PCI: Interrupt link LNKB configured for IRQ 0* *[ 1.167007] ACPI: PCI: Interrupt link LNKB disabled* *[ 1.170195] ACPI: PCI: Interrupt link LNKC configured for IRQ 0* *[ 1.174007] ACPI: PCI: Interrupt link LNKC disabled* *[ 1.178192] ACPI: PCI: Interrupt link LNKD configured for IRQ 0* *[ 1.182007] ACPI: PCI: Interrupt link LNKD disabled* *[ 1.185255] iommu: Default domain type: Translated* *[ 1.189052] pci 0000:00:08.0: vgaarb: setting as boot VGA device* *[ 1.190005] pci 0000:00:08.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none* *[ 1.197008] pci 0000:00:08.0: vgaarb: bridge control possible* *[ 1.201008] vgaarb: loaded* *[ 1.203121] SCSI subsystem initialized* *[ 1.213044] ACPI: bus type USB registered* *[ 1.216020] usbcore: registered new interface driver usbfs* *[ 1.220016] usbcore: registered new interface driver hub* *[ 1.224016] usbcore: registered new device driver usb* *[ 1.227040] EDAC MC: Ver: 3.0.0* *[ 1.230448] NetLabel: Initializing* *[ 1.233008] NetLabel: domain hash size = 128* *[ 1.236007] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO* *[ 1.240019] NetLabel: unlabeled traffic allowed by default* *[ 1.243007] PCI: Using ACPI for IRQ routing* *[ 1.246008] PCI: pci_cache_line_size set to 64 bytes* *[ 1.246347] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]* *[ 1.246351] e820: reserve RAM buffer [mem 0x3fff0000-0x3fffffff]* *[ 1.247008] clocksource: Switched to clocksource hyperv_clocksource_tsc_page* *[ 1.259280] VFS: Disk quotas dquot_6.6.0* *[ 1.262322] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)* *[ 1.266471] pnp: PnP ACPI init* *[ 1.271572] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)* *[ 1.271611] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 PNP030b (active)* *[ 1.271642] pnp 00:02: Plug and Play ACPI device, IDs PNP0f03 PNP0f13 (active)* *[ 1.272200] pnp 00:03: [dma 0 disabled]* *[ 1.272217] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)* *[ 1.272791] pnp 00:04: [dma 0 disabled]* *[ 1.272809] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)* *[ 1.273466] pnp 00:05: [dma 2]* *[ 1.273492] pnp 00:05: Plug and Play ACPI device, IDs PNP0700 (active)* *[ 1.273527] system 00:06: [io 0x01e0-0x01ef] has been reserved* *[ 1.277167] system 00:06: [io 0x0160-0x016f] has been reserved* *[ 1.284520] system 00:06: [io 0x0278-0x027f] has been reserved* *[ 1.288510] system 00:06: [io 0x0378-0x037f] has been reserved* *[ 1.292082] system 00:06: [io 0x0678-0x067f] has been reserved* *[ 1.295428] system 00:06: [io 0x0778-0x077f] has been reserved* *[ 1.298990] system 00:06: [io 0x04d0-0x04d1] has been reserved* *[ 1.302668] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)* *[ 1.302770] system 00:07: [io 0x0400-0x043f] has been reserved* *[ 1.306637] system 00:07: [io 0x0370-0x0371] has been reserved* *[ 1.320913] system 00:07: [io 0x0440-0x044f] has been reserved* *[ 1.324636] system 00:07: [mem 0xfec00000-0xfec00fff] could not be reserved* *[ 1.328944] system 00:07: [mem 0xfee00000-0xfee00fff] has been reserved* *[ 1.332910] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)* *[ 1.333042] system 00:08: [mem 0x00000000-0x0009ffff] could not be reserved* *[ 1.337842] system 00:08: [mem 0x000c0000-0x000dffff] could not be reserved* *[ 1.341947] system 00:08: [mem 0x000e0000-0x000fffff] could not be reserved* *[ 1.346173] system 00:08: [mem 0x00100000-0x3fffffff] could not be reserved* *[ 1.350306] system 00:08: [mem 0xfffc0000-0xffffffff] has been reserved* *[ 1.354378] system 00:08: Plug and Play ACPI device, IDs PNP0c01 (active)* *[ 1.354596] pnp: PnP ACPI: found 9 devices* *[ 1.364282] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns* *[ 1.369715] NET: Registered protocol family 2* *[ 1.373151] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)* *[ 1.379652] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes, linear)* *[ 1.385231] TCP established hash table entries: 131072 (order: 8, 1048576 bytes, linear)* *[ 1.392870] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)* *[ 1.397404] TCP: Hash tables configured (established 131072 bind 65536)* *[ 1.401454] UDP hash table entries: 8192 (order: 6, 262144 bytes, linear)* *[ 1.405588] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes, linear)* *[ 1.416432] NET: Registered protocol family 1* *[ 1.420201] pci_bus 0000:00: resource 4 [mem 0xfe0000000-0xfffffffff window]* *[ 1.424522] pci_bus 0000:00: resource 5 [io 0x0000-0x0cf7 window]* *[ 1.428380] pci_bus 0000:00: resource 6 [io 0x0d00-0xffff window]* *[ 1.432423] pci_bus 0000:00: resource 7 [mem 0x000a0000-0x000bffff window]* *[ 1.436163] pci_bus 0000:00: resource 8 [mem 0x40000000-0xfffbffff window]* *[ 1.439128] pci 0000:00:00.0: Limiting direct PCI/PCI transfers* *[ 1.442341] pci 0000:00:08.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]* *[ 1.447472] PCI: CLS 0 bytes, default 64* *[ 1.458508] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)* *[ 1.458626] Trying to unpack rootfs image as initramfs...* *[ 1.462044] software IO TLB: mapped [mem 0x000000003bff0000-0x000000003fff0000] (64MB)* *[ 1.472550] Initialise system trusted keyrings* *[ 1.475855] workingset: timestamp_bits=36 max_order=22 bucket_order=0* *[ 1.481769] zbud: loaded* *[ 1.492494] NET: Registered protocol family 38* *[ 1.498205] Key type asymmetric registered* *[ 1.501261] Asymmetric key parser 'x509' registered* *[ 1.504442] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)* *[ 1.509108] io scheduler mq-deadline registered* *[ 1.512172] io scheduler kyber registered* *[ 1.515028] io scheduler bfq registered* *[ 1.518695] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0* *[ 1.523349] ACPI: button: Power Button [PWRF]* *[ 1.527101] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled* *[ 1.531839] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A* *[ 1.537278] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A* *[ 1.542170] Non-volatile memory driver v1.3* *[ 1.545283] Linux agpgart interface v0.103* *[ 1.548948] rdac: device handler registered* *[ 1.568365] hp_sw: device handler registered* *[ 1.571972] emc: device handler registered* *[ 1.575178] alua: device handler registered* *[ 1.578299] libphy: Fixed MDIO Bus: probed* *[ 1.581420] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver* *[ 1.585683] ehci-pci: EHCI PCI platform driver* *[ 1.588956] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver* *[ 1.599213] ohci-pci: OHCI PCI platform driver* *[ 1.602108] uhci_hcd: USB Universal Host Controller Interface driver* *[ 1.606149] usbcore: registered new interface driver usbserial_generic* *[ 1.610099] usbserial: USB Serial support registered for generic* *[ 1.614065] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12* *[ 1.621506] serio: i8042 KBD port at 0x60,0x64 irq 1* *[ 1.624767] serio: i8042 AUX port at 0x60,0x64 irq 12* *[ 1.628296] mousedev: PS/2 mouse device common for all mice* *[ 1.634323] rtc_cmos 00:00: RTC can wake from S4* *[ 1.640694] rtc_cmos 00:00: registered as rtc0* *[ 1.644159] rtc_cmos 00:00: setting system clock to 2021-07-19T12:20:49 UTC (1626697249)* *[ 1.648889] rtc_cmos 00:00: alarms up to one month, 114 bytes nvram* *[ 1.663676] intel_pstate: CPU model not supported* *[ 1.667313] hid: raw HID events driver (C) Jiri Kosina* *[ 1.670616] usbcore: registered new interface driver usbhid* *[ 1.674445] usbhid: USB HID core driver* *[ 1.677051] drop_monitor: Initializing network drop monitor service* *[ 1.680996] Initializing XFRM netlink socket* *[ 1.683998] NET: Registered protocol family 10* *[ 1.687355] Segment Routing with IPv6* *[ 1.689874] NET: Registered protocol family 17* *[ 1.692817] Bridge firewalling registered* *[ 1.693504] Freeing initrd memory: 18856K* *[ 1.700091] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1* *[ 1.710170] IPI shorthand broadcast: enabled* *[ 1.713376] registered taskstats version 1* *[ 1.716320] Loading compiled-in X.509 certificates* *[ 1.719635] zswap: loaded using pool lzo/zbud* *[ 1.725553] Key type encrypted registered* *[ 1.728220] ima: No TPM chip found, activating TPM-bypass!* *[ 1.731600] ima: Allocated hash algorithm: sha1* *[ 1.734656] ima: No architecture policies found* *[ 1.738019] evm: Initialising EVM extended attributes:* *[ 1.741922] evm: security.selinux* *[ 1.744729] evm: security.ima* *[ 1.747169] evm: security.capability* *[ 1.749653] evm: HMAC attrs: 0x1* *[ 1.752421] Unstable clock detected, switching default tracing clock to "global"* *If you want to keep using the local clock, then add:* * "trace_clock=local"* *on the kernel command line* *[ 1.772490] Freeing unused kernel image (initmem) memory: 2584K* *[ 1.778015] Write protecting the kernel read-only data: 20480k* *[ 1.782891] Freeing unused kernel image (text/rodata gap) memory: 2036K* *[ 1.787521] Freeing unused kernel image (rodata/data gap) memory: 1580K* *[ 1.791879] Run /init as init process* *[ 1.794413] with arguments:* *[ 1.794414] /init* *[ 1.794415] with environment:* *[ 1.794416] HOME=/* *[ 1.794416] TERM=linux* *[ 1.794417] BOOT_IMAGE=/vmlinuz-5.13.2-1.el7.elrepo.x86_64* *[ 1.794418] crashkernel=auto* *[ 1.798169] random: systemd: uninitialized urandom read (16 bytes read)* *[ 1.805820] random: systemd: uninitialized urandom read (16 bytes read)* *[ 1.810232] random: systemd: uninitialized urandom read (16 bytes read)* *[ 1.821081] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)* *[ 1.832192] systemd[1]: Detected virtualization microsoft.* *[ 1.836344] systemd[1]: Detected architecture x86-64.* *[ 1.839832] systemd[1]: Running in initial RAM disk.* *[ 1.846553] systemd[1]: Set hostname to <testvm>.* *[ 1.878284] systemd[1]: Reached target Timers.* *[ 1.883927] systemd[1]: Reached target Swap.* *[ 1.888982] systemd[1]: Created slice Root Slice.* *[ 1.894361] systemd[1]: Reached target Local File Systems.* *[ 1.905903] systemd[1]: Listening on udev Kernel Socket.* *[ 2.118023] psmouse serio1: trackpoint: failed to get extended button data, assuming 3 buttons* *[ 2.391858] libata version 3.00 loaded.* *[ 2.392379] ata_piix 0000:00:07.1: version 2.13* *[ 2.392735] ata_piix 0000:00:07.1: Hyper-V Virtual Machine detected, ATA device ignore set* *[ 2.394891] hv_vmbus: Vmbus version:4.0* *[ 2.400307] scsi host0: ata_piix* *[ 2.412211] scsi host1: ata_piix* *[ 2.412251] ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0xffa0 irq 14* *[ 2.412254] ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0xffa8 irq 15* *[ 2.412330] hv_vmbus: registering driver hyperv_fb* *[ 2.414035] hv_vmbus: registering driver hv_storvsc* *[ 2.414041] hv_vmbus: registering driver hyperv_keyboard* *[ 2.415932] hv_vmbus: registering driver hid_hyperv* *[ 2.416220] hv_vmbus: registering driver hv_netvsc* *[ 2.420987] hyperv_fb: Synthvid Version major 3, minor 5* *[ 2.421027] hyperv_fb: Screen resolution: 1024x768, Color depth: 32* *[ 2.421031] hyperv_fb: Unable to allocate enough contiguous physical memory on Gen 1 VM. Using MMIO instead.* *[ 2.421160] scsi host3: storvsc_host_t* *[ 2.421190] scsi host2: storvsc_host_t* *[ 2.421310] input: Microsoft Vmbus HID-compliant Mouse as /devices/0006:045E:0621.0001/input/input4* *[ 2.421460] scsi 3:0:1:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5* *[ 2.421529] scsi 2:0:0:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5* *[ 2.421596] hid-generic 0006:045E:0621.0001: input: VIRTUAL HID v0.01 Mouse [Microsoft Vmbus HID-compliant Mouse] on* *[ 2.421690] scsi host5: storvsc_host_t* *[ 2.421852] scsi host4: storvsc_host_t* *[ 2.428406] sd 2:0:0:0: [sdb] 62914560 512-byte logical blocks: (32.2 GB/30.0 GiB)* *[ 2.428410] sd 2:0:0:0: [sdb] 4096-byte physical blocks* *[ 2.428445] sd 2:0:0:0: [sdb] Write Protect is off* *[ 2.428447] sd 2:0:0:0: [sdb] Mode Sense: 0f 00 10 00* *[ 2.428463] sd 3:0:1:0: [sda] 134217728 512-byte logical blocks: (68.7 GB/64.0 GiB)* *[ 2.428465] sd 3:0:1:0: [sda] 4096-byte physical blocks* *[ 2.428503] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA* *[ 2.428509] sd 3:0:1:0: [sda] Write Protect is off* *[ 2.428511] sd 3:0:1:0: [sda] Mode Sense: 0f 00 10 00* *[ 2.428599] sd 3:0:1:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA* *[ 2.567779] ata1.01: host indicates ignore ATA devices, ignored* *[ 2.568668] ata1.00: host indicates ignore ATA devices, ignored* *[ 2.629300] sdb: sdb1 sdb2 sdb14 sdb15* *[ 2.748209] ata2.01: NODEV after polling detection* *[ 2.784247] sda: sda1* *[ 2.818584] ata2.00: ATAPI: Virtual CD, , max MWDMA2* *[ 2.905025] random: crng init done* *[ 2.909396] scsi 1:0:0:0: CD-ROM Msft Virtual CD/ROM 1.0 PQ: 0 ANSI: 5* *[ 2.906011] random: 7 urandom warning(s) missed due to ratelimiting* *[ 2.927949] Console: switching to colour frame buffer device 128x48* *[ 2.938210] sd 2:0:0:0: [sdb] Attached SCSI disk* *[ 2.939232] sd 3:0:1:0: [sda] Attached SCSI disk* *[ 2.980270] sr 1:0:0:0: [sr0] scsi3-mmc drive: 0x/0x tray* *[ 2.983622] cdrom: Uniform CD-ROM driver Revision: 3.20* *[ 3.021487] sr 1:0:0:0: Attached scsi CD-ROM sr0* *[ 5.861141] psmouse serio1: trackpoint: IBM TrackPoint firmware: 0x01, buttons: 3/3* *[ 5.866309] input: TPPS/2 IBM TrackPoint as /devices/platform/i8042/serio1/input/input3* *[ 5.870910] input: AT Translated Set 2 keyboard as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A03:00/device:07/VMBUS:01/d34b2567-b9b6-42b9-8778-0a4ec0b955bf/serio2/input/input5* *[ 6.637932] hv_netvsc 000d3abe-aae5-000d-3abe-aae5000d3abe eth1: VF slot 2 added* *[ 6.649333] hv_vmbus: registering driver hv_pci* *[ 6.651839] hv_pci ef3bda84-ebc3-4fb5-8d25-26be84802f3d: PCI VMBus probing: Using version 0x10002* *[ 8.309253] hv_pci ef3bda84-ebc3-4fb5-8d25-26be84802f3d: PCI host bridge to bus ebc3:00* *[ 8.314015] pci_bus ebc3:00: root bus resource [mem 0xfe0000000-0xfe00fffff window]* *[ 9.141422] hv_netvsc 000d3abe-ab34-000d-3abe-ab34000d3abe eth2: VF slot 3 added* *[ 9.142330] hv_pci 29c7b9eb-731a-4dc6-9994-56902d762ac3: PCI VMBus probing: Using version 0x10002* *[ 9.151269] pci ebc3:00:02.0: [15b3:1016] type 00 class 0x020000* *[ 9.159725] hv_pci 29c7b9eb-731a-4dc6-9994-56902d762ac3: PCI host bridge to bus 731a:00* *[ 9.165296] pci_bus 731a:00: root bus resource [mem 0xfe0100000-0xfe01fffff window]* *[ 9.165840] pci ebc3:00:02.0: reg 0x10: [mem 0xfe0000000-0xfe00fffff 64bit pref]* *[ 9.252455] pci ebc3:00:02.0: enabling Extended Tags* *[ 9.262979] pci ebc3:00:02.0: 0.000 Gb/s available PCIe bandwidth, limited by Unknown x0 link at ebc3:00:02.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)* *[ 9.271139] pci ebc3:00:02.0: BAR 0: assigned [mem 0xfe0000000-0xfe00fffff 64bit pref]* *[ 9.288295] pci 731a:00:02.0: [15b3:1016] type 00 class 0x020000* *[ 9.297434] pci 731a:00:02.0: reg 0x10: [mem 0xfe0100000-0xfe01fffff 64bit pref]* *[ 9.388364] pci 731a:00:02.0: enabling Extended Tags* *[ 9.397082] pci 731a:00:02.0: 0.000 Gb/s available PCIe bandwidth, limited by Unknown x0 link at 731a:00:02.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)* *[ 9.405325] pci 731a:00:02.0: BAR 0: assigned [mem 0xfe0100000-0xfe01fffff 64bit pref]* *[ 9.429767] pps_core: LinuxPPS API ver. 1 registered* *[ 9.433589] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giome...@linux.it <giome...@linux.it>>* *[ 9.439842] PTP clock support registered* *[ 9.448398] mlx5_core ebc3:00:02.0: firmware version: 14.25.8368* *[ 9.461253] mlx5_core ebc3:00:02.0: handle_hca_cap:528:(pid 275): log_max_qp value in current profile is 18, changing it to HCA capability limit (12)* *[ 9.672358] mlx5_core 731a:00:02.0: firmware version: 14.25.8368* *[ 9.683580] mlx5_core 731a:00:02.0: handle_hca_cap:528:(pid 275): log_max_qp value in current profile is 18, changing it to HCA capability limit (12)* *[ 9.887389] mlx5_core ebc3:00:02.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(0)* *[ 10.035714] hv_netvsc 000d3abe-aae5-000d-3abe-aae5000d3abe eth1: VF registering: eth3* *[ 10.041235] mlx5_core ebc3:00:02.0 eth3: joined to eth1* *[ 10.045687] mlx5_core ebc3:00:02.0 eth3: Disabling LRO, not supported in legacy RQ* *[ 10.054253] mlx5_core 731a:00:02.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(0)* *[ 10.204126] hv_netvsc 000d3abe-ab34-000d-3abe-ab34000d3abe eth2: VF registering: eth4* *[ 10.210040] mlx5_core 731a:00:02.0 eth4: joined to eth2* *[ 10.213923] mlx5_core 731a:00:02.0 eth4: Disabling LRO, not supported in legacy RQ* *[ 10.293332] SGI XFS with ACLs, security attributes, quota, no debug enabled* *[ 10.305818] XFS (sdb2): Mounting V5 Filesystem* *[ 10.709685] XFS (sdb2): Ending clean mount* *[ 11.036442] systemd-journald[177]: Received SIGTERM from PID 1 (systemd).* *[ 11.044336] printk: systemd: 11 output lines suppressed due to ratelimiting* *[ 11.063196] SELinux: Runtime disable is deprecated, use selinux=0 on the kernel cmdline.* *[ 11.068095] SELinux: Disabled at runtime.* *[ 11.093112] audit: type=1404 audit(1626697258.948:2): enforcing=0 old_enforcing=0 auid=4294967295 ses=4294967295 enabled=0 old-enabled=1 lsm=selinux res=1* *[ 11.102986] systemd[1]: Inserted module 'ip_tables'* *[ 11.282392] xfs filesystem being remounted at / supports timestamps until 2038 (0x7fffffff)* *[ 11.303978] systemd-journald[532]: Received request to flush runtime journal from PID 1* *[ 11.358927] hv_vmbus: registering driver hv_balloon* *[ 11.362549] hv_balloon: Using Dynamic Memory protocol version 2.0* *[ 11.367320] hv_utils: Registering HyperV Utility Driver* *[ 11.370752] hv_vmbus: registering driver hv_utils* *[ 11.375571] hv_utils: Shutdown IC version 3.2* *[ 11.378608] hv_utils: Heartbeat IC version 3.0* *[ 11.381987] hv_utils: TimeSync IC version 4.0* *[ 11.415864] piix4_smbus 0000:00:07.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr* *[ 11.415996] sd 3:0:1:0: Attached scsi generic sg0 type 0* *[ 11.426368] sd 2:0:0:0: Attached scsi generic sg1 type 0* *[ 11.430091] sr 1:0:0:0: Attached scsi generic sg2 type 5* *[ 11.458895] input: PC Speaker as /devices/platform/pcspkr/input/input6* *[ 11.559429] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer* *[ 11.608292] cryptd: max_cpu_qlen set to 1000* *[ 11.619132] AVX2 version of gcm_enc/dec engaged.* *[ 11.622744] AES CTR mode by8 optimization enabled* *[ 11.635247] XFS (sdb1): Mounting V5 Filesystem* *[ 11.646063] XFS (sdb1): Ending clean mount* *[ 11.649215] xfs filesystem being mounted at /boot supports timestamps until 2038 (0x7fffffff)* *[ 11.763717] KVM: vmx: using Hyper-V Enlightened VMCS* *[ 11.972133] device-mapper: uevent: version 1.0.3* *[ 11.975461] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-de...@redhat.com <dm-de...@redhat.com>* *[ 12.062035] xfs filesystem being remounted at /tmp supports timestamps until 2038 (0x7fffffff)* *[ 12.062589] xfs filesystem being remounted at /var/tmp supports timestamps until 2038 (0x7fffffff)* *[ 12.109785] xfs filesystem being remounted at /tmp supports timestamps until 2038 (0x7fffffff)* *[ 12.118374] xfs filesystem being remounted at /var/tmp supports timestamps until 2038 (0x7fffffff)* *[ 12.576346] xfs filesystem being remounted at /tmp supports timestamps until 2038 (0x7fffffff)* *[ 12.581738] xfs filesystem being remounted at /var/tmp supports timestamps until 2038 (0x7fffffff)* *[ 12.619891] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready* *[ 12.712695] mlx5_core ebc3:00:02.0 eth3: Link up* *[ 12.760771] hv_netvsc 000d3abe-aae5-000d-3abe-aae5000d3abe eth1: Data path switched to VF: eth3* *[ 12.867717] mlx5_core 731a:00:02.0 eth4: Link up* *[ 12.921817] hv_netvsc 000d3abe-ab34-000d-3abe-ab34000d3abe eth2: Data path switched to VF: eth4* *[ 13.407356] hv_utils: KVP IC version 4.0* *[ 13.622065] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready* *[ 13.626953] IPv6: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready* *[ 14.002679] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.* *[ 59.483008] hv_balloon: Max. dynamic memory size: 16384 MB* *[ 1602.711187] mlx5_core ebc3:00:02.0: mlx5_cmd_check:777:(pid 1770): SET_FLOW_TABLE_ENTRY(0x936) op_mod(0x0) failed, status limits exceeded(0x8), syndrome (0xe18816)* *[ 1602.725387] mlx5_core ebc3:00:02.0: mlx5_cmd_check:777:(pid 1770): SET_FLOW_TABLE_ENTRY(0x936) op_mod(0x0) failed, status limits exceeded(0x8), syndrome (0xe18816)* I've checked the code and it seems to be failing in rdma_rxq_finalize while executing ibv_create_flow(). If anyone could give me any clue as to what could be the problem it would be greatly appreciated. Thanks a lot in advance. Sergio Tur
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#19834): https://lists.fd.io/g/vpp-dev/message/19834 Mute This Topic: https://lists.fd.io/mt/84307743/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-