[Kernel-packages] [Bug 1786752] Re: Reference counter issue in 4.15 (nf_xfrm_me_harder / dst_release)

2019-03-19 Thread roobesh ganapathy mohandass
We have upgraded to kernel v4.20.15 and its going to be more than a
week, we are not seeing any more call traces in this kernel logs. We
will watch for few more days and i will report back here.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1786752

Title:
  Reference counter issue in 4.15 (nf_xfrm_me_harder / dst_release)

Status in linux package in Ubuntu:
  Confirmed

Bug description:
  Since upgrading from 14.04 to 18.04, we see very frequent warnings
  about negative refcnts in dst_release:

  [ 3117.882227] WARNING: CPU: 6 PID: 0 at 
/build/linux-I4R9hO/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
  [ 3117.882229] Modules linked in: xt_policy cls_u32 sch_sfq ip_vti ip_tunnel 
authenc echainiv xfrm6_mode_tunnel xfrm4_mode_tunnel xfrm4_tunnel tunnel4 
ipcomp xfrm_ipcomp esp4 ah4 af_key nfnetlink_queue nfnetlink_log sch_htb 
xt_TPROXY xt_multiport veth nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo 
br_netfilter bridge overlay macvlan 8021q garp mrp stp llc bonding 
algif_skcipher af_alg xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 
ip6t_REJECT nf_reject_ipv6 xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 
dm_crypt iptable_nat nf_nat_ipv4 xt_DSCP xt_dscp xt_mark iptable_mangle 
xt_limit xt_tcpudp xt_addrtype intel_rapl sb_edac x86_pkg_temp_thermal 
intel_powerclamp coretemp nf_conntrack_ipv4 nf_defrag_ipv4 kvm_intel 
xt_conntrack kvm joydev input_leds ipt_REJECT nf_reject_ipv4 ftdi_sio usbserial 
ipmi_si
  [ 3117.882265]  irqbypass intel_cstate mei_me mei ioatdma acpi_pad 
intel_rapl_perf shpchp ipmi_devintf ipmi_msghandler acpi_power_meter lpc_ich 
mac_hid ip6table_filter ip6_tables nf_conntrack_netbios_ns 
nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp sch_fq_codel 
nf_conntrack iptable_filter ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp 
libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs 
zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor 
async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear mgag200 ttm 
crct10dif_pclmul igb ixgbe crc32_pclmul drm_kms_helper hid_generic 
ghash_clmulni_intel syscopyarea i2c_algo_bit dca sysfillrect usbhid pcbc 
sysimgblt fb_sys_fops aesni_intel aes_x86_64 crypto_simd ahci glue_helper ptp 
hid mxm_wmi cryptd
  [ 3117.882309]  drm libahci megaraid_sas pps_core mdio wmi
  [ 3117.882315] CPU: 6 PID: 0 Comm: swapper/6 Tainted: GW
4.15.0-30-generic #32-Ubuntu
  [ 3117.882316] Hardware name: Intel Corporation S2600WT2R/S2600WT2R, BIOS 
SE5C610.86B.01.01.0022.062820171903 06/28/2017
  [ 3117.882319] RIP: 0010:nf_xfrm_me_harder+0x127/0x140 [nf_nat]
  [ 3117.882320] RSP: 0018:88d77f3839f0 EFLAGS: 00010246
  [ 3117.882322] RAX:  RBX: 90de4000 RCX: 
1924
  [ 3117.882323] RDX:  RSI: 88d749ae6400 RDI: 
88d655e96600
  [ 3117.882324] RBP: 88d77f383a68 R08: 88d7493dc000 R09: 
0018
  [ 3117.882324] R10: 0001 R11: 88e770dedc00 R12: 
88d655e96600
  [ 3117.882325] R13: 88d77f383ae8 R14: 88d7799ff200 R15: 
88d7493dc000
  [ 3117.882327] FS:  () GS:88d77f38() 
knlGS:
  [ 3117.882327] CS:  0010 DS:  ES:  CR0: 80050033
  [ 3117.882328] CR2: ff600400 CR3: 00193de0a002 CR4: 
003606e0
  [ 3117.882329] DR0:  DR1:  DR2: 

  [ 3117.882330] DR3:  DR6: fffe0ff0 DR7: 
0400
  [ 3117.882331] Call Trace:
  [ 3117.882332]  
  [ 3117.882337]  ? nf_nat_ipv4_fn+0x15b/0x200 [nf_nat_ipv4]
  [ 3117.882339]  nf_nat_ipv4_out+0xc5/0xe0 [nf_nat_ipv4]
  [ 3117.882342]  iptable_nat_ipv4_out+0x15/0x20 [iptable_nat]
  [ 3117.882347]  nf_hook_slow+0x48/0xc0
  [ 3117.882353]  ip_output+0xd2/0xe0
  [ 3117.882355]  ? ip_fragment.constprop.44+0x80/0x80
  [ 3117.882357]  ip_forward_finish+0x49/0x70
  [ 3117.882359]  ip_forward+0x366/0x440
  [ 3117.882361]  ? ip_frag_mem+0x20/0x20
  [ 3117.882362]  ip_rcv_finish+0x129/0x430
  [ 3117.882364]  ip_rcv+0x28f/0x3a0
  [ 3117.882366]  ? inet_del_offload+0x40/0x40
  [ 3117.882372]  __netif_receive_skb_core+0x432/0xb40
  [ 3117.882379]  ? handle_edge_irq+0x7c/0x190
  [ 3117.882384]  ? irq_exit+0x67/0xc0
  [ 3117.882391]  ? do_IRQ+0x82/0xd0
  [ 3117.882393]  __netif_receive_skb+0x18/0x60
  [ 3117.882395]  ? __netif_receive_skb+0x18/0x60
  [ 3117.882397]  netif_receive_skb_internal+0x37/0xd0
  [ 3117.882398]  napi_gro_receive+0xc5/0xf0
  [ 3117.882407]  ixgbe_clean_rx_irq+0x446/0xe30 [ixgbe]
  [ 3117.882411]  ixgbe_poll+0x256/0x710 [ixgbe]
  [ 3117.882413]  ? do_IRQ+0x82/0xd0
  [ 3117.882415]  net_rx_action+0x140/0x3a0
  [ 3117.882418]  __do_softirq+0xdf/0x2b2
  [ 3117.882419]  irq_exit+0xb6/0xc0
  [ 3117.882421]  do_IRQ+0x82/0xd0
  [ 3117.882423]  common_interrupt+0x84/0x84
  [ 

[Kernel-packages] [Bug 1786752] Re: Reference counter issue in 4.15 (nf_xfrm_me_harder / dst_release)

2019-03-04 Thread roobesh ganapathy mohandass
# lspci
00:00.0 Host bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D 
DMI2 (rev 01)
00:01.0 PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D 
PCI Express Root Port 1 (rev 01)
00:02.0 PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D 
PCI Express Root Port 2 (rev 01)
00:02.2 PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D 
PCI Express Root Port 2 (rev 01)
00:03.0 PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D 
PCI Express Root Port 3 (rev 01)
00:04.0 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 0 (rev 01)
00:04.1 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 1 (rev 01)
00:04.2 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 2 (rev 01)
00:04.3 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 3 (rev 01)
00:04.4 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 4 (rev 01)
00:04.5 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 5 (rev 01)
00:04.6 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 6 (rev 01)
00:04.7 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Crystal Beach DMA Channel 7 (rev 01)
00:05.0 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D Map/VTd_Misc/System Management (rev 01)
00:05.1 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D IIO Hot Plug (rev 01)
00:05.2 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D IIO RAS/Control Status/Global Errors (rev 01)
00:05.4 PIC: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D I/O APIC 
(rev 01)
00:11.0 Unassigned class [ff00]: Intel Corporation C610/X99 series chipset SPSR 
(rev 05)
00:11.1 SMBus: Intel Corporation C610/X99 series chipset MS SMBus 0 (rev 05)
00:11.4 SATA controller: Intel Corporation C610/X99 series chipset sSATA 
Controller [AHCI mode] (rev 05)
00:14.0 USB controller: Intel Corporation C610/X99 series chipset USB xHCI Host 
Controller (rev 05)
00:16.0 Communication controller: Intel Corporation C610/X99 series chipset MEI 
Controller #1 (rev 05)
00:16.1 Communication controller: Intel Corporation C610/X99 series chipset MEI 
Controller #2 (rev 05)
00:1a.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced 
Host Controller #2 (rev 05)
00:1c.0 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root 
Port #1 (rev d5)
00:1c.3 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root 
Port #4 (rev d5)
00:1d.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced 
Host Controller #1 (rev 05)
00:1f.0 ISA bridge: Intel Corporation C610/X99 series chipset LPC Controller 
(rev 05)
00:1f.2 SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA 
Controller [AHCI mode] (rev 05)
00:1f.3 SMBus: Intel Corporation C610/X99 series chipset SMBus Controller (rev 
05)
01:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS-3 3108 
[Invader] (rev 02)
02:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit 
X540-AT2 (rev 01)
02:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit 
X540-AT2 (rev 01)
04:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection 
(rev 01)
04:00.3 Ethernet controller: Intel Corporation I350 Gigabit Network Connection 
(rev 01)
06:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit 
X540-AT2 (rev 01)
06:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit 
X540-AT2 (rev 01)
09:00.0 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200e 
[Pilot] ServerEngines (SEP1) (rev 05)
7f:08.0 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D QPI Link 0 (rev 01)
7f:08.2 Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D QPI Link 0 (rev 01)
7f:08.3 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D QPI Link 0 (rev 01)
7f:09.0 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D QPI Link 1 (rev 01)
7f:09.2 Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D QPI Link 1 (rev 01)
7f:09.3 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D QPI Link 1 (rev 01)
7f:0b.0 System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D R3 QPI Link 0/1 (rev 01)
7f:0b.1 Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D R3 QPI Link 0/1 (rev 01)
7f:0b.2 Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 
v4/Xeon D R

[Kernel-packages] [Bug 1786752] Re: Reference counter issue in 4.15 (nf_xfrm_me_harder / dst_release)

2019-03-04 Thread roobesh ganapathy mohandass
We have upgraded the latest kernel and even occasionally we facing this
call traces and CPU tainted,

# uname -rn
 4.15.0-45-generic
# uname -a
Linux  4.15.0-45-generic #48-Ubuntu SMP Tue Jan 29 16:28:13 UTC 2019 x86_64 
x86_64 x86_64 GNU/Linux

# dmesg -T | grep "Fri Mar  1.*CPU"
[Fri Mar  1 10:28:42 2019] WARNING: CPU: 33 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:28:42 2019] CPU: 33 PID: 0 Comm: swapper/33 Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 10:29:56 2019] WARNING: CPU: 12 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:29:56 2019] CPU: 12 PID: 0 Comm: swapper/12 Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 10:53:01 2019] WARNING: CPU: 13 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:53:01 2019] WARNING: CPU: 1 PID: 18428 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:53:01 2019] WARNING: CPU: 5 PID: 18424 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:53:01 2019] CPU: 1 PID: 18428 Comm: haproxy Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 10:53:01 2019] CPU: 5 PID: 18424 Comm: haproxy Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 10:53:01 2019] CPU: 13 PID: 0 Comm: swapper/13 Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 10:53:50 2019] WARNING: CPU: 5 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:53:50 2019] CPU: 5 PID: 0 Comm: swapper/5 Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 12:29:32 2019] WARNING: CPU: 22 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 12:29:32 2019] CPU: 22 PID: 0 Comm: swapper/22 Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 13:01:20 2019] WARNING: CPU: 31 PID: 20932 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 13:01:20 2019] CPU: 31 PID: 20932 Comm: thread.rb:70 Tainted: G 
   W  OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 13:01:23 2019] WARNING: CPU: 14 PID: 18429 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 13:01:23 2019] CPU: 14 PID: 18429 Comm: haproxy Tainted: GW 
 OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 13:01:23 2019] WARNING: CPU: 31 PID: 7532 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 13:01:23 2019] CPU: 31 PID: 7532 Comm: telegraf Tainted: GW 
 OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 13:16:28 2019] WARNING: CPU: 32 PID: 7842 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 13:16:28 2019] CPU: 32 PID: 7842 Comm: haproxy Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 13:48:17 2019] WARNING: CPU: 13 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 13:48:17 2019] CPU: 13 PID: 0 Comm: swapper/13 Tainted: GW  
OE4.15.0-45-generic #48-Ubuntu
[Fri Mar  1 13:48:20 2019] WARNING: CPU: 5 PID: 41 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 13:48:20 2019] CPU: 5 PID: 41 Comm: ksoftirqd/5 Tainted: GW 
 OE4.15.0-45-generic #48-Ubuntu

# dmesg -T | grep "Fri Mar  1"
[Fri Mar  1 10:28:42 2019] WARNING: CPU: 33 PID: 0 at 
/build/linux-uQJ2um/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
[Fri Mar  1 10:28:42 2019] Modules linked in: sctp xt_recent xfrm4_tunnel 
tunnel4 nfnetlink_queue nfnetlink_log ipcomp xfrm_ipcomp esp4 ah4 af_key 
tcp_diag udp_diag inet_diag sch_htb xt_TPROXY xt_multiport veth 
nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo br_netfilter bridge aufs 
overlay macvlan 8021q garp mrp stp llc bonding wireguard(OE) ip6_udp_tunnel 
udp_tunnel algif_skcipher af_alg xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 
ip6t_REJECT nf_reject_ipv6 xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 
iptable_nat nf_nat_ipv4 xt_DSCP xt_dscp xt_mark dm_crypt iptable_mangle 
xt_limit xt_tcpudp xt_addrtype intel_rapl nf_conntrack_ipv4 nf_defrag_ipv4 
sb_edac x86_pkg_temp_thermal intel_powerclamp xt_conntrack coretemp ipt_REJECT 
nf_reject_ipv4 kvm_intel kvm shpchp ftdi_sio usbserial irqbypass lpc_ich joydev 
input_leds
[Fri Mar  1 10:28:42 2019]  intel_cstate intel_rapl_perf mei_me mei ipmi_si 
ipmi_devintf ipmi_msghandler ioatdma ip6table_filter ip6_tables mac_hid 
acpi_power_meter acpi_pad nf_conntrack_netbios_ns nf_connt

[Kernel-packages] [Bug 1786752] Re: Reference counter issue in 4.15 (nf_xfrm_me_harder / dst_release)

2019-01-07 Thread roobesh ganapathy mohandass
Just to follow up , on behalf of Juergen. Do we have any progress with
this bug ?

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1786752

Title:
  Reference counter issue in 4.15 (nf_xfrm_me_harder / dst_release)

Status in linux package in Ubuntu:
  Confirmed

Bug description:
  Since upgrading from 14.04 to 18.04, we see very frequent warnings
  about negative refcnts in dst_release:

  [ 3117.882227] WARNING: CPU: 6 PID: 0 at 
/build/linux-I4R9hO/linux-4.15.0/include/net/dst.h:256 
nf_xfrm_me_harder+0x127/0x140 [nf_nat]
  [ 3117.882229] Modules linked in: xt_policy cls_u32 sch_sfq ip_vti ip_tunnel 
authenc echainiv xfrm6_mode_tunnel xfrm4_mode_tunnel xfrm4_tunnel tunnel4 
ipcomp xfrm_ipcomp esp4 ah4 af_key nfnetlink_queue nfnetlink_log sch_htb 
xt_TPROXY xt_multiport veth nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo 
br_netfilter bridge overlay macvlan 8021q garp mrp stp llc bonding 
algif_skcipher af_alg xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 
ip6t_REJECT nf_reject_ipv6 xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 
dm_crypt iptable_nat nf_nat_ipv4 xt_DSCP xt_dscp xt_mark iptable_mangle 
xt_limit xt_tcpudp xt_addrtype intel_rapl sb_edac x86_pkg_temp_thermal 
intel_powerclamp coretemp nf_conntrack_ipv4 nf_defrag_ipv4 kvm_intel 
xt_conntrack kvm joydev input_leds ipt_REJECT nf_reject_ipv4 ftdi_sio usbserial 
ipmi_si
  [ 3117.882265]  irqbypass intel_cstate mei_me mei ioatdma acpi_pad 
intel_rapl_perf shpchp ipmi_devintf ipmi_msghandler acpi_power_meter lpc_ich 
mac_hid ip6table_filter ip6_tables nf_conntrack_netbios_ns 
nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp sch_fq_codel 
nf_conntrack iptable_filter ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp 
libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs 
zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor 
async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear mgag200 ttm 
crct10dif_pclmul igb ixgbe crc32_pclmul drm_kms_helper hid_generic 
ghash_clmulni_intel syscopyarea i2c_algo_bit dca sysfillrect usbhid pcbc 
sysimgblt fb_sys_fops aesni_intel aes_x86_64 crypto_simd ahci glue_helper ptp 
hid mxm_wmi cryptd
  [ 3117.882309]  drm libahci megaraid_sas pps_core mdio wmi
  [ 3117.882315] CPU: 6 PID: 0 Comm: swapper/6 Tainted: GW
4.15.0-30-generic #32-Ubuntu
  [ 3117.882316] Hardware name: Intel Corporation S2600WT2R/S2600WT2R, BIOS 
SE5C610.86B.01.01.0022.062820171903 06/28/2017
  [ 3117.882319] RIP: 0010:nf_xfrm_me_harder+0x127/0x140 [nf_nat]
  [ 3117.882320] RSP: 0018:88d77f3839f0 EFLAGS: 00010246
  [ 3117.882322] RAX:  RBX: 90de4000 RCX: 
1924
  [ 3117.882323] RDX:  RSI: 88d749ae6400 RDI: 
88d655e96600
  [ 3117.882324] RBP: 88d77f383a68 R08: 88d7493dc000 R09: 
0018
  [ 3117.882324] R10: 0001 R11: 88e770dedc00 R12: 
88d655e96600
  [ 3117.882325] R13: 88d77f383ae8 R14: 88d7799ff200 R15: 
88d7493dc000
  [ 3117.882327] FS:  () GS:88d77f38() 
knlGS:
  [ 3117.882327] CS:  0010 DS:  ES:  CR0: 80050033
  [ 3117.882328] CR2: ff600400 CR3: 00193de0a002 CR4: 
003606e0
  [ 3117.882329] DR0:  DR1:  DR2: 

  [ 3117.882330] DR3:  DR6: fffe0ff0 DR7: 
0400
  [ 3117.882331] Call Trace:
  [ 3117.882332]  
  [ 3117.882337]  ? nf_nat_ipv4_fn+0x15b/0x200 [nf_nat_ipv4]
  [ 3117.882339]  nf_nat_ipv4_out+0xc5/0xe0 [nf_nat_ipv4]
  [ 3117.882342]  iptable_nat_ipv4_out+0x15/0x20 [iptable_nat]
  [ 3117.882347]  nf_hook_slow+0x48/0xc0
  [ 3117.882353]  ip_output+0xd2/0xe0
  [ 3117.882355]  ? ip_fragment.constprop.44+0x80/0x80
  [ 3117.882357]  ip_forward_finish+0x49/0x70
  [ 3117.882359]  ip_forward+0x366/0x440
  [ 3117.882361]  ? ip_frag_mem+0x20/0x20
  [ 3117.882362]  ip_rcv_finish+0x129/0x430
  [ 3117.882364]  ip_rcv+0x28f/0x3a0
  [ 3117.882366]  ? inet_del_offload+0x40/0x40
  [ 3117.882372]  __netif_receive_skb_core+0x432/0xb40
  [ 3117.882379]  ? handle_edge_irq+0x7c/0x190
  [ 3117.882384]  ? irq_exit+0x67/0xc0
  [ 3117.882391]  ? do_IRQ+0x82/0xd0
  [ 3117.882393]  __netif_receive_skb+0x18/0x60
  [ 3117.882395]  ? __netif_receive_skb+0x18/0x60
  [ 3117.882397]  netif_receive_skb_internal+0x37/0xd0
  [ 3117.882398]  napi_gro_receive+0xc5/0xf0
  [ 3117.882407]  ixgbe_clean_rx_irq+0x446/0xe30 [ixgbe]
  [ 3117.882411]  ixgbe_poll+0x256/0x710 [ixgbe]
  [ 3117.882413]  ? do_IRQ+0x82/0xd0
  [ 3117.882415]  net_rx_action+0x140/0x3a0
  [ 3117.882418]  __do_softirq+0xdf/0x2b2
  [ 3117.882419]  irq_exit+0xb6/0xc0
  [ 3117.882421]  do_IRQ+0x82/0xd0
  [ 3117.882423]  common_interrupt+0x84/0x84
  [ 3117.882424]  
  [ 3117.882427] RIP: 0010:cpuidle_enter_state+0xa7/0x2f0
  [ 3117.882428] RSP: 0018:9e1a46413