[Group.of.nepali.translators] [Bug 1706132] Re: xfs slab objects (memory) leak when xfs shutdown is called
** Changed in: linux (Ubuntu)
Status: In Progress => Fix Released
** Changed in: linux (Ubuntu)
Assignee: Rafael David Tinoco (inaddy) => (unassigned)
** Changed in: linux (Ubuntu Xenial)
Assignee: Rafael David Tinoco (inaddy) => (unassigned)
--
You received this bug notification because you are a member of नेपाली
भाषा समायोजकहरुको समूह, which is subscribed to Xenial.
Matching subscriptions: Ubuntu 16.04 Bugs
https://bugs.launchpad.net/bugs/1706132
Title:
xfs slab objects (memory) leak when xfs shutdown is called
Status in linux package in Ubuntu:
Fix Released
Status in linux source package in Xenial:
Fix Released
Bug description:
[Impact]
* xfs kernel memory leak in case of xfs shutdown due to i/o errors
* if xfs on iscsi, iscsi disconnection and module unload will case mem leak
[Test Case]
* configure tgtd with 1 lun and make it available through tcp/ip
* configure open-iscsi to map this lun
* make sure node.session.timeo.replacement_timeout = 0 in iscsid.conf
* mount a xfs volume using the lun from tgtd host, run bonnie -d /xfsdir
* in tgtd server, drop iscsi packets and watch client to have i/o errors
* after sometime (depending on timeout) xfs will call shutdown
* make sure the i/o errors led to xfs shutdown (comment #3)
* after shutdown you try to remove xfs module and it will leak
[Regression Potential]
* based on upstream fix
* tested in the same environment
* potential damage to xfs
[Other Info]
Original Description:
This scenario is testing [iscsi <-> scsi <-> disk <-> xfs]
[ 551.125604] sd 2:0:0:1: rejecting I/O to offline device
[ 551.125615] sd 2:0:0:1: rejecting I/O to offline device
[ 551.125627] sd 2:0:0:1: rejecting I/O to offline device
[ 551.125639] sd 2:0:0:1: rejecting I/O to offline device
[ 551.135216] XFS (sda1): metadata I/O error: block 0xeffe01
("xfs_trans_read_buf_map") error 5 numblks 1
[ 551.135274] XFS (sda1): page discard on page ea0002a89cc0, inode 0x83,
offset 6442385408.
# when XFS shuts down because of an error (or offline disk, example):
[ 551.850498] XFS (sda1): xfs_do_force_shutdown(0x2) called from line 1197
of file /build/linux-lts-xenial-roXrYH/linux-lts-xenial-4.4.0/fs/xfs/xfs_log.c.
Return address = 0xc0300388
[ 551.850568] XFS (sda1): Log I/O Error Detected. Shutting down filesystem
[ 551.850618] XFS (sda1): xfs_log_force: error -5 returned.
[ 551.850630] XFS (sda1): Failing async write on buffer block 0x77ff08.
Retrying async write.
[ 551.850634] XFS (sda1): Failing async write on buffer block 0x77ff10.
Retrying async write.
[ 551.850638] XFS (sda1): Failing async write on buffer block 0x77ff01.
Retrying async write.
[ 551.853171] XFS (sda1): Please umount the filesystem and rectify the
problem(s)
[ 551.874131] XFS (sda1): metadata I/O error: block 0x1dffc49
("xlog_iodone") error 5 numblks 64
[ 551.877993] XFS (sda1): xfs_do_force_shutdown(0x2) called from line 1197
of file /build/linux-lts-xenial-roXrYH/linux-lts-xenial-4.4.0/fs/xfs/xfs_log.c.
Return address = 0xc0300388
[ 551.899036] XFS (sda1): xfs_log_force: error -5 returned.
[ 569.323074] XFS (sda1): xfs_log_force: error -5 returned.
[ 599.403085] XFS (sda1): xfs_log_force: error -5 returned.
[ 629.483111] XFS (sda1): xfs_log_force: error -5 returned.
[ 659.563115] XFS (sda1): xfs_log_force: error -5 returned.
[ 689.643014] XFS (sda1): xfs_log_force: error -5 returned.
# when I execute:
# sudo umount /dev/sda1:
[81634.923043] XFS (sda1): xfs_log_force: error -5 returned.
[81640.739097] XFS (sda1): xfs_log_force: error -5 returned.
[81640.739137] XFS (sda1): Unmounting Filesystem
[81640.739463] XFS (sda1): xfs_log_force: error -5 returned.
[81640.739508] XFS (sda1): xfs_log_force: error -5 returned.
[81640.742741] sd 2:0:0:1: rejecting I/O to offline device
[81640.745576] blk_update_request: 25 callbacks suppressed
[81640.745601] blk_update_request: I/O error, dev sda, sector 0
# i was able to umount and then to remove iscsi disk.
# but if i try to unload the xfs module:
inaddy@(trustyiscsicli):~$ sudo rmmod xfs
[82211.059301]
=
[82211.063764] BUG xfs_log_ticket (Tainted: G OE ): Objects
remaining in xfs_log_ticket on kmem_cache_close()
[82211.067450]
-
[82211.067450]
[82211.070580] INFO: Slab 0xea0002eb7640 objects=22 used=1
fp=0x8800badd9f18 flags=0xc00080
[82211.074430] INFO: Object 0x8800badd9228 @offset=552
[82211.076133] kmem_cache_destroy xfs_log_ticket: Slab cache still has objects
AND
[82211.059301]
=
[82211.063764] BUG xfs_log_ticket (Tainted: G OE ): Objects
remaining in
[Group.of.nepali.translators] [Bug 1706132] Re: xfs slab objects (memory) leak when xfs shutdown is called
This bug was fixed in the package linux - 4.4.0-93.116 --- linux (4.4.0-93.116) xenial; urgency=low * linux: 4.4.0-93.116 -proposed tracker (LP: #1709296) * Creating conntrack entry failure with kernel 4.4.0-89 (LP: #1709032) - Revert "Revert "netfilter: synproxy: fix conntrackd interaction"" - netfilter: nf_ct_ext: fix possible panic after nf_ct_extend_unregister * CVE-2017-1000112 - Revert "udp: consistently apply ufo or fragmentation" - udp: consistently apply ufo or fragmentation * CVE-2017-1000111 - Revert "net-packet: fix race in packet_set_ring on PACKET_RESERVE" - packet: fix tp_reserve race in packet_set_ring * kernel BUG at [tty_ldisc_reinit] mm/slub.c! (LP: #1709126) - tty: Simplify tty_set_ldisc() exit handling - tty: Reset c_line from driver's init_termios - tty: Handle NULL tty->ldisc - tty: Move tty_ldisc_kill() - tty: Use 'disc' for line discipline index name - tty: Refactor tty_ldisc_reinit() for reuse - tty: Destroy ldisc instance on hangup * atheros bt failed after S3 (LP: #1706833) - SAUCE: Bluetooth: Make request workqueue freezable * The Precision Touchpad(PTP) button sends incorrect event code (LP: #1708372) - HID: multitouch: handle external buttons for Precision Touchpads * Set CONFIG_SATA_HIGHBANK=y on armhf (LP: #1703430) - [Config] CONFIG_SATA_HIGHBANK=y * xfs slab objects (memory) leak when xfs shutdown is called (LP: #1706132) - xfs: fix xfs_log_ticket leak in xfs_end_io() after fs shutdown * Adt tests of src:linux time out often on armhf lxc containers (LP: #1705495) - [Packaging] tests -- reduce rebuild test to one flavour * CVE-2017-7495 - ext4: fix data exposure after a crash * ubuntu/rsi driver downlink wifi throughput drops to 5-6 Mbps when BT keyboard is connected (LP: #1706991) - SAUCE: Redpine: enable power save by default for coex mode - SAUCE: Redpine: uapsd configuration changes * [Hyper-V] hv_netvsc: Exclude non-TCP port numbers from vRSS hashing (LP: #1690174) - hv_netvsc: Exclude non-TCP port numbers from vRSS hashing * ath10k doesn't report full RSSI information (LP: #1706531) - ath10k: add per chain RSSI reporting * ideapad_laptop don't support v310-14isk (LP: #1705378) - platform/x86: ideapad-laptop: Add several models to no_hw_rfkill * [8087:0a2b] Failed to load bluetooth firmware(might affect some other Intel bt devices) (LP: #1705633) - Bluetooth: btintel: Create common Intel Version Read function - Bluetooth: Use switch statement for Intel hardware variants - Bluetooth: Replace constant hw_variant from Intel Bluetooth firmware filename - Bluetooth: hci_intel: Fix firmware file name to use hw_variant - Bluetooth: btintel: Add MODULE_FIRMWARE entries for iBT 3.5 controllers * xhci_hcd: ERROR Transfer event TRB DMA ptr not part of current TD ep_index 2 comp_code 13 (LP: #1667750) - xhci: Bad Ethernet performance plugged in ASM1042A host * OpenPower: Some multipaths temporarily have only a single path (LP: #1696445) - scsi: ses: don't get power status of SES device slot on probe * Hotkeys on new Thinkpad systems aren't working (LP: #1705169) - platform/x86: thinkpad_acpi: Adding new hotkey ID for Lenovo thinkpad - platform/x86: thinkpad_acpi: guard generic hotkey case - platform/x86: thinkpad_acpi: add mapping for new hotkeys * CVE-2015-7837 - SAUCE: (no-up) kexec/uefi: copy secure_boot flag in boot params across kexec reboot * misleading kernel warning skb_warn_bad_offload during checksum calculation (LP: #1705447) - net: reduce skb_warn_bad_offload() noise * bonding: stack dump when unregistering a netdev (LP: #1704102) - bonding: avoid NETDEV_CHANGEMTU event when unregistering slave * Ubuntu 16.04 IOB Error when the Mustang board rebooted (LP: #1693673) - drivers: net: xgene: Fix redundant prefetch buffer cleanup * Ubuntu16.04: NVMe 4K+T10 DIF/DIX format returns I/O error on dd with split op (LP: #1689946) - blk-mq: NVMe 512B/4K+T10 DIF/DIX format returns I/O error on dd with split op * linux >= 4.2: bonding 802.3ad does not work with 5G, 25G and 50G link speeds (LP: #1697892) - bonding: add 802.3ad support for 100G speeds - bonding: fix 802.3ad aggregator reselection - bonding: add 802.3ad support for 25G speeds - bonding: fix 802.3ad support for 5G and 50G speeds * Xenial update to 4.4.79 stable release (LP: #1707233) - disable new gcc-7.1.1 warnings for now - ir-core: fix gcc-7 warning on bool arithmetic - s5p-jpeg: don't return a random width/height - thermal: cpu_cooling: Avoid accessing potentially freed structures - ath9k: fix tx99 use after free - ath9k: fix tx99 bus error - NFC: fix broken device allocation - NFC: nfcmrvl_uart: add missing tty-device sanity check - NFC: nfcmrvl: do not use
[Group.of.nepali.translators] [Bug 1706132] Re: xfs slab objects (memory) leak when xfs shutdown is called
** Also affects: linux (Ubuntu Xenial)
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of नेपाली
भाषा समायोजकहरुको समूह, which is subscribed to Xenial.
Matching subscriptions: Ubuntu 16.04 Bugs
https://bugs.launchpad.net/bugs/1706132
Title:
xfs slab objects (memory) leak when xfs shutdown is called
Status in linux package in Ubuntu:
Confirmed
Status in linux source package in Xenial:
New
Bug description:
[Impact]
* xfs kernel memory leak in case of xfs shutdown due to i/o errors
* if xfs on iscsi, iscsi disconnection and module unload will case mem leak
[Test Case]
* configure tgtd with 1 lun and make it available through tcp/ip
* configure open-iscsi to map this lun
* make sure node.session.timeo.replacement_timeout = 0 in iscsid.conf
* mount a xfs volume using the lun from tgtd host, run bonnie -d /xfsdir
* in tgtd server, drop iscsi packets and watch client to have i/o errors
* after sometime (depending on timeout) xfs will call shutdown
* make sure the i/o errors led to xfs shutdown (comment #3)
* after shutdown you try to remove xfs module and it will leak
[Regression Potential]
* based on upstream fix
* tested in the same environment
* potential damage to xfs
[Other Info]
Original Description:
This scenario is testing [iscsi <-> scsi <-> disk <-> xfs]
[ 551.125604] sd 2:0:0:1: rejecting I/O to offline device
[ 551.125615] sd 2:0:0:1: rejecting I/O to offline device
[ 551.125627] sd 2:0:0:1: rejecting I/O to offline device
[ 551.125639] sd 2:0:0:1: rejecting I/O to offline device
[ 551.135216] XFS (sda1): metadata I/O error: block 0xeffe01
("xfs_trans_read_buf_map") error 5 numblks 1
[ 551.135274] XFS (sda1): page discard on page ea0002a89cc0, inode 0x83,
offset 6442385408.
# when XFS shuts down because of an error (or offline disk, example):
[ 551.850498] XFS (sda1): xfs_do_force_shutdown(0x2) called from line 1197
of file /build/linux-lts-xenial-roXrYH/linux-lts-xenial-4.4.0/fs/xfs/xfs_log.c.
Return address = 0xc0300388
[ 551.850568] XFS (sda1): Log I/O Error Detected. Shutting down filesystem
[ 551.850618] XFS (sda1): xfs_log_force: error -5 returned.
[ 551.850630] XFS (sda1): Failing async write on buffer block 0x77ff08.
Retrying async write.
[ 551.850634] XFS (sda1): Failing async write on buffer block 0x77ff10.
Retrying async write.
[ 551.850638] XFS (sda1): Failing async write on buffer block 0x77ff01.
Retrying async write.
[ 551.853171] XFS (sda1): Please umount the filesystem and rectify the
problem(s)
[ 551.874131] XFS (sda1): metadata I/O error: block 0x1dffc49
("xlog_iodone") error 5 numblks 64
[ 551.877993] XFS (sda1): xfs_do_force_shutdown(0x2) called from line 1197
of file /build/linux-lts-xenial-roXrYH/linux-lts-xenial-4.4.0/fs/xfs/xfs_log.c.
Return address = 0xc0300388
[ 551.899036] XFS (sda1): xfs_log_force: error -5 returned.
[ 569.323074] XFS (sda1): xfs_log_force: error -5 returned.
[ 599.403085] XFS (sda1): xfs_log_force: error -5 returned.
[ 629.483111] XFS (sda1): xfs_log_force: error -5 returned.
[ 659.563115] XFS (sda1): xfs_log_force: error -5 returned.
[ 689.643014] XFS (sda1): xfs_log_force: error -5 returned.
# when I execute:
# sudo umount /dev/sda1:
[81634.923043] XFS (sda1): xfs_log_force: error -5 returned.
[81640.739097] XFS (sda1): xfs_log_force: error -5 returned.
[81640.739137] XFS (sda1): Unmounting Filesystem
[81640.739463] XFS (sda1): xfs_log_force: error -5 returned.
[81640.739508] XFS (sda1): xfs_log_force: error -5 returned.
[81640.742741] sd 2:0:0:1: rejecting I/O to offline device
[81640.745576] blk_update_request: 25 callbacks suppressed
[81640.745601] blk_update_request: I/O error, dev sda, sector 0
# i was able to umount and then to remove iscsi disk.
# but if i try to unload the xfs module:
inaddy@(trustyiscsicli):~$ sudo rmmod xfs
[82211.059301]
=
[82211.063764] BUG xfs_log_ticket (Tainted: G OE ): Objects
remaining in xfs_log_ticket on kmem_cache_close()
[82211.067450]
-
[82211.067450]
[82211.070580] INFO: Slab 0xea0002eb7640 objects=22 used=1
fp=0x8800badd9f18 flags=0xc00080
[82211.074430] INFO: Object 0x8800badd9228 @offset=552
[82211.076133] kmem_cache_destroy xfs_log_ticket: Slab cache still has objects
AND
[82211.059301]
=
[82211.063764] BUG xfs_log_ticket (Tainted: G OE ): Objects
remaining in xfs_log_ticket on kmem_cache_close()
[82211.067450]
-
[82211.067450]
[82211.070570] Disabling lock debugging
