[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
With realtime access enabled via Ubuntu Pro (either via `sudo pro enable realtime-kernel` or `sudo pro enable realtime-kernel --access-only`), you can run the following command to download the source: sudo apt-get source --only-source linux-realtime -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
Fair point. Where can I find the source? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
> Normally I'd help debug this further, but I don't know how to get access to the RT kernel source. You should ask for it, it'd be interesting to see what happens... Canonical has to provide it or they're violating he GPL (I think). Maybe file a bug here https://launchpad.net/ubuntu-realtime -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
Given it's a case of adding debug into the calling paths of aafs_create() and into aafs_create to see why the ptr is null I don't think finding reproducers is necessary the fast path to solving this. I suspect this is a race condition hence it's not easily reproducible in some configurations. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
I disassembled the offending code, the error is in the following code: r13 is zero so the mov 0x40 is accessing data from the NULL ptr in r13 8172898f: 4d 8b 55 40 mov0x40(%r13),%r10 < here 81728993: 4d 8d ba c0 00 00 00lea0xc0(%r10),%r15 8172899a: 4c 89 55 c0 mov%r10,-0x40(%rbp) 8172899e: 4c 89 ffmov%r15,%rdi 817289a1: e8 6a d3 af 00 call 0x82225d10 <--- down_write() So looking at aafs_create() in security/apparmor/apparmorfs.c I'm presuming the dir from d_inode(parent) is null and this is tripping this issue. Would be good to get John the apparmor maintainer to look at this. Normally I'd help debug this further, but I don't know how to get access to the RT kernel source. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
To be clear, so far I've only been able to get the following hardware configurations to fail reliably: - QEMU VM amd64, linux-realtime 6.8.1-1002-realtime - QEMU VM amd64, linux (generic) 6.8.0-35-generic I once got each of the following to fail, but haven't been able to reproduce it consistently: - QEMU arm64, linux-realtime 6.8.1-1002-realtime - QEMU arm64, linux (generic) 6.8.0-35-generic I haven't been able to get these combinations to fail: - bare metal amd64, linux-realtime 6.8.1-1002-realtime - LXD VM (multipass) amd64, linux-realtime 6.8.1-1002-realtime -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
Hi Colin, I've been able to reproduce this issue in QEMU VMs on amd64 consistently and I got it to happen once in arm64, however, I haven't been able to reproduce the kernel oops again. I can't get it to happen on bare metal or in an LXD VM (multipass). I've also found that this doesn't just happen on realtime, at least on amd64. I was able to reliably reproduce it in QEMU on amd64 without realtime. I'll add that to this bug ticket and let the relevant people know. We'll continue investigating this. ** Also affects: linux (Ubuntu) Importance: Undecided Status: New ** Also affects: linux (Ubuntu Noble) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
** Package changed: linux (Ubuntu) => linux-realtime (Ubuntu) ** Package changed: linux-realtime (Ubuntu) => ubuntu-realtime ** Changed in: ubuntu-realtime Importance: Medium => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-realtime/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
Same issue on ARM64 with 6.8.1-1002-realtime too: stress-ng: error: [4568] klog-check: alert: [445.413206] 'Unable to handle kernel access to user memory outside uaccess routines at virtual address 0040' stress-ng: error: [4568] klog-check: alert: [445.413235] 'Mem abort info:' stress-ng: error: [4568] klog-check: alert: [445.413239] ' ESR = 0x9604' stress-ng: error: [4568] klog-check: alert: [445.413244] ' EC = 0x25: DABT (current EL), IL = 32 bits' stress-ng: error: [4568] klog-check: alert: [445.413251] ' SET = 0, FnV = 0' stress-ng: error: [4568] klog-check: alert: [445.413256] ' EA = 0, S1PTW = 0' stress-ng: error: [4568] klog-check: alert: [445.413260] ' FSC = 0x04: level 0 translation fault' stress-ng: error: [4568] klog-check: alert: [445.413265] 'Data abort info:' stress-ng: error: [4568] klog-check: alert: [445.413268] ' ISV = 0, ISS = 0x0004, ISS2 = 0x' stress-ng: error: [4568] klog-check: alert: [445.413273] ' CM = 0, WnR = 0, TnD = 0, TagAccess = 0' stress-ng: error: [4568] klog-check: alert: [445.413279] ' GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0' stress-ng: error: [4568] klog-check: alert: [445.413286] 'user pgtable: 4k pages, 48-bit VAs, pgdp=000128037000' stress-ng: error: [4568] klog-check: alert: [445.413295] '[0040] pgd=, p4d=' stress-ng: error: [4568] klog-check: emergency: [445.413316] 'Internal error: Oops: 9604 [#1] PREEMPT_RT SMP' stress-ng: info: [4568] klog-check: warning: [445.413385] 'Modules linked in: nhpoly1305_neon nhpoly1305 libpoly1305 michael_mic md4 streebog_generic rmd160 crc32_generic cmac algif_rng twofish_generic twofish_common serpent_generic fcrypt cast6_generic cast5_generic cast_common camellia_generic blowfish_generic blowfish_common aes_arm64 algif_skcipher algif_hash aria_generic sm4_generic sm4_neon ccm aes_ce_ccm des_generic libdes authenc aegis128 algif_aead af_alg tls qrtr cfg80211 binfmt_misc nls_iso8859_1 dm_multipath efi_pstore nfnetlink dmi_sysfs qemu_fw_cfg ip_tables x_tables autofs4 btrfs blake2b_generic raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor xor_neon raid6_pq libcrc32c raid1 raid0 crct10dif_ce polyval_ce polyval_generic ghash_ce sm4 sha2_ce sha256_arm64 sha1_ce arm_smccc_trng virtio_rng xhci_pci xhci_pci_renesas aes_neon_bs aes_neon_blk aes_ce_blk aes_ce_cipher' stress-ng: info: [4568] klog-check: warning: [445.413741] 'CPU: 18 PID: Comm: stress-ng-appar Not tainted 6.8.1-1002-realtime #2-Ubuntu' stress-ng: info: [4568] klog-check: warning: [445.413759] 'Hardware name: QEMU KVM Virtual Machine, BIOS 2023.05-2ubuntu0.1 02/12/2024' stress-ng: info: [4568] klog-check: warning: [445.413767] 'pstate: 6045 (nZCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)' stress-ng: info: [4568] klog-check: warning: [445.413778] 'pc : aafs_create.constprop.0+0xc0/0x170' stress-ng: info: [4568] klog-check: warning: [445.413802] 'lr : aafs_create.constprop.0+0x70/0x170' stress-ng: info: [4568] klog-check: warning: [445.413811] 'sp : 800085513b10' stress-ng: info: [4568] klog-check: warning: [445.413815] 'x29: 800085513b10 x28: 14ec8bf7967c x27: ' stress-ng: info: [4568] klog-check: warning: [445.413831] 'x26: x25: 14ec804e1600 x24: ' stress-ng: info: [4568] klog-check: warning: [445.413846] 'x23: x22: x21: 41ed' stress-ng: info: [4568] klog-check: warning: [445.413860] 'x20: a043069917f8 x19: a04304f2bb98 x18: 8000840f5068' stress-ng: info: [4568] klog-check: warning: [445.413876] 'x17: x16: x15: ' stress-ng: info: [4568] klog-check: warning: [445.413890] 'x14: 0001 x13: 67652d6f69647561 x12: ' stress-ng: info: [4568] klog-check: warning: [445.413905] 'x11: x10: 8478 x9 : a04303752a9c' stress-ng: info: [4568] klog-check: warning: [445.413919] 'x8 : 8000855139c8 x7 : x6 : a04306597118' stress-ng: info: [4568] klog-check: warning: [445.413934] 'x5 : x4 : x3 : ' stress-ng: info: [4568] klog-check: warning: [445.413947] 'x2 : x1 : x0 : ' stress-ng: info: [4568] klog-check: warning: [445.413962] 'Call trace:' stress-ng: info: [4568] klog-check: warning: [445.413967] ' aafs_create.constprop.0+0xc0/0x170' stress-ng: info: [4568] klog-check: warning: [445.413977] ' __aafs_profile_mkdir+0x3a4/0x4a0' stress-ng: info: [4568] klog-check: warning: [445.413988] ' aa_replace_profiles+0x4ec/0x12c8' stress-ng: info: [4568] klog-check: warning: [445.414003] ' policy_update+0xfc/0x1c0' stress-ng: info: [4568] klog-check: warning: [445.414012] ' profile_replace+0x110/0x200' stress-ng: info: [4568] klog-check: warning:
[Bug 2068602] Re: kernel oops in aafs_create in 6.8.1-1002-realtime kernel
** Summary changed: - kernel oops in aafs_create in 6.8.1-1002-realtime + kernel oops in aafs_create in 6.8.1-1002-realtime kernel -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2068602 Title: kernel oops in aafs_create in 6.8.1-1002-realtime kernel To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2068602/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
