[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Changed in: grub2 (Ubuntu Bionic) Status: New => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Merge proposal linked: https://code.launchpad.net/~beidl/grub/+git/ubuntu/+merge/409919 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Merge proposal linked: https://code.launchpad.net/~juliank/grub/+git/bionic/+merge/409352 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Also affects: grub2 (Ubuntu Bionic) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
This bug was fixed in the package grub2 - 2.04-1ubuntu26.13 --- grub2 (2.04-1ubuntu26.13) focal; urgency=medium [ Julian Andres Klode ] * unapply all patches, use gbp pq instead of git-dpm [ Dimitri John Ledkov ] * 10_linux: emit messages when initrdless boot is configured, attempted and fails triggering fallback. LP: #1901553 * grub-common.service: port init.d script to systemd unit. Add warning message, when initrdless boot fails triggering fallback. LP: #1901553 * debian/grub-common.service: change type to oneshot, add wantedby sleep.target, after sleep.target. The service will now start after resume from hybernation. (LP: #1929860) * grub-initrd-fallback.service: add wantedby sleep.target, after sleep.target. The service will now start after resume from hybernation. LP: #1929860 * grub-initrd-fallback.service, debian/grub-common.service: only start units when booted with grub. Use presence of /boot/grub/grub.cfg as proxy. LP: #1925507 -- Julian Andres Klode Thu, 12 Aug 2021 11:18:25 +0200 ** Changed in: grub2 (Ubuntu Focal) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
Adding verification-done as this does fix the problem in nearly all testing. I think there is a corner case or something specific to the testing which is causing these outliers. ** Tags removed: verification-needed-focal ** Tags added: verification-done-focal -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
I also tested this update on an Intel NUC and I was able to reboot w/o any issues. bdmurray@atom:~$ cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=20.04 DISTRIB_CODENAME=focal DISTRIB_DESCRIPTION="Ubuntu 20.04.2 LTS" bdmurray@atom:~$ uname -a Linux atom 5.4.0-81-generic #91-Ubuntu SMP Thu Jul 15 19:09:17 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux bdmurray@atom:~$ dpkg -l | grep ii.*grub ii grub-common 2.04-1ubuntu26.13 amd64GRand Unified Bootloader (common files) ii grub-efi-amd642.04-1ubuntu44.2 amd64GRand Unified Bootloader, version 2 (EFI-AMD64 version) ii grub-efi-amd64-bin2.04-1ubuntu44.2 amd64GRand Unified Bootloader, version 2 (EFI-AMD64 modules) ii grub-efi-amd64-signed 1.167.2+2.04-1ubuntu44.2 amd64GRand Unified Bootloader, version 2 (EFI-AMD64 version, signed) ii grub2-common 2.04-1ubuntu26.13 amd64GRand Unified Bootloader (common files for version 2) ii ubuntu-recovery-grub-hotkey 1.1columbia1 all Ubuntu Recovery Grub Hotkey Configuration -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
I tested the grub2 update on a virtual machine and was able to reboot and login without any issues. bdmurray@clean-focal-amd64:~$ dpkg -l | grep ii.*grub ii grub-common2.04-1ubuntu26.13 amd64GRand Unified Bootloader (common files) ii grub-gfxpayload-lists 0.7 amd64GRUB gfxpayload blacklist ii grub-pc2.04-1ubuntu26.13 amd64GRand Unified Bootloader, version 2 (PC/BI OS version) ii grub-pc-bin2.04-1ubuntu26.13 amd64GRand Unified Bootloader, version 2 (PC/BI OS modules) ii grub2-common 2.04-1ubuntu26.13 amd64GRand Unified Bootloader (common files for version 2) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
@sil2100 Following up on our chat conversation. I actually thing this grub2 package update could be released. It is greatly improving the situation and I think is doing the right thing. But I think there may be other external factors in play that may result in these corner cases. I can give a verification done. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
Thank you Francis for checking up on this! In this case we'll probably not block on this re: our usual 20.04.3. Would that be fine if this gets fixed after the regular flavors of 20.04.3 are released? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
@juliank This does not appear to be a complete fix for the issue seen on AWS t2.nano. I see failures in about 5 - 10% of cases. There are two different symptoms: * grub-initrd-fallback.service sometimes runs right before the system hibernates (it runs after the hibernation request was sent to the VM and before it and before it fully hibernates). * grub-initrd-fallback.service sometimes runs after resume, but checking the status of `initrdfail` a few minutes later indicates it is still set (not sure if it was ever cleared). Both of these were determined by checking the last active timestamp reported by 'systemctl status grub-initrd-fallback.service' and comparing this with timestamps generated by the hibernation test. If either situation occurs, the next hibernation/resume will fail. I'm trying to collect more information. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
Hello Francis, or anyone else affected, Accepted grub2 into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/grub2/2.04-1ubuntu26.13 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed- focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification- failed-focal. In either case, without details of your testing we will not be able to proceed. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping! N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days. ** Changed in: grub2 (Ubuntu Focal) Status: Triaged => Fix Committed ** Tags added: verification-needed verification-needed-focal -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Description changed: - Ubuntu Focal (and new releases) on AWS will normally boot without an - initrd image (just the microcode.cpio). There is a fallback mechanism to - reboot with the full initrd image when the boot fails to complete. The - grub environment variable "initrdfail" is used to track when a boot - failed and switch between the optimized initrd-less boot path and the - full initrd path. + [Impact] + Ubuntu Focal (and new releases) on AWS will normally boot without an initrd image (just the microcode.cpio). There is a fallback mechanism to reboot with the full initrd image when the boot fails to complete. The grub environment variable "initrdfail" is used to track when a boot failed and switch between the optimized initrd-less boot path and the full initrd path. On a normal successful boot, the "initrdfail" variable is cleared by grub-initrd-fallback.service. However, this doesn't happen when resuming from hibernation. As a result, the initrd fallback will get triggered on the second hibernation / resume cycle despite the original boot using only the microcode.cpio. This switch in initrd images leads to the second resume hanging. We've been able to successfully avoid this issue by adding the following to the ec2-hibinit-agent resume handler: /usr/bin/grub-editenv - unset initrdfail /usr/bin/grub-editenv - unset recordfail (Note: clearing recordfail may not be necessary, will need to try again without it.) This bug was filed against grub2 as it appears to own initrdfail. + + [Test plan] + TBD w/ CPC + + [Regression potential] + Services get changed to oneshot, and wantedby=multi-user sleep; maybe we miss other places it should run, or record the wrong thing on resume? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Merge proposal linked: https://code.launchpad.net/~ubuntu-core-dev/grub/+git/ubuntu/+merge/407003 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Changed in: grub2 (Ubuntu Focal) Milestone: None => ubuntu-20.04.3 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Also affects: grub2 (Ubuntu Focal) Importance: Undecided Status: New ** Changed in: grub2 (Ubuntu Focal) Status: New => Triaged -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
This bug was fixed in the package grub2 - 2.04-1ubuntu46 --- grub2 (2.04-1ubuntu46) impish; urgency=medium * debian/grub-common.service: change type to oneshot, add wantedby sleep.target, after sleep.target. The service will now start after resume from hybernation. LP: #1929860 * grub-initrd-fallback.service: add wantedby sleep.target, after sleep.target. The service will now start after resume from hybernation. LP: #1929860 * cherrypick upstream fix to make armhf efi boot work. LP: #1788940 * debian/rules: disable LTO. LP: #1922005 * grub-initrd-fallback.service, debian/grub-common.service: only start units when booted with grub. Use presence of /boot/grub/grub.cfg as proxy. LP: #1925507 * tests: patch qemu command to use ide-hd instead of the removed ide-drive. -- Dimitri John Ledkov Fri, 16 Jul 2021 14:01:31 +0100 ** Changed in: grub2 (Ubuntu) Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Merge proposal linked: https://code.launchpad.net/~xnox/grub/+git/grub/+merge/405806 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Changed in: grub2 (Ubuntu) Status: New => In Progress ** Changed in: grub2 (Ubuntu) Importance: Undecided => Critical -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Tags added: fr-1421 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1929860] Re: initrdfail can result in resuming with different initrd images and hanging resume
** Tags added: rls-ii-incomings -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1929860 Title: initrdfail can result in resuming with different initrd images and hanging resume To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1929860/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
