[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Agreeing to Michaels suggestion. Marking LP 1905412 as affecting the Power project. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Oh so the last crash with LVM was this silly thing: https://bugs.launchpad.net/subiquity/+bug/1905412. I really need to fix this. I think given that this bug report has fixed two real problems and has resulted in a successful install without LVM, I'm going to close it and any new problems can be handed in a new report. Feel free to reopen if you disagree :) Also, thanks for all your testing with this system, it's definitely made the installer better! ** Changed in: ubuntu-power-systems Status: In Progress => Fix Released ** Changed in: subiquity Status: In Progress => Fix Released ** Changed in: multipath-tools (Ubuntu) Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
thank you for that. i am tempted to close out the multipath package task; and open an lvm package task. i'm not sure if we allow reusing existing lvms, if we do, that would be also an intersting datapoint test case. normally lvm commands do create udev cookies, and trigger udev to settle with a timeout. I do wonder, if curtin should be doing something more clever here. Like lookaside at all the prober data and try to disable that behaviour and instead do udev triggers / waiting by itself possibly with larger timeouts. or if we can somehow "speed things up" by deactivating all the multipaths and all the "unused" drives not selected for the installation. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
The crash file is interesting, it seems that we have many many udev timeouts getting stuck for more than 120s. I'm now not sure if these are timeouts in lvm calls of udev. or somewhere else. It would be interesting to see if one can complete the install without lvm, with just ext4. Also not sure how to make this more resilient. Cause clearly things are not broken, it's just there is a lot of things to do. Hence timeouts are getting in the way, rather than being helpful. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Thanks again Thierry, there's a new subiquity version available. Please, could you try with Hirsute/21.04 - This URL: `http://cdimage.ubuntu.com/ubuntu-server/daily-live/current/hirsute-live-server-ppc64el.iso` and you do not need to add `subiquity-channel=...` on kernel command line. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
This bug is believed to be fixed in curtin in version 21.2. If this is still a problem for you, please make a comment and set the state back to New Thank you. ** Changed in: curtin Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Yes, it should be subiquity-channel=edge/mwhudson-hack on the kernel command line -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Hi Thierry thanks again for testing this, >From your crash files, I noticed you're using an image built on October >-2020-10-22 14:33 >(url=http://cdimage.ubuntu.com/releases/20.10/release/ubuntu-20.10-live-server-ppc64el.iso) > and also subiquity is an old version: ` 2021-01-26 08:10:48,735 INFO subiquity:135 Starting Subiquity revision 2101 ` ``` SnapRevision: 2101 SnapUpdated: False SnapVersion: 20.09.1+git1.67496d12 SourcePackage: subiquity ``` so, I'm going to ask you for trying again following these steps, please: https://people.canonical.com/~patriciasd/ppc64le/power_subiquityJAN26 with this latest 20.10 URL: http://cdimage.ubuntu.com/ubuntu-server /daily-live/20210126/hirsute-live-server-ppc64el.iso For my own reference I've tested it on P9 witherspoon (bobone). Let me know if you have any questions. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
It looks like the snap didn't get updated to the version from edge /mwhudson-hack for that run? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
** Attachment added: "1611663228.337142229.install_fail.meta" https://bugs.launchpad.net/ubuntu-power-systems/+bug/1878041/+attachment/5457019/+files/1611663228.337142229.install_fail.meta -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
unfortunately same behaviour ** Attachment added: "1611663228.337142229.install_fail.crash" https://bugs.launchpad.net/ubuntu-power-systems/+bug/1878041/+attachment/5457018/+files/1611663228.337142229.install_fail.crash -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Hm that's failing in the same sort of way. I've just pushed a new version (0+git.5ef5b352) to edge/mwhudson-hack, can you try that? Hopefully that will work better, or at least have more informative logs. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
When I reach the FILE SYSTEM SUMMARY panel and say 'continue' I get the 'an error occured during installation' message within a minute. I was running the parameters : snap refresh subiquity --channel=edge/mwhudson-hack I didn't apply to update to the new version of the installer as I believe it would override the previous parameter. I wait for 5mn at FILE SYSTEM SUMMARY and nothing happen, so it sound slike it is when I validate the problem occures. Attached you'll find content of crash. ** Attachment added: "1611649013.477067232.install_fail.meta" https://bugs.launchpad.net/ubuntu-power-systems/+bug/1878041/+attachment/5456961/+files/1611649013.477067232.install_fail.meta -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
** Attachment added: "1611649013.477067232.install_fail.crash" https://bugs.launchpad.net/ubuntu-power-systems/+bug/1878041/+attachment/5456962/+files/1611649013.477067232.install_fail.crash -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
This bug is fixed with commit ea15dfa9 to curtin on branch master. To view that commit see the following URL: https://git.launchpad.net/curtin/commit/?id=ea15dfa9 ** Changed in: curtin Status: Incomplete => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
** Merge proposal linked: https://code.launchpad.net/~mwhudson/curtin/+git/curtin/+merge/396703 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Actually lets try something simple, can you try suiquity-channel=edge /mwhudson-hack when this build finishes (probably in about 20 minutes, but I'm going to bed): https://launchpad.net/~mwhudson/+snap/subiquity- hack/+build/1267203 Also I'm glad to hear today's hirsute daily works! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Thanks for that. The failure is different now (which suggests my changes have helped): Running command ['sgdisk', '--new', '2:18432:2424585727', '--typecode=2:8300', '/dev/mapper/mpathr'] with allowed return codes [0] (capture=True) An error occured handling 'partition-1': ProcessExecutionError - Unexpected error while running command. Command: ['sgdisk', '--new', '2:18432:2424585727', '--typecode=2:8300', '/dev/mapper/mpathr'] Exit code: 4 Reason: - Stdout: '' Stderr: Could not create partition 2 from 18432 to 2424585727 Could not change partition 2's type code to 8300! Error encountered; not saving changes. I think curtin has some bugs with multipath disks where the block size is 4096. The end of the attempted partition in bytes is 2424585727*4096 = 9931103137792, larger than the reported size of the disk, 9931038130176. The first call to sgdisk was ['sgdisk', '--new', '1:256:2303', '--typecode=1:4100', '/dev/mapper/mpathr'] So simply based on this, I would expect the start sector of the second partition to be 2304, not 18432. Chasing code a bit, I think the function calc_dm_partition_info (https://git.launchpad.net/curtin/tree/curtin/commands/block_meta.py#n666) is doing something wrong wrt sector sizes but it's too late at night for me to really even try to see what. Back tomorrow with a fresher brain. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Hi, can you try again with suiquity-channel=edge/lp1878041 please? If it fails, and it's possible, can you attach the .crash file here? Error reports to the tracker get truncated in ways that make them a bit less useful for this sort of thing (it is also hard to find a specific report). The initramfs failure sounds worrying, can you file a separate bug about that? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
** Merge proposal linked: https://code.launchpad.net/~mwhudson/curtin/+git/curtin/+merge/396538 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Tried to boot hirsute dated of 01/14 - it failed to initramfs Booted with 20.10 suiquity-channel=edge - and it failed again - sent to canonical the failure using the installer -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
Looking at this a bit more carefully, I think we can remove the call that is failing and replace it with some udev checking instead. I'm actually a bit surprised it fails -- a very similar call was made by probert earlier in the run and that seems to have worked fine (although I can't . I wonder if it is conflicting over the multipathd lock with multipath calls made by udev in response to device changes or something like that. Do you still have access to this system for testing? I can probably make a snap for testing with tomorrow. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1878041] Re: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths
** Also affects: multipath-tools (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1878041 Title: installation fails creating user on large multipath system - multipathd show command times out in curtin log with 163 paths To manage notifications about this bug go to: https://bugs.launchpad.net/curtin/+bug/1878041/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
