[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
** Changed in: unattended-upgrades (Ubuntu) Status: New => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
@chris.sanders: Since this happended on 2019-04-24 I assume the system still had u-u 0.90ubuntu0.10 installed. In that case it may have hit LP: #1803749. If this is the case, the latest versions in all releases are fixed now. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
requested logging during the month of the error ** Attachment added: "unattended-upgrades.log.1" https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+attachment/5261355/+files/unattended-upgrades.log.1 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
dpk logging from the same time period ** Attachment added: "unattended-upgrades-dpkg.log.1" https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+attachment/5261356/+files/unattended-upgrades-dpkg.log.1 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
@rbalint I've included the logs but I don't see any Traces as mentioned in LP: #1824341 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
@vorlon: Yes, but there is (was) a bug where u-u removes auto removable but not newly auto removable packages when an upgrade step fails and leaves a dirty cache behind: LP: #1824341 . The fix is scheduled to be released for Xenial next week. @chris.sanders: To confirm that this happened please attach the relevant part of: /var/log/unattended-upgrades/unattended-upgrades.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
Balint, can you comment here on the unattended-upgrades autoremoval behavior? I think the intended behavior is only to remove packages that have newly become unused as part of an upgrade, is that correct? ** Also affects: unattended-upgrades (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
** Changed in: maas (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
After having a look at all the provided logs, I see the following: 1. On dpkg.log I see that packages where installed and removed: - on 2019-04-19, non-maas related packages were configured (likely upgraded) - on 2019-04-24, maas related packages were marked for removal, and removed, e.g: 2019-04-24 06:02:09 startup packages remove 2019-04-24 06:02:09 status installed maas-region-controller:all 2.3.0-6434-gd354690-0ubuntu1~16.04.1 2019-04-24 06:02:11 remove maas-region-controller:all 2.3.0-6434-gd354690-0ubuntu1~16.04.1 2. On term.log, I see the counterparts of the above, were: - on 2019-04-19 packages were upgraded and MAAS wasn't removed - on 2019-04-24 I see that MAAS packages were removed, but nothing was upgraded nor updated. 3. On history.log, I confirm what I see the above, which is that: - on 2019-04-19 packages were ntfs-3g:amd64 was upgraded, and nothing removed automatically. - on 2019-04-24 MAAS related packages were removed. >From looking at the above, nothing really tells me what could be wrong and why MAAS packages were removed. However, the one thing to notice here is that MAAS 2.3.0-6434-gd354690 was the one removed. The interesting part, is the following: 4. From looking at install.log things turn interesting. This is because what's installed is MAAS 2.3.5-6511-gf466fdb-0ubuntu1. So, from looking at all of the above I can conclude that: a. There's not enough information why MAAS got removed. b. The installed MAAS version on the system was *2.3.0-6434-gd354690* while the version available in -updates was *2.3.5-6511-gf466fdb-0ubuntu1*. This to me means that unattended upgrades never really upgraded the MAAS version with the latest in -updates (e.g. it seems this MAAS could've been installed when 2.3.0 was in -updates). c. More interestingly, is that: - In previous unattended upgrades, no MAAS packages were removed, so why in the latest? - When MAAS was removed, no other packages were installed, which if there were to have been a conflict that would have caused MAAS to be removed, I would have expected a dependency would have conflicted and installed instead, which would have caused the upgrade? Unless unattended upgrades simply managed to remove while not upgrade a given dep? - When MAAS was manually installed, the installation happened just fine without really any issues, so if there would've been dependency issues, I would have expected the install to complain. So from the above, it would seem that someone or something marked the MAAS package for removal, and doesn't seem related to a dependency because we can see no dep issues, or new deps installed which would've caused this. That said, I'm not certain how unattended upgrades works internally so not sure why it never did upgrade the MAAS version in previous upgrades, and why it removed it in the latest. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
Also, the big questions would be: 1. Why was MAAS never previously been upgraded if 2.3.5 (from 2.3.0) has been in the archive forever. Or why this issue was never seen before if the same applies. 2. There are no reported broken packages, or newly installed packages when MAAS was removed, nor removed packages when MAAS was manually installed later on. So would it be possible the package was marked for removal by something else? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
** Changed in: maas (Ubuntu) Status: Incomplete => New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
I've reinstalled with: sudo apt install maas -o debug::pkgproblemresolver=true 2>&1 | tee install.log As the attached log shows there were no errors, clean install. After following the restore and restarting the services juju returned the following error: ERROR opening environment: unexpected: ServerError: 409 Conflict (http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";> http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> Error: Conflict Error Conflict error. Try your request again, as it will most likely succeed. ) Restarting the machine has restored normal operation. ** Attachment added: "install.log" https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+attachment/5260208/+files/install.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
That's all relevant logs I could think of, when I am able to do a reinstall I'll include the above recommended debug option as well. If there's something I didn't think of let me know and I'll provide that as well. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
attached apt history.log ** Attachment added: "history.log" https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+attachment/5260156/+files/history.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
Attached dpkg.log ** Attachment added: "dpkg.log" https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+attachment/5260154/+files/dpkg.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
attached apt term.log ** Attachment added: "term.log" https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+attachment/5260155/+files/term.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
adding '-o debug::pkgproblemresolver=true' to apt commands may help here; e.g. if you try to reinstall maas. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1826916] Re: MAAS uninstalls itself on unattended upgrade
Hi Chris, Please provide more context on this. We specifically need logs on what apt commands were executed, how, and the full process log of the terminal (e.g. we wanna see what apt has done). That said, we've never seen anything like this before. TO recover, you should just be able to stop all maas server, apply your db backup, restart maas services and should be good to go. ** Changed in: maas (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1826916 Title: MAAS uninstalls itself on unattended upgrade To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1826916/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs