[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
** Also affects: apt-clone (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/apt-clone/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
** Branch linked: lp:apt-clone -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/apt-clone/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
** Changed in: apt-clone (Ubuntu) Status: New = In Progress ** Changed in: apt-clone (Ubuntu) Assignee: (unassigned) = Brian Murray (brian-murray) ** Changed in: apt-clone (Ubuntu) Importance: Undecided = High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/apt-clone/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
** Changed in: ubuntu-release-upgrader (Ubuntu) Status: Expired = Confirmed ** Changed in: ubuntu-release-upgrader (Ubuntu) Importance: Undecided = High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
[Expired for ubuntu-release-upgrader (Ubuntu) because there has been no activity for 60 days.] ** Changed in: ubuntu-release-upgrader (Ubuntu) Status: Incomplete = Expired -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
With regards to point number 1: 1. First of all, if the updater crashes with a stack trace, a dialog should appear to report the error. Pointing to the log file, which I later found out to be /var/log/dist-upgrade/main.log, would be helpful. I waited several minutes, thinking that it was busy in the background. I would expect the upgrader to present you with a crash dialog and a bug reporting wizard to be launched. Do you have a crash file in /var/crash? It would be named after the binary so something like _usr_bin_update-manager. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
How did you determine that it was the undo file causing the issue? I tried to recreate this with apt-clone (which is used by the release upgrader to save information about the system state) after having made a vim undo file in my /etc/apt/sources.list.d/ folder. Running apt-clone clone I was able to create a clone file and did not receive a crash with the undo file. Do any of your other sources files have unicode in them? Thanks in advance! ** Changed in: ubuntu-release-upgrader (Ubuntu) Status: New = Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
% sudo ls -la /etc/apt/sources.list.d total 28 drwxr-xr-x 2 root root 4096 Nov 24 20:04 . drwxr-xr-x 6 root root 4096 Nov 25 21:09 .. -rw-r--r-- 1 root root 176 Nov 24 20:04 google-chrome.list -rw-r--r-- 1 root root 207 Nov 24 20:03 google-chrome.list~ -rw-r--r-- 1 root root 176 Nov 24 13:59 google-chrome.list.distUpgrade -rw-r--r-- 1 root root 209 Nov 24 19:22 google-chrome.list.save -rw-r--r-- 1 root root 1714 Nov 24 20:04 .google-chrome.list.un~ -rw-r--r-- 1 root root0 Nov 24 19:22 xorg-edgers-ppa-saucy.list -rw-r--r-- 1 root root0 Nov 24 19:22 xorg-edgers-ppa-saucy.list.save In this situation I get the mentioned stack trace. % sudo rm /etc/apt/sources.list.d/.google-chrome.list.un~ Now the stack trace does not happen. QED. The undo file was created by reverting the change caused by upgrading, the Google source line was commented out, using Vim with 'undofile' enabled. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
Thank you for taking the time to report this bug and helping to make Ubuntu better. Please execute the following command, as it will automatically gather debugging information, in a terminal: apport-collect 1254447 When reporting bugs in the future please use apport by using 'ubuntu- bug' and the name of the package affected. You can learn more about this functionality at https://wiki.ubuntu.com/ReportingBugs. ** Changed in: ubuntu-release-upgrader (Ubuntu) Status: New = Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1254447] Re: Upgrade to 13.30 crashes because of hidden file
Fortunately (for reporting the bug), after upgrading to 13.10, trying to upgrade to 14.04 has the same problem: /home/mool 30 % sudo update-manager -d [sudo] password for mool: Checking for a new Ubuntu release authenticate 'trusty.tar.gz' against 'trusty.tar.gz.gpg' extracting 'trusty.tar.gz' Traceback (most recent call last): File /tmp/ubuntu-release-upgrader-qwg0du/trusty, line 10, in module sys.exit(main()) File /tmp/ubuntu-release-upgrader-qwg0du/DistUpgrade/DistUpgradeMain.py, line 240, in main save_system_state(logdir) File /tmp/ubuntu-release-upgrader-qwg0du/DistUpgrade/DistUpgradeMain.py, line 133, in save_system_state scrub_sources=True) File /tmp/ubuntu-release-upgrader-qwg0du/DistUpgrade/apt_clone.py, line 149, in save_state self._write_state_sources_list(tar, scrub_sources) File /tmp/ubuntu-release-upgrader-qwg0du/DistUpgrade/apt_clone.py, line 241, in _write_state_sources_list ./etc/apt/sources.list.d/+source) File /tmp/ubuntu-release-upgrader-qwg0du/DistUpgrade/apt_clone.py, line 246, in _add_file_to_tar_with_password_check for line in f.readlines(): File /usr/lib/python2.7/codecs.py, line 296, in decode (result, consumed) = self._buffer_decode(data, self.errors, final) UnicodeDecodeError: 'utf8' codec can't decode byte 0x9f in position 3: invalid start byte ** Tags added: apport-collected dist-upgrade saucy ** Description changed: Following the normal procedure to upgrade with the update manager doesn't work. No error message, just stops working. Starting it from the command line: sudo update-manager -d Produces a stack trace in the terminal. The error is: UnicodeDecodeError: 'utf8' codec can't decode byte ... This is in function _add_file_to_tar_with_password_check (Sorry, didn't copy the whole stack trace; however you should be able to reproduce it from the instructions below). The cause was a hidden file in /etc/apt/sources.list.d This is a Vim undo file, which has a binary format, thus not utf-8 encoded: .google-chrome.list.un~ 1. First of all, if the updater crashes with a stack trace, a dialog should appear to report the error. Pointing to the log file, which I later found out to be /var/log/dist-upgrade/main.log, would be helpful. I waited several minutes, thinking that it was busy in the background. 2. The update must ignore hidden files. The user may edit files with Vim, which may leave hidden undo files behind. A better solution is to only use files that are known to be relevant, not blindly processing every random file. - 3. If the update fails to read a file there should be an option to - ignore the error and continue. Listing the file name and/or contents - should give the user a hint about what he is skipping. This is the only - way the upgrade can continue from a damaged system without the user - manually hunting around for problems and guessing how to fix them. + 3. If the update fails to read a file there should be an option to ignore the error and continue. Listing the file name and/or contents should give the user a hint about what he is skipping. This is the only way the upgrade can continue from a damaged system without the user manually hunting around for problems and guessing how to fix them. + --- + ApportVersion: 2.12.5-0ubuntu2.1 + Architecture: i386 + CrashDB: ubuntu + DistroRelease: Ubuntu 13.10 + InstallationDate: Installed on 2012-11-18 (371 days ago) + InstallationMedia: Ubuntu 12.10 Quantal Quetzal - Release i386 (20121017.2) + MarkForUpload: True + NonfreeKernelModules: nvidia + Package: ubuntu-release-upgrader (not installed) + ProcVersionSignature: Ubuntu 3.11.0-13.20-generic 3.11.6 + Tags: saucy dist-upgrade + Uname: Linux 3.11.0-13-generic i686 + UpgradeStatus: Upgraded to saucy on 2013-11-24 (0 days ago) + UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo + VarLogDistupgradeAptclonesystemstate.tar.gz: Error: command ['pkexec', 'cat', '/var/log/dist-upgrade/apt-clone_system_state.tar.gz'] failed with exit code 126: Error executing command as another user: Request dismissed + VarLogDistupgradeTermlog: -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1254447 Title: Upgrade to 13.30 crashes because of hidden file To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1254447/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs