[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
*** This bug is a duplicate of bug 1770929 *** https://bugs.launchpad.net/bugs/1770929 Seeing it on Ubuntu 18.04.3 LTS De ja Dup: 37.0 backups fail Traceback (innermost last): File "/usr/bin/duplicity", line 1555, in with_tempdir(main) File "/usr/bin/duplicity", line 1541, in with_tempdir fn() File "/usr/bin/duplicity", line 1393, in main do_backup(action) File "/usr/bin/duplicity", line 1511, in do_backup full_backup(col_stats) File "/usr/bin/duplicity", line 572, in full_backup globals.backend) File "/usr/bin/duplicity", line 454, in write_multivol (tdp, dest_filename, vol_num))) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 146, in schedule_task return self.__run_synchronously(fn, params) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 172, in __run_synchronously ret = fn(*params) File "/usr/bin/duplicity", line 453, in vol_num: put(tdp, dest_filename, vol_num), File "/usr/bin/duplicity", line 342, in put backend.put(tdp, dest_filename) File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 395, in inner_retry % (n, e.__class__.__name__, util.uexc(e))) File "/usr/lib/python2.7/dist-packages/duplicity/util.py", line 79, in uexc return ufn(unicode(e).encode('utf-8')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 37: ordinal not in range(128) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
*** This bug is a duplicate of bug 1770929 *** https://bugs.launchpad.net/bugs/1770929 ** This bug has been marked a duplicate of bug 1770929 backup fails on ubuntu 18.4 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
Okay so this explains everything: in my case the fault was not about special characters in files or filenames but of error messages. I executed Deja Dup / Duplicity in a localized environment and got an error. If the *error message* contains special characters the response in the view won't show the real message at all. Instead the error message will cause the encoding exception. In my case it was: […] DUPLICITY: . File "/usr/lib/python2.7/dist-packages/duplicity/backends/giobackend.py", line 124, in __copy_file DUPLICITY: . None, self.__copy_progress, None) DUPLICITY: . Error: g-io-error-quark: Fehler beim Senden von Daten: Datenübergabe unterbrochen (broken pipe) (44) DUPLICITY: . […] So it seems that the error could be everything. As long as it contains special characters it will lead to the encoding issue. In my case switching the locale showed the real cause in the GUI. I hope this information helps someone else too. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
This bug is rather https://bugs.launchpad.net/duplicity/+bug/1386373 — right? As it seems that there's a fix in Fedora somewhere[1]: is there any chance to get this upstream fix on Ubuntu 18.04 LTS as well? I mean, I would love to have a working backup solution again. ;) Also the error message seems to be caused by totally different problems!? 1. a read encoding issue: https://bugs.launchpad.net/duplicity/+bug/1386373 (because the suggested fix seem to work for Eugene) 2. readonly mount https://bugs.launchpad.net/deja-dup/+bug/1769891#yui_3_10_3_1_1545160806792_1239 and https://bugs.launchpad.net/deja-dup/+bug/1741769 So I guess the error message in general is or was very misleading!? [1] Should the patch be visible on https://bugzilla.redhat.com/show_bug.cgi?id=1470873 ? I can't see it!? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
** Changed in: deja-dup (Fedora) Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
OK, update on the above. Taking google drive ocamlfuse out of the mix solved the problem. I am now backing up locally and syncing the backup with Insync. Two backups have run without incident. I haven't tried a restore yet but all looks good so far. Looking at this with some of the other posts above concerning permissions issues, etc. it sounds like the error message above is non-specific and gets thrown when there are access and perhaps other issues. In my case I think it was due to ocamlfuse trying to catch up after moving a bunch of backup files. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
As others have noted. I get this trying to backup to Google Drive mounted with gdrive ocamlfuse. Several times now the backup has proceeded normally creating 100+ tar diffs then crashes with the below. - Ubuntu 18.04 Kernel 4.15.0-39-generic - duplicity 0.7.17 Traceback (innermost last): File "/usr/bin/duplicity", line 1555, in with_tempdir(main) File "/usr/bin/duplicity", line 1541, in with_tempdir fn() File "/usr/bin/duplicity", line 1393, in main do_backup(action) File "/usr/bin/duplicity", line 1511, in do_backup full_backup(col_stats) File "/usr/bin/duplicity", line 572, in full_backup globals.backend) File "/usr/bin/duplicity", line 454, in write_multivol (tdp, dest_filename, vol_num))) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 146, in schedule_task return self.__run_synchronously(fn, params) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 172, in __run_synchronously ret = fn(*params) File "/usr/bin/duplicity", line 453, in vol_num: put(tdp, dest_filename, vol_num), File "/usr/bin/duplicity", line 342, in put backend.put(tdp, dest_filename) File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 395, in inner_retry % (n, e.__class__.__name__, util.uexc(e))) File "/usr/lib/python2.7/dist-packages/duplicity/util.py", line 79, in uexc return ufn(unicode(e).encode('utf-8')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 37: ordinal not in range(128) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
Same exact error in: * Ubuntu 18.04 kernel 4.15.0-38-generic * duplicity 0.7.17 Traceback (innermost last): File "/usr/bin/duplicity", line 1555, in with_tempdir(main) File "/usr/bin/duplicity", line 1541, in with_tempdir fn() File "/usr/bin/duplicity", line 1393, in main do_backup(action) File "/usr/bin/duplicity", line 1523, in do_backup incremental_backup(sig_chain) File "/usr/bin/duplicity", line 668, in incremental_backup globals.backend) File "/usr/bin/duplicity", line 454, in write_multivol (tdp, dest_filename, vol_num))) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 146, in schedule_task return self.__run_synchronously(fn, params) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 172, in __run_synchronously ret = fn(*params) File "/usr/bin/duplicity", line 453, in vol_num: put(tdp, dest_filename, vol_num), File "/usr/bin/duplicity", line 342, in put backend.put(tdp, dest_filename) File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 395, in inner_retry % (n, e.__class__.__name__, util.uexc(e))) File "/usr/lib/python2.7/dist-packages/duplicity/util.py", line 79, in uexc return ufn(unicode(e).encode('utf-8')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 42: ordinal not in range(128) It could be great if the error message could include the file path that induced the decodification error. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
Traceback (innermost last): File "/usr/bin/duplicity", line 1555, in with_tempdir(main) File "/usr/bin/duplicity", line 1541, in with_tempdir fn() File "/usr/bin/duplicity", line 1380, in main action = commandline.ProcessCommandLine(sys.argv[1:]) File "/usr/lib/python2.7/dist-packages/duplicity/commandline.py", line 1127, in ProcessCommandLine globals.backend = backend.get_backend(args[0]) File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 223, in get_backend obj = get_backend_object(url_string) File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 209, in get_backend_object return factory(pu) File "/usr/lib/python2.7/dist-packages/duplicity/backends/giobackend.py", line 97, in __init__ self.remote_file.make_directory_with_parents(None) Error: g-io-error-quark: Error creating directory /media/root/TOURO: Permission denied (14) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
Hello James, thanks for comment #14, which indicates a problem with the unicode handling of the original error message. I recommend to everyone attempting to fix this to look at the solution from bug #1377873 and investigate if this patch had been removed or somehow deactivated. ** Changed in: deja-dup (Ubuntu) Status: New => Triaged ** Changed in: deja-dup (Ubuntu) Importance: Undecided => High ** Tags added: bionic -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
UPDATE: In my situation, the problem was caused by using a backup directory ("/var/backups") that my user did not have permission to write to. A simple chmod fixed the issue, but this manifested itself in deja- dup as a unicode error. Please consider adding a check/caveat to the code to provide a more helpful error message in cases where permission is denied. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1736164] Re: deja-dup/duplicity backup fails with UnicodeDecodeError
On Ubuntu MATE 18.04, I get the following error: Traceback (innermost last): File "/usr/bin/duplicity", line 1555, in with_tempdir(main) File "/usr/bin/duplicity", line 1541, in with_tempdir fn() File "/usr/bin/duplicity", line 1393, in main do_backup(action) File "/usr/bin/duplicity", line 1511, in do_backup full_backup(col_stats) File "/usr/bin/duplicity", line 572, in full_backup globals.backend) File "/usr/bin/duplicity", line 454, in write_multivol (tdp, dest_filename, vol_num))) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 146, in schedule_task return self.__run_synchronously(fn, params) File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py", line 172, in __run_synchronously ret = fn(*params) File "/usr/bin/duplicity", line 453, in vol_num: put(tdp, dest_filename, vol_num), File "/usr/bin/duplicity", line 342, in put backend.put(tdp, dest_filename) File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 395, in inner_retry % (n, e.__class__.__name__, util.uexc(e))) File "/usr/lib/python2.7/dist-packages/duplicity/util.py", line 79, in uexc return ufn(unicode(e).encode('utf-8')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 37: ordinal not in range(128) james@OldDell:~$ apt-show-versions deja-dup deja-dup:amd64/bionic 37.1-2fakesync1 uptodate deja-dup:i386 not installed james@OldDell:~$ apt-show-versions duplicity duplicity:amd64/bionic 0.7.17-0ubuntu1 uptodate duplicity:i386 not installed james@OldDell:~$ uname -a Linux OldDell 4.15.0-22-generic #24-Ubuntu SMP Wed May 16 12:15:17 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux ** Also affects: deja-dup (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1736164 Title: deja-dup/duplicity backup fails with UnicodeDecodeError To manage notifications about this bug go to: https://bugs.launchpad.net/deja-dup/+bug/1736164/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs