Some more testing: I installed a virtualenv with python 2.7.12 and duplicity 0.7.09, but the problem still remains.
Then I ran the little test mentioned in https://bugs.python.org/issue27130 which shows that zlib has a problem zipping files > 4Gb: When looking at the timestamps of the comments, it seems this issue was fixed after 2.7.12 came out, so it will probably be in the next release. I am currently running a backup with all files >4Gb excluded to see if that completes OK. --- $ python --version Python 2.7.6 $ python -c "import zlib;zlib.crc32('a'*(1<<31 - 1))" $ python -c "import zlib;zlib.crc32('a'*(1<<31))" Traceback (most recent call last): File "<string>", line 1, in <module> OverflowError: size does not fit in an int --- $ . venv.2.7.12/bin/activate (venv.2.7.12) $ python --version Python 2.7.12 (venv.2.7.12) $ python -c "import zlib;zlib.crc32('a'*(1<<31 - 1))" (venv.2.7.12) $ python -c "import zlib;zlib.crc32('a'*(1<<31))" Traceback (most recent call last): File "<string>", line 1, in <module> OverflowError: size does not fit in an int ** Bug watch added: Python Roundup #27130 http://bugs.python.org/issue27130 -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to duplicity in Ubuntu. https://bugs.launchpad.net/bugs/1612554 Title: duplicity backup fails with OverflowError: size does not fit in an int Status in Duplicity: New Status in duplicity package in Ubuntu: New Bug description: Ubuntu 14.04.4 LTS duplicity 0.6.23-1ubuntu4.1 python2.7 2.7.6-8ubuntu0.2 Backup command used: duplicity --exclude-filelist "/root/.duplicity_excludes" --full-if-older-than 7D --log-file "/var/log/duplicity" --no-encryption --volsize 100 / "$S3BUCKET" Backups have been running fine for several months, but since last night it started giving following error: --- Reading filelist /root/.duplicity_excludes Sorting filelist /root/.duplicity_excludes Local and Remote metadata are synchronized, no sync needed. Last full backup date: Sun Aug 7 23:30:02 2016 Traceback (most recent call last): File "/usr/bin/duplicity", line 1494, in <module> with_tempdir(main) File "/usr/bin/duplicity", line 1488, in with_tempdir fn() File "/usr/bin/duplicity", line 1337, in main do_backup(action) File "/usr/bin/duplicity", line 1470, in do_backup incremental_backup(sig_chain) File "/usr/bin/duplicity", line 637, in incremental_backup globals.backend) File "/usr/bin/duplicity", line 405, in write_multivol at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name, globals.volsize) File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 383, in GzipWriteFile new_block = block_iter.next() File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 518, in next result = self.process(self.input_iter.next()) File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 213, in get_delta_iter (new_path, sig_path, sigTarFile)) File "/usr/lib/python2.7/dist-packages/duplicity/robust.py", line 37, in check_common_error return function(*args) File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 134, in get_delta_path delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp)) File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line 150, in __init__ self.maker = _librsync.new_deltamaker(sig_string) OverflowError: size does not fit in an int To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1612554/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp