Some more testing:

I installed a virtualenv with python 2.7.12 and duplicity 0.7.09, but
the problem still remains.

Then I ran the little test mentioned in
https://bugs.python.org/issue27130 which shows that zlib has a problem
zipping files > 4Gb:

When looking at the timestamps of the comments, it seems this issue was
fixed after 2.7.12 came out, so it will probably be in the next release.

I am currently running a backup with all files >4Gb excluded to see if
that completes OK.


---

$ python --version
Python 2.7.6

$ python -c "import zlib;zlib.crc32('a'*(1<<31 - 1))"

$ python -c "import zlib;zlib.crc32('a'*(1<<31))"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
OverflowError: size does not fit in an int

---

$ . venv.2.7.12/bin/activate

(venv.2.7.12) $ python --version
Python 2.7.12

(venv.2.7.12) $ python -c "import zlib;zlib.crc32('a'*(1<<31 - 1))"

(venv.2.7.12) $ python -c "import zlib;zlib.crc32('a'*(1<<31))"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
OverflowError: size does not fit in an int


** Bug watch added: Python Roundup #27130
   http://bugs.python.org/issue27130

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to duplicity in Ubuntu.
https://bugs.launchpad.net/bugs/1612554

Title:
  duplicity backup fails with OverflowError: size does not fit in an int

Status in Duplicity:
  New
Status in duplicity package in Ubuntu:
  New

Bug description:
  Ubuntu 14.04.4 LTS
  duplicity 0.6.23-1ubuntu4.1
  python2.7 2.7.6-8ubuntu0.2

  Backup command used:
  duplicity --exclude-filelist "/root/.duplicity_excludes" --full-if-older-than 
7D --log-file "/var/log/duplicity" --no-encryption --volsize 100 / "$S3BUCKET"

  Backups have been running fine for several months, but since last
  night it started giving following error:

  ---

  Reading filelist /root/.duplicity_excludes

  Sorting filelist /root/.duplicity_excludes

  Local and Remote metadata are synchronized, no sync needed.

  Last full backup date: Sun Aug  7 23:30:02 2016

  Traceback (most recent call last):

    File "/usr/bin/duplicity", line 1494, in <module>

      with_tempdir(main)

    File "/usr/bin/duplicity", line 1488, in with_tempdir

      fn()

    File "/usr/bin/duplicity", line 1337, in main

      do_backup(action)

    File "/usr/bin/duplicity", line 1470, in do_backup

      incremental_backup(sig_chain)

    File "/usr/bin/duplicity", line 637, in incremental_backup

      globals.backend)

    File "/usr/bin/duplicity", line 405, in write_multivol

      at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name,
  globals.volsize)

    File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 383,
  in GzipWriteFile

      new_block = block_iter.next()

    File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
  518, in next

      result = self.process(self.input_iter.next())

    File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
  213, in get_delta_iter

      (new_path, sig_path, sigTarFile))

    File "/usr/lib/python2.7/dist-packages/duplicity/robust.py", line
  37, in check_common_error

      return function(*args)

    File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
  134, in get_delta_path

      delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))

    File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line
  150, in __init__

      self.maker = _librsync.new_deltamaker(sig_string)

  OverflowError: size does not fit in an int

To manage notifications about this bug go to:
https://bugs.launchpad.net/duplicity/+bug/1612554/+subscriptions

-- 
Mailing list: https://launchpad.net/~desktop-packages
Post to     : desktop-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~desktop-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to