Package: obnam
Version: 1.8-1
Severity: important
Dear Lars,
I'm running into a MemoryError when trying to do a backup:
sudo obnam --config .obnam.conf backup .
[sudo] password for arne:
05h18m27s 742799 files 86.79 GiB scanned: making checkpoint: starting a new
generationTraceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/cliapp/app.py", line 190, in _run
self.process_args(args)
File "/usr/lib/python2.7/dist-packages/obnamlib/app.py", line 201, in
process_args
cliapp.Application.process_args(self, args)
File "/usr/lib/python2.7/dist-packages/cliapp/app.py", line 568, in
process_args
method(args[1:])
File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py",
line 370, in backup
self.backup_roots(roots)
File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py",
line 560, in backup_roots
pathname, metadata)
File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py",
line 909, in backup_file_contents
self.make_checkpoint()
File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py",
line 659, in make_checkpoint
self.client_name)
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/repo_fmt_6.py", line
490, in create_generation
client_name, open_client_info)
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/repo_fmt_6.py", line
455, in _refresh_open_client_info_cached_generation_ids
for gen_number in client_info.client.list_generations()]
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/clientmetadatatree.py",
line 246, in list_generations
genid = self._get_generation_id_or_None(t)
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/clientmetadatatree.py",
line 285, in _get_generation_id_or_None
return self.get_generation_id(tree)
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/clientmetadatatree.py",
line 281, in get_generation_id
return self._lookup_int(tree, self.genkey(self.GEN_ID))
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/clientmetadatatree.py",
line 207, in _lookup_int
return struct.unpack('!Q', tree.lookup(key))[0]
File "/usr/lib/python2.7/dist-packages/larch/tree.py", line 142, in lookup
node = self._get_node(node[k])
File "/usr/lib/python2.7/dist-packages/larch/tree.py", line 111, in _get_node
return self.node_store.get_node(node_id)
File "/usr/lib/python2.7/dist-packages/larch/nodestore_disk.py", line 235, in
get_node
encoded = self.journal.cat(name)
File "/usr/lib/python2.7/dist-packages/larch/journal.py", line 162, in cat
return self.fs.cat(filename)
File "/usr/lib/python2.7/dist-packages/obnamlib/fmt_6/repo_fmt_6.py", line
57, in cat
data = self.fs.cat(filename)
File "/usr/lib/python2.7/dist-packages/obnamlib/vfs_local.py", line 299, in
cat
chunk = f.read(self.chunk_size)
File "/usr/lib/python2.7/dist-packages/obnamlib/vfs_local.py", line 45, in
read
data = file.read(self, amount)
MemoryError
As you can see, it took quite some time for ~87GiB. That is because
there are a lot of small files (ca. 1.8mil files over all).
This is the second backup with obnam, the first one worked just
fine. There is also another backup from a different computer in the
repository.
I'm making the backups to a USB-attached HDD.
Thank you for this software (other than this bug, it rocks)
Arne
-- System Information:
Debian Release: jessie/sid
APT prefers unstable
APT policy: (900, 'unstable'), (800, 'experimental')
Architecture: i386 (i686)
Kernel: Linux 3.13-1-686-pae (SMP w/2 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Versions of packages obnam depends on:
ii libc6 2.18-4
ii python 2.7.5-5
ii python-cliapp 1.20140315-1
ii python-fuse 2:0.2.1-9
ii python-larch 1.20131130-1
ii python-paramiko 1.10.1-1
ii python-tracing 0.8-1
ii python-ttystatus 0.23-1
obnam recommends no packages.
obnam suggests no packages.
-- no debconf information
--
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
