Simpler reproducer:
valgrind lftp -e 'get gnu/glibc/nss_db-2.2.tar.gz;exit' ftp.gnu.org
==9023== Memcheck, a memory error detector
==9023== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al.
==9023== Using Valgrind-3.13.0 and LibVEX; rerun with -h for copyright info
==9023== Command: lftp -e get\ gnu/glibc/nss_db-2.2.tar.gz;exit ftp.gnu.org
==9023==
==9024== .gnu.org' [Resolving host address...]
==9024== HEAP SUMMARY:
==9024== in use at exit: 209,311 bytes in 1,703 blocks
==9024== total heap usage: 4,136 allocs, 2,433 frees, 579,083 bytes allocated
==9024==
==9024== LEAK SUMMARY:
==9024== definitely lost: 0 bytes in 0 blocks
==9024== indirectly lost: 0 bytes in 0 blocks
==9024== possibly lost: 3,109 bytes in 41 blocks
==9024== still reachable: 206,202 bytes in 1,662 blocks
==9024== suppressed: 0 bytes in 0 blocks
==9024== Rerun with --leak-check=full to see details of leaked memory
==9024==
==9024== For counts of detected and suppressed errors, rerun with: -v
==9024== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0)
get: gnu/glibc/nss_db-2.2.tar.gz: /home/ubuntu/nss_db-2.2.tar.gz: file already
exists and xfer:clobber is unset
==9023== Invalid read of size 4
==9023== at 0x2184B0: AddXfer (RateLimit.cc:30)
==9023== by 0x2184B0: RateLimit::~RateLimit() (RateLimit.cc:63)
==9023== by 0x218B18: dispose (xmap.h:107)
==9023== by 0x218B18: xmap_p<RateLimit>::~xmap_p() (xmap.h:112)
==9023== by 0x6224160: __run_exit_handlers (exit.c:108)
==9023== by 0x6224259: exit (exit.c:139)
==9023== by 0x6202BFD: (below main) (libc-start.c:344)
==9023== Address 0x8072550 is 16 bytes inside a block of size 88 free'd
==9023== at 0x4C3323B: operator delete(void*) (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==9023== by 0x218B25: dispose (xmap.h:107)
==9023== by 0x218B25: xmap_p<RateLimit>::~xmap_p() (xmap.h:112)
==9023== by 0x6224160: __run_exit_handlers (exit.c:108)
==9023== by 0x6224259: exit (exit.c:139)
==9023== by 0x6202BFD: (below main) (libc-start.c:344)
==9023== Block was alloc'd at
==9023== at 0x4C3217F: operator new(unsigned long) (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==9023== by 0x218A09: RateLimit::init(RateLimit::level_e, char const*)
(RateLimit.cc:55)
==9023== by 0x218A2C: RateLimit (RateLimit.h:52)
==9023== by 0x218A2C: RateLimit::init(RateLimit::level_e, char const*)
(RateLimit.cc:55)
==9023== by 0x1ED1E2: Ftp::Do() (ftpclass.cc:2337)
==9023== by 0x1A97C4: SMTask::ScheduleThis() (SMTask.cc:209)
==9023== by 0x1A99D0: SMTask::Schedule() (SMTask.cc:248)
==9023== by 0x16614C: Job::WaitDone() (Job.cc:557)
==9023== by 0x15CBE3: main (lftp.cc:590)
==9023==
==9023== Invalid read of size 8
==9023== at 0x2184B5: AddXfer (RateLimit.cc:31)
==9023== by 0x2184B5: RateLimit::~RateLimit() (RateLimit.cc:63)
==9023== by 0x218B18: dispose (xmap.h:107)
==9023== by 0x218B18: xmap_p<RateLimit>::~xmap_p() (xmap.h:112)
==9023== by 0x6224160: __run_exit_handlers (exit.c:108)
==9023== by 0x6224259: exit (exit.c:139)
==9023== by 0x6202BFD: (below main) (libc-start.c:344)
==9023== Address 0x8072548 is 8 bytes inside a block of size 88 free'd
==9023== at 0x4C3323B: operator delete(void*) (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==9023== by 0x218B25: dispose (xmap.h:107)
==9023== by 0x218B25: xmap_p<RateLimit>::~xmap_p() (xmap.h:112)
==9023== by 0x6224160: __run_exit_handlers (exit.c:108)
==9023== by 0x6224259: exit (exit.c:139)
==9023== by 0x6202BFD: (below main) (libc-start.c:344)
==9023== Block was alloc'd at
==9023== at 0x4C3217F: operator new(unsigned long) (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==9023== by 0x218A09: RateLimit::init(RateLimit::level_e, char const*)
(RateLimit.cc:55)
==9023== by 0x218A2C: RateLimit (RateLimit.h:52)
==9023== by 0x218A2C: RateLimit::init(RateLimit::level_e, char const*)
(RateLimit.cc:55)
==9023== by 0x1ED1E2: Ftp::Do() (ftpclass.cc:2337)
==9023== by 0x1A97C4: SMTask::ScheduleThis() (SMTask.cc:209)
==9023== by 0x1A99D0: SMTask::Schedule() (SMTask.cc:248)
==9023== by 0x16614C: Job::WaitDone() (Job.cc:557)
==9023== by 0x15CBE3: main (lftp.cc:590)
==9023==
==9023==
==9023== HEAP SUMMARY:
==9023== in use at exit: 41,827 bytes in 845 blocks
==9023== total heap usage: 4,439 allocs, 3,594 frees, 1,067,188 bytes
allocated
==9023==
==9023== LEAK SUMMARY:
==9023== definitely lost: 144 bytes in 9 blocks
==9023== indirectly lost: 13 bytes in 1 blocks
==9023== possibly lost: 3,026 bytes in 39 blocks
==9023== still reachable: 38,644 bytes in 796 blocks
==9023== suppressed: 0 bytes in 0 blocks
==9023== Rerun with --leak-check=full to see details of leaked memory
==9023==
==9023== For counts of detected and suppressed errors, rerun with: -v
==9023== ERROR SUMMARY: 3 errors from 2 contexts (suppressed: 0 from 0)
Seems like one of the various core dumps on exit fixed in lftp later releases:
Version 4.8.4 - 2018-08-01
* fixed a security vulnerability with "file:" file names.
* fixed mirror --flat.
* http: extract links from <source> tags.
* fixed upload of zero-length files over ftps.
* fixed assert on "mput -d".
* fixed a core dump.
* avoid multiple backup files of DHT cache.
* translations updated (uk, zh_CN).
Version 4.8.3 - 2017-10-09
* fixed compilation with older C++ compilers.
* fixed 2 other core dumps on exit (incorrect order of deallocation).
Version 4.8.2 - 2017-09-25
* fixed compilation on FreeBSD and OS X.
* fixed a memory leak.
* fixed a core dump on exit.
I'm checking what could be backported for lftp.
** Changed in: glibc (Ubuntu)
Status: Confirmed => Invalid
** Changed in: glibc (Ubuntu Bionic)
Status: Confirmed => Invalid
** Package changed: duplicity (Ubuntu) => lftp (Ubuntu)
--
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to duplicity in Ubuntu.
https://bugs.launchpad.net/bugs/1902832
Title:
lftp support broken - exits with error_code -11 on Bionic
Status in glibc package in Ubuntu:
Invalid
Status in lftp package in Ubuntu:
Confirmed
Status in glibc source package in Bionic:
Invalid
Status in lftp source package in Bionic:
Confirmed
Bug description:
We are using duplicity 0.7.17 and Ubuntu 18.04 LTS.
After upgrading these packages in Ubuntu:
Upgrade: libc-bin:amd64 (2.27-3ubuntu1.2, 2.27-3ubuntu1.3)
Upgrade: locales:amd64 (2.27-3ubuntu1.2, 2.27-3ubuntu1.3)
Upgrade: multiarch-support:amd64 (2.27-3ubuntu1.2, 2.27-3ubuntu1.3)
Upgrade: libc6-dev:amd64 (2.27-3ubuntu1.2, 2.27-3ubuntu1.3),
Upgrade: libc6:amd64 (2.27-3ubuntu1.2, 2.27-3ubuntu1.3)
Upgrade: libc-dev-bin:amd64 (2.27-3ubuntu1.2, 2.27-3ubuntu1.3)
the duplicity/lftp support stopped working. It worked for years just
fine before that.
Basic error message is:
Giving up after 5 attempts. BackendException: Error running 'lftp -c
"source /tmp/duplicity-gVCsqa-tempdir/mkstemp-serY3Q-1; ( cd
etc_backup/ && ls ) || ( mkdir -p etc_backup/ && cd etc_backup/ && ls
)"': returned -11, with output:
Error/debug output:
Using archive dir: /root/.duplicity/etc_daily
Using backup name: etc_daily
GPG binary is gpg, version 2.2.4
Import of duplicity.backends.acdclibackend Succeeded
Import of duplicity.backends.azurebackend Succeeded
Import of duplicity.backends.b2backend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.hubicbackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.lftpbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.mediafirebackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.multibackend Succeeded
Import of duplicity.backends.ncftpbackend Succeeded
Import of duplicity.backends.onedrivebackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.pydrivebackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.ssh_paramiko_backend Succeeded
Import of duplicity.backends.ssh_pexpect_backend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
LFTP version is 4.8.1
Using temporary directory /tmp/duplicity-_Mgype-tempdir
Registering (mkstemp) temporary file
/tmp/duplicity-_Mgype-tempdir/mkstemp-55iPLR-1
SETTINGS:
set ssl:verify-certificate true
set ftp:ssl-allow false
set http:use-propfind true
set net:timeout 30
set net:max-retries 5
set ftp:passive-mode on
debug
open -u '<username_removed>,<password_removed>'
ftp://hostname.your-storagebox.de
Main action: remove-all-but-n-full
Acquiring lockfile /root/.duplicity/etc_daily/lockfile
================================================================================
duplicity 0.7.17 (February 26, 2018)
Args: /usr/bin/duplicity remove-all-but-n-full 7 -v9
--archive-dir=/root/.duplicity --force --name etc_daily --no-encryption
ftp://<username_removed>@<hostname_removed>.your-storagebox.de/etc_full
Linux <hostname_removed> 4.15.0-122-generic #124-Ubuntu SMP Thu Oct 15
13:03:05 UTC 2020 x86_64 x86_64
/usr/bin/python2 2.7.17 (default, Sep 30 2020, 13:38:04)
[GCC 7.5.0]
================================================================================
CMD: lftp -c "source /tmp/duplicity-_Mgype-tempdir/mkstemp-55iPLR-1; ( cd
etc_full/ && ls ) || ( mkdir -p etc_full/ && cd etc_full/ && ls )"
Reading results of 'lftp -c "source
/tmp/duplicity-_Mgype-tempdir/mkstemp-55iPLR-1; ( cd etc_full/ && ls ) || (
mkdir -p etc_full/ && cd etc_full/ && ls )"'
Backtrace of previous error: Traceback (innermost last):
File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 369, in
inner_retry
return fn(self, *args)
File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 578, in
list
return [tobytes(x) for x in self.backend._list()]
File "/usr/lib/python2.7/dist-packages/duplicity/backends/lftpbackend.py",
line 181, in _list
_, l, e = self.subprocess_popen(commandline)
File "/usr/lib/python2.7/dist-packages/duplicity/backend.py", line 499, in
subprocess_popen
(logstr, result, stdout + '
' + stderr))
BackendException: Error running 'lftp -c "source
/tmp/duplicity-_Mgype-tempdir/mkstemp-55iPLR-1; ( cd etc_full/ && ls ) || (
mkdir -p etc_full/ && cd etc_full/ && ls )"': returned -11, with output:
-rw-r--r-- 1 u234538-sub2 u234538 885032 Oct 28 00:00
duplicity-full-signatures.20201028T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 885113 Oct 29 00:00
duplicity-full-signatures.20201029T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886172 Oct 30 00:00
duplicity-full-signatures.20201030T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886175 Oct 31 00:00
duplicity-full-signatures.20201031T000002Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886163 Nov 1 00:00
duplicity-full-signatures.20201101T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886173 Nov 2 00:00
duplicity-full-signatures.20201102T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886625 Nov 3 00:00
duplicity-full-signatures.20201103T000002Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 481 Oct 28 00:00
duplicity-full.20201028T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64187446 Oct 28 00:00
duplicity-full.20201028T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 480 Oct 29 00:00
duplicity-full.20201029T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64189301 Oct 29 00:00
duplicity-full.20201029T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 480 Oct 30 00:00
duplicity-full.20201030T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198883 Oct 30 00:00
duplicity-full.20201030T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 479 Oct 31 00:00
duplicity-full.20201031T000002Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198893 Oct 31 00:00
duplicity-full.20201031T000002Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 482 Nov 1 00:00
duplicity-full.20201101T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198890 Nov 1 00:00
duplicity-full.20201101T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 479 Nov 2 00:00
duplicity-full.20201102T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198894 Nov 2 00:00
duplicity-full.20201102T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 481 Nov 3 00:00
duplicity-full.20201103T000002Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64203538 Nov 3 00:00
duplicity-full.20201103T000002Z.vol1.difftar.gpg
---- Resolving host address...
---- 2 addresses found: 202:4f8:b23:3000::16, 146.202.112.16
---- Connecting to <hostname_removed> (202:4f8:b23:3000::16) port 21
<--- 220 ProFTPD Server (Backup) [202:4f8:b23:3000::16]
---> FEAT
<--- 211-Features:
<--- AUTH TLS
<--- CCC
<--- CLNT
<--- EPRT
<--- EPSV
<--- HOST
<--- LANG
ko-KR.UTF-8;ko-KR;es-ES.UTF-8;es-ES;bg-BG.UTF-8;bg-BG;it-IT.UTF-8;it-IT;zh-CN.UTF-8;zh-CN;ja-JP.UTF-8;ja-JP;zh-TW.UTF-8;zh-TW;ru-RU.UTF-8;ru-RU;fr-FR.UTF-8;fr-FR;en-US.UTF-8;en-US*
<--- MDTM
<--- MFF modify;UNIX.group;UNIX.mode;
<--- MFMT
<--- MLST
modify*;perm*;size*;type*;unique*;UNIX.group*;UNIX.groupname*;UNIX.mode*;UNIX.owner*;UNIX.ownername*;
<--- PBSZ
<--- PROT
<--- REST STREAM
<--- SIZE
<--- SSCN
<--- TVFS
<--- UTF8
<--- 211 End
---> CLNT lftp/4.8.1
<--- 200 OK
---> LANG
<--- 200 Using default language en_US
---> OPTS UTF8 ON
<--- 200 UTF8 set to on
---> HOST <hostname_removed>
<--- 504 <hostname_removed>: Unknown hostname provided
---> OPTS MLST modify;perm;size;type;UNIX.group;UNIX.mode;UNIX.owner
<--- 200 MLST OPTS modify;perm;size;type;UNIX.group;UNIX.mode;
---> USER <username_removed>
<--- 331 Password required for <username_removed>
---> PASS <password_removed>
<--- 230 User <username_removed> logged in
---> PWD
<--- 257 "/" is the current directory
---- CWD path to be sent is `/etc_full'
---> CWD /etc_full
<--- 250 CWD command successful
---> EPSV
<--- 229 Entering Extended Passive Mode (|||54612|)
---- Connecting data socket to (202:4f8:b23:3000::16) port 54612
---- Data connection established
---> LIST
<--- 150 Opening ASCII mode data connection for file list
---- Got EOF on data connection
---- Closing data socket
<--- 226 Transfer complete
---> QUIT
<--- 221 Goodbye.
---- Closing control socket
Attempt 1 failed. BackendException: Error running 'lftp -c "source
/tmp/duplicity-_Mgype-tempdir/mkstemp-55iPLR-1; ( cd etc_full/ && ls ) || (
mkdir -p etc_full/ && cd etc_full/ && ls )"': returned -11, with output:
-rw-r--r-- 1 u234538-sub2 u234538 885032 Oct 28 00:00
duplicity-full-signatures.20201028T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 885113 Oct 29 00:00
duplicity-full-signatures.20201029T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886172 Oct 30 00:00
duplicity-full-signatures.20201030T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886175 Oct 31 00:00
duplicity-full-signatures.20201031T000002Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886163 Nov 1 00:00
duplicity-full-signatures.20201101T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886173 Nov 2 00:00
duplicity-full-signatures.20201102T000001Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 886625 Nov 3 00:00
duplicity-full-signatures.20201103T000002Z.sigtar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 481 Oct 28 00:00
duplicity-full.20201028T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64187446 Oct 28 00:00
duplicity-full.20201028T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 480 Oct 29 00:00
duplicity-full.20201029T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64189301 Oct 29 00:00
duplicity-full.20201029T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 480 Oct 30 00:00
duplicity-full.20201030T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198883 Oct 30 00:00
duplicity-full.20201030T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 479 Oct 31 00:00
duplicity-full.20201031T000002Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198893 Oct 31 00:00
duplicity-full.20201031T000002Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 482 Nov 1 00:00
duplicity-full.20201101T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198890 Nov 1 00:00
duplicity-full.20201101T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 479 Nov 2 00:00
duplicity-full.20201102T000001Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64198894 Nov 2 00:00
duplicity-full.20201102T000001Z.vol1.difftar.gpg
-rw-r--r-- 1 u234538-sub2 u234538 481 Nov 3 00:00
duplicity-full.20201103T000002Z.manifest.gpg
-rw-r--r-- 1 u234538-sub2 u234538 64203538 Nov 3 00:00
duplicity-full.20201103T000002Z.vol1.difftar.gpg
Using
Duplicity 0.7.17
Python 2.7.17
Ubuntu 18.04 LTS.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/glibc/+bug/1902832/+subscriptions
--
Mailing list: https://launchpad.net/~desktop-packages
Post to : desktop-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~desktop-packages
More help : https://help.launchpad.net/ListHelp
