Bug#548417: debmirror: Transfer truncated
Hello,
I can reproduce this problem in one of my networks. It occurs for some
files on security.debian.org. It can also be reproduced using curl (wget
works, as it automatically resumes the download):
The problem occurs both using a http proxy:
root@host:~# curl
http://security.debian.org/debian-security/pool/updates/main/d/drupal7/drupal7_7.14.orig.tar.gz
> /dev/null
% Total% Received % Xferd Average Speed TimeTime Time Current
Dload Upload Total SpentLeft Speed
26 3055k 26 823k0 0 1695k 0 0:00:01 --:--:-- 0:00:01 1719k
curl: (18) transfer closed with 2284998 bytes remaining to read
And using a SOCKS proxy:
root@host:~# http_proxy= tsocks curl
http://security.debian.org/debian-security/pool/updates/main/d/drupal7/drupal7_7.14.orig.tar.gz
> /dev/null
% Total% Received % Xferd Average Speed TimeTime Time Current
Dload Upload Total SpentLeft Speed
26 3055k 26 823k0 0 504k 0 0:00:06 0:00:01 0:00:05 1389k
curl: (56) Recv failure: Connection reset by peer
I cannot access the Internet without a proxy from this network.
It worked over the HTTP-proxy after changing LWP::UserAgent:
$ diff /usr/share/perl5/LWP/UserAgent.pm
/root/src/libwww-perl-6.13/debian/libwww-perl/usr/share/perl5/LWP/UserAgent.pm
898,904d897
< sub append_to_file
< {
< my ($filename, $data) = @_;
< open(FILE, ">>$filename");
< print FILE $data;
< close (FILE);
< }
935,956c928,929
< if ($response->header('Accept-Ranges') eq 'bytes') {
< warn "Transfer truncated: " . "only $file_length out of
$content_length bytes received, retrying\n";
<
< my $try = 0;
< my $continue_at = $file_length + 1;
<
< while ($try++ < 10 && $file_length < $content_length) {
header('Content-length');
header('Range' => "bytes=$file_length-");
<$response = $self->request($request, sub {
append_to_file($tmpfile, @_); }, 102400);
<
<@stat= stat("$tmpfile") or die "Could not stat tmpfile
'$tmpfile': $!";
<$file_length = $stat[7];
<$continue_at = $file_length + 1;
< }
< }
< else {
< unlink($tmpfile);
< die "Transfer truncated: " . "only $file_length out of
$content_length bytes received\n"
< }
---
> unlink($tmpfile);
> die "Transfer truncated: " . "only $file_length out of
> $content_length bytes received\n";
-- System Information:
Debian Release: 7.9
APT prefers squeeze-lts
APT policy: (500, 'squeeze-lts'), (500, 'oldoldstable-updates'), (500,
'oldoldstable'), (500, 'oldstable')
Architecture: amd64 (x86_64)
Kernel: Linux 3.2.0-4-amd64 (SMP w/1 CPU core)
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Versions of packages libwww-perl depends on:
ii ca-certificates 20130119+deb7u1
ii libencode-locale-perl 1.03-1
ii libfile-listing-perl6.04-1
ii libhtml-parser-perl 3.69-2
ii libhtml-tagset-perl 3.20-2
ii libhtml-tree-perl 5.02-1
ii libhttp-cookies-perl6.00-2
ii libhttp-date-perl 6.02-1
ii libhttp-message-perl6.03-1
ii libhttp-negotiate-perl 6.00-2
ii liblwp-mediatypes-perl 6.02-1
ii liblwp-protocol-https-perl 6.03-1
ii libnet-http-perl6.09-1
ii liburi-perl 1.60-1
ii libwww-robotrules-perl 6.01-1
ii netbase 5.0
ii perl5.14.2-21+deb7u2
Versions of packages libwww-perl recommends:
ii libhtml-form-perl6.03-1
ii libhtml-format-perl 2.10-1
ii libhttp-daemon-perl 6.01-1
ii libmailtools-perl2.09-1
Versions of packages libwww-perl suggests:
pn libauthen-ntlm-perl
-- no debconf information
signature.asc
Description: PGP signature
Bug#548417: debmirror: Transfer truncated
Hi, I'm facing the same problem using debmirror 2.16 and libwww-perl 6.08-1 on Debian Jessie. It failed when I try to mirror the debian security repository, and only with this repository, but it fails on various packages. $ debmirror --getcontents --diff=none --verbose --progress --ignore-missing-release --nocleanup --method=http --arch=i386,amd64 --nosource ./repositories/debian-security/ --host=security.debian.org --dist=squeeze/updates,wheezy/updates,jessie/updates --root=/ --section=main,contrib,non-free [ 2%] Getting: pool/updates/main/c/chromium-browser/chromium-dbg_44.0.2403.89-1~deb8u1_amd64.deb... #** GET http://security.debian.org//pool/updates/main/c/chromium-browser/chromium-dbg_44.0.2403.89-1~deb8u1_amd64.deb == 200 OK (78s) Transfer truncated: only 62989085 out of 619651636 bytes received WARNING: releasing 1 pending lock... It's the first time I report it but I'm facing this problem since years (when squeeze was the stable one) -- Thomas DEBESSE
Bug#548417: debmirror: Transfer truncated
Hi, ilf wrote (06 Dec 2009 15:15:03 GMT) : On Sat, 3 Oct 2009 20:21:10 +0200, Andreas Tille wrote: I would like to report that I was able to produce the problem when using debmirror 2.2 when libwww-perl version 5.831-1 was installed. The problem vanished again after installing libwww-perl version 5.812-1. Same here with libwww-perl 5.831-1. 5.834-1 fixed it. FWIW, I'm not sure the forwarded URL (http://rt.cpan.org/Public/Bug/Display.html?id=62420) is correct, then, since that one was reported against a newer version of libwww-perl (namely, 5.835) than the one that presumably fixes it according to this Debian bug report. Cheers, -- intrigeri | GnuPG key @ https://gaffer.ptitcanardnoir.org/intrigeri/intrigeri.asc | OTR fingerprint @ https://gaffer.ptitcanardnoir.org/intrigeri/otr.asc -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#548417: debmirror: Transfer truncated
On Sat, 3 Oct 2009 20:21:10 +0200, Andreas Tille wrote: I would like to report that I was able to produce the problem when using debmirror 2.2 when libwww-perl version 5.831-1 was installed. The problem vanished again after installing libwww-perl version 5.812-1. Same here with libwww-perl 5.831-1. 5.834-1 fixed it. -- ilf i...@jabber.berlin.ccc.de Über 80 Millionen Deutsche benutzen keine Konsole. Klick dich nicht weg! -- Eine Initiative des Bundesamtes für Tastaturbenutzung signature.asc Description: Digital signature
Bug#548417: debmirror: Transfer truncated
Hi once more, I would like to report that I was able to produce the problem when using debmirror 2.2 when libwww-perl version 5.831-1 was installed. The problem vanished again after installing libwww-perl version 5.812-1. Do you have any suggestions to implement some fine grained debugging to track down the issue? Kind regards Andreas. -- http://fam-tille.de -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#548417: debmirror: Transfer truncated
Package: debmirror Version: 1:2.2 Severity: normal Hi, when using debmirror ver a slow connection (385kBit) I get some strange interupts which disables me to update my mirror. Using verbose option I get ... [ 1%] Getting: pool/main/a/apt-dater/apt-dater-host_0.8.0-3_all.deb... ok [ 1%] Getting: pool/main/a/apt-dater/apt-dater_0.8.0-3_amd64.deb... ok [ 1%] Getting: pool/main/a/argparse/python-argparse-doc_1.0-1_all.deb... Use of uninitialized value $file_length in numeric lt () at /usr/share/perl5/LWP/UserAgent.pm line 845. Use of uninitialized value $file_length in concatenation (.) or string at /usr/share/perl5/LWP/UserAgent.pm line 847. Transfer truncated: only out of 54896 bytes received WARNING: releasing 1 pending lock... If I wget the relevant file debmirror continues to fetch some packages but stumbles upon another package. I have tried this for about 10 packages but was unable to find a rule according to which this interuptions might occure. I tested with debmirror 1:2.2.1 with the very same effect. This was not the case with pre-2.x versions of debmirror. I observe this effect since debmirror 2.x entered testing. Kind regards and thanks for maintaining debmirror Andreas. -- System Information: Debian Release: squeeze/sid APT prefers testing APT policy: (501, 'testing'), (50, 'unstable') Architecture: amd64 (x86_64) Kernel: Linux 2.6.30-1-amd64 (SMP w/2 CPU cores) Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages debmirror depends on: ii bzip2 1.0.5-3high-quality block-sorting file co ii libcompress-zlib-perl 2.020-2Transitional dummy package for Com ii libdigest-sha1-perl 2.12-1 NIST SHA-1 message digest algorith ii libio-compress-perl [libcompr 2.020-2IO::Compress modules ii liblockfile-simple-perl 0.207-1Simple advisory file locking ii libwww-perl 5.831-1WWW client/server library for Perl ii perl [libdigest-md5-perl] 5.10.0-25 Larry Wall's Practical Extraction ii perl-modules [libnet-perl]5.10.0-25 Core Perl modules ii rsync 3.0.6-1fast remote file copy program (lik Versions of packages debmirror recommends: ii ed1.4-1 The classic UNIX line editor ii gnupg 1.4.9-4GNU privacy guard - a free PGP rep ii patch 2.5.9-5Apply a diff file to an original debmirror suggests no packages. -- no debconf information -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
