Package: apt
Version: 0.6.46.2
Severity: serious

I'm filing this new bug following some discussion (attached) in
debian-devel. I've also seen this behaviour a few time and it's very
annoying. This should be fixed for etch...

Cheers,
-- 
Raphaël Hertzog

Premier livre français sur Debian GNU/Linux :
http://www.ouaza.com/livre/admin-debian/
--- Begin Message ---
Hello,

Is this a bug in apt?

pbuilder update --override-config --configfile /tmp/pbuilder-local.SvMNy19452
W: /home/brian/.pbuilderrc does not exist
Upgrading for distribution etch
Building the build Environment
 -> extracting base tarball [/var/cache/pbuilder/base-etch.tgz]
 -> creating local configuration
 -> copying local configuration
 -> mounting /proc filesystem
 -> mounting /dev/pts filesystem
 -> policy-rc.d already exists
  -> Installing apt-lines
Refreshing the base.tgz 
 -> upgrading packages
Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
Get:2 http://ftp.au.debian.org etch Release [74.4kB]
Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
99% [5 Packages gzip 0]                                                         
                                                       
 (hangs for ever)

I have tried waiting for it to timeout, but it doesn't.

I tried running it in strace, but then it works. Perfectly.

Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Installed/Config-files/Unpacked/Failed-config/Half-installed
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name                         Version                      Description
+++-============================-============================-========================================================================
ii  apt                          0.6.46.2                     Advanced 
front-end for dpkg

The chroot in question doesn't yet have the latest Etch key, but I
don't think that is significant.

Doing a search for bugs, I see #358817, but this doesn't involve NFS
so it looks different.
-- 
Brian May <[EMAIL PROTECTED]>


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---
--- Begin Message ---
Hi,

Brian May wrote:
> Hello,
> 
> Is this a bug in apt?
> 
> pbuilder update --override-config --configfile /tmp/pbuilder-local.SvMNy19452
[...]
> Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> 99% [5 Packages gzip 0]                                                       
>                                                          
>  (hangs for ever)
[...]

I experienced the same some time ago and worked it around
by temporarily switching to a different mirror. It then succeeded,
and afterwards I could again switch to my usual mirror.

But, yesterday I had the same issue in my i386 chroot, so the issue
seems to persist....

        Andreas




-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---
--- Begin Message ---
On Mon, 27 Nov 2006, Andreas Fester wrote:
> I experienced the same some time ago and worked it around
> by temporarily switching to a different mirror. It then succeeded,
> and afterwards I could again switch to my usual mirror.
> 
> But, yesterday I had the same issue in my i386 chroot, so the issue
> seems to persist....

Use --save-after-login and pbuilder login to open the chroot, add the new
apt key, and only then run the update.

I don't know where the bug is, but it is directly related to apt key
management.

-- 
  "One disk to rule them all, One disk to find them. One disk to bring
  them all and in the darkness grind them. In the Land of Redmond
  where the shadows lie." -- The Silicon Valley Tarot
  Henrique Holschuh


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---
--- Begin Message ---
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Henrique de Moraes Holschuh wrote:
> On Mon, 27 Nov 2006, Andreas Fester wrote:
>> I experienced the same some time ago and worked it around
>> by temporarily switching to a different mirror. It then succeeded,
>> and afterwards I could again switch to my usual mirror.
>>
>> But, yesterday I had the same issue in my i386 chroot, so the issue
>> seems to persist....
> 
> Use --save-after-login and pbuilder login to open the chroot, add the new
> apt key, and only then run the update.
> 
> I don't know where the bug is, but it is directly related to apt key
> management.

I tried to track it down; I could reproduce it with non-stripped apt-binaries 
from
a re-compiled apt source package. pstree showed the following processes while
apt-get was hanging:

apt-get(5027)???bzip2(5049)
              ??gpgv(5032)
              ??gzip(5038)
              ??http(5029)
              ??http(5030)

apt-get was blocked in a select() called from apt-get.cc:1354

1353   // Run it
1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
1355      return false;

bzip/gzip/gpgv were hanging in a select() which was called from WaitFd(),
and http did not show a useful stack trace.

Then, strangely, while still debugging, apt-get update suddenly
worked again (even without updating the apt key), so I was not able to
further examine it ... Maybe the above observations help when it happens
again :)

        Andreas

- --
Andreas Fester
mailto:[EMAIL PROTECTED]
WWW: http://www.littletux.net
ICQ: 326674288
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFaz9jZ3bQVzeW+rsRAjQVAKCZYlKQftP1lwjz7OvbUUYXJYaZ6wCgv5mp
S4msVMYT39GL2ZaXET4fUF0=
=Glr1
-----END PGP SIGNATURE-----


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---
--- Begin Message ---
On Mon, Nov 27, 2006 at 08:41:23PM +0100, Andreas Fester wrote:
> I tried to track it down; I could reproduce it with non-stripped apt-binaries 
> from
> a re-compiled apt source package. pstree showed the following processes while
> apt-get was hanging:
> 
> apt-get(5027)???bzip2(5049)
>               ??gpgv(5032)
>               ??gzip(5038)
>               ??http(5029)
>               ??http(5030)
> 
> apt-get was blocked in a select() called from apt-get.cc:1354
> 
> 1353   // Run it
> 1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
> 1355      return false;
> 
> bzip/gzip/gpgv were hanging in a select() which was called from WaitFd(),
> and http did not show a useful stack trace.

This sounds similar to
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=341537

Try to see if the place where apt is getting stuck is one where it's
waiting for input from an external process which might have gotten
stuck or dead.

-- 
Rodrigo Gallardo
GPG-Fingerprint: 7C81 E60C 442E 8FBC D975  2F49 0199 8318 ADC9 BC28

Billboard billboard burning bright / in my windshield every night.
Lead me to a decent joint / where I can stop and get a bite.

Attachment: signature.asc
Description: Digital signature


--- End Message ---
--- Begin Message ---
Andreas Fester wrote:
> I tried to track it down; I could reproduce it with non-stripped apt-binaries 
> from
> a re-compiled apt source package. pstree showed the following processes while
> apt-get was hanging:
> 
> apt-get(5027)???bzip2(5049)
>               ??gpgv(5032)
>               ??gzip(5038)
>               ??http(5029)
>               ??http(5030)

I'm also seeing this, I've been seeing it starting approximatly 2 weeks ago
(well before the new apt key) on several machines (i386, arm) with several
mirrors, including mirrors.kernel.org and ftp.nl.debian.org.

> apt-get was blocked in a select() called from apt-get.cc:1354
> 
> 1353   // Run it
> 1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
> 1355      return false;

Hmm, when I straced apt-get, it was in a loop looking for a file:

select(8, [5 6 7], [], NULL, {0, 500000}) = 0 (Timeout)
stat64("/var/lib/apt/lists/partial/mirrors.kernel.org_debian_dists_testing_non-free_binary-i386_Packages.decomp",
0xafe9b960) = -1 ENOENT (No such file or directory)
gettimeofday({1164688481, 613704}, NULL) = 0
rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
write(1, "\r99% [3 Packages bzip2 0]", 25) = 25

I've also seen this on some of the machines. Running apt again clears
this up:

Get: 9 http://mirrors.kernel.org testing/main Packages [4249kB]
Get: 10 http://mirrors.kernel.org testing/main Packages [4249kB]              
50% [9 Packages bzip2 0] [10 Packages 22499/4249kB 0%]              512kB/s 8s
bzip2: Compressed file ends unexpectedly;
        perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
        Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

Err http://mirrors.kernel.org testing/main Packages                           
  Sub-process bzip2 returned an error code (2)

> Then, strangely, while still debugging, apt-get update suddenly
> worked again (even without updating the apt key), so I was not able to
> further examine it ... Maybe the above observations help when it happens
> again :)

Ditto, after I run it 4-5 times it completes.

-- 
see shy jo

Attachment: signature.asc
Description: Digital signature


--- End Message ---
--- Begin Message ---
>>>>> "Henrique" == Henrique de Moraes Holschuh <[EMAIL PROTECTED]> writes:

    Henrique> Use --save-after-login and pbuilder login to open the
    Henrique> chroot, add the new apt key, and only then run the
    Henrique> update.

I tried that, it didn't help.

The only solution I found when I checked last was to run apt-get via
strace...

I also have plenty of diskspace.
-- 
Brian May <[EMAIL PROTECTED]>


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---
--- Begin Message ---
On Monday 27 November 2006 11:55, Brian May wrote:
> Hello,
>
> Is this a bug in apt?
>
> pbuilder update --override-config --configfile
> /tmp/pbuilder-local.SvMNy19452 W: /home/brian/.pbuilderrc does not exist
> Upgrading for distribution etch
> Building the build Environment
>  -> extracting base tarball [/var/cache/pbuilder/base-etch.tgz]
>  -> creating local configuration
>  -> copying local configuration
>  -> mounting /proc filesystem
>  -> mounting /dev/pts filesystem
>  -> policy-rc.d already exists
>   -> Installing apt-lines
> Refreshing the base.tgz
>  -> upgrading packages
> Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
> Get:2 http://ftp.au.debian.org etch Release [74.4kB]
> Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
> Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
> Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> 99% [5 Packages gzip 0]
>  (hangs for ever)
>
> I have tried waiting for it to timeout, but it doesn't.
>

Don't know whether its related, I stopped using ftp.au.debian.org.  IIRC it 
was replying to package requests with a 302 redirect, which apt-proxy 
seemed to be unable to handle.

Is this a 302 redirect something debian package management/archive mirroring 
tools are expected to handle, or are mirrors not expected to use redirects?

ftp.iinet.net.au/debian/ also seems to be intermittent partially updated.  I 
wonder whether they're mirroring from ftp.au.debian.org, and also having 
problems with the 302 responses. 

HTH
Andrew


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---
--- Begin Message ---
On Tue, Nov 28, 2006 at 01:34:54AM +1100, Andrew Vaughan wrote:
> > Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
> > Get:2 http://ftp.au.debian.org etch Release [74.4kB]
> > Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
> > Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
> > Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> > 99% [5 Packages gzip 0]
> >  (hangs for ever)
> >
> > I have tried waiting for it to timeout, but it doesn't.
> >
> 
> Don't know whether its related, I stopped using ftp.au.debian.org.  IIRC it 
> was replying to package requests with a 302 redirect, which apt-proxy 
> seemed to be unable to handle.
> 
> Is this a 302 redirect something debian package management/archive mirroring 
> tools are expected to handle, or are mirrors not expected to use redirects?
> 
> ftp.iinet.net.au/debian/ also seems to be intermittent partially updated.  I 
> wonder whether they're mirroring from ftp.au.debian.org, and also having 
> problems with the 302 responses. 

This is indepent on mirror choice I think. I got the same issue with ftp.it and 
solved
twice as pointed by henrique. Installing debian-archive-keyring in the
pbuilder chroot (with the new recent key) just before updating solved the
issue this time and in the previous case also. 

-- 
Francesco P. Lovergine


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]


--- End Message ---

Reply via email to