Re: apt hangs for ever

[Andreas Fester]

Hi,

Brian May wrote:
> Hello,
> 
> Is this a bug in apt?
> 
> pbuilder update --override-config --configfile /tmp/pbuilder-local.SvMNy19452
[...]
> Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> 99% [5 Packages gzip 0]   
>  
>  (hangs for ever)
[...]

I experienced the same some time ago and worked it around
by temporarily switching to a different mirror. It then succeeded,
and afterwards I could again switch to my usual mirror.

But, yesterday I had the same issue in my i386 chroot, so the issue
seems to persist

Andreas




-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Henrique de Moraes Holschuh]

On Mon, 27 Nov 2006, Andreas Fester wrote:
> I experienced the same some time ago and worked it around
> by temporarily switching to a different mirror. It then succeeded,
> and afterwards I could again switch to my usual mirror.
> 
> But, yesterday I had the same issue in my i386 chroot, so the issue
> seems to persist

Use --save-after-login and pbuilder login to open the chroot, add the new
apt key, and only then run the update.

I don't know where the bug is, but it is directly related to apt key
management.

-- 
  "One disk to rule them all, One disk to find them. One disk to bring
  them all and in the darkness grind them. In the Land of Redmond
  where the shadows lie." -- The Silicon Valley Tarot
  Henrique Holschuh


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Andrew Vaughan]

On Monday 27 November 2006 11:55, Brian May wrote:
> Hello,
>
> Is this a bug in apt?
>
> pbuilder update --override-config --configfile
> /tmp/pbuilder-local.SvMNy19452 W: /home/brian/.pbuilderrc does not exist
> Upgrading for distribution etch
> Building the build Environment
>  -> extracting base tarball [/var/cache/pbuilder/base-etch.tgz]
>  -> creating local configuration
>  -> copying local configuration
>  -> mounting /proc filesystem
>  -> mounting /dev/pts filesystem
>  -> policy-rc.d already exists
>   -> Installing apt-lines
> Refreshing the base.tgz
>  -> upgrading packages
> Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
> Get:2 http://ftp.au.debian.org etch Release [74.4kB]
> Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
> Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
> Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> 99% [5 Packages gzip 0]
>  (hangs for ever)
>
> I have tried waiting for it to timeout, but it doesn't.
>

Don't know whether its related, I stopped using ftp.au.debian.org.  IIRC it 
was replying to package requests with a 302 redirect, which apt-proxy 
seemed to be unable to handle.

Is this a 302 redirect something debian package management/archive mirroring 
tools are expected to handle, or are mirrors not expected to use redirects?

ftp.iinet.net.au/debian/ also seems to be intermittent partially updated.  I 
wonder whether they're mirroring from ftp.au.debian.org, and also having 
problems with the 302 responses. 

HTH
Andrew


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Francesco P. Lovergine]

On Tue, Nov 28, 2006 at 01:34:54AM +1100, Andrew Vaughan wrote:
> > Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
> > Get:2 http://ftp.au.debian.org etch Release [74.4kB]
> > Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
> > Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
> > Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> > 99% [5 Packages gzip 0]
> >  (hangs for ever)
> >
> > I have tried waiting for it to timeout, but it doesn't.
> >
> 
> Don't know whether its related, I stopped using ftp.au.debian.org.  IIRC it 
> was replying to package requests with a 302 redirect, which apt-proxy 
> seemed to be unable to handle.
> 
> Is this a 302 redirect something debian package management/archive mirroring 
> tools are expected to handle, or are mirrors not expected to use redirects?
> 
> ftp.iinet.net.au/debian/ also seems to be intermittent partially updated.  I 
> wonder whether they're mirroring from ftp.au.debian.org, and also having 
> problems with the 302 responses. 

This is indepent on mirror choice I think. I got the same issue with ftp.it and 
solved
twice as pointed by henrique. Installing debian-archive-keyring in the
pbuilder chroot (with the new recent key) just before updating solved the
issue this time and in the previous case also. 

-- 
Francesco P. Lovergine


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Andreas Fester]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Henrique de Moraes Holschuh wrote:
> On Mon, 27 Nov 2006, Andreas Fester wrote:
>> I experienced the same some time ago and worked it around
>> by temporarily switching to a different mirror. It then succeeded,
>> and afterwards I could again switch to my usual mirror.
>>
>> But, yesterday I had the same issue in my i386 chroot, so the issue
>> seems to persist
> 
> Use --save-after-login and pbuilder login to open the chroot, add the new
> apt key, and only then run the update.
> 
> I don't know where the bug is, but it is directly related to apt key
> management.

I tried to track it down; I could reproduce it with non-stripped apt-binaries 
from
a re-compiled apt source package. pstree showed the following processes while
apt-get was hanging:

apt-get(5027)???bzip2(5049)
  ??gpgv(5032)
  ??gzip(5038)
  ??http(5029)
  ??http(5030)

apt-get was blocked in a select() called from apt-get.cc:1354

1353   // Run it
1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
1355  return false;

bzip/gzip/gpgv were hanging in a select() which was called from WaitFd(),
and http did not show a useful stack trace.

Then, strangely, while still debugging, apt-get update suddenly
worked again (even without updating the apt key), so I was not able to
further examine it ... Maybe the above observations help when it happens
again :)

Andreas

- --
Andreas Fester
mailto:[EMAIL PROTECTED]
WWW: http://www.littletux.net
ICQ: 326674288
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFaz9jZ3bQVzeW+rsRAjQVAKCZYlKQftP1lwjz7OvbUUYXJYaZ6wCgv5mp
S4msVMYT39GL2ZaXET4fUF0=
=Glr1
-END PGP SIGNATURE-


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Luis Rodrigo Gallardo Cruz]

On Mon, Nov 27, 2006 at 08:41:23PM +0100, Andreas Fester wrote:
> I tried to track it down; I could reproduce it with non-stripped apt-binaries 
> from
> a re-compiled apt source package. pstree showed the following processes while
> apt-get was hanging:
> 
> apt-get(5027)???bzip2(5049)
>   ??gpgv(5032)
>   ??gzip(5038)
>   ??http(5029)
>   ??http(5030)
> 
> apt-get was blocked in a select() called from apt-get.cc:1354
> 
> 1353   // Run it
> 1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
> 1355  return false;
> 
> bzip/gzip/gpgv were hanging in a select() which was called from WaitFd(),
> and http did not show a useful stack trace.

This sounds similar to
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=341537

Try to see if the place where apt is getting stuck is one where it's
waiting for input from an external process which might have gotten
stuck or dead.

-- 
Rodrigo Gallardo
GPG-Fingerprint: 7C81 E60C 442E 8FBC D975  2F49 0199 8318 ADC9 BC28

Billboard billboard burning bright / in my windshield every night.
Lead me to a decent joint / where I can stop and get a bite.


signature.asc
Description: Digital signature

Re: apt hangs for ever

[Joey Hess]

Andreas Fester wrote:
> I tried to track it down; I could reproduce it with non-stripped apt-binaries 
> from
> a re-compiled apt source package. pstree showed the following processes while
> apt-get was hanging:
> 
> apt-get(5027)???bzip2(5049)
>   ??gpgv(5032)
>   ??gzip(5038)
>   ??http(5029)
>   ??http(5030)

I'm also seeing this, I've been seeing it starting approximatly 2 weeks ago
(well before the new apt key) on several machines (i386, arm) with several
mirrors, including mirrors.kernel.org and ftp.nl.debian.org.

> apt-get was blocked in a select() called from apt-get.cc:1354
> 
> 1353   // Run it
> 1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
> 1355  return false;

Hmm, when I straced apt-get, it was in a loop looking for a file:

select(8, [5 6 7], [], NULL, {0, 50}) = 0 (Timeout)
stat64("/var/lib/apt/lists/partial/mirrors.kernel.org_debian_dists_testing_non-free_binary-i386_Packages.decomp",
0xafe9b960) = -1 ENOENT (No such file or directory)
gettimeofday({1164688481, 613704}, NULL) = 0
rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
write(1, "\r99% [3 Packages bzip2 0]", 25) = 25

I've also seen this on some of the machines. Running apt again clears
this up:

Get: 9 http://mirrors.kernel.org testing/main Packages [4249kB]
Get: 10 http://mirrors.kernel.org testing/main Packages [4249kB]  
50% [9 Packages bzip2 0] [10 Packages 22499/4249kB 0%]  512kB/s 8s
bzip2: Compressed file ends unexpectedly;
perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

Err http://mirrors.kernel.org testing/main Packages   
  Sub-process bzip2 returned an error code (2)

> Then, strangely, while still debugging, apt-get update suddenly
> worked again (even without updating the apt key), so I was not able to
> further examine it ... Maybe the above observations help when it happens
> again :)

Ditto, after I run it 4-5 times it completes.

-- 
see shy jo


signature.asc
Description: Digital signature

Re: apt hangs for ever

[Brian May]

> "Henrique" == Henrique de Moraes Holschuh <[EMAIL PROTECTED]> writes:

Henrique> Use --save-after-login and pbuilder login to open the
Henrique> chroot, add the new apt key, and only then run the
Henrique> update.

I tried that, it didn't help.

The only solution I found when I checked last was to run apt-get via
strace...

I also have plenty of diskspace.
-- 
Brian May <[EMAIL PROTECTED]>


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Peter Palfrader]

On Wed, 29 Nov 2006, Brian May wrote:

> > "Henrique" == Henrique de Moraes Holschuh <[EMAIL PROTECTED]> writes:
> 
> Henrique> Use --save-after-login and pbuilder login to open the
> Henrique> chroot, add the new apt key, and only then run the
> Henrique> update.
> 
> I tried that, it didn't help.
> 
> The only solution I found when I checked last was to run apt-get via
> strace...

I've seen this often in recent weeks.  Disabling pdiffs works around the
issue most of the time.  ^Cing apt-get update and restarting it usually
works too.

Peter
-- 
   |  .''`.  ** Debian GNU/Linux **
  Peter Palfrader  | : :' :  The  universal
 http://www.palfrader.org/ | `. `'  Operating System
   |   `-http://www.debian.org/


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Re: apt hangs for ever

[Russ Allbery]

Peter Palfrader <[EMAIL PROTECTED]> writes:

> I've seen this often in recent weeks.  Disabling pdiffs works around the
> issue most of the time.  ^Cing apt-get update and restarting it usually
> works too.

Also deleting all of the existing lists in /var/lib/apt/lists and then
rerunning apt-get (or aptitude) update seems to make the problem go away.

-- 
Russ Allbery ([EMAIL PROTECTED])   


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]