On Tue, Apr 24, 2012 at 6:30 PM, Scott Moser <smo...@ubuntu.com> wrote:
> On Tue, 24 Apr 2012, Deepti B. Kalakeri wrote: > > > According to the comments in the bug above we have been able to resolve > the 404 Not Found error and HashSum issue by using the following 2 things. > > 1) sudo sed -i.dist 's,archive.ubuntu.com, > archive.ubuntu.com.s3.amazonaws.com,g' /etc/apt/sources.list > > 2) echo "Acquire::http::Pipeline-Depth 0;" | sudo tee > /etc/apt/apt.conf.d/99no-pipelining > > > > I see on ci.linaro.org init for precise instance ami-b5ea34dc has been > updated to use all the above. > > But, even after applying those changes I still I got the 404 file not > found, though not the HashSum mismatch errors this morning continuously. > > With this the builds started to be queue in for longer time. > > Finally I had to change the ami instance used from beta2 ami-b5ea34dc > instance to beta1 ami-2061b349 instance and was able to proceed with the > builds. > > I can't come up with an explanation for this. > This doesn't really make any sense to me. > > I just launched an instance of ami-b5ea34dc, and ran the same 2 commands > above and cannot replicate the issues. After doing so, I also did: > apt-get dist-upgrade > which downloaded 86M in 142 packages, and then > apt-get --download-only --assume-yes install ubuntu-desktop^ > which downloaded 454M in 1009 packages > > Well I have logs for the slave that used ami instance ami-b5ea34dc and failed to start with the 404 failure in the morning. Now the same slaves using ami-b5ea34dc instance are able to start without the problem. I am not an EC2 expert so am not sure why that failure occurred when I tried earlier. Anyways will keep a watch and inform if I see the problem again. > Also, I see the following http URL in the error slave logs: > > W: Failed to fetch > http://us-east-1.ec2.us-east-1.ec2.archive.ubuntu.com.s3.amazonaws.com/ubuntu/dists/precise-updates/universe/binary-i386/Packages > 404 Not Found > > This is a very confusing error indeed. The fact is that 'Packages', as > opposed to Packages.gz or Packages.bz2 does not really exist anywhere. > The error you're seeing is because the apt did not like the content it > got for Packages.gz or Packages.bz2 (likely both of them) , and fell back > to trying Packages, which resulted in a 404. > > Its annoying that apt basically hides the original error. > > -- > You received this bug notification because you are subscribed to Linaro > CI. > https://bugs.launchpad.net/bugs/932088 > > Title: > Ubuntu EC2 package mirror intermitent failures > > Status in Linaro Android Infrastructure: > In Progress > Status in Linaro Continuous Integration: > New > Status in Ubuntu: > Confirmed > > Bug description: > Not too frequent, but regularly (say, once a month) https://android- > build.linaro.org/ service, which is Jenkins with EC2 slaves, gets > failures when initializing EC2 instances, which involves installing > packages. > > The log looks like: > Connecting to ec2-23-20-20-233.compute-1.amazonaws.com on port 22. > Waiting for SSH to come up. Sleeping 5. > Connecting to ec2-23-20-20-233.compute-1.amazonaws.com on port 22. > Connected via SSH. > Authenticating as ubuntu > Connecting to ec2-23-20-20-233.compute-1.amazonaws.com on port 22. > Connected via SSH. > Executing init script > + apt-get update > Ign http://security.ubuntu.com natty-security InRelease > Get:1 http://security.ubuntu.com natty-security Release.gpg [198 B] > Get:2 http://security.ubuntu.com natty-security Release [39.8 kB] > Ign http://us-east-1.ec2.archive.ubuntu.com natty InRelease > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates InRelease > Ign http://us-east-1.ec2.archive.ubuntu.com natty Release.gpg > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates Release.gpg > Ign http://us-east-1.ec2.archive.ubuntu.com natty Release > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates Release > Ign http://us-east-1.ec2.archive.ubuntu.com natty/main amd64 > Packages/DiffIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty/universe amd64 > Packages/DiffIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty/main TranslationIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty/universe > TranslationIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates/main amd64 > Packages/DiffIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates/universe amd64 > Packages/DiffIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates/main > TranslationIndex > Ign http://us-east-1.ec2.archive.ubuntu.com natty-updates/universe > TranslationIndex > Err http://us-east-1.ec2.archive.ubuntu.com natty/main Sources > 403 Forbidden [IP: 10.210.205.172 80] > Err http://us-east-1.ec2.archive.ubuntu.com natty/universe Sources > 403 Forbidden [IP: 10.210.205.172 80] > ... > > > Trying to access a specific file manually shows that there're > interleaving 404 and 403 responses for it (the file indeed doesn't exists). > And generally situation look like 403 is being intermittently returned for > any url (be it 200 or 404 one). > > ubuntu@ip-10-243-34-224:~$ wget > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > --2012-02-14 13:42:12-- > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > Resolving us-east-1.ec2.archive.ubuntu.com... 10.250.142.223, > 10.252.111.96, 10.202.26.15, ... > Connecting to us-east-1.ec2.archive.ubuntu.com|10.250.142.223|:80... > connected. > HTTP request sent, awaiting response... 404 Not Found > 2012-02-14 13:42:12 ERROR 404: Not Found. > > ubuntu@ip-10-243-34-224:~$ wget > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > --2012-02-14 13:42:14-- > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > Resolving us-east-1.ec2.archive.ubuntu.com... 10.210.205.172, > 10.250.142.223, 10.252.111.96, ... > Connecting to us-east-1.ec2.archive.ubuntu.com|10.210.205.172|:80... > connected. > HTTP request sent, awaiting response... 403 Forbidden > 2012-02-14 13:42:14 ERROR 403: Forbidden. > > ubuntu@ip-10-243-34-224:~$ wget > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > --2012-02-14 13:42:16-- > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > Resolving us-east-1.ec2.archive.ubuntu.com... 10.202.26.15, > 10.210.205.172, 10.250.142.223, ... > Connecting to us-east-1.ec2.archive.ubuntu.com|10.202.26.15|:80... > connected. > HTTP request sent, awaiting response... 404 Not Found > 2012-02-14 13:42:16 ERROR 404: Not Found. > > ubuntu@ip-10-243-34-224:~$ wget > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > --2012-02-14 13:42:17-- > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > Resolving us-east-1.ec2.archive.ubuntu.com... 10.252.111.96, > 10.202.26.15, 10.210.205.172, ... > Connecting to us-east-1.ec2.archive.ubuntu.com|10.252.111.96|:80... > connected. > HTTP request sent, awaiting response... 404 Not Found > 2012-02-14 13:42:17 ERROR 404: Not Found. > > ubuntu@ip-10-243-34-224:~$ wget > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > --2012-02-14 13:42:18-- > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > Resolving us-east-1.ec2.archive.ubuntu.com... 10.250.142.223, > 10.252.111.96, 10.202.26.15, ... > Connecting to us-east-1.ec2.archive.ubuntu.com|10.250.142.223|:80... > connected. > HTTP request sent, awaiting response... 404 Not Found > 2012-02-14 13:42:18 ERROR 404: Not Found. > > ubuntu@ip-10-243-34-224:~$ wget > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > --2012-02-14 13:42:19-- > http://us-east-1.ec2.archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources > Resolving us-east-1.ec2.archive.ubuntu.com... 10.210.205.172, > 10.250.142.223, 10.252.111.96, ... > Connecting to us-east-1.ec2.archive.ubuntu.com|10.210.205.172|:80... > connected. > HTTP request sent, awaiting response... 403 Forbidden > 2012-02-14 13:42:19 ERROR 403: Forbidden. > > To manage notifications about this bug go to: > > https://bugs.launchpad.net/linaro-android-infrastructure/+bug/932088/+subscriptions > -- Thanks and Regards, Deepti -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/932088 Title: Ubuntu EC2 package mirror intermitent failures To manage notifications about this bug go to: https://bugs.launchpad.net/linaro-android-infrastructure/+bug/932088/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
