Re: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread Johnny Hughes

Les Mikesell wrote:

Johnny Hughes wrote:


Is there a way to coax several hosts behind the same caching proxy to 
use the same URL as the 1st choice but still fail over and try others 
if there is a problem?  And preferably without having to manually 
edit files on each machine or coordinate choices.


Fatestmirror does not work with a proxy server ... however you can 
adjust your yum.conf to use the priority failover method, from 'man 
yumconf':


===
failovermethod

 Either ‘roundrobin’ or ‘priority’.

 ‘roundrobin’  randomly selects a URL out of the list of URLs to 
start with and proceeds through each of them as it encounters a 
failure contacting the host.


 ‘priority’ starts from the first baseurl listed and reads through 
them sequentially.


 failovermethod defaults to ‘roundrobin’ if not specified.
===

You can use baseurl= at the top, then other ones after 
that.  They will be picked in order.


But this doesn't work if two different people in the same building do 
updates since they won't know the other's choice of order.  Plus it is 
painful to have to edit files on every machine to make something happen 
that should work by default.  I liked the Centos 3.x approach with rrdns 
much better since all requests had the same URL even when served by 
different sites.


we had this discussion many times, rrdns does NOT work correctly with 
python, it causes one server to carry 67% of the load, no matter how 
many servers you pass back to it.  It also does not allow us to leverage 
200 public servers.  We do not have enough servers to serve 2 million 
updates if we don't leverage external public mirrors ... and nether does 
fedora.


 ... and you can sync the same config file to everyone's machine if you 
want.  You can also just have a local mirror on any webserver.




signature.asc
Description: OpenPGP digital signature
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


Re: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread Les Mikesell

Johnny Hughes wrote:


Is there a way to coax several hosts behind the same caching proxy to 
use the same URL as the 1st choice but still fail over and try others 
if there is a problem?  And preferably without having to manually edit 
files on each machine or coordinate choices.


Fatestmirror does not work with a proxy server ... however you can 
adjust your yum.conf to use the priority failover method, from 'man 
yumconf':


===
failovermethod

 Either ‘roundrobin’ or ‘priority’.

 ‘roundrobin’  randomly selects a URL out of the list of URLs to 
start with and proceeds through each of them as it encounters a failure 
contacting the host.


 ‘priority’ starts from the first baseurl listed and reads through 
them sequentially.


 failovermethod defaults to ‘roundrobin’ if not specified.
===

You can use baseurl= at the top, then other ones after 
that.  They will be picked in order.


But this doesn't work if two different people in the same building do 
updates since they won't know the other's choice of order.  Plus it is 
painful to have to edit files on every machine to make something happen 
that should work by default.  I liked the Centos 3.x approach with rrdns 
much better since all requests had the same URL even when served by 
different sites.


--
   Les Mikesell
[EMAIL PROTECTED]

___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


Re: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread Karanbir Singh

Les Mikesell wrote:

Is there a way to coax several hosts behind the same caching proxy to
use the same URL as the 1st choice but still fail over and try others if
there is a problem? And preferably without having to manually edit files
on each machine or coordinate choices.


I've been using ncache ( nginx+caching ) to the same effect at one setup 
to achieve something like this, but I have a script that hijacks the 
request to mirrorlist= fetches and returns my own fixed list from a 
local fixed cache.


I know its very very hacky and completely bogus. But it works for me in 
a very limited sense. Someone might want to pickup on that and develop 
it further into a more functional system perhaps.


But if you dont control the proxy and cant admin/change configs in 
there, then you will need to manually setup each machine to use the same 
set of mirrors and drop the mirrorlist fetch's from .centos.org


- KB
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


Re: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread Johnny Hughes

Les Mikesell wrote:

Johnny Hughes wrote:


Is there a way to coax several hosts behind the same caching proxy to 
use the same URL as the 1st choice but still fail over and try others if 
there is a problem?  And preferably without having to manually edit 
files on each machine or coordinate choices.


Fatestmirror does not work with a proxy server ... however you can 
adjust your yum.conf to use the priority failover method, from 'man 
yumconf':


===
failovermethod

 Either ‘roundrobin’ or ‘priority’.

 ‘roundrobin’  randomly selects a URL out of the list of URLs to 
start with and proceeds through each of them as it encounters a failure 
contacting the host.


 ‘priority’ starts from the first baseurl listed and reads through 
them sequentially.


 failovermethod defaults to ‘roundrobin’ if not specified.
===

You can use baseurl= at the top, then other ones after 
that.  They will be picked in order.






signature.asc
Description: OpenPGP digital signature
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


Re: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread Les Mikesell

Johnny Hughes wrote:



Almost one hour and only 1.7 of 4.8 m was downloaded

This is typical for me getting data from .tw sites.


Then ... find the fastest mirrors and don't use the default.

We can't possibly try to program in thnigs like this on our end.

The fastestmirror script actually makes a connection to the mirrors in 
question, the lower ones should be the best ones.  It is possible that 
is not the cause, but we can't test for that.


You can, however, remark out the "mirrorlist=" line and instead add 
several baseurl= lines yourself that you want to use.


Then you get updates from where ever you want


Is there a way to coax several hosts behind the same caching proxy to 
use the same URL as the 1st choice but still fail over and try others if 
there is a problem?  And preferably without having to manually edit 
files on each machine or coordinate choices.


--
  Les Mikesell
   [EMAIL PROTECTED]

___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


Re: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread Johnny Hughes

tech wrote:

Joseph L. Casale wrote:


Me thinks they call that yum-fastestmirror :)


Me thinks that doesn't work.

fastest mirror give me the lowest values for .tw sites. Which, I think 
mean the fastest. They are in fact, the slowest. Here are some real 
numbers:


base 856 kb 27:38
updates 91 kb 1:20

kernel-devel died after 52:01

At this point several mirrors were tried finally a fast one was found 
and things went quickly and smoothly.


Almost one hour and only 1.7 of 4.8 m was downloaded

This is typical for me getting data from .tw sites.


Then ... find the fastest mirrors and don't use the default.

We can't possibly try to program in thnigs like this on our end.

The fastestmirror script actually makes a connection to the mirrors in 
question, the lower ones should be the best ones.  It is possible that 
is not the cause, but we can't test for that.


You can, however, remark out the "mirrorlist=" line and instead add 
several baseurl= lines yourself that you want to use.


Then you get updates from where ever you want



signature.asc
Description: OpenPGP digital signature
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


RE: [CentOS] Re: Automatic site selection for dowload

2008-06-27 Thread [EMAIL PROTECTED]
tech <> scribbled on Friday, June 27, 2008 9:57 AM:

> Joseph L. Casale wrote:
> 
>> Me thinks they call that yum-fastestmirror :)
> 
> Me thinks that doesn't work.

It works in Sweden. In fact the fastest-mirror thing works better now with the
v5.2 than ever before.


smime.p7s
Description: S/MIME cryptographic signature
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos