Re: [CentOS] Re: Automatic site selection for dowload
Les Mikesell wrote: Johnny Hughes wrote: Is there a way to coax several hosts behind the same caching proxy to use the same URL as the 1st choice but still fail over and try others if there is a problem? And preferably without having to manually edit files on each machine or coordinate choices. Fatestmirror does not work with a proxy server ... however you can adjust your yum.conf to use the priority failover method, from 'man yumconf': === failovermethod Either ‘roundrobin’ or ‘priority’. ‘roundrobin’ randomly selects a URL out of the list of URLs to start with and proceeds through each of them as it encounters a failure contacting the host. ‘priority’ starts from the first baseurl listed and reads through them sequentially. failovermethod defaults to ‘roundrobin’ if not specified. === You can use baseurl= at the top, then other ones after that. They will be picked in order. But this doesn't work if two different people in the same building do updates since they won't know the other's choice of order. Plus it is painful to have to edit files on every machine to make something happen that should work by default. I liked the Centos 3.x approach with rrdns much better since all requests had the same URL even when served by different sites. we had this discussion many times, rrdns does NOT work correctly with python, it causes one server to carry 67% of the load, no matter how many servers you pass back to it. It also does not allow us to leverage 200 public servers. We do not have enough servers to serve 2 million updates if we don't leverage external public mirrors ... and nether does fedora. ... and you can sync the same config file to everyone's machine if you want. You can also just have a local mirror on any webserver. signature.asc Description: OpenPGP digital signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Re: Automatic site selection for dowload
Johnny Hughes wrote: Is there a way to coax several hosts behind the same caching proxy to use the same URL as the 1st choice but still fail over and try others if there is a problem? And preferably without having to manually edit files on each machine or coordinate choices. Fatestmirror does not work with a proxy server ... however you can adjust your yum.conf to use the priority failover method, from 'man yumconf': === failovermethod Either ‘roundrobin’ or ‘priority’. ‘roundrobin’ randomly selects a URL out of the list of URLs to start with and proceeds through each of them as it encounters a failure contacting the host. ‘priority’ starts from the first baseurl listed and reads through them sequentially. failovermethod defaults to ‘roundrobin’ if not specified. === You can use baseurl= at the top, then other ones after that. They will be picked in order. But this doesn't work if two different people in the same building do updates since they won't know the other's choice of order. Plus it is painful to have to edit files on every machine to make something happen that should work by default. I liked the Centos 3.x approach with rrdns much better since all requests had the same URL even when served by different sites. -- Les Mikesell [EMAIL PROTECTED] ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Re: Automatic site selection for dowload
Les Mikesell wrote: Is there a way to coax several hosts behind the same caching proxy to use the same URL as the 1st choice but still fail over and try others if there is a problem? And preferably without having to manually edit files on each machine or coordinate choices. I've been using ncache ( nginx+caching ) to the same effect at one setup to achieve something like this, but I have a script that hijacks the request to mirrorlist= fetches and returns my own fixed list from a local fixed cache. I know its very very hacky and completely bogus. But it works for me in a very limited sense. Someone might want to pickup on that and develop it further into a more functional system perhaps. But if you dont control the proxy and cant admin/change configs in there, then you will need to manually setup each machine to use the same set of mirrors and drop the mirrorlist fetch's from .centos.org - KB ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Re: Automatic site selection for dowload
Les Mikesell wrote: Johnny Hughes wrote: Is there a way to coax several hosts behind the same caching proxy to use the same URL as the 1st choice but still fail over and try others if there is a problem? And preferably without having to manually edit files on each machine or coordinate choices. Fatestmirror does not work with a proxy server ... however you can adjust your yum.conf to use the priority failover method, from 'man yumconf': === failovermethod Either ‘roundrobin’ or ‘priority’. ‘roundrobin’ randomly selects a URL out of the list of URLs to start with and proceeds through each of them as it encounters a failure contacting the host. ‘priority’ starts from the first baseurl listed and reads through them sequentially. failovermethod defaults to ‘roundrobin’ if not specified. === You can use baseurl= at the top, then other ones after that. They will be picked in order. signature.asc Description: OpenPGP digital signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Re: Automatic site selection for dowload
Johnny Hughes wrote: Almost one hour and only 1.7 of 4.8 m was downloaded This is typical for me getting data from .tw sites. Then ... find the fastest mirrors and don't use the default. We can't possibly try to program in thnigs like this on our end. The fastestmirror script actually makes a connection to the mirrors in question, the lower ones should be the best ones. It is possible that is not the cause, but we can't test for that. You can, however, remark out the "mirrorlist=" line and instead add several baseurl= lines yourself that you want to use. Then you get updates from where ever you want Is there a way to coax several hosts behind the same caching proxy to use the same URL as the 1st choice but still fail over and try others if there is a problem? And preferably without having to manually edit files on each machine or coordinate choices. -- Les Mikesell [EMAIL PROTECTED] ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Re: Automatic site selection for dowload
tech wrote: Joseph L. Casale wrote: Me thinks they call that yum-fastestmirror :) Me thinks that doesn't work. fastest mirror give me the lowest values for .tw sites. Which, I think mean the fastest. They are in fact, the slowest. Here are some real numbers: base 856 kb 27:38 updates 91 kb 1:20 kernel-devel died after 52:01 At this point several mirrors were tried finally a fast one was found and things went quickly and smoothly. Almost one hour and only 1.7 of 4.8 m was downloaded This is typical for me getting data from .tw sites. Then ... find the fastest mirrors and don't use the default. We can't possibly try to program in thnigs like this on our end. The fastestmirror script actually makes a connection to the mirrors in question, the lower ones should be the best ones. It is possible that is not the cause, but we can't test for that. You can, however, remark out the "mirrorlist=" line and instead add several baseurl= lines yourself that you want to use. Then you get updates from where ever you want signature.asc Description: OpenPGP digital signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
RE: [CentOS] Re: Automatic site selection for dowload
tech <> scribbled on Friday, June 27, 2008 9:57 AM: > Joseph L. Casale wrote: > >> Me thinks they call that yum-fastestmirror :) > > Me thinks that doesn't work. It works in Sweden. In fact the fastest-mirror thing works better now with the v5.2 than ever before. smime.p7s Description: S/MIME cryptographic signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos