Re: [Yum-devel] [GSoC] Avahi repositories for yum

2011-03-23 Thread James Antill
On Mon, 2011-03-21 at 01:48 +0800, Yin Qiu wrote:
 Hi,
 
 I'm Yin from China. As the subject line says, I'd like to apply for
 the summer project of adding automatic repo discovery for yum. I've
 personally contacted Roland McGrath, who is supposed to be the mentor
 for this project, and he told me to discuss this with the community. I
 don't have idea which mailing list is best suitable for this
 discussion, so I'm sorry for my cross-posting.
 
 I'll briefly talk about my understanding about the idea. In the spirit
 of dividing the project into separate pieces, I suggest the final
 deliverables include:

 Just as an FYI to everybody, this is the original idea as posted:

http://fedoraproject.org/wiki/Summer_coding_ideas_for_2011#Avahi_yum_repositories

...this is notably different from previous POC avahi ideas, the idea of
both was more that avahi could be used to share a sub-set of a repo.
that had already been downloaded.

 The main RFEs seem to be:

1. Only required change on client is installing a plugin.

2. Plugin will use avahi to find mirrors for repos, and add those
URLs to the mirrorlist.

3. Plugin will include proper NFS support, which means if the URL is
nfs:/blah ... the plugin will make sure that NFS location is mounted
somewhere, and then pass the file:/ URLs to yum.

4. Tool for servers to advertise that they have a mirror of repo. XYZ.

5. Get plugin installed for anaconda environment.

 1) a script to help repositories that reside on nfs or http servers to
 advertise their presence. Does this mean we shall add a new service
 type, say _yum._tcp, to zeroconf?

 I don't think you can be that generic, with this proposal. As it's all
about mirroring specific repos. So you need to be able to keep the avahi
advertised mirrors for fedora and updates away from each other.
 The other problem is how you identify the repos. ... the obvious answer
would be to use the Repo id's ... except that doesn't work for Anaconda,
AIUI ... and isn't 100% for other usecases I bet Roland is thinking
about.

 The way my attempt at avahi worked was to go super generic and have a
CAS (http://en.wikipedia.org/wiki/Content-addressable_storage), and then
whenever yum would want to download something it'd ask any of the avahi
providers if they had it (over simple http/ftp/file/whatever).
 This solves all the repo. identification problems, because you don't
care ... if they have the bits, you get them locally.


 Roland might even be happy(ier) here with some work on MirrorManager so
that you can easily create private mirrors, using a command line tool
(although that would remove yum and avahi, so is a very different
proposal).

 2) a plugin that, once enabled, automatically discovers published yum
 services and adds it to the pool.

 Kind of, you'd need to get two pieces of information:

1. What is the repo.
2. What is the mirror URL.

...and then lookup the repo. object given #1 and add the mirror URL #2
to it.

 3) modification to anaconda to incorporate automatic yum repo
 detection.

 This should be the fairly simple case of getting the anaconda guys to
include the plugin (assuming you can can make it work in the anaconda
environment).

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel


[GSoC] Avahi repositories for yum

2011-03-20 Thread Yin Qiu
Hi,

I'm Yin from China. As the subject line says, I'd like to apply for the summer 
project of adding automatic repo discovery for yum. I've personally contacted 
Roland McGrath, who is supposed to be the mentor for this project, and he told 
me to discuss this with the community. I don't have idea which mailing list is 
best suitable for this discussion, so I'm sorry for my cross-posting.

I'll briefly talk about my understanding about the idea. In the spirit of 
dividing the project into separate pieces, I suggest the final deliverables 
include:

1) a script to help repositories that reside on nfs or http servers to 
advertise their presence. Does this mean we shall add a new service type, say 
_yum._tcp, to zeroconf?
2) a plugin that, once enabled, automatically discovers published yum services 
and adds it to the pool.
3) modification to anaconda to incorporate automatic yum repo detection.

Any comments? Thanks.

--
Yin Qiu
Nanjing University, China

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel


Re: [GSoC] Avahi repositories for yum

2011-03-20 Thread seth vidal
On Mon, 2011-03-21 at 01:48 +0800, Yin Qiu wrote:
 Hi,
 
 I'm Yin from China. As the subject line says, I'd like to apply for the 
 summer project of adding automatic repo discovery for yum. I've personally 
 contacted Roland McGrath, who is supposed to be the mentor for this project, 
 and he told me to discuss this with the community. I don't have idea which 
 mailing list is best suitable for this discussion, so I'm sorry for my 
 cross-posting.
 
 I'll briefly talk about my understanding about the idea. In the spirit of 
 dividing the project into separate pieces, I suggest the final deliverables 
 include:
 
 1) a script to help repositories that reside on nfs or http servers to 
 advertise their presence. Does this mean we shall add a new service type, say 
 _yum._tcp, to zeroconf?
 2) a plugin that, once enabled, automatically discovers published yum 
 services and adds it to the pool.
 3) modification to anaconda to incorporate automatic yum repo detection.
 
 Any comments? Thanks.
 

An avahi plugin already exists:

http://james.fedorapeople.org/yum/avahi/


James wrote it a couple of years back.

-sv


-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel


Re: [GSoC] Avahi repositories for yum

2011-03-20 Thread Paul Wouters
On Mon, 21 Mar 2011, Yin Qiu wrote:

Have fun with your GSoC project!

 I'll briefly talk about my understanding about the idea. In the spirit of 
 dividing the project into separate pieces, I suggest the final deliverables 
 include:

 1) a script to help repositories that reside on nfs or http servers to 
 advertise their presence. Does this mean we shall add a new service type, say 
 _yum._tcp, to zeroconf?
 2) a plugin that, once enabled, automatically discovers published yum 
 services and adds it to the pool.
 3) modification to anaconda to incorporate automatic yum repo detection.

- Allow for checking with GPG, and make it the default to require it to ensure 
my machine does
   not start downloading evil packages in an evil network
- anaconda last I checked (el5) was somewhat limited in what authentication it 
could do
   during install and what repos it would write in the yum.repos.d - it has to 
come from
   a 'release' package. Perhaps that announcing would really help.
- discovering external far away repos would be nice (esp for europeans that 
don't have software
   patents and could use mp3, ecc, based package repos)
- with DNSSEC, one could publish the GPG key for a repo in the DNS as a trust 
anchor to use. I am
   not sure if a dnssec validating resolver is available on install, but we are 
working on making
   it available on all installs.

Paul
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel