caching in general (was Re: [Fedora-livecd-list] caching repository?)

2008-01-16 Thread Bill Nottingham
Douglas McClendon ([EMAIL PROTECTED]) said: 
 Tim Wood wrote:
 Thanks.  That will work.  InstantMirror does look more maintainable but 
 has the downside (at v0.4) that it looks a little early to use as the 
 basis of real work.

 Yes- I assumed --cache was so obvious, that you must have wanted something 
 for a wider purpose than just livecd creation.

Speaking of, we already have:

- livecd-creator --cache
- /var/cache/pungi
- /var/cache/yum/repository
- InstantMirror

Is there any work/thought on makeing these not duplicate each other
so much?

Bill

--
Fedora-livecd-list mailing list
Fedora-livecd-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-livecd-list


Re: caching in general (was Re: [Fedora-livecd-list] caching repository?)

2008-01-16 Thread Tim Wood
InstantMirror (I suspect) has the advantage that it can be utilized 
anytime you're looking for rpms for livecd-creator, your local machine, 
etc.  And, I suspect, by configuring it right, you can actually use it 
as a repo server for an entire network.


They say they're working on creating a daemon that accepts requests and 
manages downloads, etc., as appropriate.  So, turning the question 
around, maybe something like InstantMirror could become a common 
resource utilized by all of these tools?


Tim



Bill Nottingham wrote:
Douglas McClendon ([EMAIL PROTECTED]) said: 
  

Tim Wood wrote:

Thanks.  That will work.  InstantMirror does look more maintainable but 
has the downside (at v0.4) that it looks a little early to use as the 
basis of real work.
  
Yes- I assumed --cache was so obvious, that you must have wanted something 
for a wider purpose than just livecd creation.



Speaking of, we already have:

- livecd-creator --cache
- /var/cache/pungi
- /var/cache/yum/repository
- InstantMirror

Is there any work/thought on makeing these not duplicate each other
so much?

Bill

--
Fedora-livecd-list mailing list
Fedora-livecd-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-livecd-list

  



--
_
Tim Wood, CLP, RHCT
719.338.7484 (tel)

The Data Wranglers
Web, Database  more sincesince 1994
www.datawranglers.com

--
Fedora-livecd-list mailing list
Fedora-livecd-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-livecd-list


Re: caching in general (was Re: [Fedora-livecd-list] caching repository?)

2008-01-16 Thread Jesse Keating
On Wed, 16 Jan 2008 14:35:28 -0500
Bill Nottingham [EMAIL PROTECTED] wrote:

 Speaking of, we already have:
 
 - livecd-creator --cache
 - /var/cache/pungi
 - /var/cache/yum/repository
 - InstantMirror
 
 Is there any work/thought on makeing these not duplicate each other
 so much?

I've thought some about it.  We don't want to stomp on the
system /var/cache/yum, don't want to accidentally clear a cache when it
shouldn't, or lock the system yum from doing anything while you're
composing.

We'd have to implement our own locking to make sure other processes
don't stomp on other compose processes going (something I don't really
handle well in pungi as it is).

Pungi itself uses yum caching code for max code reuse.  Comes in handy
for using yum's downloading code too as I get the cache verification
for free.

At some point livecd and pungi could potentially merge into one code
base, that does different parts after creating yum objects and logging
objects and such.  Processing the kickstart file and getting packages
out of the repos is roughly the same, it's what we do with those
packages that are different.

-- 
Jesse Keating
Fedora -- All my bits are free, are yours?


signature.asc
Description: PGP signature
--
Fedora-livecd-list mailing list
Fedora-livecd-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-livecd-list


Re: caching in general (was Re: [Fedora-livecd-list] caching repository?)

2008-01-16 Thread Colin Walters
On Wed, 2008-01-16 at 17:28 -0500, Jesse Keating wrote:

 I've thought some about it.  We don't want to stomp on the
 system /var/cache/yum, don't want to accidentally clear a cache when it
 shouldn't, or lock the system yum from doing anything while you're
 composing.

I think it would be cool if the operating system basically had a big
key-value cache, that would be automatically purged as system space ran
low.  So various tools could stuff rpm SHA1-rpm into there.  Maybe you
could even do this just using a filesystem interface
say /var/cache/objects.  

You don't really need yum instances and livecd-creator etc. to share say
the sqlite db downloads (though that would be nice); the big part is the
RPMs.


--
Fedora-livecd-list mailing list
Fedora-livecd-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-livecd-list