Re: yum-presto to get multicore support

2012-05-24 Thread Ian Pilcher
On 05/22/2012 05:45 AM, Andre Robatino wrote:
> For some people with fast connections/slow PCs, using deltarpms via yum-presto
> can be slower than downloading the full RPMs. Jonathan Dieter just did a 
> Rawhide
> build (yum-presto-0.8.0-1.fc18) that adds multicore support to yum-presto. 
> Would
> be interested if people would note what rebuild speed they get before and 
> after
> updating to this version, and if the speedup is close to linear. My experience
> is that rebuilding drpms is CPU-bound so there's a good chance it will be.

Excellent!  I'm one of those people who have been removing yum-presto
for exactly the reason that you describe (40Mbps connection, 4-core
SandyBridge CPU).

Would love to test this out.  Can we a F17 build?

-- 

Ian Pilcher arequip...@gmail.com
"If you're going to shift my paradigm ... at least buy me dinner first."


-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

Re: yum-presto to get multicore support

2012-05-22 Thread Adam Pribyl

On Tue, 22 May 2012, Andre Robatino wrote:


Tom Horsley  gmail.com> writes:


It sure looks like it to me. I have a "gkrellm" monitor running, and
I don't see the cpu jump till after the last one is fetched and it
says "rebuilding rpms...".


See https://bugzilla.redhat.com/show_bug.cgi?id=701711#c3 where Jonathan Dieter
says that it's supposed to already be doing the rebuild during drpm download.


I personally never noticed that, but maybe my download is that fast, the 
rebuild progress is so minor, it's invisible on the bar when the 
"rebuilding rpms" message shows.


Anyway interesting..

Adam Pribyl

--
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

yum-presto to get multicore support

2012-05-22 Thread Andre Robatino
Tom Horsley  gmail.com> writes:

> It sure looks like it to me. I have a "gkrellm" monitor running, and
> I don't see the cpu jump till after the last one is fetched and it
> says "rebuilding rpms...".

See https://bugzilla.redhat.com/show_bug.cgi?id=701711#c3 where Jonathan Dieter
says that it's supposed to already be doing the rebuild during drpm download.




-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

Re: yum-presto to get multicore support

2012-05-22 Thread Tom Horsley
On Tue, 22 May 2012 11:49:18 + (UTC)
Andre Robatino wrote:

> > Actually, what would be even more useful is to start the building
> > of the rpms from the drpms as soon as the first drpm is fetched
> > instead of waiting till all of them are fetched before starting
> > the rebuilding.  
> 
> Are you sure that's what it currently does? I thought I'd seen the progress
> substantially higher than 0% at the instant the drpm downloads finish.

It sure looks like it to me. I have a "gkrellm" monitor running, and
I don't see the cpu jump till after the last one is fetched and it
says "rebuilding rpms...".
-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

yum-presto to get multicore support

2012-05-22 Thread Andre Robatino
Tom Horsley  gmail.com> writes:

> Actually, what would be even more useful is to start the building
> of the rpms from the drpms as soon as the first drpm is fetched
> instead of waiting till all of them are fetched before starting
> the rebuilding.

Are you sure that's what it currently does? I thought I'd seen the progress
substantially higher than 0% at the instant the drpm downloads finish.




-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

Re: yum-presto to get multicore support

2012-05-22 Thread Tom Horsley
On Tue, 22 May 2012 10:45:37 + (UTC)
Andre Robatino wrote:

> Jonathan Dieter just did a Rawhide
> build (yum-presto-0.8.0-1.fc18) that adds multicore support to yum-presto.

Actually, what would be even more useful is to start the building
of the rpms from the drpms as soon as the first drpm is fetched
instead of waiting till all of them are fetched before starting
the rebuilding.
-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

yum-presto to get multicore support

2012-05-22 Thread Andre Robatino
For some people with fast connections/slow PCs, using deltarpms via yum-presto
can be slower than downloading the full RPMs. Jonathan Dieter just did a Rawhide
build (yum-presto-0.8.0-1.fc18) that adds multicore support to yum-presto. Would
be interested if people would note what rebuild speed they get before and after
updating to this version, and if the speedup is close to linear. My experience
is that rebuilding drpms is CPU-bound so there's a good chance it will be.

I'd also be interested if someone more familiar with the deltaiso code than me
could venture an opinion as to whether the same basic approach would work for
that.

This is important because in recent years, networks have gotten faster but
individual CPUs mostly haven't. This will help deltarpms to keep up.

yum-presto build: http://koji.fedoraproject.org/koji/buildinfo?buildID=320054

RFE: Yum should use multiple threads to reassemble deltarpms
https://bugzilla.redhat.com/show_bug.cgi?id=701711

-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test