Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-02-04 Thread Enrico Weigelt
* Dale rdalek1...@gmail.com wrote: If one instance of emerge doesn't know what the other instance has already done, then the second one could emerge it again. Doesn't emerge do all the calculating at the beginning and runs with that until the end? That's also one of my questions - does

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-02-04 Thread Enrico Weigelt
Nikos Chantziaras rea...@arcor.de wrote: I'm not aware of any package system that supports this. Briegel does this. It can even build the same package (maybe with different feature flags) in parallel. Basicly it walks the dependency tree from leaves to root, builds binpkg's yet missing (at

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-28 Thread Dale
J. Roeleveld wrote: On Thursday 27 January 2011 23:53:04 Dale wrote: I just used -j with no number. It worked fine and I played Solitaire and checked my email while it was running. The only thing I noticed was it using swap. That could slow things down but otherwise, it worked fine. I

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Neil Bothwick
On Thu, 27 Jan 2011 07:12:24 +0200, Nikos Chantziaras wrote: I'm aware that portage uses locking mechanism before modifying 'world' file, but what about the actual building process ? I'd expect emerge to check if dependency package is already build/installed (or currently being build by

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Dale
Neil Bothwick wrote: On Thu, 27 Jan 2011 07:12:24 +0200, Nikos Chantziaras wrote: I'm aware that portage uses locking mechanism before modifying 'world' file, but what about the actual building process ? I'd expect emerge to check if dependency package is already build/installed (or

[gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Nikos Chantziaras
On 01/27/2011 03:11 PM, Dale wrote: [...] I am using the -j option for the first time now. I'm updating KDE. It seems to work fine. It doesn't scroll all the stuff like with a regular emerges but this new rig is so fast, I can't read it anyway. I did have a package to fail and it spit out the

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread YoYo Siska
On Thu, Jan 27, 2011 at 03:33:21PM +0200, Nikos Chantziaras wrote: On 01/27/2011 03:11 PM, Dale wrote: [...] I am using the -j option for the first time now. I'm updating KDE. It seems to work fine. It doesn't scroll all the stuff like with a regular emerges but this new rig is so fast, I

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 15:05:25 YoYo Siska wrote: On Thu, Jan 27, 2011 at 03:33:21PM +0200, Nikos Chantziaras wrote: On 01/27/2011 03:11 PM, Dale wrote: [...] I am using the -j option for the first time now. I'm updating KDE. It seems to work fine. It doesn't scroll all the stuff

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Neil Bothwick
On Thu, 27 Jan 2011 15:33:21 +0200, Nikos Chantziaras wrote: I am using the -j option for the first time now. I'm updating KDE. It seems to work fine. It doesn't scroll all the stuff like with a regular emerges but this new rig is so fast, I can't read it anyway. I did have a package to

[gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Nikos Chantziaras
On 01/27/2011 04:16 PM, Neil Bothwick wrote: On Thu, 27 Jan 2011 15:33:21 +0200, Nikos Chantziaras wrote: I am using the -j option for the first time now. I'm updating KDE. It seems to work fine. It doesn't scroll all the stuff like with a regular emerges but this new rig is so fast, I can't

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Neil Bothwick
On Thu, 27 Jan 2011 16:30:30 +0200, Nikos Chantziaras wrote: Using --jobs does a better job of making use of your CPU because one package can use it fully for compiling while another is configuring. And what about the last package? The time you gained for faster configure and install

[gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Nikos Chantziaras
On 01/27/2011 04:53 PM, Neil Bothwick wrote: On Thu, 27 Jan 2011 16:30:30 +0200, Nikos Chantziaras wrote: Using --jobs does a better job of making use of your CPU because one package can use it fully for compiling while another is configuring. And what about the last package? The time you

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Paul Hartman
On Thu, Jan 27, 2011 at 7:33 AM, Nikos Chantziaras rea...@arcor.de wrote: On 01/27/2011 03:11 PM, Dale wrote: [...] I am using the -j option for the first time now. I'm updating KDE. It seems to work fine. It doesn't scroll all the stuff like with a regular emerges but this new rig is so

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Alan McKinnon
Apparently, though unproven, at 17:09 on Thursday 27 January 2011, Nikos Chantziaras did opine thusly: On 01/27/2011 04:53 PM, Neil Bothwick wrote: On Thu, 27 Jan 2011 16:30:30 +0200, Nikos Chantziaras wrote: Using --jobs does a better job of making use of your CPU because one package can

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread PK
On Thu, Jan 27, 2011 at 5:12 AM, Nikos Chantziaras rea...@arcor.de wrote: You can try, but the second instance with simply block until the lock has been removed. I'm not aware of any package system that supports this. I don't think adding support for this justifies the added complexity.

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Neil Bothwick
On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: So on a 20 package world update, only 19 are faster while the 20th runs at the same speed? Where's the loss there? Even if the last were slower, it would be worth it. Given the amount of time unpack/configure/install of most

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Dale
Alan McKinnon wrote: Apparently, though unproven, at 17:09 on Thursday 27 January 2011, Nikos Chantziaras did opine thusly: Given the amount of time unpack/configure/install of most packages needs (very short), my observation is that it would not be worth it. KDE.

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread David W Noon
On Thu, 27 Jan 2011 11:10:02 +0100, Neil Bothwick wrote about Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies: On Thu, 27 Jan 2011 07:12:24 +0200, Nikos Chantziaras wrote: [snip] You can try, but the second instance with simply block until the lock has

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread YoYo Siska
On Thu, Jan 27, 2011 at 03:12:49PM +0100, J. Roeleveld wrote: On Thursday 27 January 2011 15:05:25 YoYo Siska wrote: On Thu, Jan 27, 2011 at 03:33:21PM +0200, Nikos Chantziaras wrote: On 01/27/2011 03:11 PM, Dale wrote: [...] I am using the -j option for the first time now. I'm

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Allan Gottlieb
On Thu, Jan 27 2011, Neil Bothwick wrote: On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: So on a 20 package world update, only 19 are faster while the 20th runs at the same speed? Where's the loss there? Even if the last were slower, it would be worth it. Given the

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 19:56:23 Allan Gottlieb wrote: On Thu, Jan 27 2011, Neil Bothwick wrote: On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: So on a 20 package world update, only 19 are faster while the 20th runs at the same speed? Where's the loss there? Even if the

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Dale
YoYo Siska wrote: Yes. It might not be perfect, but mostly it works pretty well. Once make started 10 or so process, which ate all my ram, because I forgot to reenable swap, when I was playing with something before that :) yoyo I noticed the same thing with mine. It used a LOT of ram. I

[gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Nikos Chantziaras
On 01/27/2011 09:41 PM, Dale wrote: YoYo Siska wrote: Yes. It might not be perfect, but mostly it works pretty well. Once make started 10 or so process, which ate all my ram, because I forgot to reenable swap, when I was playing with something before that :) yoyo I noticed the same thing

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread YoYo Siska
On Thu, Jan 27, 2011 at 08:18:34PM +0100, J. Roeleveld wrote: On Thursday 27 January 2011 19:56:23 Allan Gottlieb wrote: On Thu, Jan 27 2011, Neil Bothwick wrote: On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: So on a 20 package world update, only 19 are faster while the

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Bill Longman
On 01/27/2011 12:15 PM, Nikos Chantziaras wrote: Btw, if you're using more instances than the amount of CPUs, the result will be slow-down. With the default kernel scheduler, best if amount of CPUs + 1. (On a 4-core, that's -j5). And if you use emerge's --jobs 2, each of those jobs will

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Paul Hartman
On Thu, Jan 27, 2011 at 2:15 PM, Nikos Chantziaras rea...@arcor.de wrote: On 01/27/2011 09:41 PM, Dale wrote: YoYo Siska wrote: Yes. It might not be perfect, but mostly it works pretty well. Once make started 10 or so process, which ate all my ram, because I forgot to reenable swap, when I

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 21:25:02 Paul Hartman wrote: On Thu, Jan 27, 2011 at 2:15 PM, Nikos Chantziaras rea...@arcor.de wrote: On 01/27/2011 09:41 PM, Dale wrote: YoYo Siska wrote: Yes. It might not be perfect, but mostly it works pretty well. Once make started 10 or so process,

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 22:06:30 YoYo Siska wrote: On Thu, Jan 27, 2011 at 08:18:34PM +0100, J. Roeleveld wrote: On Thursday 27 January 2011 19:56:23 Allan Gottlieb wrote: On Thu, Jan 27 2011, Neil Bothwick wrote: On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: So

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Paul Hartman
On Thu, Jan 27, 2011 at 3:46 PM, J. Roeleveld jo...@antarean.org wrote: On Thursday 27 January 2011 21:25:02 Paul Hartman wrote: On Thu, Jan 27, 2011 at 2:15 PM, Nikos Chantziaras rea...@arcor.de wrote: On 01/27/2011 09:41 PM, Dale wrote: YoYo Siska wrote: Yes. It might not be perfect,

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 22:06:30 YoYo Siska wrote: On Thu, Jan 27, 2011 at 08:18:34PM +0100, J. Roeleveld wrote: On Thursday 27 January 2011 19:56:23 Allan Gottlieb wrote: On Thu, Jan 27 2011, Neil Bothwick wrote: On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: So

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 23:05:22 Paul Hartman wrote: On Thu, Jan 27, 2011 at 3:46 PM, J. Roeleveld jo...@antarean.org wrote: On Thursday 27 January 2011 21:25:02 Paul Hartman wrote: On Thu, Jan 27, 2011 at 2:15 PM, Nikos Chantziaras rea...@arcor.de wrote: On 01/27/2011 09:41 PM, Dale

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Mick
On Thursday 27 January 2011 22:18:22 J. Roeleveld wrote: On Thursday 27 January 2011 23:05:22 Paul Hartman wrote: On Thu, Jan 27, 2011 at 3:46 PM, J. Roeleveld jo...@antarean.org wrote: Once, when building my kernel, I accidentally forgot to specify the number of makes and ran make -j

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread Dale
Nikos Chantziaras wrote: On 01/27/2011 09:41 PM, Dale wrote: I noticed the same thing with mine. It used a LOT of ram. I have 4Gbs and it was up to about 3Gbs at one point and using some swap as well. I'm hoping to max out to 16Gbs as soon as I can. May upgrade to a 6 core CPU too. I wonder

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 23:59:24 Mick wrote: I'm running i7 Q 720 (4 cores, hyperthreaded) and have MAKEOPTS=-j9 without any slowdown. One or two packages (like OpenOffice) will fail and need -j=1 to emerge. Otherwise no noticeable drop in desktop responsiveness. I have not set up

Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-27 Thread J. Roeleveld
On Thursday 27 January 2011 23:53:04 Dale wrote: Nikos Chantziaras wrote: On 01/27/2011 09:41 PM, Dale wrote: I noticed the same thing with mine. It used a LOT of ram. I have 4Gbs and it was up to about 3Gbs at one point and using some swap as well. I'm hoping to max out to 16Gbs as soon

[gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies

2011-01-26 Thread Nikos Chantziaras
On 01/26/2011 02:12 PM, PK wrote: Hi, Is there any way to simultaneously emerge multiple packages (multiple instances of 'emerge') that share common dependencies ? I'm aware that portage uses locking mechanism before modifying 'world' file, but what about the actual building process ? I'd