On Thursday 27 January 2011 22:06:30 YoYo Siska wrote: > On Thu, Jan 27, 2011 at 08:18:34PM +0100, J. Roeleveld wrote: > > On Thursday 27 January 2011 19:56:23 Allan Gottlieb wrote: > > > On Thu, Jan 27 2011, Neil Bothwick wrote: > > > > On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: > > > >> > So on a 20 package world update, only 19 are faster while the 20th > > > >> > runs at the same speed? Where's the loss there? Even if the last > > > >> > were slower, it would be worth it. > > > >> > > > >> Given the amount of time unpack/configure/install of most packages > > > >> needs (very short), my observation is that it would not be worth it. > > > > > > > > Even if that were true, how much time would you have to save to > > > > justify adding -j 2 to EMERGE_DEFAULTS in make.conf? > > > > > > > > But it's not true, large packages spend a lot of time on these phases > > > > of the install. > > > > > > OK I'm convinced since I know that those phases do take noticeable > > > time. > > > > > > I have a "4" processor i7 model 620 (2 cores, doubled for > > > hyperthreading) and have set MAKEOPTS="-j5". > > > If I add -jobs=2 to EMERGE_DEFAULT_OPTS, should I lower > > > MAKEOPTS to 3 (to 4)? > > > > > > thanks, > > > allan > > > > You could, as if you leave it at -j5, you can end up with 2 * 5 = 10 > > processed, eg: similar as if running with MAKEOPTS="-j10" > > > > I think the option that YoYo came with is a good compromise: > > # MAKEOPTS="-j -l5" emerge -j --load-average=5 > > > > Next time I am doing a big upgrade, I'm going to test that to see how it > > behaves. > > I was just building the whole system for my notebook in a chroot on my > desktop machine ( I use FEATURES=buildpkg to build binary packages in > the chroot on a fast desktop machine and then upgrade the notebook with > the binary packages) and I used exactly that (-j -l5 for bot make and > emerge). Can't say if it really is better or not ;) but most of the time > all four cores were busy, though sometimes I saw even 6 or 7 gcc-s > simultaneously in top ;) > emerge was running 3 to 4 jobs most of the time, sometimes dropping to 1 > and once I saw it emerging about 10 parallel packages ;) (mostly small > things, which I guess were doing a lot of > unpacking/configuring/installing but almost nothing of compiling ;) > > > btw, just now I got this error from dev-lang/v8: > > SCons error: option -j: invalid integer value: '-l4' > > seems scons honors MAKEOPTS, but doesn't understand the "loadaverage" > version (-j -l4) > > > yoyo
Doing an update now, just had this:
***
top - 23:09:47 up 15:12, 4 users, load average: 5.92, 3.62, 1.87
Tasks: 321 total, 35 running, 285 sleeping, 0 stopped, 1 zombie
Cpu(s): 89.5%us, 10.5%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8114712k total, 5266456k used, 2848256k free, 162600k buffers
Swap: 12582904k total, 0k used, 12582904k free, 2812008k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
24196 root 20 0 63756 39m 6932 R 15 0.5 0:00.45 cc1plus
24092 root 20 0 65532 40m 6896 R 15 0.5 0:00.64 cc1plus
24158 root 20 0 60572 36m 6832 R 15 0.5 0:00.50 cc1plus
24187 root 20 0 61296 36m 6904 R 15 0.5 0:00.45 cc1plus
24202 root 20 0 59404 34m 6832 R 14 0.4 0:00.43 cc1plus
24096 root 20 0 61272 36m 6868 R 14 0.5 0:00.56 cc1plus
24245 root 20 0 43364 20m 6372 R 12 0.3 0:00.36 cc1
24240 root 20 0 41636 18m 6340 R 12 0.2 0:00.35 cc1
24271 root 20 0 42776 19m 6296 R 11 0.2 0:00.34 cc1
24281 root 20 0 41132 17m 6308 R 8 0.2 0:00.25 cc1
24302 root 20 0 40996 17m 6268 R 8 0.2 0:00.24 cc1
24320 root 20 0 42356 18m 6192 R 8 0.2 0:00.23 cc1
24304 root 20 0 42000 18m 6832 R 7 0.2 0:00.22 cc1plus
24331 root 20 0 52232 27m 6388 R 7 0.3 0:00.22 cc1plus
24330 root 20 0 54068 27m 4016 R 6 0.3 0:00.19 cc1plus
24338 root 20 0 47924 23m 6160 R 6 0.3 0:00.19 cc1plus
24329 root 20 0 45212 20m 5852 R 6 0.3 0:00.18 cc1
24335 root 20 0 51212 26m 6300 R 6 0.3 0:00.18 cc1plus
24360 root 20 0 37316 14m 6240 R 6 0.2 0:00.17 cc1
24344 root 20 0 48028 24m 6432 R 5 0.3 0:00.16 cc1plus
24399 root 20 0 47652 20m 3532 R 4 0.3 0:00.13 cc1plus
24377 root 20 0 45552 18m 3536 R 3 0.2 0:00.10 cc1plus
24380 root 20 0 45536 18m 3528 R 3 0.2 0:00.10 cc1plus
4574 root 20 0 170m 62m 15m S 3 0.8 8:09.14 X
24413 root 20 0 38308 9m 2620 R 1 0.1 0:00.04 cc1plus
11522 joost 20 0 93144 36m 13m S 1 0.5 1:51.05 skype
24417 root 20 0 36456 8628 2620 R 1 0.1 0:00.03 cc1plus
24424 root 20 0 34724 8588 2908 R 1 0.1 0:00.03 cc1
24426 root 20 0 35752 9088 2928 R 1 0.1 0:00.03 cc1
11573 joost 20 0 849m 403m 31m S 1 5.1 3:07.35 firefox
13388 root 20 0 30216 5144 1452 S 1 0.1 0:00.89 configure
19920 root 20 0 20696 2316 1336 S 1 0.0 0:00.38 sh
11490 joost 20 0 453m 46m 31m S 0 0.6 0:04.61 kopete
12922 root 20 0 205m 102m 3788 S 0 1.3 0:21.50 emerge
14463 joost 20 0 449m 40m 18m R 0 0.5 0:20.04 konsole
18085 joost 20 0 38456 2604 1724 R 0 0.0 0:00.88 top
22015 root 20 0 21732 3332 908 S 0 0.0 0:00.12 make
24418 root 20 0 34708 7056 2620 R 0 0.1 0:00.01 cc1plus
24429 root 20 0 34680 7048 2616 R 0 0.1 0:00.01 cc1plus
***
Looks nice :)
--
Joost
