Re: Does someone keep track of how long it takes to buildworld/kernel?
On Mon, 16 Jan 2017 07:41:06 -0800, jungle Boogie wrote: > On 13 January 2017 at 12:23, Eric Joyner wrote: > > > > It takes forever, but I keep on forgetting to time how long it takes, so I > > don't know how long "forever" is. > > > My last buildworld on a severely under powered i386 for 11stable: 420:41 > minutes > Build kernel is around 85 minutes. Some "manual copy & paste" data from the past (original post is from 2008, repost from 11/2015): *** quote *** FreeBSD 5 on Pentium 4 with 2 GHz and 1 GB RAM: b.world+b.kern: 17494.415u 2562.134s 5:46:42.25 96.4% (with CFLAGS) 17474.169u 2481.368s 5:46:30.40 95.9% (without CLFAGS) 5608.712u 1595.130s 2:13:18.67 90.0% 6382.185u 1788.433s 2:26:36.06 92.8% buildworld: 5086.993u 1431.086s 1:58:16.33 91.8% 11457.047u 2151.158s 3:54:15.31 96.8% buildkernel 2326.380u 234.457s 43:42.15 97.6% 1102.491u 278.194s 25:18.58 90.9% 1182.203u 294.622s 26:12.71 93.9% 1518.402u 310.741s 34:16.96 88.9% 3289.368u 529.669s 1:05:25.90 97.2% installkernel: 5.718u6.898s0:30.97 40.6% 6.655u7.389s0:32.08 43.7% 6.994u7.734s0:33.19 44.3% (...software advance happens here...) FreeBSD 7 on Pentium 4 with 2 GHz and 1 GB RAM: b.world+b.kern: 16574.070u 2516.128s 6:06:03.90 86.9% (with debug) 18232.967u 2427.404s 7:19:49.24 78.2% (with debug) 18992.839u 2569.146s 9:12:00.28 65.1% buildworld: 11457.047u 2151.158s 3:54:15.31 96.8% buildkernel: 3289.368u 529.669s 1:05:25.90 97.2% 3503.732u 524.399s 1:11:05.53 94.4% 4032.019u 572.636s 1:58:29.08 64.7% (with debug) installkernel: 17.396u 12.587s0:46.89 63.9% 18.890u 12.131s1:11.85 43.1% As you can see, 5 hours was a possible value on a single-core single-threat slow-as-ass CPU. But then the system became more advanced, and 7 - 9 hours compile time became possible. :-) *** end quote *** Sadly I don't have a "copy" of my build time on my current home PC, including a Core 2 Duo 4600 with 1.8 GHz and 2 GB RAM, using a SATA disk, with FreeBSD 8-STABLE, but I think it was around 5 hours for everything (including a custom kernel). It would be nice if the build system would automatically issue a log file or at least log message about build time and usage statistics. If it wouldn't tell about my brain's age, I would politely ask to have a "flower box"... ;-) -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: Does someone keep track of how long it takes to buildworld/kernel?
On 13 January 2017 at 12:23, Eric Joyner wrote: > > It takes forever, but I keep on forgetting to time how long it takes, so I > don't know how long "forever" is. My last buildworld on a severely under powered i386 for 11stable: 420:41 minutes Build kernel is around 85 minutes. How I track: https://github.com/dschep/ntfy + https://pushover.net I get a notification on my phone, otherwise I would forget to check and/or check too frequently. I set it up in a tmux session and detach until it's finished. -- --- inum: 883510009027723 sip: jungleboo...@sip2sip.info ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: Does someone keep track of how long it takes to buildworld/kernel?
> On Jan 13, 2017, at 14:48, Ngie Cooper (yaneurabeya) > wrote: > > >> On Jan 13, 2017, at 12:23, Eric Joyner wrote: >> >> ^ Message ^ >> >> It takes forever, but I keep on forgetting to time how long it takes, so I >> don't know how long "forever" is. > > Using -DNO_CLEAN on my 12.0-CURRENT / amd64 / 3GB RAM / 3 cores / VMware > Fusion + open-vmtools VM… > - … buildworld with special baked WITHOUT/MK options in src.conf: 26 mins > - …. buildkernel of GENERIC/GENERIC-NODEBUG with stripped src.conf and > MODULES_OVERRIDE: 14 minutes > > Overall time: 40 minutes > > Granted, I’m pretty up-to-date (just upgrading a few hundred revs at a time), > but a from-scratch build on more ample Sandybridge/Haswell hardware with SSDs > shouldn’t take any longer than 30 mins (if you optimize things heavily, it > can be less than that). > > If you need a beefy box to play with for building en masse (since you’re a > FreeBSD dev), try the universe*.freebsd.org boxes. Important note: unless I have a good reason to test out GENERIC, I always used GENERIC-NODEBUG, so needless to say witness and other debug bits don’t add time to my build. Thanks, -Ngie signature.asc Description: Message signed with OpenPGP using GPGMail
Re: Does someone keep track of how long it takes to buildworld/kernel?
> On Jan 13, 2017, at 12:23, Eric Joyner wrote: > > ^ Message ^ > > It takes forever, but I keep on forgetting to time how long it takes, so I > don't know how long "forever" is. Using -DNO_CLEAN on my 12.0-CURRENT / amd64 / 3GB RAM / 3 cores / VMware Fusion + open-vmtools VM… - … buildworld with special baked WITHOUT/MK options in src.conf: 26 mins - …. buildkernel of GENERIC/GENERIC-NODEBUG with stripped src.conf and MODULES_OVERRIDE: 14 minutes Overall time: 40 minutes Granted, I’m pretty up-to-date (just upgrading a few hundred revs at a time), but a from-scratch build on more ample Sandybridge/Haswell hardware with SSDs shouldn’t take any longer than 30 mins (if you optimize things heavily, it can be less than that). If you need a beefy box to play with for building en masse (since you’re a FreeBSD dev), try the universe*.freebsd.org boxes. Cheers, -Ngie signature.asc Description: Message signed with OpenPGP using GPGMail
Re: Does someone keep track of how long it takes to buildworld/kernel?
On 13 Jan 2017, at 17:27, Garance A Drosehn wrote: > On 13 Jan 2017, at 15:23, Eric Joyner wrote: > >> ^ Message ^ >> >> It takes forever, but I keep on forgetting to time how long it takes, >> so I don't know how long "forever" is. > > I do build on older hardware, so it takes a long time. (hours, iirc) Here's some sample stats from a build of 9.3-stable back in May: start=2016-0505-15:30:49real=9531.41user=7850.36sys=920.24 duration=9531 outsize=27322524 target='buildworld' start=2016-0505-18:09:53real=1713.81user=1323.83sys=162.50 duration=1713 outsize=4611462 target='buildkernel' start=2016-0505-18:38:32real=41.59 user=13.56 sys=4.68 duration=41 outsize=119067 target='installkernel' start=2016-0505-18:42:38real=161.52 user=35.09 sys=17.70 duration=161outsize=1235184 target='installworld' -- Garance Alistair Drosehn= dro...@rpi.edu Senior Systems Programmer or g...@freebsd.org Rensselaer Polytechnic Institute; Troy, NY; USA ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: Does someone keep track of how long it takes to buildworld/kernel?
On 13 Jan 2017, at 15:23, Eric Joyner wrote: > ^ Message ^ > > It takes forever, but I keep on forgetting to time how long it takes, > so I don't know how long "forever" is. I have scripts which do buildworld's for me, and they keep all kinds of extra information for each step (buildkernel, installkernel, buildworld, installworld). Unfortunately I haven't been building world very much lately, and I haven't built anything on release-11. I do build on older hardware, so it takes a long time. (hours, iirc) -- Garance Alistair Drosehn= dro...@rpi.edu Senior Systems Programmer or g...@freebsd.org Rensselaer Polytechnic Institute; Troy, NY; USA ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: Does someone keep track of how long it takes to buildworld/kernel?
On 13 January 2017 at 21:46, Boris Samorodov wrote: > 13.01.2017 23:23, Eric Joyner пишет: >> ^ Message ^ >> >> It takes forever, but I keep on forgetting to time how long it takes, so I >> don't know how long "forever" is. > > For me "forever" today was less then 3 minutes. ;-) > Here is some stats: > --- > % cd /usr/obj > % grep "World build" bw.amd64.log* > bw.amd64.log:>>> World build started on Fri Jan 13 17:42:07 MSK 2017 > bw.amd64.log:>>> World build completed on Fri Jan 13 17:44:45 MSK 2017 > bw.amd64.log.0:>>> World build started on Thu Jan 12 20:55:07 MSK 2017 > bw.amd64.log.0:>>> World build completed on Thu Jan 12 21:00:37 MSK 2017 > bw.amd64.log.1:>>> World build started on Thu Jan 12 11:54:28 MSK 2017 > bw.amd64.log.1:>>> World build completed on Thu Jan 12 11:59:43 MSK 2017 > bw.amd64.log.2:>>> World build started on Wed Jan 11 14:41:59 MSK 2017 > bw.amd64.log.2:>>> World build completed on Wed Jan 11 14:46:36 MSK 2017 > bw.amd64.log.3:>>> World build started on Wed Jan 11 13:15:03 MSK 2017 > bw.amd64.log.3:>>> World build completed on Wed Jan 11 13:59:01 MSK 2017 > bw.amd64.log.4:>>> World build started on Sun Jan 8 17:21:15 MSK 2017 > bw.amd64.log.4:>>> World build completed on Sun Jan 8 17:30:30 MSK 2017 > bw.amd64.log.5:>>> World build started on Sat Jan 7 21:27:06 MSK 2017 > bw.amd64.log.5:>>> World build completed on Sat Jan 7 23:37:25 MSK 2017 > bw.amd64.log.6:>>> World build started on Thu Dec 22 13:19:08 MSK 2016 > bw.amd64.log.6:>>> World build completed on Thu Dec 22 13:40:22 MSK 2016 > --- > > With "WITH_META_MODE=yes" at /etc/src-env.conf it's rather sane time. > But not if clang or like changes. :-( > > The machine is: > --- > FreeBSD 12.0-CURRENT #39 r312075: Fri Jan 13 17:47:05 MSK 2017 > bsam@bb055.bsnet:/usr/obj/usr/src/sys/BB64X amd64 > FreeBSD clang version 3.9.1 (tags/RELEASE_391/final 289601) (based on > LLVM 3.9.1) > VT(vga): resolution 640x480 > info: [drm] Initialized drm 1.1.0 20060810 > CPU: Intel(R) Core(TM) i3-2100 CPU @ 3.10GHz (3092.27-MHz K8-class CPU) > Origin="GenuineIntel" Id=0x206a7 Family=0x6 Model=0x2a Stepping=7 > Features=0xbfebfbff > Features2=0x1d9ae3bf > AMD Features=0x28100800 > AMD Features2=0x1 > XSAVE Features=0x1 > VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID > TSC: P-state invariant, performance statistics > real memory = 8589934592 (8192 MB) > avail memory = 8136523776 (7759 MB) > Event timer "LAPIC" quality 600 > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs > FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 hardware threads > [...] > ada1 at ahcich4 bus 0 scbus2 target 0 lun 0 > ada1: ACS-2 ATA SATA 3.x device > ada1: Serial Number Z1D5Y0X8 > ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) > ada1: Command Queueing enabled > ada1: 953869MB (1953525168 512 byte sectors) > ada1: quirks=0x1<4K> > --- > 'kay you got me curious here guys. Building 10-STABLE on a KVM with 2 CPU cores, 4gb of RAM and UFS filesystem with noatime takes actual, literal *hours* here. I think I build with debug + dtrace userland though, so that might extend the build time somewhat... ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: Does someone keep track of how long it takes to buildworld/kernel?
13.01.2017 23:23, Eric Joyner пишет: > ^ Message ^ > > It takes forever, but I keep on forgetting to time how long it takes, so I > don't know how long "forever" is. For me "forever" today was less then 3 minutes. ;-) Here is some stats: --- % cd /usr/obj % grep "World build" bw.amd64.log* bw.amd64.log:>>> World build started on Fri Jan 13 17:42:07 MSK 2017 bw.amd64.log:>>> World build completed on Fri Jan 13 17:44:45 MSK 2017 bw.amd64.log.0:>>> World build started on Thu Jan 12 20:55:07 MSK 2017 bw.amd64.log.0:>>> World build completed on Thu Jan 12 21:00:37 MSK 2017 bw.amd64.log.1:>>> World build started on Thu Jan 12 11:54:28 MSK 2017 bw.amd64.log.1:>>> World build completed on Thu Jan 12 11:59:43 MSK 2017 bw.amd64.log.2:>>> World build started on Wed Jan 11 14:41:59 MSK 2017 bw.amd64.log.2:>>> World build completed on Wed Jan 11 14:46:36 MSK 2017 bw.amd64.log.3:>>> World build started on Wed Jan 11 13:15:03 MSK 2017 bw.amd64.log.3:>>> World build completed on Wed Jan 11 13:59:01 MSK 2017 bw.amd64.log.4:>>> World build started on Sun Jan 8 17:21:15 MSK 2017 bw.amd64.log.4:>>> World build completed on Sun Jan 8 17:30:30 MSK 2017 bw.amd64.log.5:>>> World build started on Sat Jan 7 21:27:06 MSK 2017 bw.amd64.log.5:>>> World build completed on Sat Jan 7 23:37:25 MSK 2017 bw.amd64.log.6:>>> World build started on Thu Dec 22 13:19:08 MSK 2016 bw.amd64.log.6:>>> World build completed on Thu Dec 22 13:40:22 MSK 2016 --- With "WITH_META_MODE=yes" at /etc/src-env.conf it's rather sane time. But not if clang or like changes. :-( The machine is: --- FreeBSD 12.0-CURRENT #39 r312075: Fri Jan 13 17:47:05 MSK 2017 bsam@bb055.bsnet:/usr/obj/usr/src/sys/BB64X amd64 FreeBSD clang version 3.9.1 (tags/RELEASE_391/final 289601) (based on LLVM 3.9.1) VT(vga): resolution 640x480 info: [drm] Initialized drm 1.1.0 20060810 CPU: Intel(R) Core(TM) i3-2100 CPU @ 3.10GHz (3092.27-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206a7 Family=0x6 Model=0x2a Stepping=7 Features=0xbfebfbff Features2=0x1d9ae3bf AMD Features=0x28100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 8589934592 (8192 MB) avail memory = 8136523776 (7759 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 hardware threads [...] ada1 at ahcich4 bus 0 scbus2 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number Z1D5Y0X8 ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 953869MB (1953525168 512 byte sectors) ada1: quirks=0x1<4K> --- HTH & WBR -- bsam ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
Re: Does someone keep track of how long it takes to buildworld/kernel?
On Fri, Jan 13, 2017 at 08:23:21PM +, Eric Joyner wrote:
> ^ Message ^
>
> It takes forever, but I keep on forgetting to time how long it takes, so I
> don't know how long "forever" is.
>
I don't have much historical information, but I do my builds within
script(1), so that provides a (crude) estimate. ("Crude" because I use
a csh alias to do it, so I invoke it by hand -- and as noted below, that
also iincludes any manual mergemaster activities.)
This morning (on my laptop), the build from r311974 -> r312063 started
at Fri Jan 13 04:43:06 2017 and ended at Fri Jan 13 05:00:54 2017, which
included buildworld, buildkernel, installkernel, and installworld (as
well as assorted mergemaster, &c.) So that was 17:48.
The equivalent yesterday, for r311926 -> r311974, started at Thu Jan 12
04:48:24 2017 and ended at Thu Jan 12 05:12:42 2017. So that was 24:18.
My build machine was a fair bit faster, but its work is done for the
day, so it's powered off.
Peace,
david
--
David H. Wolfskill da...@catwhisker.org
How could one possibly "respect" a misogynist, racist, bullying con-man??!?
See http://www.catwhisker.org/~david/publickey.gpg for my public key.
signature.asc
Description: PGP signature
Does someone keep track of how long it takes to buildworld/kernel?
^ Message ^ It takes forever, but I keep on forgetting to time how long it takes, so I don't know how long "forever" is. ___ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
