Re: [ccache] amd64 buildworld (FreeBSD 8.0p2) consistently fails with ccache [SOLVED]
On Wed, May 12, 2010 at 12:25 AM, Joel Rosdahl wrote: > Just to make it clear: The build works without ccache, right? It has always worked without ccache, yes. I have solved the issue now. It was on my end. Generally when I install FreeBSD I select the 'minimal' option and nothing more. Today, in testing this, I looked more closely at what I could/should be installing. One of the possible items is the '32bit runtime compatibility libraries'. After ensuring this was installed I tried my builds again. I have now successfully completed three builds and recorded their results. I don't understand why the inclusion/exclusion of this would cause the difference when building with ccache, but it does work now. Below are the speed improvements (first pass, second pass), using ccache 3.0pre1 on FreeBSD 8.0. 4cpu, 4G RAM: -- >>> World build completed on Wed May 12 12:04:26 MDT 2010 -- real44m2.754s user80m5.733s sys 55m59.135s -- >>> Kernel build for MOUZONE completed on Wed May 12 12:19:54 MDT 2010 -- real13m31.544s user18m38.484s sys 11m38.547s -- >>> World build completed on Wed May 12 12:41:39 MDT 2010 -- real7m0.725s user10m1.925s sys 9m56.014s -- >>> Kernel build for MOUZONE completed on Wed May 12 12:44:00 MDT 2010 -- real1m34.594s user1m1.464s sys 0m57.740s (after two passes) [r...@mouzone /usr/src]# ccache -s cache directory /usr/.ccache cache hit (direct) 1890 cache hit (preprocessed) 652 cache miss 27492 called for link 918 multiple source files 2 compile failed 300 preprocessor error 111 bad compiler arguments37 not a C/C++ file2284 autoconf compile/link 1547 unsupported compiler option4 no input file182 files in cache 27492 cache size 407.3 Mbytes max cache size 1.0 Gbytes Thank you for your help. -- Christer Edwards ___ ccache mailing list ccache@lists.samba.org https://lists.samba.org/mailman/listinfo/ccache
Re: [ccache] amd64 buildworld (FreeBSD 8.0p2) consistently fails with ccache
On Mon, May 10, 2010 at 2:58 PM, Joel Rosdahl wrote: > The most important thing is to find out the exact command line used when > the compilation failed. Your build system doesn't seem to print that, so > I think you either should try to increase verbosity in some way or > upgrade to ccache 3.0pre1, which was just released. 3.0pre1 logs the > executed compiler commands to CCACHE_LOGFILE, so it would be enough to > get the log snippet of the failed compilation. Possibly, the compiled > source code could also be of interest. I've got another failure (same place) on 3.0pre1.Below are the details: I executed 'ccache make buildworld' at /usr/src. ccache related ENV values are: CCACHE_DIR=/usr/.ccache CCACHE_LOGFILE=/var/log/ccache.log Below is the error output from the ccache.log (46M total, only pasting the tail here): [2010-05-10T17:30:38.824821 53291] === CCACHE STARTED = [2010-05-10T17:30:38.825491 53291] Hostname: mouzone.part.net [2010-05-10T17:30:38.825542 53291] Cwd: /usr/obj/lib32/usr/src/lib/csu/i386-elf [2010-05-10T17:30:38.825560 53291] Source file: /usr/src/lib/csu/i386-elf/crt1.c [2010-05-10T17:30:38.825578 53291] Object file: crt1.o [2010-05-10T17:30:38.825608 53291] Trying direct lookup [2010-05-10T17:30:38.825853 53291] Looking for object file hash in /usr/.ccache/b/b/d92cd3966f3aa0a8ba17e11308c7c9-2334.manifest [2010-05-10T17:30:38.825950 53291] Did not find object file hash in manifest [2010-05-10T17:30:38.825974 53291] Running preprocessor [2010-05-10T17:30:38.827775 53292] Executing /usr/obj/usr/src/tmp/usr/bin/cc -O2 -pipe -I/usr/src/lib/csu/i386-elf/../common -I/usr/src/lib/csu/i386-elf/../../libc/include -std=gnu99 -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wcast-align -Wunused-parameter -Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls -Wno-pointer-sign -c -E /usr/src/lib/csu/i386-elf/crt1.c [2010-05-10T17:30:38.853494 53291] Got object file hash from preprocessor [2010-05-10T17:30:38.853749 53291] Object file /usr/.ccache/7/e/00e1bb753cccab0b3367e6287435a8-23935.o not in cache [2010-05-10T17:30:38.853797 53291] Running real compiler [2010-05-10T17:30:38.855228 53294] Executing /usr/obj/usr/src/tmp/usr/bin/cc -O2 -pipe -I/usr/src/lib/csu/i386-elf/../common -I/usr/src/lib/csu/i386-elf/../../libc/include -std=gnu99 -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wcast-align -Wunused-parameter -Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls -Wno-pointer-sign -c -o /usr/.ccache/7/e/00e1bb753cccab0b3367e6287435a8-23935.o.tmp.mouzone.part.net.53291 /usr/.ccache/tmp/crt1.tmp.mouzone.part.net.53291.i [2010-05-10T17:30:38.903089 53291] Compiler gave exit status 1 [2010-05-10T17:30:38.903377 53291] Copying /usr/.ccache/7/e/00e1bb753cccab0b3367e6287435a8-23935.o.tmp.mouzone.part.net.53291 to crt1.o (uncompressed) [2010-05-10T17:30:38.906771 53291] open error: No such file or directory Please let me know what more I can provide.. -- Christer Edwards ___ ccache mailing list ccache@lists.samba.org https://lists.samba.org/mailman/listinfo/ccache
Re: [ccache] amd64 buildworld (FreeBSD 8.0p2) consistently fails with ccache
On Mon, May 10, 2010 at 2:58 PM, Joel Rosdahl wrote: > The most important thing is to find out the exact command line used when > the compilation failed. Your build system doesn't seem to print that, so > I think you either should try to increase verbosity in some way or > upgrade to ccache 3.0pre1, which was just released. 3.0pre1 logs the > executed compiler commands to CCACHE_LOGFILE, so it would be enough to > get the log snippet of the failed compilation. Possibly, the compiled > source code could also be of interest. I just saw the release notes and I built a port for 3.0pre1. I'll give it a try this evening and report back my findings. -- Christer Edwards ___ ccache mailing list ccache@lists.samba.org https://lists.samba.org/mailman/listinfo/ccache
Re: [ccache] amd64 buildworld (FreeBSD 8.0p2) consistently fails with ccache
On Sun, May 9, 2010 at 11:17 AM, Joel Rosdahl wrote: > You can enable debug logging by setting CCACHE_LOGFILE to a log file > path and then send the log of a failed compilation here. I've enabled logging and I would attach the logfile, but it is 12M total size. I've included the tail end, just leading up to the failure: [78023] === 2010-05-09 14:54:37 === [78023] Base directory: /usr/obj/lib32/usr/src/gnu/lib/csu [78023] Source file: /usr/src/gnu/lib/csu/../../../contrib/gcc/crtstuff.c [78023] Object file: crtend.So [78023] Trying direct lookup [78023] Looking for object file hash in /usr/.ccache/7/d/95616197a1156b28cdd39a8047d5db-9623.manifest [78023] Did not find object file hash in manifest [78023] Running preprocessor [78023] Got object file hash from preprocessor [78023] Object file /usr/.ccache/c/a/512e749085241d05f1a72bfb1fa910-77439.o not in cache [78023] Running real compiler [78023] Stored in cache: /usr/.ccache/c/a/512e749085241d05f1a72bfb1fa910-77439.o [78023] Created crtend.So from /usr/.ccache/c/a/512e749085241d05f1a72bfb1fa910-77439.o [78023] Added object file hash to /usr/.ccache/7/d/95616197a1156b28cdd39a8047d5db-9623.manifest [78040] === 2010-05-09 14:54:37 === [78040] Base directory: /usr/obj/lib32/usr/src/lib/csu/i386-elf [78040] Compiler option -E is unsupported [78040] Failed; falling back to running the real compiler [78047] === 2010-05-09 14:54:37 === [78047] Base directory: /usr/obj/lib32/usr/src/lib/csu/i386-elf [78047] Source file: /usr/src/lib/csu/i386-elf/crt1.c [78047] Object file: crt1.o [78047] Trying direct lookup [78047] Looking for object file hash in /usr/.ccache/c/9/ea7ce3c6c0dcbf8e347e950e9ff6ea-1903.manifest [78047] Did not find object file hash in manifest [78047] Running preprocessor [78047] Got object file hash from preprocessor [78047] Object file /usr/.ccache/f/a/86dcc9067c2597ce7a0dbd718899ac-23567.o not in cache [78047] Running real compiler [78047] Compiler gave exit status 1 This build had no CFLAGS or CXXFLAGS and exited at the same point. What other information can I provide? [r...@stringer /usr/src]# ccache -s cache directory /usr/.ccache cache hit (direct) 871 cache hit (preprocessed)1039 cache miss 30393 called for link 1342 multiple source files 5 compile failed 2 not a C/C++ file3316 no input file 2 files in cache 30393 cache size 107.8 Mbytes max cache size 1.0 Gbytes -- Christer Edwards ___ ccache mailing list ccache@lists.samba.org https://lists.samba.org/mailman/listinfo/ccache
Re: [ccache] amd64 buildworld (FreeBSD 8.0p2) consistently fails with ccache
On Sun, May 9, 2010 at 11:17 AM, Joel Rosdahl wrote:
> That's strange. Which ccache version are you using? If you're using 2.4,
> please try 3.0pre0.
[r...@stringer /usr/src]# ccache -V
ccache version 3.0pre0
It just failed for me again. I did not turn on logging, but this is
where it failed, if this gives you any hints:
===> lib/csu/i386-elf (obj,depend,all,install)
rm -f .depend
CC='/usr/local/libexec/ccache/world-cc' mkdep -f .depend -a
-I/usr/src/lib/csu/i386-elf/../common
-I/usr/src/lib/csu/i386-elf/../../libc/include
/usr/src/lib/csu/i386-elf/crt1.c /usr/src/lib/csu/i386-elf/crti.S
/usr/src/lib/csu/i386-elf/crtn.S
/usr/local/libexec/ccache/world-cc -march=native -O2
-fno-strict-aliasing -pipe -I/usr/src/lib/csu/i386-elf/../common
-I/usr/src/lib/csu/i386-elf/../../libc/include -std=gnu99
-Wsystem-headers -Werror -Wall -Wno-format-y2k -W
-Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes
-Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch
-Wshadow -Wcast-align -Wunused-parameter -Wchar-subscripts -Winline
-Wnested-externs -Wredundant-decls -Wno-pointer-sign -c
/usr/src/lib/csu/i386-elf/crt1.c
{standard input}: Assembler messages:
{standard input}:27: Error: suffix or operands invalid for `mov'
*** Error code 1
Stop in /usr/src/lib/csu/i386-elf.
*** Error code 1
Stop in /usr/src.
*** Error code 1
Stop in /usr/src.
*** Error code 1
Stop in /usr/src.
*** Error code 1
Stop in /usr/src.
I can run it again with logging enabled if you need.
Ooh, and this build was using CFLAGS/CXXFLAGS. I can test again
without those if needed as well.
--
Christer Edwards
___
ccache mailing list
ccache@lists.samba.org
https://lists.samba.org/mailman/listinfo/ccache
[ccache] amd64 buildworld (FreeBSD 8.0p2) consistently fails with ccache
I've been testing the use of ccache on my FreeBSD machines and I've found that 'make buildworld' will consistently fail when ccache is activated on my amd64 machines, while it performs as expected on my i386 machines. I have tested on both platforms with and without compile options, such as -jX, CFLAGS and CXXFLAGS. With or without these options on i386 it compiles successfully, but with or without these options on amd64 it fails. It appears that it fails at building lib32 related files but I'm not familiar enough with buildworld or ccache to be sure. What more information can I provide toward troubleshooting and hopefully resolving this situation? Cheers, -- Christer Edwards ___ ccache mailing list ccache@lists.samba.org https://lists.samba.org/mailman/listinfo/ccache
