Greetings!
"Page, Bill" <[EMAIL PROTECTED]> writes:
> Camm,
>
> On Wednesday, October 18, 2006 11:25 AM you wrote:
> > >
> > > I have succeeded in compiling gcl-2.6.8pre on MAC OSX 10.2 on the
> > > SourceForge compile farm 'ppc-osx3' server, however some patches
> > > were necessary. This machine has Xcode installed by not Fink.
> > >
> > > First, I checked out gcl-2.6.8pre from cvs on October 15, 2006,
> > > created a tarball and scp'd it and the standard gnu gettext-0.15
> > > and sed-4.1.4 tarballs to my home directory on SourceForge.
> > >
> > > Next I compiled and installed gettext and sed with
> > > --prefix=/home/users/b/bi/billpage/osx
> > > creating the ~/osx/bin and ~/osx/lib directories. These are
> > > apparently required to satisfy the gcl build dependencies on
> > > OSX 10.2. (Note: A Fink installation might also have provided
> > > these in the /sw directory.)
> > >
> >
> > I thought that gettext was no longer required, as it was included
> > in the local bfd build (from configure.in:)
> >
> > cd binutils/bfd && chmod +x configure && ./configure
> > --with-included-gettext && cd ../..
> >
>
> If I remove my local osx/bin from the PATH and try again I get
> the error message "msgfmt: command not found" shown below.
>
> ---------
>
> $ ./configure --prefix=/home/users/b/bi/billpage/osx \
> --disable-tkconfig --disable-statsysbfd --enable-locbfd
> $ make
> cd binutils/intl && make
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 intl-compat.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 bindtextdom.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 dcgettext.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 dgettext.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 gettext.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 finddomain.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 loadmsgcat.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 localealias.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 textdomain.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 l10nflist.c
> gcc -c -DLOCALEDIR=\"/usr/local/share/locale\"
> -DGNULOCALEDIR=\"/usr/local/share/locale\"
> -DLOCALE_ALIAS_PATH=\"/usr/local/share/locale:.\" -DHAVE_CONFIG_H -I.
> -I. -g -O2 explodename.c
> rm -f libintl.a
> ar cru libintl.a intl-compat.o bindtextdom.o dcgettext.o dgettext.o
> gettext.o finddomain.o loadmsgcat.o localealias.o textdomain.o
> l10nflist.o explodename.o
> ranlib libintl.a
> cd binutils/bfd && make
> make all-recursive
> Making all in doc
> make[3]: Nothing to be done for `all'.
> Making all in po
> ( if test 'x.' != 'x.'; then \
> posrcprefix='../'; \
> else \
> posrcprefix="../"; \
> fi; \
> rm -f SRC-POTFILES-t SRC-POTFILES \
> && (sed -e '/^#/d' \
> -e '/^[ ]*$/d' \
> -e "[EMAIL PROTECTED]@ $posrcprefix& \\\\@" < ./SRC-POTFILES.in
> \
> | sed -e '$s/\\$//') > SRC-POTFILES-t \
> && chmod a-w SRC-POTFILES-t \
> && mv SRC-POTFILES-t SRC-POTFILES )
> ( rm -f BLD-POTFILES-t BLD-POTFILES \
> && (sed -e '/^#/d' \
> -e '/^[ ]*$/d' \
> -e "[EMAIL PROTECTED]@ ../& \\\\@" < ./BLD-POTFILES.in \
> | sed -e '$s/\\$//') > BLD-POTFILES-t \
> && chmod a-w BLD-POTFILES-t \
> && mv BLD-POTFILES-t BLD-POTFILES )
> cd .. \
> && CONFIG_FILES=po/Makefile.in:po/Make-in \
> CONFIG_HEADERS= /bin/sh ./config.status
> config.status: creating po/Makefile.in
> config.status: executing depfiles commands
> config.status: executing default commands
> file=./`echo fr | sed 's,.*/,,'`.gmo \
> && rm -f $file && PATH=../src:$PATH msgfmt -o $file fr.po
> /bin/sh: msgfmt: command not found
> make[3]: *** [fr.gmo] Error 127
> make[2]: *** [all-recursive] Error 1
> make[1]: *** [all] Error 2
> make: *** [binutils/bfd/libbfd.a] Error 2
Sigh. I suppose reconfigured here? The binutils configure scripts do
look for msgfmt. I'm surprised they don't step around a missing one,
or at least bomb. What does your binutils configure output say in
this regard?
>
> ---------
>
> gcl-2.6.8pre/binutils/bfd/config.log confirms:
>
> Invocation command line was
>
> $ ./configure --with-included-gettext
>
> But apparently recursive makefile in bfd/po does not make
> use of the included gettext. Maybe this is a binutils bug?
>
> > We do need sed. I guess OSX has none, or it is incompatible?
> >
>
> This OSX 10.2 has an old sed that is not compatible.
>
> > Is Fink so non-standard that it must be avoided? What is
> > the canonical way to get gnu software on OSX?
> >
>
> I don't know. This SourceForge server is the closest I have
> ever been to a MAC and it's probably a few thousand miles
> away from here... :-) But I have heard that many people would
> like to try to avoid installing "foreign" package systems like
> Fink.
>
> >
> > > Then I added:
> > >
> > > export PATH=/home/users/b/bi/billpage/osx/bin:$PATH
> > > export
> > LIBRARY_PATH=/home/users/b/bi/billpage/osx/lib:$LIBRARY_PATH
> > > export CPPFLAGS="-no-cpp-precomp"
> > > cd osx
> > >
> > > to ~/.profile so that after re-login the environment was set
> > > appropriately.
> > >
> > > I untarred gcl into the osx directory creating ~/osx/gcl-2.6.8pre
> > > Then I applied the following patches (most of which have been
> > > previously reported on the gcl email list by other people):
> > >
> > > ------------------------
> > > ppc-osx3:~/osx billpage$ diff -Naur old/gcl* new/gcl*
> > >
> > > This patch required so libintl is found in $LIBRARY_PATH.
> > >
> > > diff -Naur old/gcl-2.6.8pre/h/powerpc-macosx.defs
> > > new/gcl-2.6.8pre/h/powerpc-macosx.defs
> > > --- old/gcl-2.6.8pre/h/powerpc-macosx.defs Thu Jul 15
> > 09:28:43 2004
> > > +++ new/gcl-2.6.8pre/h/powerpc-macosx.defs Sun Oct 15
> > 22:07:45 2006
> > > @@ -6,7 +6,7 @@
> > >
> > > # Set this to avoid warnings when linking against libncurses.
> > > # This is due to the requirements of the two level namespace.
> > > -LIBS := `echo $(LIBS) | sed -e 's/-lncurses/ /'`
> > /sw/lib/libintl.dylib
> > > +LIBS := `echo $(LIBS) | sed -e 's/-lncurses/ /'` -lintl
> > >
> > > # Set this for the linker to operate correctly.
> > > MACOSX_DEPLOYMENT_TARGET = 10.2
> > > @@ -32,4 +32,4 @@
> > > # This appears to be no longer necessary on Panther.
> > > ARRS = libtool -static -o
> > >
> > > -FINAL_CFLAGS := `echo $(FINAL_CFLAGS) | sed -e 's:-g::g'`
> > > \ No newline at end of file
> > > +FINAL_CFLAGS := `echo $(FINAL_CFLAGS) | sed -e 's:-g::g'`
> > >
> >
> > OK, this is going in, but I think we can lose the -lintl too.
> > Anyone want to try to verify?
> >
>
> I think you are right.
>
> If I 'make clean' and write:
>
> +++ new/gcl-2.6.8pre/h/powerpc-macosx.defs Sun Oct 15
> ...
> +LIBS := `echo $(LIBS) | sed -e 's/-lncurses/ /'`
>
> and just adding:
>
> export PATH=/home/users/b/bi/billpage/osx/bin:$PATH
>
> (to avoid gettext bug) then trying configure & make as above
> works fine.
>
>
> > > This patch is required to define sbrk.
> > >
> > > diff -Naur old/gcl-2.6.8pre/h/powerpc-macosx.h
> > > new/gcl-2.6.8pre/h/powerpc-macosx.h
> > > --- old/gcl-2.6.8pre/h/powerpc-macosx.h Thu Dec 8 17:31:25 2005
> > > +++ new/gcl-2.6.8pre/h/powerpc-macosx.h Sun Oct 15 21:32:23 2006
> > > @@ -38,8 +38,9 @@
> > > #undef SET_REAL_MAXPAGE
> > > #define SET_REAL_MAXPAGE { my_sbrk(0); real_maxpage = (int)
> > > mach_maplimit/PAGESIZE; }
> > >
> > > -#define sbrk my_sbrk
> > > +#include <unistd.h> /* to get sbrk defined */
> > > extern void *my_sbrk(int incr);
> > > +#define sbrk my_sbrk
> > >
> > >
> > > /** (si::save-system "...") a.k.a. unexec implementation */
> > >
> >
> > I don't get this one, as we emulate sbrk here. Where is the system
> > definition required?
> >
>
> If I reverse this change and do 'make clean & configure & make'
> I get the error "conflicting types for `my_sbrk'":
>
> cd unixport && make saved_pre_gcl
> ls: ../xgcl-2/*.o: No such file or directory
> ls: ../mod/*.o: No such file or directory
> ls: ../pcl/*.o: No such file or directory
> ls: ../clcs/*.o: No such file or directory
> ls: ../clcs/clcs_*.lisp: No such file or directory
> gcc -Wall -DVOL=volatile -fsigned-char -pipe -O3 -fomit-frame-pointer
> -I/home/users/b/bi/billpage/osx/new/gcl-2.6.8pre/o -c -o sys_pre_gcl.o
> sys_pre_gcl.c
> ../h/../h/protoize.h:465: warning: could not use precompiled header
> '/usr/include/unistd-gcc3.p', because:
> ../h/../h/protoize.h:465: warning: macro 'valloc' defined by
> ../h/config.h conflicts with precomp
> In file included from ../h/../h/protoize.h:465,
> from ../h/include.h:70,
> from sys_pre_gcl.c:3:
> /usr/include/unistd.h:203: conflicting types for `my_sbrk'
> ../h/config.h:42: previous declaration of `my_sbrk'
> make[1]: *** [sys_pre_gcl.o] Error 1
> make: *** [unixport/saved_pre_gcl] Error 2
>
OK this is in.
> -------
>
> > > This patch is required to remove functions symbols from plt.
> > >
> > > diff -Naur old/gcl-2.6.8pre/o/makefile new/gcl-2.6.8pre/o/makefile
> > > --- old/gcl-2.6.8pre/o/makefile Fri Sep 15 10:45:18 2006
> > > +++ new/gcl-2.6.8pre/o/makefile Mon Oct 16 22:03:52 2006
> > > @@ -154,7 +154,7 @@
> > > print a}' \
> > > k=$(LEADING_UNDERSCORE) |\
> > > sort | \
> > > - grep -v '[^ \t_]_' |\
> > > + grep -v 'restFP' | grep -v 'saveFP'
> > | grep -v
> > > '[^ \t_]_' |\
> > > $(AWK) '{A[++k]=$$0} END {for
> > (i=1;i<=k;i++) \
> > >
> > printf("MY_PLT(%s)%s\n",A[i],i==k ? "" :
> > > ",");}' >$@
> > >
> >
> > OK. This is quite ugly, but its a hack to begin with. Suggestions
> > most welcome.
> >
>
> I only vaguely understand what this is doing but 'restFP' and
> 'saveFP' are not removed from this list than the compile complains
> about "function symbols" not used in a function ... or something
> like that. The other names make sense to me. For example:
>
> MY_PLT(__srget),
> MY_PLT(__swbuf),
> ...
>
> which derive from the implementation of getc(f) and putc(ch,f).
> But see later in the message - I apparently have a problem with
> __srget.
>
There is a notorious platform specific _ name mangling issue here.
See the LEADING_UNDERSCORE variable.
> > > This patch is required to find malloc.h on some OSX machines.
> > >
> > > diff -Naur old/gcl-2.6.8pre/o/unexmacosx.c
> > > new/gcl-2.6.8pre/o/unexmacosx.c
> > > --- old/gcl-2.6.8pre/o/unexmacosx.c Thu Dec 15 10:48:43 2005
> > > +++ new/gcl-2.6.8pre/o/unexmacosx.c Tue Oct 17 18:55:04 2006
> > > @@ -124,7 +124,13 @@
> > > #endif
> > > #include <mach-o/nlist.h>
> > > #include <mach-o/getsect.h>
> > > +/* not <sys/malloc.h> */
> > > +/* not <malloc.h> */
> > > +#if defined (HAVE_MALLOC_MALLOC_H)
> > > #include <malloc/malloc.h>
> > > +#else
> > > +#include <objc/malloc.h>
> > > +#endif
> > >
> > > #include <sys/mman.h>
> > >
> >
> > OK, I take it you are using objc/malloc.h. We need configure code
> > to look for this, and bomb if it cannot find one, just on macosx.
> > I'll take a stab unless someone else wants to.
> >
>
> Makes sense to me. You are the autoconf wizard. :-)
>
Ugh. :-)
> > May I suggest we also lose the diagnostic output on save-system
> > on this platform?
>
> Yes, it looks pretty ugly but maybe it is needed just a little
> while longer (or optionally) to verify that si::save-system and
> compiler::link are really working properly?
OK.
>
> >
> > Thanks again! Will post when something is checked in.
> >
>
> Thank you. I look forward to a finally finalized 2.6.8. The
> evoluton of 2.6.8pre is causing us a little consternaton in
> the current Axiom source distribution... :-)
>
My apologies. So many moving parts. I have to get everything synched
on one image, however, if we want these apps in Etch. And there have
been so many gcc et. al. issues.
BTW, are we not updating
http://axiom.axiom-developer.org/axiom-website/DOWNLOADS/
anymore? Is there a latest official tarball somewhere for Etch (eta
this December)? Having a simple webpage with the filenames in some
sort of alphabetical/cronological sort order lets me automatically
know when the Debian package needs updating.
> > BTW, I'm pushing 2.6.8 (in the guise of 2.6.7) and all the apps
> > through the Debian autobuilder system before releasing 2.6.8.
> > Please let me know of any other 2.6.8 issues you may be
> > encountering in your axiom work asap. Bug fix only at this
> > point, of course.
> >
>
> Hmmmm... well I do currently have a problem with the Axiom build.
> After successfully building bootsys and depsys the build fails
> building interpsys with the following message:
>
> start address -T 0xb8f000 Finished loading
> /home/users/b/bi/billpage/osx/axiom.build-improvements/obj/powerpc-apple
> -darwin6.8/interp/bookvol5.o
> Loading
> /home/users/b/bi/billpage/osx/axiom.build-improvements/obj/powerpc-apple
> -darwin6.8/interp/util.o
>
> Error: Undefined symbol "___srget"
> Fast links are on: do (si::use-fast-links nil) for debugging
> Error signalled by LOAD.
> Broken at LOAD. Type :H for Help.
> >>make[2]: ***
> [/home/users/b/bi/billpage/osx/axiom.build-improvements/build/powerpc-ap
> ple-darwin6.8/bin/interpsys] Error 255
> make[1]: *** [interp/stamp] Error 2
> make: *** [all-recursive] Error 1
>
> ---------
>
> Something is strange about thid symbol "___srget" with the 3
> underscore characters, I think??? The name "__srget" with 2
> underscore characters is properly defined in /usr/include/stdio.h
>
> I don't understand what is going on here.
>
OK, your linker is prepending an underscore, and apparently
LEADING_UNDERSCORE was improperly set. Could you investigate? There
may also be a C compiler switch for this. Is this gcc?
> Also prior to compiling depsys, bootsys was already successfully
> created however it did have one oddity. The original Axiom load
> commands like ')load postpar' run during building depsys fails
> with an error message like "'postpar.8' does not exist" (Yes, that's
> the digit 8 after the dot.). If I change the command to include the
> .o like this: ')load postpar.o' everything seems fine and depsys
> is built.
>
> bootsys itself is actually built form a copy of gcl called 'lisp'
> that is created using compiler::link. The 'lisp' image includes
> several Axiom specific external routines. I.e.
>
> echo '(compiler::link nil
>
> "/home/users/b/bi/billpage/osx/axiom.build-improvements/build/powerpc-ap
> ple-darwin6.8/bin/lisp" ' \
> ' (format nil "(progn (let ((*load-path* (cons ~S
> *load-path*))'\
> ' (si::*load-types* ~S))' \
> ' (compiler::emit-fn t))' \
> ' (when (fboundp (quote si::sgc-on))' \
> ' (si::sgc-on t))' \
> ' (setq compiler::*default-system-p* t))"' \
> ' si::*system-directory* (quote (list ".lsp")))' \
> '
> "/home/users/b/bi/billpage/osx/axiom.build-improvements/lsp/.././src/lib
> /cfuns-c.o' \
> '
> /home/users/b/bi/billpage/osx/axiom.build-improvements/lsp/.././src/lib/
> sockio-c.o' \
> '
> /home/users/b/bi/billpage/osx/axiom.build-improvements/lsp/.././src/lib/
> libspad.a")' \
> | /home/users/b/bi/billpage/osx/bin/gcl
Can you post the output from this?
>
> If I intervene and make Axiom use the original 'saved_gcl' to build
> 'bootsys' instead of using 'lisp', then the 'postpar.8' problem does
> not occur and gcl finds the .o files anyway, as expected.
>
> This makes me suspicious that something subtle may be wrong with
> the output of 'compiler:link'. The size of the result images also
> seem curious:
>
> -rwxr-xr-x 1 billpage 100 18362444 Oct 17 19:08 saved_gcl
> ...
> -rwxr-xr-x 1 billpage 100 13072984 Oct 18 04:01 lisp
> -rwxr-xr-x 1 billpage 100 19159640 Oct 18 04:01 bootsys
> -rwxr-xr-x 1 billpage 100 7719512 Oct 18 04:01 raw_lisp.tmp
> -rw-r--r-- 1 billpage 100 0 Oct 18 04:01 raw_lisp_map
> -rwxr-xr-x 1 billpage 100 49588824 Oct 18 03:10 depsys
>
> Remember that 'lisp' is create by 'compiler::link' from
> saved_gcl plus some externals. Why is it smaller? Also the
> "raw" files were left here don't look "normal" to me.
>
> A test image of gcl created by
>
> $ gcl
> (si:save-system "test-image")
> (quit)
>
> is actually *larger* than the original saved_gcl.
>
> -rwxr-xr-x 1 billpage 100 23699532 Oct 18 11:07 test-image
>
> Are all these problems related?
>
> Any thing you can suggest would be greatly appreciated.
>
I also suspect compiler::link failure. It is also odd that
save-system images are so much bigger. Here is the tiny difference on
Linux:
ls -l /usr/lib/gcl-2.6.7/unixport/saved_gcl
-rwxr-xr-x 1 root root 9329131 Oct 18 13:43
/usr/lib/gcl-2.6.7/unixport/saved_gcl
/usr/lib/gcl-2.6.7/unixport/saved_gcl
GCL (GNU Common Lisp) 2.6.7 CLtL1 Oct 18 2006 13:40:07
Source License: LGPL(gcl,gmp), GPL(unexec,bfd,xgcl)
Binary License: GPL due to GPL'ed components: (XGCL READLINE BFD UNEXEC)
Modifications of this banner must retain notice of a compatible license
Dedicated to the memory of W. Schelter
Use (help) to get some basic information on how to use GCL.
Temporary directory for compiler files set to /tmp/
>(si::save-system "/tmp/ff")
ls -l /tmp/ff
-rwxr-x--- 1 camm camm 9333267 Oct 18 16:25 /tmp/ff
compiler::link should be no smaller than saved_gcl. The raw files are
explicitly deleted as named and output by gcc -- the .tmp extension
appears non-std and might be expected to persist.
I'd make two images, one with
(si::save-system "foo")
and the other with
(compiler::link nil "bar")
And then in each, do a few tests, including looking at
si::*load-types*.
Lastly, you all in the axiom world might like to know that I'm about
to release an HOL88 Debian package build atop GCL. In addition to
providing an alternate theorem proving environment, one also has the
ML language built into the same image for potential use by axiom.
More on this later.
Take care,
> Regards,
> Bill Page.
>
> > >
> > > ---------
> > >
> > > The resulting gcl binary (unixport/saved_gcl) in available here:
> > >
> > > http://page.axiom-developer.org/gcl-2.6.8-osx10-20061017.bin
> > >
> > > I would be very happy if anyone with a MAC OSX machine would try
> > > this version of gcl on their systems and let me know of any
> > > problems.
> > >
> > > I am currently working on completing the Axiom build based on the
> > > new build-improvements branch.
> > >
>
>
>
--
Camm Maguire [EMAIL PROTECTED]
==========================================================================
"The earth is but one country, and mankind its citizens." -- Baha'u'llah
_______________________________________________
Axiom-developer mailing list
Axiom-developer@nongnu.org
http://lists.nongnu.org/mailman/listinfo/axiom-developer
