Re: Snow Leopard Compilation Help
Ronald, Please take a look at https://issues.apache.org/jira/browse/HADOOP-7147, and https://issues.apache.org/jira/browse/HADOOP-7824 - milind On 12/1/11 5:31 PM, "Ronald Petty" wrote: >Alejandro, > >I suppose I will give it a go since that is the computer I have. I tried >searching on JIRA for issues mac related but its hard for me to tell which >ones might be related or not. Should I just figure it out and email the >list with my fix (if I find one?) > >Ron > >On Thu, Dec 1, 2011 at 7:23 PM, Alejandro Abdelnur >wrote: > >> Ron, >> >> Hadoop native currently does not compile in Mac OS X. There have been >>some >> JIRAs to fix that, but nobody took on them. >> >> Thanks. >> >> Alejandro >> >> On Thu, Dec 1, 2011 at 3:55 PM, Ronald Petty >> wrote: >> >> > Hello, >> > >> > I am new to Hadoop development and seem to be stuck on building with >>Snow >> > Leopard. Here is what is going on: >> > >> > 1. svn checkout >> > http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-trunk >> > 2. wget http://protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz >> > 3. tar ... proto...gz; cd proto... >> > 4. ./configure --prefix=/hadoop/contribute/protobuf/;make;make >>install >> > 5. export PATH=/hadoop/contribute/protobuf/bin/:$PATH >> > 6. cd hadoop-trunk >> > 7. mvn clean >> > 8. mvn install -Dmaven.test.skip.exec=true >> > 9. mvn assembly:assembly -Pnative >> > 10. Error >> > >> > [INFO] --- make-maven-plugin:1.0-beta-1:make-install (compile) @ >> > hadoop-common --- >> > [INFO] /bin/sh ./libtool --tag=CC --mode=compile gcc >>-DHAVE_CONFIG_H >> -I. >> > -I/Library/Java/Home/include >> > >> > >> >>-I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/tar >>get/native/src >> > >> > >> >>-I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/tar >>get/native/javah >> > -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT >>ZlibCompressor.lo >> > -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f >> > 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo >> > './'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c >> > [INFO] libtool: compile: gcc -DHAVE_CONFIG_H -I. >> > -I/Library/Java/Home/include >> > >> > >> >>-I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/tar >>get/native/src >> > >> > >> >>-I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/tar >>get/native/javah >> > -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT >>ZlibCompressor.lo >> > -MD -MP -MF .deps/ZlibCompressor.Tpo -c >> > src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c -fno-common >> -DPIC >> > -o .libs/ZlibCompressor.o >> > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In >> function >> > 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs': >> > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: >>error: >> > 'libnotfound' undeclared (first use in this function) >> > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: >>error: >> > (Each undeclared identifier is reported only once >> > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: >>error: >> > for each function it appears in.) >> > [INFO] make: *** [ZlibCompressor.lo] Error 1 >> > [INFO] >> > >> >> > [INFO] Reactor Summary: >> > [INFO] >> > [INFO] Apache Hadoop Main FAILURE >> > [46.914s] >> > [INFO] Apache Hadoop Project POM . SKIPPED >> > [INFO] Apache Hadoop Annotations . SKIPPED >> > >> > >> > >> > I looked around and found this >> > http://wiki.apache.org/hadoop/UsingLzoCompression. I tried to mess >>with >> > lzo via MacPort. Seems to be there, but I am not certain where to go >> from >> > here. >> > >> > Also, how do you search the mail archives ( >> > http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/)? >> > >> > Thanks for the help. >> > >> > Kindest regards. >> > >> > Ron >> > >>
Re: Snow Leopard Compilation Help
Alejandro, I suppose I will give it a go since that is the computer I have. I tried searching on JIRA for issues mac related but its hard for me to tell which ones might be related or not. Should I just figure it out and email the list with my fix (if I find one?) Ron On Thu, Dec 1, 2011 at 7:23 PM, Alejandro Abdelnur wrote: > Ron, > > Hadoop native currently does not compile in Mac OS X. There have been some > JIRAs to fix that, but nobody took on them. > > Thanks. > > Alejandro > > On Thu, Dec 1, 2011 at 3:55 PM, Ronald Petty > wrote: > > > Hello, > > > > I am new to Hadoop development and seem to be stuck on building with Snow > > Leopard. Here is what is going on: > > > > 1. svn checkout > > http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-trunk > > 2. wget http://protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz > > 3. tar ... proto...gz; cd proto... > > 4. ./configure --prefix=/hadoop/contribute/protobuf/;make;make install > > 5. export PATH=/hadoop/contribute/protobuf/bin/:$PATH > > 6. cd hadoop-trunk > > 7. mvn clean > > 8. mvn install -Dmaven.test.skip.exec=true > > 9. mvn assembly:assembly -Pnative > > 10. Error > > > > [INFO] --- make-maven-plugin:1.0-beta-1:make-install (compile) @ > > hadoop-common --- > > [INFO] /bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H > -I. > > -I/Library/Java/Home/include > > > > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/src > > > > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/javah > > -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo > > -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f > > 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo > > './'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c > > [INFO] libtool: compile: gcc -DHAVE_CONFIG_H -I. > > -I/Library/Java/Home/include > > > > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/src > > > > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/javah > > -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo > > -MD -MP -MF .deps/ZlibCompressor.Tpo -c > > src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c -fno-common > -DPIC > > -o .libs/ZlibCompressor.o > > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In > function > > 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs': > > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: > > 'libnotfound' undeclared (first use in this function) > > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: > > (Each undeclared identifier is reported only once > > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: > > for each function it appears in.) > > [INFO] make: *** [ZlibCompressor.lo] Error 1 > > [INFO] > > > > [INFO] Reactor Summary: > > [INFO] > > [INFO] Apache Hadoop Main FAILURE > > [46.914s] > > [INFO] Apache Hadoop Project POM . SKIPPED > > [INFO] Apache Hadoop Annotations . SKIPPED > > > > > > > > I looked around and found this > > http://wiki.apache.org/hadoop/UsingLzoCompression. I tried to mess with > > lzo via MacPort. Seems to be there, but I am not certain where to go > from > > here. > > > > Also, how do you search the mail archives ( > > http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/)? > > > > Thanks for the help. > > > > Kindest regards. > > > > Ron > > >
Re: Snow Leopard Compilation Help
Ron, Hadoop native currently does not compile in Mac OS X. There have been some JIRAs to fix that, but nobody took on them. Thanks. Alejandro On Thu, Dec 1, 2011 at 3:55 PM, Ronald Petty wrote: > Hello, > > I am new to Hadoop development and seem to be stuck on building with Snow > Leopard. Here is what is going on: > > 1. svn checkout > http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-trunk > 2. wget http://protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz > 3. tar ... proto...gz; cd proto... > 4. ./configure --prefix=/hadoop/contribute/protobuf/;make;make install > 5. export PATH=/hadoop/contribute/protobuf/bin/:$PATH > 6. cd hadoop-trunk > 7. mvn clean > 8. mvn install -Dmaven.test.skip.exec=true > 9. mvn assembly:assembly -Pnative > 10. Error > > [INFO] --- make-maven-plugin:1.0-beta-1:make-install (compile) @ > hadoop-common --- > [INFO] /bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. > -I/Library/Java/Home/include > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/src > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/javah > -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo > -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f > 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo > './'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c > [INFO] libtool: compile: gcc -DHAVE_CONFIG_H -I. > -I/Library/Java/Home/include > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/src > > -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/javah > -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo > -MD -MP -MF .deps/ZlibCompressor.Tpo -c > src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c -fno-common -DPIC > -o .libs/ZlibCompressor.o > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In function > 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs': > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: > 'libnotfound' undeclared (first use in this function) > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: > (Each undeclared identifier is reported only once > [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: > for each function it appears in.) > [INFO] make: *** [ZlibCompressor.lo] Error 1 > [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Hadoop Main FAILURE > [46.914s] > [INFO] Apache Hadoop Project POM . SKIPPED > [INFO] Apache Hadoop Annotations . SKIPPED > > > > I looked around and found this > http://wiki.apache.org/hadoop/UsingLzoCompression. I tried to mess with > lzo via MacPort. Seems to be there, but I am not certain where to go from > here. > > Also, how do you search the mail archives ( > http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/)? > > Thanks for the help. > > Kindest regards. > > Ron >
Snow Leopard Compilation Help
Hello, I am new to Hadoop development and seem to be stuck on building with Snow Leopard. Here is what is going on: 1. svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-trunk 2. wget http://protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz 3. tar ... proto...gz; cd proto... 4. ./configure --prefix=/hadoop/contribute/protobuf/;make;make install 5. export PATH=/hadoop/contribute/protobuf/bin/:$PATH 6. cd hadoop-trunk 7. mvn clean 8. mvn install -Dmaven.test.skip.exec=true 9. mvn assembly:assembly -Pnative 10. Error [INFO] --- make-maven-plugin:1.0-beta-1:make-install (compile) @ hadoop-common --- [INFO] /bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I/Library/Java/Home/include -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/src -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/javah -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo './'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c [INFO] libtool: compile: gcc -DHAVE_CONFIG_H -I. -I/Library/Java/Home/include -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/src -I/hadoop/contribute/hadoop-trunk/hadoop-common-project/hadoop-common/target/native/javah -I/usr/local/include -g -Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c -fno-common -DPIC -o .libs/ZlibCompressor.o [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In function 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs': [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: 'libnotfound' undeclared (first use in this function) [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: (Each undeclared identifier is reported only once [INFO] src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71: error: for each function it appears in.) [INFO] make: *** [ZlibCompressor.lo] Error 1 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop Main FAILURE [46.914s] [INFO] Apache Hadoop Project POM . SKIPPED [INFO] Apache Hadoop Annotations . SKIPPED I looked around and found this http://wiki.apache.org/hadoop/UsingLzoCompression. I tried to mess with lzo via MacPort. Seems to be there, but I am not certain where to go from here. Also, how do you search the mail archives ( http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/)? Thanks for the help. Kindest regards. Ron
