Native libraries on Mac

2010-03-09 Thread Christopher Tubbs
I'm trying to build the native libraries for hadoop on Mac OS X Leopard (10.5.8) for Hadoop 0.20.1 I tried the "ant compile-native" method, but I don't have access to the internet. I do have a local repository though with all the dependencies (not to mention they are in the $HADOOP_HOME/lib). I wa

Re: Native libraries on Mac

2010-03-10 Thread Christopher Tubbs
A follow up: I've successfully figured out how to point ivy to my maven repository by editing the ivy/ivysettings.xml file, and have successfully built the binaries. However, now I can't figure out how to load the libraries. I try to run a simple java program that calls 'System.loadLibrary("hadoo

Re: Native libraries on Mac

2010-03-11 Thread Christopher Tubbs
Well, I finally figured it out. Apparently, the library being generated WAS i386 and not x86_64. So, you have to set CFLAGS="-arch x86_64" prior to running "ant compile-native" Think we can get patches into 0.20.3 to fix building on a Mac? Also, it would be nice if ivy could be preconfigured for

Re: Native libraries on Mac

2010-03-11 Thread Arun C Murthy
Of course, please open a jira and attach the patch. Thanks! On Mar 11, 2010, at 10:11 AM, Christopher Tubbs wrote: Well, I finally figured it out. Apparently, the library being generated WAS i386 and not x86_64. So, you have to set CFLAGS="-arch x86_64" prior to running "ant compile-native"

Re: Native libraries on Mac

2010-03-11 Thread Allen Wittenauer
*nods* There is a bug with the bitness detection in general (it breaks horribly on Solaris due to the java executable supporting both). I've started working on a general patch (it a] asks Java what bitness it is and b] asks java which JVM lib to link against), but got sidetracked by switching our

Re: Native libraries on Mac

2010-03-11 Thread Christopher Tubbs
For now, I think it would be sufficient to apply HADOOP-3659 and document the rest. Later, the build.xml can be patched to set the environment correctly. I'm not familiar with ivy to determine how to point to the local lib directory, but I'm sure somebody savvy with ivy could do it easilyor all

Re: Native libraries on Mac

2010-03-11 Thread Hong Tang
Right, this is similar to the instructions on hadoop-gpl-compression FAQ page: http://code.google.com/p/hadoop-gpl-compression/wiki/FAQ (the last question). On 3/11/10 10:23 AM, "Arun C Murthy" wrote: > Of course, please open a jira and attach the patch. Thanks! > > On Mar 11, 2010, at 10:11 A

Re: Native libraries on Mac

2010-03-11 Thread Jason Venner
It is funny, I just put this together myself, my next step is figuring out why the libjvm.dynlib doesn't actually define the get a jvm instance symbol, for libhdfs. Once that is sorted out, I will have fuse_dfs going on the mac. The build stuff for solaris and macos is ugly, I have ended up hand ha

Re: Native libraries on Mac

2010-03-11 Thread Allen Wittenauer
If you want, I can send you my patches and see if that fixes your issues. Maybe I'll work on this tomorrow and actually get a JIRA posted, etc. lol On 3/11/10 6:28 PM, "Jason Venner" wrote: > It is funny, I just put this together myself, my next step is figuring > out why the libjvm.dynlib d

Re: Native libraries on Mac

2010-03-11 Thread Jason Venner
Thank you Allen. On Thu, Mar 11, 2010 at 7:58 PM, Allen Wittenauer wrote: > > If you want, I can send you my patches and see if that fixes your issues. > > Maybe I'll work on this tomorrow and actually get a JIRA posted, etc. lol > > > > On 3/11/10 6:28 PM, "Jason Venner" wrote: > >> It is funn