Re: Native libraries on OS X

2010-02-23 Thread Derek Brown
Allen, You mean compiling the native library? I did "ant compile-native". My code to read/write the files was built in Eclipse, but the same problem occurs with "testsequencefile" in hadoop-0.21-test.jar. What would you recommend regarding how to build, or tweak or regenerate the configure scripts

Re: Native libraries on OS X

2010-02-22 Thread Derek Brown
lex Kozlov >SubjectRe: Native libraries on OS X >DateMon, 22 Feb 2010 22:12:48 GMT > >Sometimes another problem is shadowed by the file loading exception. Could >you try to define HADOOP_ROOT_LOOGER=DEBUG,console rerun the command and >check the log? > >On Mon, Feb 22, 2

Re: Native libraries on OS X

2010-02-22 Thread Derek Brown
/native/Mac_OS_X-x86_64-64/lib"* to >mapred.child.java.opts. > >On Mon, Feb 22, 2010 at 12:51 PM, Derek Brown wrote: > >> I was (seemingly) able to build the native libraries, but still get the >> "unable to load native-hadoop library" message at run-time (with a simple &g

Re: Native libraries on OS X

2010-02-22 Thread Derek Brown
0 -count 1000 >-compressType RECORD blah.seq -codec org.apache.hadoop.io.compress.GzipCodec >-check > > > >On 2/22/10 12:51 PM, "Derek Brown" wrote: > >> I was (seemingly) able to build the native libraries, but still get the >> "unable to load nativ

Native libraries on OS X

2010-02-22 Thread Derek Brown
I was (seemingly) able to build the native libraries, but still get the "unable to load native-hadoop library" message at run-time (with a simple app of my own to read/write a gzip-compressed sequence file). Based on https://issues.apache.org/jira/browse/HADOOP-3659, "Patch to allow hadoop native t

Configuration values only needed by master daemons, only by slaves, or both

2010-01-06 Thread Derek Brown
I'd like to minimize clutter and unneeded values in the core-, hdfs-, and mapred-site.xml files that appear on the master, and that appear on the slaves, only having those that are actually used in the files on the NN/SNN/JT, and in the files on the DNs/TTs. Some values are clearly only needed on t

XInclude and tags in conf files

2009-12-28 Thread Derek Brown
Regarding the ability to include other files in configuration files: http://issues.apache.org/jira/browse/HADOOP-4944 I'm seeing apparent differing behavior that may make sense to someone. I say I have my core-site.xml as follows: http://www.w3.org/2001/XInclude";> include-site.

Fair Scheduler config issues

2009-12-02 Thread Derek Brown
I'm using Cloudera's distribution of 0.20.1, but this seems like a general question to I'm posting here. I'm having some issues getting the Fair Scheduler setup. I followed the basic instructions, from http://hadoop.apache.org/common/docs/current/fair_scheduler.html: * Added to mapred-site.xml: