Reduce hanging with custom value objects?

2008-08-30 Thread Ryan LeCompte
Hello all, I'm new to Hadoop. I'm trying to write a small hadoop map/reduce program that instead of reading/writing the primitive LongWritable,IntWritable, etc. classes I'm using a custom object that I wrote that implements the Writable interface. I'm still using a LongWritable for the keys, but

hadoop webdav with permission support

2008-08-30 Thread Boris Musykantski
Hi, list Some time ago there was a discussion on this list about exposing HDFS through webdav. The almost complete code is in https://issues.apache.org/jira/browse/HADOOP-496. We re-touched it a bit, updated it to work with 0.16 and 0.17 and put some support for authentications and permissions.

perms clarification for streaming

2008-08-30 Thread Frank Singleton
fedora 9 hadoop 0-18.0 observation a python (for example) mapper used in streaming job creates part-0 etc with id of user. eg: user1 submits job, their part-0 has rw-r--r-- user1 user1 according to dfs -ls but, side effects created by mapper (eg: programmatic file creation etc