Consider using the following to retrieve file:
Path[] cacheFiles=DistributedCache.getFileClassPaths(conf);
BufferedReader joinReader=new BufferedReader(new
FileReader(cacheFiles[0].toString()));
On Tue, Sep 7, 2010 at 6:02 AM, Cristi Cioriia
Hi :) I did check stdout under userlogs, but it's empty. If I want to see
the log messages I add to mapper and reducer, should I check them only in
the runtime?
Thanks a lot!
On Sun, Sep 5, 2010 at 10:59 PM, Rita Liu crystaldol...@gmail.com wrote:
Thanks so much for the kind reply! :) I looked
On Sep 7, 2010, at 6:02 AM, Cristi Cioriia wrote:
So I guess what I would like to have is something like
DistributedCache.addCacheFile(new
URI(/user/ccioriia/storage-conf.xml#storage-conf.xml), conf);
which would also add it to the classpath so that the call
Hi all,
I still have the same problem -- So far I've added some log messages to
WordCount.java and JobClient.java with info level, but none of them shows
in any of the logs (JobTracker, TaskTracker, Namenode, Datanode,
SecondaryNamenode) under logs/. However, when I add a log message with the
On Sep 7, 2010, at 9:59 AM, Rita Liu wrote:
Hi all,
I still have the same problem -- So far I've added some log messages
to WordCount.java and JobClient.java with info level, but none of
them shows in any of the logs (JobTracker, TaskTracker, Namenode,
Datanode, SecondaryNamenode) under
Hi,
The last few weeks we built an application using Hadoop.
Because we're implementing against special logfiles (line oriented,
textual and gzipped) and we wanted to extract specific fields from
those file before putting it into our mapper. We chose to implement
our own derivative of the
Actually, I did, but still couldn't find my log messages. I'll double check
and reply to this thread later tonight, but I am pretty sure that they are
not there either :S
Please help? Thanks a lot! -Rita :S
On Tue, Sep 7, 2010 at 10:46 AM, Owen O'Malley omal...@apache.org wrote:
On Sep 7,
I'm writing my first m/r program, and seem to be having problems describing
the types of my key-value pairs.
I have this mapper
public static class Map
extends MapperLongWritable, Text, Text, CensusData
and this reducer
public static class Reduce
extends ReducerText,
There's jc.setMapOutput{Key, Value} methods you can use for this.
Harsh J
http://harshj.com
On 8 Sep 2010 10:21, Clarence Gardner clarence1...@gmail.com wrote:
I'm writing my first m/r program, and seem to be having problems describing
the types of my key-value pairs.
I have this mapper
