Re: How to read output files over HDFS

2009-03-11 Thread lohit
http://wiki.apache.org/hadoop/HadoopDfsReadWriteExample Loht - Original Message From: Amandeep Khurana To: core-user@hadoop.apache.org Sent: Wednesday, March 11, 2009 9:46:09 PM Subject: Re: How to read output files over HDFS 2 ways that I can think of: 1. Write another MR job

Re: How to read output files over HDFS

2009-03-11 Thread Amandeep Khurana
2 ways that I can think of: 1. Write another MR job without a reducer. The mapper can be made to do whatever logic you want to do. OR 2. Take an instance of DistributedFileSystem class in your java code and use it to read the file from HDFS. Amandeep Khurana Computer Science Graduate Student Un

How to read output files over HDFS

2009-03-11 Thread Muhammad Arshad
Hi, I am running multiple MapReduce jobs which generate their output in directories named output0, output1, output2, ...etc. Once these jobs complete i want to read the output stored in these files(line by line) using a Java code automatically. Kindly tell me how i can do this. I do not want