RE: reducers output

2012-02-04 Thread Uma Maheswara Rao G
This looks to be HDFS specific question. please send it to correct mailing list. cc'ed to mapreduce user if you have not registered for hdfs. Please look at the previous discussion in mailing list about your question.

skip rest of input in mapper/reducer

2012-02-04 Thread Radim Kolar
Is there way to signal mapreduce framework from mapper or reducer that I am not interested in any more input data? Currently i read rest of data but ignore them.

Re: skip rest of input in mapper/reducer

2012-02-04 Thread Harsh J
You can implement such logic using the advanced MapRunner (Stable API) class, or by overriding the Mapper#run method (New, unstable API). MapRunner: http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/MapRunner.html#run(org.apache.hadoop.mapred.RecordReader,

RE: reducers output

2012-02-04 Thread Uma Maheswara Rao G
Sorry. Ignore my previos answer. Was just thinking about normal HDFS files :-). In your question, they will be decided by your job itself. sorry for the confusion. From: Uma Maheswara Rao G [mahesw...@huawei.com] Sent: Saturday, February 04, 2012 5:46 PM To: