Re: Failure to write to HDFS in MapReduce job

2014-11-05 Thread Azuryy Yu
please check your network issue. generally this was casued by unstable network device. On Wed, Nov 5, 2014 at 5:55 PM, Hayden Marchant wrote: > > I have a MapReduce job running on Hadoop 2.0.0, and on some 'heavy' jobs, > I am seeing the following errors in the reducer. > > > 2014-11-04 13:30:57

Failure to write to HDFS in MapReduce job

2014-11-05 Thread Hayden Marchant
I have a MapReduce job running on Hadoop 2.0.0, and on some 'heavy' jobs, I am seeing the following errors in the reducer. 2014-11-04 13:30:57,761 WARN org.apache.hadoop.hdfs.DFSClient: DFSOutputStream ResponseProcessor exception for block BP-60005389-172.30.21.49-1379424439243:blk_-4575496