Error could only be replicated to 0 nodes instead of minReplication (=1)

2014-08-28 Thread Jakub Stransky
Hello, we are using Hadoop 2.2.0 (HDP 2.0), avro 1.7.4. running on CentOS 6.3 I am facing a following issue when using a AvroMultipleOutputs with dynamic output files. My M/R job works fine for a smaller amount of data or at least the error hasn't appear there so far. With bigger amount of data I

Re: hadoop 2.2.0 cluster setup error : could only be replicated to 0 nodes instead of minReplication (=1)

2014-02-25 Thread Manoj Khangaonkar
Thanks On Mon, Feb 24, 2014 at 6:39 PM, Azuryy Yu azury...@gmail.com wrote: Generally, this is caused by insufficient space. please check the total capacity of your cluster and used, remaining ratio, and check dfs.datanode.du.reserved in the hdfs-site.xml if this value is larger than your

hadoop 2.2.0 cluster setup error : could only be replicated to 0 nodes instead of minReplication (=1)

2014-02-24 Thread Manoj Khangaonkar
Hi, I setup a cluster with machine1 : namenode and datanode machine 2 : data node A simple hdfs copy is not working. Can someone help with this issue ? Several folks have posted this error on the web, But I have seen a good reason or solution. command: bin/hadoop fs -copyFromLocal ~/hello

Re: hadoop 2.2.0 cluster setup error : could only be replicated to 0 nodes instead of minReplication (=1)

2014-02-24 Thread Manoj Khangaonkar
Hi Can one of the implementors comment on what conditions trigger this error ? All the data nodes show up as commissioned. No errors during startup If I google for this error, there are several posts reporting the issue : but most of the answers have weak solutions like reformating and

Re: hadoop 2.2.0 cluster setup error : could only be replicated to 0 nodes instead of minReplication (=1)

2014-02-24 Thread Azuryy Yu
Generally, this is caused by insufficient space. please check the total capacity of your cluster and used, remaining ratio, and check dfs.datanode.du.reserved in the hdfs-site.xml if this value is larger than your remained capacity, then you got this Exception. On Tue, Feb 25, 2014 at 10:35