Hey Jayaseelan, You can't distcp to a file:// destination URI, unless that location is a NFS point commonly available across all your nodes.
What you probably need for 3 GB worth of data is a simple "hadoop fs -copyToLocal src dest" command. On 21-Dec-2011, at 12:20 PM, Jayaseelan E wrote: > > Hi Folks! > I am have some 40 folders whose size of each folders are aproximately 3GB.I > used distcp command to take a copy from HDFS to local machine. > But it fails with the following error. > /opt/hadoop/bin/hadoop distcp hdfs://bl460x1890:9000/<<Source location>> > file:///<<targetpath>> > > java.io.IOException: The temporary job-output directory > file:/archive/_distcp_logs_ndyr8m/_temporarydoesn't exist! > at > org.apache.hadoop.mapred.FileOutputCommitter.getWorkPath(FileOutputCommitter.java:204) > at > org.apache.hadoop.mapred.FileOutputFormat.getTaskOutputPath(FileOutputFormat.java:234) > > My hadoop version is 2.0.1 > If any one can please help me resolve this > > Thanks indeed > jayaseelan >