Hi, When loading a file from local to HDFS cluster using the below command
hadoop fs -put sales.txt /sales_dept. Getting the following exception.Please let me know how to resolve this issue asap.Please find the attached is the logs that is displaying on namenode. Regards, Sandeep.v
hadoop26@optimus:~/Jarfiles$ hadoop fs -put 1M.csv /newoutput 15/04/06 15:24:59 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/04/06 15:26:01 WARN hdfs.DFSClient: Slow ReadProcessor read fields took 60012ms (threshold=30000ms); ack: seqno: -2 status: SUCCESS status: ERROR downstreamAckTimeNanos: 0, targets: [192.168.2.84:50010, 192.168.2.82:50010, 192.168.2.81:50010] 15/04/06 15:26:01 WARN hdfs.DFSClient: DFSOutputStream ResponseProcessor exception for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540 java.io.IOException: Bad response ERROR for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540 from datanode 192.168.2.82:50010 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:897) 15/04/06 15:26:54 WARN hdfs.DFSClient: DataStreamer Exception java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImpl.write0(Native Method) at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) at sun.nio.ch.IOUtil.write(IOUtil.java:65) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142) at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159) at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117) at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122) at java.io.DataOutputStream.write(DataOutputStream.java:107) at org.apache.hadoop.hdfs.DFSOutputStream$Packet.writeTo(DFSOutputStream.java:321) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:643) 15/04/06 15:26:54 WARN hdfs.DFSClient: Error Recovery for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540 in pipeline 192.168.2.84:50010, 192.168.2.82:50010, 192.168.2.81:50010: bad datanode 192.168.2.82:50010 15/04/06 15:27:55 WARN hdfs.DFSClient: Slow ReadProcessor read fields took 60044ms (threshold=30000ms); ack: seqno: -2 status: SUCCESS status: ERROR downstreamAckTimeNanos: 0, targets: [192.168.2.84:50010, 192.168.2.81:50010] 15/04/06 15:27:55 WARN hdfs.DFSClient: DFSOutputStream ResponseProcessor exception for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11541 java.io.IOException: Bad response ERROR for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11541 from datanode 192.168.2.81:50010 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:897) ^C^Z [2]+ Stopped