Hello all, This may be unrelated and/or belong to a different mailing list but issue I'm having is evident only with M/R. I've been playing with Hadoop ports and iptables and after a recent change I'd noticed the following messages every time I execute a job:
12/08/09 10:02:06 INFO hdfs.DFSClient: Exception in createBlockOutputStream 192.168.1.100:50010 java.io.IOException: Bad connect ack with firstBadLink as 192.168.1.103:50010 12/08/09 10:02:06 INFO hdfs.DFSClient: Abandoning block blk_1399101038038930115_1309 12/08/09 10:02:06 INFO hdfs.DFSClient: Excluding datanode 192.168.1.103:50010 12/08/09 10:02:06 INFO hdfs.DFSClient: Exception in createBlockOutputStream 192.168.1.100:50010 java.io.IOException: Bad connect ack with firstBadLink as 192.168.1.101:50010 12/08/09 10:02:06 INFO hdfs.DFSClient: Abandoning block blk_-8044771541473099539_1309 12/08/09 10:02:06 INFO hdfs.DFSClient: Excluding datanode 192.168.1.101:50010 12/08/09 10:02:06 INFO mapred.FileInputFormat: Total input paths to process : 10 12/08/09 10:02:06 INFO hdfs.DFSClient: Exception in createBlockOutputStream 192.168.1.100:50010 java.io.IOException: Bad connect ack with firstBadLink as 192.168.1.101:50010 12/08/09 10:02:06 INFO hdfs.DFSClient: Abandoning block blk_-7369573366706223799_1310 I searched on the interwebs and found a link to a similar message but that only related to datanodes not working. All datanodes do indeed work. M/R finishes successfully and I get results but I don't want to see any extra information if not necessary. Please advise. Thank you. Artem Ervits Data Analyst New York Presbyterian Hospital ________________________________ This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you.
