[ https://issues.apache.org/jira/browse/HDFS-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886090#action_12886090 ]
Cody Saunders commented on HDFS-693: ------------------------------------ Followup, even though I set TZ, I still get 480s timeouts in datanodes. Here's a sample, where it appears only 3ms actually pass before it complains: 2010-07-07 13:56:57,865 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /192.168.200.207:50010, dest: /192.168.200.207:44915, bytes: 264192, op: HDFS_READ, cliID: DFSClient_1293902555, srvID: DS-7579347-192.168.200.207-50010-1278476587314, blockid: blk_-3262154426456719253_1840 2010-07-07 13:56:57,868 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(192.168.200.207:50010, storageID=DS-7579347-192.168.200.207-50010-1278476587314, infoPort=50075, ipcPort=50020):Got exception while serving blk_-3262154426456719253_1840 to /192.168.200.207: java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be ready for write. ch : java.nio.channels.SocketChannel[connected local=/192.168.200.207:50010 remote=/192.168.200.207:44915] at org.apache.hadoop.net.SocketIOWithTimeout.waitForIO(SocketIOWithTimeout.java:246) at org.apache.hadoop.net.SocketOutputStream.waitForWritable(SocketOutputStream.java:159) at org.apache.hadoop.net.SocketOutputStream.transferToFully(SocketOutputStream.java:198) at org.apache.hadoop.hdfs.server.datanode.BlockSender.sendChunks(BlockSender.java:313) at org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:400) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:180) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:95) at java.lang.Thread.run(Thread.java:619) I am using hadoop 0.20.2 and hbase 0.20.4. > java.net.SocketTimeoutException: 480000 millis timeout while waiting for > channel to be ready for write exceptions were cast when trying to read file > via StreamFile. > -------------------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: HDFS-693 > URL: https://issues.apache.org/jira/browse/HDFS-693 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node > Affects Versions: 0.20.1 > Reporter: Yajun Dong > Attachments: HDFS-693.log > > > To exclude the case of network problem, I found the count of dataXceiver is > about 30. Also, I could see the output of netstate -a | grep 50075 has many > TIME_WAIT status when this happened. > partial log in attachment. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.