[ 
https://issues.apache.org/jira/browse/HDFS-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886090#action_12886090
 ] 

Cody Saunders commented on HDFS-693:
------------------------------------

Followup, even though I set TZ, I still get 480s timeouts in datanodes. Here's 
a sample, where it appears only 3ms actually pass before it complains:

2010-07-07 13:56:57,865 INFO 
org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: 
/192.168.200.207:50010, dest: /192.168.200.207:44915, bytes: 264192, op: 
HDFS_READ, cliID: DFSClient_1293902555, srvID: 
DS-7579347-192.168.200.207-50010-1278476587314, blockid: 
blk_-3262154426456719253_1840

2010-07-07 13:56:57,868 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: 
DatanodeRegistration(192.168.200.207:50010, 
storageID=DS-7579347-192.168.200.207-50010-1278476587314, infoPort=50075, 
ipcPort=50020):Got exception while serving blk_-3262154426456719253_1840 to 
/192.168.200.207:
java.net.SocketTimeoutException: 480000 millis timeout while waiting for 
channel to be ready for write. ch : java.nio.channels.SocketChannel[connected 
local=/192.168.200.207:50010 remote=/192.168.200.207:44915]
    at 
org.apache.hadoop.net.SocketIOWithTimeout.waitForIO(SocketIOWithTimeout.java:246)
    at 
org.apache.hadoop.net.SocketOutputStream.waitForWritable(SocketOutputStream.java:159)
    at 
org.apache.hadoop.net.SocketOutputStream.transferToFully(SocketOutputStream.java:198)
    at 
org.apache.hadoop.hdfs.server.datanode.BlockSender.sendChunks(BlockSender.java:313)
    at 
org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:400)
    at 
org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:180)
    at 
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:95)
    at java.lang.Thread.run(Thread.java:619)

I am using hadoop 0.20.2 and hbase 0.20.4.

> java.net.SocketTimeoutException: 480000 millis timeout while waiting for 
> channel to be ready for write exceptions were cast when trying to read file 
> via StreamFile.
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-693
>                 URL: https://issues.apache.org/jira/browse/HDFS-693
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 0.20.1
>            Reporter: Yajun Dong
>         Attachments: HDFS-693.log
>
>
> To exclude the case of network problem, I found the count of  dataXceiver is 
> about 30.  Also, I could see the output of netstate -a | grep 50075 has many 
> TIME_WAIT status when this happened.
> partial log in attachment. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to