[
https://issues.apache.org/jira/browse/HADOOP-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640330#action_12640330
]
Raghu Angadi commented on HADOOP-4396:
--------------------------------------
We caught one of the nodes in this state in last couple of minutes. 'sda' was
very busy and the remaining disks were idle. Logs and os also reside on sda..
ssh login took more than a minute. This can explain why reading a block could
take so long. Still not sure what causes the load on sda alone. we have
datanode log for this node. Didn't have much time to take jstack and other info.
> sort on 400 nodes is now slower than in 18
> ------------------------------------------
>
> Key: HADOOP-4396
> URL: https://issues.apache.org/jira/browse/HADOOP-4396
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Jothi Padmanabhan
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: 4396-v3.patch
>
>
> Sort on 400 nodes on hadoop release 18 takes about 29 minutes, but with the
> 19 branch takes about 32 minutes. This behavior is consistent.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
