[ https://issues.apache.org/jira/browse/HADOOP-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13066488#comment-13066488 ]
Harsh J commented on HADOOP-970: -------------------------------- Dhruba, Looking at the blocker linked to this ticket, is the problem still valid on trunk or a maintained release today with Java 1.6 being the bare minimum requirement? > Reduce CPU usage of hadoop ipc package > -------------------------------------- > > Key: HADOOP-970 > URL: https://issues.apache.org/jira/browse/HADOOP-970 > Project: Hadoop Common > Issue Type: Bug > Components: ipc > Reporter: dhruba borthakur > > There are a couple of optimizations that could be done to reduce CPU > consumption. > 1. The method Server.cleanupConnections() could be invoked less often. > 2. The method Server.cleanupConnections() uses a List to manage all active > connections and uses connectionList.get(i) to iterate. Locating the ith > element essentially translates to traversing the list from the beginning to > the ith position. > 3. The current DFS heartbeattime is 3 seconds whereas > ipc.client.connection.maxidletime is set to 1 second. The proposal is to > change the default value of ipc.client.connection.maxidletime to something > larger than the heartbeat interval. This also has to suit the heartbeat > periodicity of map-reduce software. > 4. Evaluate epoll() added in JDK 1.5.10 (this is a java cmd line option) > http://java.sun.com/j2se/1.5.0/ReleaseNotes.html#150_10 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira