[jira] Updated: (MAPREDUCE-1906) Lower minimum heartbeat interval for tasktracker > Jobtracker

2010-12-30 Thread Eli Collins (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eli Collins updated MAPREDUCE-1906:
---

Component/s: jobtracker

> Lower minimum heartbeat interval for tasktracker > Jobtracker
> -
>
> Key: MAPREDUCE-1906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1906
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>  Components: jobtracker
>Affects Versions: 0.20.1, 0.20.2
>Reporter: Scott Carey
>Assignee: Todd Lipcon
> Fix For: 0.20.3, 0.22.0, 0.23.0
>
> Attachments: MAPREDUCE-1906-0.21.patch, mapreduce-1906.txt, 
> mapreduce-1906.txt
>
>
> I get a 0% to 15% performance increase for smaller clusters by making the 
> heartbeat throttle stop penalizing clusters with less than 300 nodes.
> Between 0.19 and 0.20, the default minimum heartbeat interval increased from 
> 2s to 3s.   If a JobTracker is throttled at 100 heartbeats / sec for large 
> clusters, why should a cluster with 10 nodes be throttled to 3.3 heartbeats 
> per second?  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (MAPREDUCE-1906) Lower minimum heartbeat interval for tasktracker > Jobtracker

2010-12-30 Thread Eli Collins (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12976163#action_12976163
 ] 

Eli Collins commented on MAPREDUCE-1906:


+1

The latest patch looks ready to go to me.

> Lower minimum heartbeat interval for tasktracker > Jobtracker
> -
>
> Key: MAPREDUCE-1906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1906
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Affects Versions: 0.20.1, 0.20.2
>Reporter: Scott Carey
>Assignee: Todd Lipcon
> Fix For: 0.20.3, 0.22.0, 0.23.0
>
> Attachments: MAPREDUCE-1906-0.21.patch, mapreduce-1906.txt, 
> mapreduce-1906.txt
>
>
> I get a 0% to 15% performance increase for smaller clusters by making the 
> heartbeat throttle stop penalizing clusters with less than 300 nodes.
> Between 0.19 and 0.20, the default minimum heartbeat interval increased from 
> 2s to 3s.   If a JobTracker is throttled at 100 heartbeats / sec for large 
> clusters, why should a cluster with 10 nodes be throttled to 3.3 heartbeats 
> per second?  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1906) Lower minimum heartbeat interval for tasktracker > Jobtracker

2010-12-30 Thread Eli Collins (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eli Collins updated MAPREDUCE-1906:
---

Fix Version/s: 0.23.0
   0.22.0
   0.20.3

> Lower minimum heartbeat interval for tasktracker > Jobtracker
> -
>
> Key: MAPREDUCE-1906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1906
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Affects Versions: 0.20.1, 0.20.2
>Reporter: Scott Carey
>Assignee: Todd Lipcon
> Fix For: 0.20.3, 0.22.0, 0.23.0
>
> Attachments: MAPREDUCE-1906-0.21.patch, mapreduce-1906.txt, 
> mapreduce-1906.txt
>
>
> I get a 0% to 15% performance increase for smaller clusters by making the 
> heartbeat throttle stop penalizing clusters with less than 300 nodes.
> Between 0.19 and 0.20, the default minimum heartbeat interval increased from 
> 2s to 3s.   If a JobTracker is throttled at 100 heartbeats / sec for large 
> clusters, why should a cluster with 10 nodes be throttled to 3.3 heartbeats 
> per second?  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.