[
https://issues.apache.org/jira/browse/WHIRR-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated WHIRR-282:
----------------------------
Attachment: WHIRR-282.patch
This patch sets the above Hadoop properties dynamically, as well as
mapred.reduce.tasks (to the number of reduce slots in the cluster).
In addition to the unit test I have run the Hadoop integration test, and tried
spinning up a small cluster with larger instance sizes and observed more
cluster slots.
> Set number of Hadoop slots based on hardware
> --------------------------------------------
>
> Key: WHIRR-282
> URL: https://issues.apache.org/jira/browse/WHIRR-282
> Project: Whirr
> Issue Type: Improvement
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.5.0
>
> Attachments: WHIRR-282.patch
>
>
> We can use the jclouds node metadata to find out the number of cores per
> node, and use it to set the mapred.tasktracker.{map,reduce}.tasks.maximum
> properties.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
