[
https://issues.apache.org/jira/browse/MAPREDUCE-653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12842549#action_12842549
]
Ravi Gummadi commented on MAPREDUCE-653:
----------------------------------------
Current proposal does not impose restriction on the number of slots(number of
maps) used by distcp job based on the bandwidth limit provided by user.
Each map task tries to adjust the bandwidth usage of the whole job by
adjusting its own bandwidth usage by sleeping for calculated amount of
time(this sleep time is calculated based on the current bandwidth usage by this
map task and the bandwidth limit specified by user and the number of currently
running map tasks in this distcp job).
> distcp can support bandwidth limiting
> -------------------------------------
>
> Key: MAPREDUCE-653
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-653
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: distcp
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Attachments: d_bw.patch, d_bw.v1.patch, d_bw.v2.patch
>
>
> distcp should support an option for user to specify the bandwidth limit for
> the distcp job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
