[
https://issues.apache.org/jira/browse/HADOOP-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HADOOP-3873:
-------------------------------------------
Release Note: Added two new options -filelimit <n> and -sizelimit <n> to
DistCp for limiting the total number of files and the total size in bytes,
respectively.
> DistCp should have an option for limiting the number of files/bytes being
> copied
> --------------------------------------------------------------------------------
>
> Key: HADOOP-3873
> URL: https://issues.apache.org/jira/browse/HADOOP-3873
> Project: Hadoop Core
> Issue Type: New Feature
> Components: tools/distcp
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.19.0
>
> Attachments: 3873_20080808b.patch, 3873_20080811b.patch
>
>
> A single DistCp command may potentially copies a huge number of files/bytes.
> In such case, DistCp will run a long time and there is no way stop it nicely.
> It would be good if DistCp have an option to limit the number of files/bytes
> being copied. Once the limit is reached, DistCp will terminate and return
> success. All files copied are guaranteed to be good and there is no
> partially copied file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
