[
https://issues.apache.org/jira/browse/HADOOP-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HADOOP-3873:
-------------------------------------------
Attachment: 3873_20080811b.patch
3873_20080811b.patch: this is a complete patch
- -filelimit <n> and -sizelimit <n> support symbolic representation. For
examples,
1230k = 1230 * 1024 = 1259520
891g = 891 * 1024^3 = 956703965184
- Comparing files sizes during setup
- Rewrote shell messages
- Added a few tests
> DistCp should have an option for limiting the number of files/bytes being
> copied
> --------------------------------------------------------------------------------
>
> Key: HADOOP-3873
> URL: https://issues.apache.org/jira/browse/HADOOP-3873
> Project: Hadoop Core
> Issue Type: New Feature
> Components: tools/distcp
> Reporter: Tsz Wo (Nicholas), SZE
> Attachments: 3873_20080808b.patch, 3873_20080811b.patch
>
>
> A single DistCp command may potentially copies a huge number of files/bytes.
> In such case, DistCp will run a long time and there is no way stop it nicely.
> It would be good if DistCp have an option to limit the number of files/bytes
> being copied. Once the limit is reached, DistCp will terminate and return
> success. All files copied are guaranteed to be good and there is no
> partially copied file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
