HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia.
(cherry picked from commit 914b0cf15f14ddff581b63f0902b7760e4d2bd56) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3e57adee Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3e57adee Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/3e57adee Branch: refs/heads/branch-3.1 Commit: 3e57adee0a621c928ebe64d2050dc3e827d556d9 Parents: ba75aee Author: Arpit Agarwal <a...@apache.org> Authored: Thu Nov 15 13:58:13 2018 -0800 Committer: Arpit Agarwal <a...@apache.org> Committed: Thu Nov 15 13:58:38 2018 -0800 ---------------------------------------------------------------------- hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm | 1 + 1 file changed, 1 insertion(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/3e57adee/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm ---------------------------------------------------------------------- diff --git a/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm index f2b3dee..b855422 100644 --- a/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm +++ b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm @@ -240,6 +240,7 @@ Flag | Description | Notes `-skipcrccheck` | Whether to skip CRC checks between source and target paths. | `-blocksperchunk <blocksperchunk>` | Number of blocks per chunk. When specified, split files into chunks to copy in parallel | If set to a positive value, files with more blocks than this value will be split into chunks of `<blocksperchunk>` blocks to be transferred in parallel, and reassembled on the destination. By default, `<blocksperchunk>` is 0 and the files will be transmitted in their entirety without splitting. This switch is only applicable when the source file system implements getBlockLocations method and the target file system implements concat method. | `-copybuffersize <copybuffersize>` | Size of the copy buffer to use. By default, `<copybuffersize>` is set to 8192B | +`-xtrack <path>` | Save information about missing source files to the specified path. | This option is only valid with `-update` option. This is an experimental property and it cannot be used with `-atomic` option. Architecture of DistCp ---------------------- --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
