HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia.
(cherry picked from commit 914b0cf15f14ddff581b63f0902b7760e4d2bd56) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/351bfa1b Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/351bfa1b Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/351bfa1b Branch: refs/heads/branch-3.2 Commit: 351bfa1bcfa300f3d4baf45d9f1b7a78a606e5ac Parents: 8c9681d Author: Arpit Agarwal <a...@apache.org> Authored: Thu Nov 15 13:58:13 2018 -0800 Committer: Arpit Agarwal <a...@apache.org> Committed: Thu Nov 15 13:58:29 2018 -0800 ---------------------------------------------------------------------- hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm | 1 + 1 file changed, 1 insertion(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/351bfa1b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm ---------------------------------------------------------------------- diff --git a/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm index f2b3dee..b855422 100644 --- a/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm +++ b/hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm @@ -240,6 +240,7 @@ Flag | Description | Notes `-skipcrccheck` | Whether to skip CRC checks between source and target paths. | `-blocksperchunk <blocksperchunk>` | Number of blocks per chunk. When specified, split files into chunks to copy in parallel | If set to a positive value, files with more blocks than this value will be split into chunks of `<blocksperchunk>` blocks to be transferred in parallel, and reassembled on the destination. By default, `<blocksperchunk>` is 0 and the files will be transmitted in their entirety without splitting. This switch is only applicable when the source file system implements getBlockLocations method and the target file system implements concat method. | `-copybuffersize <copybuffersize>` | Size of the copy buffer to use. By default, `<copybuffersize>` is set to 8192B | +`-xtrack <path>` | Save information about missing source files to the specified path. | This option is only valid with `-update` option. This is an experimental property and it cannot be used with `-atomic` option. Architecture of DistCp ---------------------- --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
