HDFS-13628. Update Archival Storage doc for Provided Storage Signed-off-by: Akira Ajisaka <aajis...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/04757e58 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/04757e58 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/04757e58 Branch: refs/heads/YARN-7402 Commit: 04757e5864bd4904fd5a59d143fff480814700e4 Parents: 88cbe57 Author: Takanobu Asanuma <tasan...@yahoo-corp.jp> Authored: Mon May 28 19:04:36 2018 +0900 Committer: Akira Ajisaka <aajis...@apache.org> Committed: Mon May 28 19:06:34 2018 +0900 ---------------------------------------------------------------------- .../hadoop-hdfs/src/site/markdown/ArchivalStorage.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/04757e58/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ArchivalStorage.md ---------------------------------------------------------------------- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ArchivalStorage.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ArchivalStorage.md index ab7975a..3c49cb1 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ArchivalStorage.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ArchivalStorage.md @@ -35,7 +35,7 @@ A new storage type *ARCHIVE*, which has high storage density (petabyte of storag Another new storage type *RAM\_DISK* is added for supporting writing single replica files in memory. -### Storage Policies: Hot, Warm, Cold, All\_SSD, One\_SSD and Lazy\_Persist +### Storage Policies: Hot, Warm, Cold, All\_SSD, One\_SSD, Lazy\_Persist and Provided A new concept of storage policies is introduced in order to allow files to be stored in different storage types according to the storage policy. @@ -47,6 +47,7 @@ We have the following storage policies: * **All\_SSD** - for storing all replicas in SSD. * **One\_SSD** - for storing one of the replicas in SSD. The remaining replicas are stored in DISK. * **Lazy\_Persist** - for writing blocks with single replica in memory. The replica is first written in RAM\_DISK and then it is lazily persisted in DISK. +* **Provided** - for storing data outside HDFS. See also [HDFS Provided Storage](./HdfsProvidedStorage.html). More formally, a storage policy consists of the following fields: @@ -68,6 +69,7 @@ The following is a typical storage policy table. | 7 | Hot (default) | DISK: *n* | \<none\> | ARCHIVE | | 5 | Warm | DISK: 1, ARCHIVE: *n*-1 | ARCHIVE, DISK | ARCHIVE, DISK | | 2 | Cold | ARCHIVE: *n* | \<none\> | \<none\> | +| 1 | Provided | PROVIDED: 1, DISK: *n*-1 | PROVIDED, DISK | PROVIDED, DISK | Note 1: The Lazy\_Persist policy is useful only for single replica blocks. For blocks with more than one replicas, all the replicas will be written to DISK since writing only one of the replicas to RAM\_DISK does not improve the overall performance. --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org