Chris Douglas created HDFS-9806: ----------------------------------- Summary: Allow HDFS block replicas to be provided by an external storage system Key: HDFS-9806 URL: https://issues.apache.org/jira/browse/HDFS-9806 Project: Hadoop HDFS Issue Type: New Feature Reporter: Chris Douglas
In addition to heterogeneous media, many applications work with heterogeneous storage systems. The guarantees and semantics provided by these systems are often similar, but not identical to those of [HDFS|https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/index.html]. Any client accessing multiple storage systems is responsible for reasoning about each system independently, and must propagate/and renew credentials for each store. Remote stores could be mounted under HDFS. Block locations could be mapped to immutable file regions, opaque IDs, or other tokens that represent a consistent view of the data. While correctness for arbitrary operations requires careful coordination between stores, in practice we can provide workable semantics with weaker guarantees. -- This message was sent by Atlassian JIRA (v6.3.4#6332)