Virajith Jalaparti created HDFS-14805:
-----------------------------------------
Summary: Mounting external stores in HDFS on-the-fly
Key: HDFS-14805
URL: https://issues.apache.org/jira/browse/HDFS-14805
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Virajith Jalaparti
Attachments: dynamic-mounts-in-hdfs.pdf
Provided storage (HDFS-9806) allows HDFS to address data in external storage
systems, including cloud stores. Data mounted in this manner, seamlessly,
appears to be part of HDFS for applications/clients. The external data can also
be cached by HDFS on local disks and SSDs, accelerating remote data reads
(HDFS-13069).
However, Provided storage was originally targeted at ephemeral HDFS deployments
in the cloud (e.g., Azure HDInsight). Long running HDFS clusters are common in
many other scenarios which can benefit from accessing data in remote stores.
This JIRA targets such scenarios and aims to provide the ability to:
(a) Dynamically mount external stores in a HDFS cluster while supporting high
availability.
(b) Mount multiple remote stores simultaneously.
(c) Reduce deployment overheads and simplify usability of Provided storage.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]