[
https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102032#comment-16102032
]
Rakesh R commented on HDFS-12090:
---------------------------------
bq. This is the case only if -createMountOnly is specified
OK, got it.
bq. Once the mount is setup on the Namenode, it can instruct the datanodes to
load the volume required for the mount. However, we would need to know what
volume should be mounted (can be specified by a configuration parameter or as
part of the mount command), and which datanodes should take part in this
process.
Providing option to specify the desired datanode volumes idea looks good to me.
Probably, one suggestion to call this configuration param as
{{favoredDatanodeVolumes}}. IIUC, the volume info is not exposed to the admin.
In order to perform mounting operation we need to expose the {{storageid}} or
volume information to the admins. Appreciate if you could add sample mounting
command with datanode volumes config parameter.
bq. This makes it easier to manage things like credentials to access the remote
store as different mount points can belong to different remote storage accounts
Agreed, {{1-1}} mapping is pretty simple and easy to manage. Here, admin has to
ensure that enough/necessary volumes are configured at the datanode which can
be used for different mount points. My thought process was to reduce the number
of volumes in the system by supporting {{1-many}} but I understand this will
add extra complexities which is not required at the initial stage. Anyway, I
don't have any use case for 1-many, now.
> Handling writes from HDFS to Provided storages
> ----------------------------------------------
>
> Key: HDFS-12090
> URL: https://issues.apache.org/jira/browse/HDFS-12090
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Virajith Jalaparti
> Attachments: HDFS-12090-design.001.pdf
>
>
> HDFS-9806 introduces the concept of {{PROVIDED}} storage, which makes data in
> external storage systems accessible through HDFS. However, HDFS-9806 is
> limited to data being read through HDFS. This JIRA will deal with how data
> can be written to such {{PROVIDED}} storages from HDFS.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
