[
https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=506535&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-506535
]
ASF GitHub Bot logged work on HDFS-15548:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Oct/20 05:21
Start Date: 30/Oct/20 05:21
Worklog Time Spent: 10m
Work Description: LeonGao91 commented on a change in pull request #2288:
URL: https://github.com/apache/hadoop/pull/2288#discussion_r514875357
##########
File path:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
##########
@@ -1503,6 +1503,20 @@
public static final boolean DFS_PROTECTED_SUBDIRECTORIES_ENABLE_DEFAULT =
false;
+ public static final String DFS_DATANODE_ALLOW_SAME_DISK_TIERING =
+ "dfs.datanode.same-disk-tiering.enabled";
+ public static final boolean DFS_DATANODE_ALLOW_SAME_DISK_TIERING_DEFAULT =
+ false;
+
+ // HDFS-15548 to allow DISK/ARCHIVE configured on the same disk mount.
+ // Beware that capacity usage might be >100% if there are already
+ // data blocks exist and the configured ratio is small, which will
+ // prevent the volume from taking new blocks until capacity is balanced out.
+ public static final String DFS_DATANODE_RESERVE_FOR_ARCHIVE_PERCENTAGE =
Review comment:
The intention is to have a configuration as a "default value" for all
disks, as in normal cases one datanode server comes with the same type of HDDs.
Therefore we can keep the DN configuration less verbose for most of the use
cases.
However, you are right that we should allow users to configure different
values, and it is a good idea to put it under "dfs.datanode.data.dir".
I will create a follow-up JIRA to address it, so we can keep this PR from
being too big, as that could involve quite a bit of change.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 506535)
Time Spent: 6h 50m (was: 6h 40m)
> Allow configuring DISK/ARCHIVE storage types on same device mount
> -----------------------------------------------------------------
>
> Key: HDFS-15548
> URL: https://issues.apache.org/jira/browse/HDFS-15548
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode
> Reporter: Leon Gao
> Assignee: Leon Gao
> Priority: Major
> Labels: pull-request-available
> Time Spent: 6h 50m
> Remaining Estimate: 0h
>
> We can allow configuring DISK/ARCHIVE storage types on the same device mount
> on two separate directories.
> Users should be able to configure the capacity for each. Also, the datanode
> usage report should report stats correctly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
