[
https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou updated HDFS-11065:
---------------------------------
Description:
There aren't much tests to verify space quota for heterogenous storages. It's
quite important to ensure space quota works well in modern clusters typically
built out of diversified storage structures. This proposes adding new tests to
cover the following scenarios.
# -Tests space quota for storage policy = ALL_SSD, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAllSSD-
# -Tests if overall space quota exceeds even if particular storage space quota
is available, covered by
TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException3 -
# -Tests spaceQuota for storage policy = Cold, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithTraditionalQuota-
# Tests space quota for storage policy = WARM
# -Tests if quota exceeds for DISK storage even if overall space quota is
available, covered by
TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException2 -
# Tests if changing replication factor results in copying file as quota doesn't
exceed
# -Tests space quota with append operation, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAppend-
# -Sanity Test : Checks if copy command fails if quota is exceeded, covered by
TestQuotaByStorageType#testQuotaByStorageTypeParent*Child*-
# Tests if clear quota per heterogenous storage doesnt result in clearing quota
for another storage
# -Tests space quota with remove operation, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateDelete-
# -Tests space quota with Snapshot operation, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithSnapshot-
# -Tests space quota with truncate operation, coveved by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateTruncate-
# -Tests space quota remains valid even with Namenode restart, covered by
TestQuotaByStorageType#testQuotaByStorageTypePersistenceInEditLog and
TestQuotaByStorageType#testQuotaByStorageTypePersistenceInFsImage-
was:
There aren't much tests to verify space quota for heterogenous storages. It's
quite important to ensure space quota works well in modern clusters typically
built out of diversified storage structures. This proposes adding new tests to
cover the following scenarios.
# -Tests space quota for storage policy = ALL_SSD, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAllSSD-
# -Tests if overall space quota exceeds even if particular storage space quota
is available, covered by
TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException3-
# -Tests spaceQuota for storage policy = Cold, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithTraditionalQuota-
# Tests space quota for storage policy = WARM
# -Tests if quota exceeds for DISK storage even if overall space quota is
available, covered by
TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException2-
# Tests if changing replication factor results in copying file as quota doesn't
exceed
# -Tests space quota with append operation, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAppend-
# -Sanity Test : Checks if copy command fails if quota is exceeded, covered by
TestQuotaByStorageType#testQuotaByStorageTypeParent*Child*-
# Tests if clear quota per heterogenous storage doesnt result in clearing quota
for another storage
# -Tests space quota with remove operation, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateDelete-
# -Tests space quota with Snapshot operation, covered by
TestQuotaByStorageType#testQuotaByStorageTypeWithSnapshot-
# -Tests space quota with truncate operation, coveved by
TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateTruncate-
# -Tests space quota remains valid even with Namenode restart, covered by
TestQuotaByStorageType#testQuotaByStorageTypePersistenceInEditLog and
TestQuotaByStorageType#testQuotaByStorageTypePersistenceInFsImage-
> Add space quota tests for heterogenous storages
> -----------------------------------------------
>
> Key: HDFS-11065
> URL: https://issues.apache.org/jira/browse/HDFS-11065
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
> Reporter: Xiaobing Zhou
> Assignee: Xiaobing Zhou
> Labels: fs, test
>
> There aren't much tests to verify space quota for heterogenous storages. It's
> quite important to ensure space quota works well in modern clusters typically
> built out of diversified storage structures. This proposes adding new tests
> to cover the following scenarios.
> # -Tests space quota for storage policy = ALL_SSD, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAllSSD-
> # -Tests if overall space quota exceeds even if particular storage space
> quota is available, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException3 -
> # -Tests spaceQuota for storage policy = Cold, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeWithTraditionalQuota-
> # Tests space quota for storage policy = WARM
> # -Tests if quota exceeds for DISK storage even if overall space quota is
> available, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException2 -
> # Tests if changing replication factor results in copying file as quota
> doesn't exceed
> # -Tests space quota with append operation, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAppend-
> # -Sanity Test : Checks if copy command fails if quota is exceeded, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeParent*Child*-
> # Tests if clear quota per heterogenous storage doesnt result in clearing
> quota for another storage
> # -Tests space quota with remove operation, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateDelete-
> # -Tests space quota with Snapshot operation, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeWithSnapshot-
> # -Tests space quota with truncate operation, coveved by
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateTruncate-
> # -Tests space quota remains valid even with Namenode restart, covered by
> TestQuotaByStorageType#testQuotaByStorageTypePersistenceInEditLog and
> TestQuotaByStorageType#testQuotaByStorageTypePersistenceInFsImage-
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
