[ 
https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624449#comment-15624449
 ] 

Xiaobing Zhou commented on HDFS-11065:
--------------------------------------

Posted patch v001 to address #1. HDFS-11079 is filed for #2. Thanks [~liuml07].

> Add space quota tests for heterogenous storages
> -----------------------------------------------
>
>                 Key: HDFS-11065
>                 URL: https://issues.apache.org/jira/browse/HDFS-11065
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs
>            Reporter: Xiaobing Zhou
>            Assignee: Xiaobing Zhou
>              Labels: fs, test
>         Attachments: HDFS-11065.000.patch, HDFS-11065.001.patch
>
>
> There are some cases of space quota that need to be tested for heterogenous 
> storages. It's quite important to ensure space quota works well in modern 
> clusters typically built out of diversified storage structures. This proposes 
> adding new tests to cover the following scenarios.
> # Tests space quota for storage policy = WARM
> # Tests if changing replication factor results in copying file as quota 
> doesn't exceed
> # Tests if clear quota per heterogenous storage doesnt result in clearing 
> quota for another storage
> The following cases have been covered.
> # Tests space quota for storage policy = ALL_SSD, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAllSSD
> # Tests if overall space quota exceeds even if particular storage space quota 
> is available, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException3
> # Tests spaceQuota for storage policy = Cold, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeWithTraditionalQuota
> # Tests if quota exceeds for DISK storage even if overall space quota is 
> available, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException2
> # Tests space quota with append operation, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAppend
> # Sanity Test : Checks if copy command fails if quota is exceeded, covered by
> TestQuotaByStorageType#testQuotaByStorageTypeParent*Child*
> # Tests space quota with remove operation, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateDelete
> # Tests space quota with Snapshot operation, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypeWithSnapshot
> # Tests space quota with truncate operation, coveved by 
> TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateTruncate
> # Tests space quota remains valid even with Namenode restart, covered by 
> TestQuotaByStorageType#testQuotaByStorageTypePersistenceInEditLog and 
> TestQuotaByStorageType#testQuotaByStorageTypePersistenceInFsImage



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to