[
https://issues.apache.org/jira/browse/HDFS-17191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-17191:
---
Description:
When we delete a large directory, it is time-consuming to collect the blocks in
the
Xiangyi Zhu created HDFS-17191:
--
Summary: HDFS: Delete operation adds a thread to collect blocks
asynchronously
Key: HDFS-17191
URL: https://issues.apache.org/jira/browse/HDFS-17191
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16000:
---
Description:
It takes a long time to move a large directory with rename. For example, it
takes
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506225#comment-17506225
]
Xiangyi Zhu commented on HDFS-16214:
[~hexiaoqiao] Thanks for your comment.
{quote}A. when clean
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16214:
---
Summary: Asynchronously collect blocks and update quota when deleting
(was: Lock optimization for
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478544#comment-17478544
]
Xiangyi Zhu commented on HDFS-16214:
[~John Smith] Currently Issues wants to solve the problem of
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16043:
---
Description: Add markedDeleteBlockScrubberThread to delete blocks
asynchronously. (was: The
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476944#comment-17476944
]
Xiangyi Zhu commented on HDFS-16214:
[~hexiaoqiao] [~weichiu] [~sodonnell] If the collection block
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16214:
---
Description:
The time-consuming deletion is mainly reflected in three logics , collecting
blocks,
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16214:
---
Description:
The time-consuming deletion is mainly reflected in three logics , collecting
blocks,
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16214:
---
Description:
The time-consuming deletion is mainly reflected in three logics , collecting
blocks,
[
https://issues.apache.org/jira/browse/HDFS-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16421:
---
Summary: Remove RouterRpcFairnessPolicyController ConcurrentNS to avoid
renewLease being unavailable
[
https://issues.apache.org/jira/browse/HDFS-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16421:
---
Summary: RouterRpcFairnessPolicyController remove ConcurrentNS (was:
RouterRpcFairnessConstants
Xiangyi Zhu created HDFS-16421:
--
Summary: RouterRpcFairnessConstants remove ConcurrentNS
Key: HDFS-16421
URL: https://issues.apache.org/jira/browse/HDFS-16421
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu resolved HDFS-16019.
Resolution: Later
> HDFS: Inode CheckPoint
> ---
>
> Key:
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470561#comment-17470561
]
Xiangyi Zhu commented on HDFS-16043:
[~mofei] I think even if the collection of blocks is made
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470363#comment-17470363
]
Xiangyi Zhu commented on HDFS-16043:
[~mofei] Thank a lot for your feedback.
> Add
[
https://issues.apache.org/jira/browse/HDFS-16412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16412:
---
Description:
Use RangeMapRange "Map fileSizeRange" to store counters at
different intervals.
Xiangyi Zhu created HDFS-16412:
--
Summary: Add metrics to support obtaining file size distribution
Key: HDFS-16412
URL: https://issues.apache.org/jira/browse/HDFS-16412
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu reassigned HDFS-16276:
--
Assignee: Xiangyi Zhu
> RBF: Remove the useless configuration of rpc isolation in md
>
Xiangyi Zhu created HDFS-16276:
--
Summary: RBF: Remove the useless configuration of rpc isolation
in md
Key: HDFS-16276
URL: https://issues.apache.org/jira/browse/HDFS-16276
Project: Hadoop HDFS
Xiangyi Zhu created HDFS-16273:
--
Summary: RBF: RouterRpcFairnessPolicyController add
availableHandleOnPerNs metrics
Key: HDFS-16273
URL: https://issues.apache.org/jira/browse/HDFS-16273
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu reassigned HDFS-16273:
--
Assignee: Xiangyi Zhu
> RBF: RouterRpcFairnessPolicyController add availableHandleOnPerNs
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16043:
---
Summary: Add markedDeleteBlockScrubberThread to delete blocks
asynchronously (was: HDFS : Add
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16043:
---
Summary: HDFS : Add markedDeleteBlockScrubberThread to delete blcoks
asynchronously (was: HDFS :
Xiangyi Zhu created HDFS-16214:
--
Summary: Lock optimization for large deleteing, no locks on the
collection block
Key: HDFS-16214
URL: https://issues.apache.org/jira/browse/HDFS-16214
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu reassigned HDFS-16214:
--
Assignee: Xiangyi Zhu
> Lock optimization for large deleteing, no locks on the collection
[
https://issues.apache.org/jira/browse/HDFS-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375286#comment-17375286
]
Xiangyi Zhu commented on HDFS-16095:
[~weichiu],[~ayushtkn],[~hexiaoqiao],[~kihwal] Looking forward
Xiangyi Zhu created HDFS-16096:
--
Summary: Delete useless method DirectoryWithQuotaFeature#setQuota
Key: HDFS-16096
URL: https://issues.apache.org/jira/browse/HDFS-16096
Project: Hadoop HDFS
Xiangyi Zhu created HDFS-16095:
--
Summary: Add lsQuotaList command and getQuotaListing api for hdfs
quota
Key: HDFS-16095
URL: https://issues.apache.org/jira/browse/HDFS-16095
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356302#comment-17356302
]
Xiangyi Zhu commented on HDFS-16043:
[~hexiaoqiao] Thanks for your comment. correct. The modification
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354754#comment-17354754
]
Xiangyi Zhu commented on HDFS-16043:
[~hexiaoqiao],[~vjasani],[~vjasani] Looking forward to your
[
https://issues.apache.org/jira/browse/HDFS-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352937#comment-17352937
]
Xiangyi Zhu commented on HDFS-16045:
[~hexiaoqiao] Thank you very much for your comment. Presto uses
Xiangyi Zhu created HDFS-16045:
--
Summary: FileSystem.CACHE memory leak
Key: HDFS-16045
URL: https://issues.apache.org/jira/browse/HDFS-16045
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16043:
---
Description:
The deletion of the large directory caused NN to hold the lock for too long,
which
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16043:
---
Attachment: 20210527-before.svg
20210527-after.svg
> HDFS : Delete performance
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu reassigned HDFS-16043:
--
Assignee: Xiangyi Zhu
> HDFS : Delete performance optimization
>
Xiangyi Zhu created HDFS-16043:
--
Summary: HDFS : Delete performance optimization
Key: HDFS-16043
URL: https://issues.apache.org/jira/browse/HDFS-16043
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangyi Zhu updated HDFS-16043:
---
Description:
The deletion of the large directory caused NN to hold the lock for too long,
which
[
https://issues.apache.org/jira/browse/HDFS-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351669#comment-17351669
]
Xiangyi Zhu commented on HDFS-16032:
[~ayushtkn],[~sodonnell] Thanks a lot for your comments, I use
[
https://issues.apache.org/jira/browse/HDFS-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351454#comment-17351454
]
Xiangyi Zhu commented on HDFS-16032:
[~hexiaoqiao],[~ayushtkn],[Stephen
[
https://issues.apache.org/jira/browse/HDFS-16039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350835#comment-17350835
]
Xiangyi Zhu commented on HDFS-16039:
[~elgoiri] Looking forward to your comments.
> RBF: Some
Xiangyi Zhu created HDFS-16039:
--
Summary: RBF: Some indicators of RBFMetrics count inaccurately
Key: HDFS-16039
URL: https://issues.apache.org/jira/browse/HDFS-16039
Project: Hadoop HDFS
Issue
43 matches
Mail list logo
