[jira] [Work logged] (HDFS-16434) Add opname to read/write lock for remaining operations

[ https://issues.apache.org/jira/browse/HDFS-16434?focusedWorklogId=747622&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747622 ] ASF GitHub Bot logged work on HDFS-16434: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16520) Improve EC pread: avoid potential reading whole block

[ https://issues.apache.org/jira/browse/HDFS-16520?focusedWorklogId=747582&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747582 ] ASF GitHub Bot logged work on HDFS-16520: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut reassigned HDFS-16507: -- Assignee: tomscut > [SBN read] Avoid purging edit log which is in progress > -

[jira] [Work logged] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?focusedWorklogId=747578&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747578 ] ASF GitHub Bot logged work on HDFS-16507: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut updated HDFS-16507: --- Description: We introduced [Standby Read] feature in branch-3.1.0, but found a FATAL exception. It looks lik

[jira] [Work logged] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?focusedWorklogId=747577&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747577 ] ASF GitHub Bot logged work on HDFS-16507: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?focusedWorklogId=747576&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747576 ] ASF GitHub Bot logged work on HDFS-16507: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?focusedWorklogId=747574&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747574 ] ASF GitHub Bot logged work on HDFS-16507: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

[ https://issues.apache.org/jira/browse/HDFS-16507?focusedWorklogId=747572&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747572 ] ASF GitHub Bot logged work on HDFS-16507: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

[ https://issues.apache.org/jira/browse/HDFS-16460?focusedWorklogId=747567&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747567 ] ASF GitHub Bot logged work on HDFS-16460: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

[ https://issues.apache.org/jira/browse/HDFS-16460?focusedWorklogId=747568&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747568 ] ASF GitHub Bot logged work on HDFS-16460: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

[ https://issues.apache.org/jira/browse/HDFS-16460?focusedWorklogId=747566&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747566 ] ASF GitHub Bot logged work on HDFS-16460: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16498) Fix NPE for checkBlockReportLease

[ https://issues.apache.org/jira/browse/HDFS-16498?focusedWorklogId=747561&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747561 ] ASF GitHub Bot logged work on HDFS-16498: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16434) Add opname to read/write lock for remaining operations

[ https://issues.apache.org/jira/browse/HDFS-16434?focusedWorklogId=747555&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747555 ] ASF GitHub Bot logged work on HDFS-16434: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16434) Add opname to read/write lock for remaining operations

[ https://issues.apache.org/jira/browse/HDFS-16434?focusedWorklogId=747554&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747554 ] ASF GitHub Bot logged work on HDFS-16434: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16518) KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom implementation of KeyProvider also

[jira] [Updated] (HDFS-16518) KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom implementation of KeyProvider also

[jira] [Updated] (HDFS-16518) KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom implementation of KeyProvider also

[jira] [Updated] (HDFS-16518) KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom implementation of KeyProvider also

[jira] [Updated] (HDFS-16518) KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom implementation of KeyProvider also

[jira] [Updated] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom implementation of KeyProvider also

[jira] [Updated] (HDFS-16518) KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Summary: KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager (was: Cached KeyProvide

[jira] [Updated] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description:     {code:java} Class KeyProviderCache ... public KeyProviderCache(long expiryMs) { cache

[jira] [Updated] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom impl of KeyProvider also needs expl

[jira] [Updated] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom impl of KeyProvider also needs expl

[jira] [Updated] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom impl of KeyProvider needs explicit

[jira] [Updated] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-16518: Description: KeyProvider implements Closable interface but some custom impl of KeyProvider needs explicit

[jira] [Work logged] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?focusedWorklogId=747447&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747447 ] ASF GitHub Bot logged work on HDFS-16518: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512012#comment-17512012 ] Owen O'Malley commented on HDFS-16518: -- I don't understand why this is required. Obv

[jira] [Assigned] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HDFS-16518: Assignee: (was: Lei Xu) > Cached KeyProvider in KeyProviderCache should be closed with

[jira] [Assigned] (HDFS-16518) Cached KeyProvider in KeyProviderCache should be closed with ShutdownHookManager

[ https://issues.apache.org/jira/browse/HDFS-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HDFS-16518: Assignee: Lei Xu > Cached KeyProvider in KeyProviderCache should be closed with > Shutdow

[jira] [Work logged] (HDFS-16519) Add throttler to EC reconstruction

[ https://issues.apache.org/jira/browse/HDFS-16519?focusedWorklogId=747335&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747335 ] ASF GitHub Bot logged work on HDFS-16519: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16434) Add opname to read/write lock for remaining operations

[ https://issues.apache.org/jira/browse/HDFS-16434?focusedWorklogId=747311&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747311 ] ASF GitHub Bot logged work on HDFS-16434: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16434) Add opname to read/write lock for remaining operations

[ https://issues.apache.org/jira/browse/HDFS-16434?focusedWorklogId=747309&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747309 ] ASF GitHub Bot logged work on HDFS-16434: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16498) Fix NPE for checkBlockReportLease

[ https://issues.apache.org/jira/browse/HDFS-16498?focusedWorklogId=747306&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747306 ] ASF GitHub Bot logged work on HDFS-16498: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16446) Consider ioutils of disk when choosing volume

[ https://issues.apache.org/jira/browse/HDFS-16446?focusedWorklogId=747286&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747286 ] ASF GitHub Bot logged work on HDFS-16446: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16477) [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

[ https://issues.apache.org/jira/browse/HDFS-16477?focusedWorklogId=747199&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747199 ] ASF GitHub Bot logged work on HDFS-16477: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16520) Improve EC pread: avoid potential reading whole block

[ https://issues.apache.org/jira/browse/HDFS-16520?focusedWorklogId=747170&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747170 ] ASF GitHub Bot logged work on HDFS-16520: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16509) Fix decommission UnsupportedOperationException: Remove unsupported

[ https://issues.apache.org/jira/browse/HDFS-16509?focusedWorklogId=747150&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747150 ] ASF GitHub Bot logged work on HDFS-16509: - Author: ASF GitHub Bot

[jira] (HDFS-16500) Make asynchronous blocks deletion lock and unlock durtion threshold configurable

[ https://issues.apache.org/jira/browse/HDFS-16500 ] Hui Fei deleted comment on HDFS-16500: was (Author: ferhui): We met one problem when we used this feature. It created and deleted files frequently in data lake scenario. Async deleting is slower

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511781#comment-17511781 ] Hui Fei commented on HDFS-16043: We met one problem when we used this feature. It created

[jira] [Commented] (HDFS-16500) Make asynchronous blocks deletion lock and unlock durtion threshold configurable

[ https://issues.apache.org/jira/browse/HDFS-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511774#comment-17511774 ] Hui Fei commented on HDFS-16500: We met one problem when we used this feature. It created

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511731#comment-17511731 ] Max Xie commented on HDFS-13671: - [~tomscut]  Thank you for your share.   Our cluster '

[jira] [Work logged] (HDFS-16457) Make fs.getspaceused.classname reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16457?focusedWorklogId=747051&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747051 ] ASF GitHub Bot logged work on HDFS-16457: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16514) Reduce the failover sleep time if multiple namenode are configured

[ https://issues.apache.org/jira/browse/HDFS-16514?focusedWorklogId=747026&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747026 ] ASF GitHub Bot logged work on HDFS-16514: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16520) Improve EC pread: avoid potential reading whole block

[ https://issues.apache.org/jira/browse/HDFS-16520?focusedWorklogId=747022&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747022 ] ASF GitHub Bot logged work on HDFS-16520: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16446) Consider ioutils of disk when choosing volume

[ https://issues.apache.org/jira/browse/HDFS-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut updated HDFS-16446: --- Description: Consider ioutils of disk when choosing volume. Consider ioutils of disk when choosing volume to

[jira] [Updated] (HDFS-16446) Consider ioutils of disk when choosing volume

[ https://issues.apache.org/jira/browse/HDFS-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut updated HDFS-16446: --- Description: Consider ioutils of disk when choosing volume to avoid busy disks. Document:  [https://docs.goo

[jira] [Work logged] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

[ https://issues.apache.org/jira/browse/HDFS-16484?focusedWorklogId=747000&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747000 ] ASF GitHub Bot logged work on HDFS-16484: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

[ https://issues.apache.org/jira/browse/HDFS-16484?focusedWorklogId=746986&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746986 ] ASF GitHub Bot logged work on HDFS-16484: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15770) fsck to support printing snapshot name for missing blocks from snapshot only files

[ https://issues.apache.org/jira/browse/HDFS-15770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasu Majeti updated HDFS-15770: Affects Version/s: 3.0.0 > fsck to support printing snapshot name for missing blocks from s

[jira] [Work logged] (HDFS-16520) Improve EC pread: avoid potential reading whole block

[ https://issues.apache.org/jira/browse/HDFS-16520?focusedWorklogId=746971&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746971 ] ASF GitHub Bot logged work on HDFS-16520: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16520) Improve EC pread: avoid potential reading whole block

[ https://issues.apache.org/jira/browse/HDFS-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16520: -- Labels: pull-request-available (was: ) > Improve EC pread: avoid potential reading whole block

[jira] [Created] (HDFS-16520) Improve EC pread: avoid potential reading whole block

daimin created HDFS-16520: - Summary: Improve EC pread: avoid potential reading whole block Key: HDFS-16520 URL: https://issues.apache.org/jira/browse/HDFS-16520 Project: Hadoop HDFS Issue Type: Impro