[jira] [Work logged] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?focusedWorklogId=709479=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709479 ] ASF GitHub Bot logged work on HDFS-16423: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16297) striped block was deleted less than 1 replication

2022-01-14 Thread chan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476554#comment-17476554 ] chan commented on HDFS-16297: - [~tasanuma] yes,it is the same problem, thanks,i will check it > striped

[jira] [Work logged] (HDFS-16425) Add debug log when requeue observer read call

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16425?focusedWorklogId=709463=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709463 ] ASF GitHub Bot logged work on HDFS-16425: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=709454=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709454 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16399) Reconfig cache report parameters for datanode

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16399?focusedWorklogId=709452=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709452 ] ASF GitHub Bot logged work on HDFS-16399: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread Yongpan Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476505#comment-17476505 ] Yongpan Liu commented on HDFS-16043: [~hexiaoqiao] [~zhuxiangyi] Now it is preliminarily concluded

[jira] [Work logged] (HDFS-16399) Reconfig cache report parameters for datanode

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16399?focusedWorklogId=709348=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709348 ] ASF GitHub Bot logged work on HDFS-16399: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?focusedWorklogId=709312=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709312 ] ASF GitHub Bot logged work on HDFS-16411: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?focusedWorklogId=709305=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709305 ] ASF GitHub Bot logged work on HDFS-16411: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16214) Lock optimization for large deleteing, no locks on the collection block

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16214?focusedWorklogId=709285=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709285 ] ASF GitHub Bot logged work on HDFS-16214: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=709192=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709192 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476281#comment-17476281 ] Chao Sun commented on HDFS-16420: - [~tasanuma] done > Avoid deleting unique data blocks when deleting

[jira] [Updated] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16420: Fix Version/s: 3.3.2 (was: 3.3.3) > Avoid deleting unique data blocks when deleting

[jira] [Resolved] (HDFS-16297) striped block was deleted less than 1 replication

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16297. - Resolution: Duplicate It seems this issue is the same as HDFS-16420. So I'm closing it.

[jira] [Work logged] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?focusedWorklogId=709115=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709115 ] ASF GitHub Bot logged work on HDFS-16423: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=709094=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709094 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16420: Fix Version/s: 3.2.3 (was: 3.2.4) > Avoid deleting unique data

[jira] [Comment Edited] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476154#comment-17476154 ] Takanobu Asanuma edited comment on HDFS-16420 at 1/14/22, 2:03 PM: ---

[jira] [Resolved] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16420. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Commented] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476156#comment-17476156 ] Takanobu Asanuma commented on HDFS-16420: - [~csun] Could you cherry-pick it into branch-3.3.2? >

[jira] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420 ] Takanobu Asanuma deleted comment on HDFS-16420: - was (Author: tasanuma0829): [~sunchensamurai] Could you cherry-pick it into branch-3.3.2? > Avoid deleting unique data blocks when

[jira] [Commented] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476155#comment-17476155 ] Takanobu Asanuma commented on HDFS-16420: - [~sunchensamurai] Could you cherry-pick it into

[jira] [Commented] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476154#comment-17476154 ] Takanobu Asanuma commented on HDFS-16420: - Merged it to trunk and cherry-picked it into

[jira] [Assigned] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-16420: --- Assignee: Jackson Wang > Avoid deleting unique data blocks when deleting redundancy

[jira] [Updated] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16420: Summary: Avoid deleting unique data blocks when deleting redundancy striped blocks (was:

[jira] [Work logged] (HDFS-16420) ec + balancer may cause missing block

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?focusedWorklogId=709065=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709065 ] ASF GitHub Bot logged work on HDFS-16420: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16420) ec + balancer may cause missing block

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?focusedWorklogId=709064=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709064 ] ASF GitHub Bot logged work on HDFS-16420: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16214) Lock optimization for large deleteing, no locks on the collection block

2022-01-14 Thread Xiangyi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangyi Zhu updated HDFS-16214: --- Description: The time-consuming deletion is mainly reflected in three logics , collecting blocks,

[jira] [Updated] (HDFS-16214) Lock optimization for large deleteing, no locks on the collection block

2022-01-14 Thread Xiangyi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangyi Zhu updated HDFS-16214: --- Description: The time-consuming deletion is mainly reflected in three logics , collecting blocks,

[jira] [Updated] (HDFS-16214) Lock optimization for large deleteing, no locks on the collection block

2022-01-14 Thread Xiangyi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangyi Zhu updated HDFS-16214: --- Description: The time-consuming deletion is mainly reflected in three logics , collecting blocks,

[jira] [Work logged] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?focusedWorklogId=709024=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709024 ] ASF GitHub Bot logged work on HDFS-16422: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16424) Add a new rpcMetric called requeueTime

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16424?focusedWorklogId=709011=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709011 ] ASF GitHub Bot logged work on HDFS-16424: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=709008=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-709008 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16400) Reconfig DataXceiver parameters for datanode

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16400?focusedWorklogId=708990=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708990 ] ASF GitHub Bot logged work on HDFS-16400: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16426) fix nextBlockReportTime when trigger full block report force

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16426?focusedWorklogId=708986=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708986 ] ASF GitHub Bot logged work on HDFS-16426: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16420) ec + balancer may cause missing block

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?focusedWorklogId=708977=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708977 ] ASF GitHub Bot logged work on HDFS-16420: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=708965=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708965 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=708957=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708957 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=708951=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708951 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16426) fix nextBlockReportTime when trigger full block report force

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16426?focusedWorklogId=708939=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708939 ] ASF GitHub Bot logged work on HDFS-16426: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16420) ec + balancer may cause missing block

2022-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?focusedWorklogId=708920=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-708920 ] ASF GitHub Bot logged work on HDFS-16420: - Author: ASF GitHub Bot