[jira] [Comment Edited] (HDFS-16830) Improve router msync operation

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635661#comment-17635661 ] Simbarashe Dzinamarira edited comment on HDFS-16830 at 11/18/22 7:46 AM: --

[jira] [Commented] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635704#comment-17635704 ] ASF GitHub Bot commented on HDFS-16847: --- simbadzina opened a new pull request, #514

[jira] [Updated] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16847: -- Labels: pull-request-available (was: ) > StateStore writer should not commit tmp fail if there

[jira] [Commented] (HDFS-16830) Improve router msync operation

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635703#comment-17635703 ] ASF GitHub Bot commented on HDFS-16830: --- zhengchenyu closed pull request #5132: HDF

[jira] [Commented] (HDFS-16830) Improve router msync operation

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635661#comment-17635661 ] Simbarashe Dzinamarira commented on HDFS-16830: --- Sorry I missed you first c

[jira] [Commented] (HDFS-16830) Improve router msync operation

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635660#comment-17635660 ] ASF GitHub Bot commented on HDFS-16830: --- simbadzina commented on PR #5132: URL: htt

[jira] [Commented] (HDFS-16841) Enhance the function of DebugAdmin#VerifyECCommand

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635654#comment-17635654 ] ASF GitHub Bot commented on HDFS-16841: --- tasanuma commented on code in PR #5137: UR

[jira] [Commented] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635652#comment-17635652 ] ASF GitHub Bot commented on HDFS-16845: --- simbadzina commented on PR #5142: URL: htt

[jira] [Commented] (HDFS-16841) Enhance the function of DebugAdmin#VerifyECCommand

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635640#comment-17635640 ] ASF GitHub Bot commented on HDFS-16841: --- ZanderXu commented on code in PR #5137: UR

[jira] [Commented] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635631#comment-17635631 ] ASF GitHub Bot commented on HDFS-16845: --- ZanderXu commented on PR #5142: URL: https

[jira] [Commented] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635627#comment-17635627 ] ASF GitHub Bot commented on HDFS-16845: --- simbadzina commented on PR #5142: URL: htt

[jira] [Commented] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635624#comment-17635624 ] ASF GitHub Bot commented on HDFS-16837: --- simbadzina commented on PR #5123: URL: htt

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635618#comment-17635618 ] ASF GitHub Bot commented on HDFS-16832: --- zhengchenyu commented on PR #5099: URL: ht

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635610#comment-17635610 ] ASF GitHub Bot commented on HDFS-16832: --- ZanderXu commented on PR #5099: URL: https

[jira] [Commented] (HDFS-16840) Add sp and ec policy opiton description about oiv in HDFSCommands.md

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635601#comment-17635601 ] ASF GitHub Bot commented on HDFS-16840: --- ZanderXu commented on code in PR #5129: UR

[jira] [Commented] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635598#comment-17635598 ] ASF GitHub Bot commented on HDFS-16837: --- ZanderXu commented on PR #5123: URL: https

[jira] [Created] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16847: - Summary: StateStore writer should not commit tmp fail if there was an error in writing the file. Key: HDFS-16847 URL: https://issues.apache.org/jira/browse/HDFS-

[jira] [Updated] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16847: -- Component/s: hdfs rbf > StateStore writer should not commit tm

[jira] [Assigned] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16847: - Assignee: Simbarashe Dzinamarira > StateStore writer should not commit t

[jira] [Updated] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16845: -- Priority: Critical (was: Major) > Add configuration flag to enable observer re

[jira] [Commented] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635584#comment-17635584 ] ASF GitHub Bot commented on HDFS-16837: --- simbadzina commented on PR #5123: URL: htt

[jira] [Commented] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635562#comment-17635562 ] ASF GitHub Bot commented on HDFS-16839: --- hadoop-yetus commented on PR #5128: URL: h

[jira] [Commented] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635553#comment-17635553 ] ASF GitHub Bot commented on HDFS-16846: --- hadoop-yetus commented on PR #5143: URL: h

[jira] [Commented] (HDFS-16844) [RBF] The routers should be resiliant against exceptions from StateStore

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635550#comment-17635550 ] ASF GitHub Bot commented on HDFS-16844: --- omalley commented on code in PR #5138: URL

[jira] [Commented] (HDFS-16844) [RBF] The routers should be resiliant against exceptions from StateStore

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635536#comment-17635536 ] ASF GitHub Bot commented on HDFS-16844: --- hadoop-yetus commented on PR #5138: URL: h

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635507#comment-17635507 ] ASF GitHub Bot commented on HDFS-16832: --- hadoop-yetus commented on PR #5099: URL: h

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635508#comment-17635508 ] ASF GitHub Bot commented on HDFS-16832: --- hadoop-yetus commented on PR #5099: URL: h

[jira] [Commented] (HDFS-16613) EC: Improve performance of decommissioning dn with many ec blocks

2022-11-17 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635400#comment-17635400 ] caozhiqiang commented on HDFS-16613: [~tasanuma] , OK, I have create an issue [HDFS-

[jira] [Updated] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2022-11-17 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16846: --- Status: Patch Available (was: In Progress) > EC: Only EC blocks should be effected by max-streams-ha

[jira] [Updated] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16846: -- Labels: pull-request-available (was: ) > EC: Only EC blocks should be effected by max-streams-

[jira] [Commented] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635396#comment-17635396 ] ASF GitHub Bot commented on HDFS-16846: --- lfxy opened a new pull request, #5143: URL

[jira] [Commented] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635275#comment-17635275 ] ASF GitHub Bot commented on HDFS-16845: --- hadoop-yetus commented on PR #5142: URL: h

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635268#comment-17635268 ] ASF GitHub Bot commented on HDFS-16832: --- zhengchenyu opened a new pull request, #50

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635264#comment-17635264 ] ASF GitHub Bot commented on HDFS-16832: --- zhengchenyu closed pull request #5099: HDF

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635248#comment-17635248 ] ASF GitHub Bot commented on HDFS-16832: --- ZanderXu commented on PR #5099: URL: https