[jira] [Created] (HDFS-17018) Normalizes log records on the hdfs client

2023-05-18 Thread Xianming Lei (Jira)
Xianming Lei created HDFS-17018: --- Summary: Normalizes log records on the hdfs client Key: HDFS-17018 URL: https://issues.apache.org/jira/browse/HDFS-17018 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-17018) Improve log format on the hdfs client

2023-05-18 Thread Xianming Lei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianming Lei updated HDFS-17018: Summary: Improve log format on the hdfs client (was: Normalizes log records on the hdfs client )

[jira] [Resolved] (HDFS-17010) Add a subtree test to TestSnapshotDiffReport

2023-05-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-17010. --- Fix Version/s: 3.4.0 Resolution: Fixed The pull request is now merged. > Add a subtree test t

[jira] [Updated] (HDFS-17018) Improve dfsclient log format

2023-05-18 Thread Xianming Lei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianming Lei updated HDFS-17018: Summary: Improve dfsclient log format (was: Improve log format on the hdfs client ) > Improve dfs

[jira] [Commented] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723855#comment-17723855 ] Ayush Saxena commented on HDFS-17012: - Committed to trunk. Thanx [~jianghuazhu] for

[jira] [Resolved] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17012. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Remove unused DFSConf

[jira] [Created] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode

2023-05-18 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17019: - Summary: Optimize the logic for reconfigure slow peer enable for Namenode Key: HDFS-17019 URL: https://issues.apache.org/jira/browse/HDFS-17019 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode

2023-05-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17019: -- Description: The logic of Reconfigure slow peer enable for Namenode requires the following optimizatio

[jira] [Assigned] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode

2023-05-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu reassigned HDFS-17019: - Assignee: Haiyang Hu > Optimize the logic for reconfigure slow peer enable for Namenode > -

[jira] [Updated] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode

2023-05-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17019: -- Description: The logic of Reconfigure slow peer enable for Namenode requires the following optimizatio

[jira] [Created] (HDFS-17020) RBF: mount table addAll should print failed records in std error

2023-05-18 Thread Viraj Jasani (Jira)
Viraj Jasani created HDFS-17020: --- Summary: RBF: mount table addAll should print failed records in std error Key: HDFS-17020 URL: https://issues.apache.org/jira/browse/HDFS-17020 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-16979) RBF: Add dfsrouter port in hdfsauditlog

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-16979: --- Assignee: liuguanghua > RBF: Add dfsrouter port in hdfsauditlog > --

[jira] [Commented] (HDFS-16979) RBF: Add dfsrouter port in hdfsauditlog

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724052#comment-17724052 ] Ayush Saxena commented on HDFS-16979: - Committed to trunk. Thanx [~liuguanghua] for

[jira] [Resolved] (HDFS-16979) RBF: Add dfsrouter port in hdfsauditlog

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16979. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Add dfsrouter po

[jira] [Assigned] (HDFS-17018) Improve dfsclient log format

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-17018: --- Assignee: Xianming Lei > Improve dfsclient log format > > >

[jira] [Resolved] (HDFS-17018) Improve dfsclient log format

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17018. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Improve dfsclient log

[jira] [Commented] (HDFS-17018) Improve dfsclient log format

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724065#comment-17724065 ] Ayush Saxena commented on HDFS-17018: - Committed to trunk. Thanx [~15217812...@163.c

[jira] [Updated] (HDFS-16653) Improve error messages in ShortCircuitCache

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-16653: Summary: Improve error messages in ShortCircuitCache (was: Safe mode related operations cannot be

[jira] [Updated] (HDFS-16653) Improve error messages in ShortCircuitCache

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-16653: Priority: Minor (was: Major) > Improve error messages in ShortCircuitCache > -

[jira] [Updated] (HDFS-16653) Improve error messages in ShortCircuitCache

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-16653: Issue Type: Improvement (was: Bug) > Improve error messages in ShortCircuitCache > ---

[jira] [Resolved] (HDFS-16653) Improve error messages in ShortCircuitCache

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16653. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Improve error message

[jira] [Commented] (HDFS-16653) Improve error messages in ShortCircuitCache

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724075#comment-17724075 ] Ayush Saxena commented on HDFS-16653: - Committed to trunk. Thanx [~fujx] for the con

[jira] [Commented] (HDFS-16521) DFS API to retrieve slow datanodes

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724097#comment-17724097 ] Ayush Saxena commented on HDFS-16521: - causes: HDFS-17017, gonna merge that in a day,

[jira] [Created] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

2023-05-18 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17021: --- Summary: GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas() Key: HDFS-17021 URL: https://issues.apache.org/jira/browse/HDFS-17021 Project: Hado

[jira] [Updated] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

2023-05-18 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17021: Description: If a replica is corrupted due to generation stamp mismatch, the corresponding datanode

[jira] [Updated] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

2023-05-18 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17021: Environment: (was: If a replica is corrupted due to generation stamp mismatch, the correspondin

[jira] [Commented] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724101#comment-17724101 ] Viraj Jasani commented on HDFS-17017: - Functionally this change makes sense because a

[jira] [Commented] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724117#comment-17724117 ] Ayush Saxena commented on HDFS-17017: - Is that an intersection of the arguments? It g

[jira] [Commented] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724119#comment-17724119 ] Viraj Jasani commented on HDFS-17017: - for the command output, it's not an intersecti

[jira] [Commented] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724121#comment-17724121 ] Viraj Jasani commented on HDFS-17017: - anyways, in order to prevent any new argument

[jira] [Updated] (HDFS-16697) Randomly setting “dfs.namenode.resource.checked.volumes.minimum” will always prevent safe mode from being turned off

2023-05-18 Thread ECFuzz (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ECFuzz updated HDFS-16697: -- Issue Type: Improvement (was: Bug) > Randomly setting “dfs.namenode.resource.checked.volumes.minimum” will alw

[jira] [Updated] (HDFS-16697) Randomly setting “dfs.namenode.resource.checked.volumes.minimum” will always prevent safe mode from being turned off

2023-05-18 Thread ECFuzz (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ECFuzz updated HDFS-16697: -- Priority: Minor (was: Major) > Randomly setting “dfs.namenode.resource.checked.volumes.minimum” will always >

[jira] [Comment Edited] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724121#comment-17724121 ] Viraj Jasani edited comment on HDFS-17017 at 5/19/23 5:24 AM: -

[jira] [Updated] (HDFS-16697) Randomly setting “dfs.namenode.resource.checked.volumes.minimum” will always prevent safe mode from being turned off

2023-05-18 Thread ECFuzz (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ECFuzz updated HDFS-16697: -- Issue Type: Bug (was: Improvement) > Randomly setting “dfs.namenode.resource.checked.volumes.minimum” will alw

[jira] [Comment Edited] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724121#comment-17724121 ] Viraj Jasani edited comment on HDFS-17017 at 5/19/23 5:25 AM: -

[jira] [Comment Edited] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724121#comment-17724121 ] Viraj Jasani edited comment on HDFS-17017 at 5/19/23 5:55 AM: -

[jira] [Commented] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724131#comment-17724131 ] Ayush Saxena commented on HDFS-17017: - Well, you can't say nobody will use it that wa

[jira] [Commented] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.

2023-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724137#comment-17724137 ] Viraj Jasani commented on HDFS-17017: - {quote}btw. lets fix something when it is brok