[jira] [Resolved] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang resolved HDFS-17465. - Resolution: Fixed > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.5.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png, image-2024-04-14-16-23-18-499.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837048#comment-17837048 ] Xiping Zhang commented on HDFS-17465: - [~goiri] Hi, this is an obvious logical problem, the failure of the use case has nothing to do with it, can you help to merge it? > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.5.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png, image-2024-04-14-16-23-18-499.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-17465: Affects Version/s: 3.5.0 > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.5.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png, image-2024-04-14-16-23-18-499.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang reopened HDFS-17465: - > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png, image-2024-04-14-16-23-18-499.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836908#comment-17836908 ] Xiping Zhang commented on HDFS-17465: - [~Keepromise] hi , will your cluster trigger this issue as well? > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png, image-2024-04-14-16-23-18-499.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836907#comment-17836907 ] Xiping Zhang edited comment on HDFS-17465 at 4/14/24 8:23 AM: -- !image-2024-04-14-16-07-32-362.png! Permit should not always be released here. Maximum permit count exceeded arthas traces to default_ns permit leakage ： !image-2024-04-14-16-23-18-499.png! was (Author: zhangxiping): !image-2024-04-14-16-07-32-362.png! Permit should not always be released here. Maximum permit count exceeded > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png, image-2024-04-14-16-23-18-499.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836907#comment-17836907 ] Xiping Zhang commented on HDFS-17465: - !image-2024-04-14-16-07-32-362.png! Permit should not always be released here. Maximum permit count exceeded > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-17465: Attachment: image-2024-04-14-16-07-32-362.png > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png, > image-2024-04-14-16-07-32-362.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
[ https://issues.apache.org/jira/browse/HDFS-17465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang resolved HDFS-17465. - Resolution: Fixed > RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: > Maximum permit count exceeded” > --- > > Key: HDFS-17465 > URL: https://issues.apache.org/jira/browse/HDFS-17465 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-04-14-15-39-59-531.png > > > !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-17465) RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded”
Xiping Zhang created HDFS-17465: --- Summary: RBF: Use ProportionRouterRpcFairnessPolicyController get “java.Lang. Error: Maximum permit count exceeded” Key: HDFS-17465 URL: https://issues.apache.org/jira/browse/HDFS-17465 Project: Hadoop HDFS Issue Type: Bug Components: rbf Reporter: Xiping Zhang Assignee: Xiping Zhang Attachments: image-2024-04-14-15-39-59-531.png !image-2024-04-14-15-39-59-531.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829452#comment-17829452 ] Xiping Zhang commented on HDFS-16016: - yes ，Deleting the red box code here will not remove blk_9,blk_10 in the figure below, and will not affect the removal of blk_1(disk damage lost blocks) !image-2024-03-21-17-19-01-183.png! > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-20-46-746.png, > image-2024-03-21-17-17-23-281.png, image-2024-03-21-17-19-01-183.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: image-2024-03-21-17-19-01-183.png > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-20-46-746.png, > image-2024-03-21-17-17-23-281.png, image-2024-03-21-17-19-01-183.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: image-2024-03-21-17-17-23-281.png > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-20-46-746.png, > image-2024-03-21-17-17-23-281.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829425#comment-17829425 ] Xiping Zhang edited comment on HDFS-16016 at 3/21/24 9:14 AM: -- [~liuguanghua] Maybe I didn't describe it clearly, the above processing is in the namenode, and does not need to be processed in the datanode end. The FBR is to align the block information of the namenode and datanode history. Now we can determine that FBR blocks in the DN have been added to the namenode by IBR, but we cannot guarantee that all the added blocks by IBR are included in FBR this time, right？ for 3.3.0 ，Just delete the red box code !image-2024-03-21-16-20-46-746.png! was (Author: zhangxiping): [~liuguanghua] Maybe I didn't describe it clearly, the above processing is in the namenode, and does not need to be processed in the datanode end. The FBR is to align the block information of the namenode and datanode history. Now we can determine that all blocks reported in the DN end have been added to the namenode end, but we cannot guarantee that all the added blocks are included in all blocks reported this time, right? for 3.3.0 ，Just delete the red box code !image-2024-03-21-16-20-46-746.png! > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-20-46-746.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: (was: image-2024-03-21-16-19-33-668.png) > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-20-46-746.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829425#comment-17829425 ] Xiping Zhang commented on HDFS-16016: - [~liuguanghua] Maybe I didn't describe it clearly, the above processing is in the namenode, and does not need to be processed in the datanode end. The FBR is to align the block information of the namenode and datanode history. Now we can determine that all blocks reported in the DN end have been added to the namenode end, but we cannot guarantee that all the added blocks are included in all blocks reported this time, right? for 3.3.0 ，Just delete the red box code !image-2024-03-21-16-20-46-746.png! > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-19-33-668.png, > image-2024-03-21-16-20-46-746.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: image-2024-03-21-16-20-46-746.png > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-19-33-668.png, > image-2024-03-21-16-20-46-746.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: image-2024-03-21-16-19-33-668.png > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png, image-2024-03-21-16-19-33-668.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-17129) mis-order of ibr and fbr on datanode
[ https://issues.apache.org/jira/browse/HDFS-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-17129: Attachment: image-2024-03-20-18-07-42-155.png > mis-order of ibr and fbr on datanode > - > > Key: HDFS-17129 > URL: https://issues.apache.org/jira/browse/HDFS-17129 > Project: Hadoop HDFS > Issue Type: Bug >Affects Versions: 3.4.0, 3.3.9, 3.3.6 > Environment: hdfs3.4.0 >Reporter: liuguanghua >Assignee: liuguanghua >Priority: Blocker > Labels: pull-request-available > Attachments: image-2024-03-20-18-07-42-155.png > > > HDFS-16016 , provide new thread to handler IBR. That is a greate improvement. > But it maybe casue the mis-order of ibr and fbr -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828914#comment-17828914 ] Xiping Zhang commented on HDFS-16016: - HDFS-16016 is a good improvement, and in our production environment, we have some large DN with 24 disks and total blocks reaching more than 10 million. With the development of hardware, it is possible that the DN will become larger, and if the FBR and IBR are coupled together, the impact on the service is great. HDFS-16016 can solve exactly this scaling problem of DN. For this issue HDFS-17129, I have a solution, which is to redefine the semantics of the FBR. Instead of requiring DN to align all blocks with Namenode by 100% in FBR this time, we only need to compare all blocks before the last block of FBR, although the FBR missed some blocks from the incremental report.I've drawn a diagram for ease of understanding： * step1：It is the NN processing blockreport process before HDFS-16016 is upgraded * step2：NN handles the blockreport process before upgrading HDFS-16016, but there will be problems HDFS-17129 * step3：We operate only on the blocks before the last zero bound point of the FBR * step4：Blocks not manipulated by the previous FBR are processed by the next FBR, unless the DN does not add any new blocks between FBRS !image-2024-03-20-18-31-23-937.png! [~liuguanghua] [~hexiaoqiao] [~tasanuma] hello, Do you have any good suggestions for me to understand FBR now and make this plan? Using lock restrictions here would be like going back to square one. If we use this solution, we only need to remove the remaining to_remove block, and we only need to remove one piece of code. > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: image-2024-03-20-18-31-23-937.png > BPServiceActor add a new thread to handle IBR > - > > Key: HDFS-16016 > URL: https://issues.apache.org/jira/browse/HDFS-16016 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: JiangHua Zhu >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.6 > > Attachments: image-2023-11-03-18-11-54-502.png, > image-2023-11-06-10-53-13-584.png, image-2023-11-06-10-55-50-939.png, > image-2024-03-20-18-31-23-937.png > > Time Spent: 5h 20m > Remaining Estimate: 0h > > Now BPServiceActor#offerService() is doing many things, FBR, IBR, heartbeat. > We can handle IBR independently to improve the performance of heartbeat and > FBR. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[
https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751465#comment-17751465
]
Xiping Zhang commented on HDFS-17138:
-
{quote}move this JIRA to COMMON module{quote}
OK
{quote} is it only for log print?{quote}
yes
> RBF: We changed the hadoop.security.auth_to_local configuration of one
> router, the other routers stopped working
>
>
> Key: HDFS-17138
> URL: https://issues.apache.org/jira/browse/HDFS-17138
> Project: Hadoop HDFS
> Issue Type: Bug
> Environment: hadoop 3.3.0
>Reporter: Xiping Zhang
>Assignee: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Attachments: image-2023-08-02-16-20-34-454.png,
> image-2023-08-03-10-32-03-457.png
>
>
> other routers error log：
> !image-2023-08-02-16-20-34-454.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751423#comment-17751423 ] Xiping Zhang commented on HDFS-17138: - [~hexiaoqiao] [~elgoiri] I feel the problem not so serious, I analysis to the server thread handle business process will capture user rules cannot match abnormalities, I can find is AbstractDelegationTokenSecretManager cleaning thread can't catch this exception, Other modules are also using subclasses of this class, and the above changes can solve this problem. The PR has been committed, and the failed test case is irrelevant ，Do you have any other ideas? > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Labels: pull-request-available > Attachments: image-2023-08-02-16-20-34-454.png, > image-2023-08-03-10-32-03-457.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750557#comment-17750557 ] Xiping Zhang commented on HDFS-17138: - OK, thanks for the suggestion. I'll check it out. > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Attachments: image-2023-08-02-16-20-34-454.png, > image-2023-08-03-10-32-03-457.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750533#comment-17750533 ] Xiping Zhang commented on HDFS-17138: - [~hexiaoqiao] I am here to add exception catching logic and it is working well , Do you have any other good suggestions? !image-2023-08-03-10-32-03-457.png! > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Attachments: image-2023-08-02-16-20-34-454.png, > image-2023-08-03-10-32-03-457.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-17138: Attachment: image-2023-08-03-10-32-03-457.png > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Attachments: image-2023-08-02-16-20-34-454.png, > image-2023-08-03-10-32-03-457.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750531#comment-17750531 ] Xiping Zhang commented on HDFS-17138: - Yes, we only changed the "hadoop.security.auth_to_local" configuration (Added resolution rules for another kerberos domain) of some routers. During this process, these routers generated tokens (It's a normal token for them) and were synchronized to other routers through zookeeper. when the other routers remove expired tokens, there was no matching exception due to the absence of configuration rules, and the other routers stopped. > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Attachments: image-2023-08-02-16-20-34-454.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750518#comment-17750518 ] Xiping Zhang commented on HDFS-17138: - [~elgoiri] Yes, I'm still coding test cases. > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Attachments: image-2023-08-02-16-20-34-454.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
Xiping Zhang created HDFS-17138: --- Summary: RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working Key: HDFS-17138 URL: https://issues.apache.org/jira/browse/HDFS-17138 Project: Hadoop HDFS Issue Type: Bug Environment: hadoop 3.3.0 Reporter: Xiping Zhang Attachments: image-2023-08-02-16-20-34-454.png other routers error log： !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Assigned] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang reassigned HDFS-17138: --- Assignee: Xiping Zhang > RBF: We changed the hadoop.security.auth_to_local configuration of one > router, the other routers stopped working > > > Key: HDFS-17138 > URL: https://issues.apache.org/jira/browse/HDFS-17138 > Project: Hadoop HDFS > Issue Type: Bug > Environment: hadoop 3.3.0 >Reporter: Xiping Zhang >Assignee: Xiping Zhang >Priority: Major > Attachments: image-2023-08-02-16-20-34-454.png > > > other routers error log： > !image-2023-08-02-16-20-34-454.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HDFS-16749) RBF: Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647794#comment-17647794
]
Xiping Zhang edited comment on HDFS-16749 at 12/15/22 2:10 AM:
---
[~hexiaoqiao] hi,
Could you help review this?
Thanks.
When retrieving the recycle bin data, some redundant lists were returned due to
the incorrect parsing of mount points.
was (Author: zhangxiping):
[~hexiaoqiao] hi,
Could you help review this?
Thanks.
> RBF: Gets the wrong directory information from Trash
>
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Affects Versions: 3.4.0
>Reporter: Xiping Zhang
>Assignee: Xiping Zhang
>Priority: Critical
> Labels: pull-request-available
>
> *Liststatus trash path, some directory information that does not exist is
> returned. Look at the following example：*
> // Current User ：zhangxiping
> // router =》 ns0 ，ns1
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
> Found 4 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/a
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/b
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/c
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
> hdfs://ns0/user/zhangxiping
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
> ls: `hdfs://ns1/user': No such file or directory
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
> Found 1 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> /user/zhangxiping/.Trash/Current/user //Requests to the router{color}
> Found 4 items
> drwxrwxrwx - zhangxiping supergroup 0 1970-01-01 08:00
> /user/zhangxiping/.Trash/Current/user/a
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/b{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it
> shouldn't exist*{color}
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> /user/zhangxiping/.Trash/Current/user/d
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16749) RBF: Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647794#comment-17647794
]
Xiping Zhang commented on HDFS-16749:
-
[~hexiaoqiao] hi,
Could you help review this?
Thanks.
> RBF: Gets the wrong directory information from Trash
>
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Affects Versions: 3.4.0
>Reporter: Xiping Zhang
>Assignee: Xiping Zhang
>Priority: Critical
> Labels: pull-request-available
>
> *Liststatus trash path, some directory information that does not exist is
> returned. Look at the following example：*
> // Current User ：zhangxiping
> // router =》 ns0 ，ns1
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
> Found 4 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/a
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/b
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/c
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
> hdfs://ns0/user/zhangxiping
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
> ls: `hdfs://ns1/user': No such file or directory
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
> Found 1 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> /user/zhangxiping/.Trash/Current/user //Requests to the router{color}
> Found 4 items
> drwxrwxrwx - zhangxiping supergroup 0 1970-01-01 08:00
> /user/zhangxiping/.Trash/Current/user/a
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/b{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it
> shouldn't exist*{color}
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> /user/zhangxiping/.Trash/Current/user/d
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16749) RBF: Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
*Liststatus trash path, some directory information that does not exist is
returned. Look at the following example：*
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
drwxrwxrwx - zhangxiping supergroup 0 1970-01-01 08:00
/user/zhangxiping/.Trash/Current/user/a
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it shouldn't
exist*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user {color:#505f79}//Requests to the
router{color}{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it shouldn't
exist*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF: Gets the wrong directory information from Trash
>
>
> Key: HDFS-16749
[jira] [Assigned] (HDFS-16749) RBF: Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang reassigned HDFS-16749:
---
Assignee: Xiping Zhang
> RBF: Gets the wrong directory information from Trash
>
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Affects Versions: 3.4.0
>Reporter: Xiping Zhang
>Assignee: Xiping Zhang
>Priority: Critical
>
> // Current User ：zhangxiping
> // router =》 ns0 ，ns1
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
> Found 4 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/a
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/b
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/c
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
> hdfs://ns0/user/zhangxiping
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
> ls: `hdfs://ns1/user': No such file or directory
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
> Found 1 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> /user/zhangxiping/.Trash/Current/user {color:#505f79}//Requests to the
> router{color}{color}
> Found 4 items
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/a{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/b{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it
> shouldn't exist*{color}
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> /user/zhangxiping/.Trash/Current/user/d
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16749) RBF: Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Component/s: rbf
Affects Version/s: 3.4.0
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user {color:#505f79}//Requests to the
router{color}{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it shouldn't
exist*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it shouldn't
exist*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF: Gets the wrong directory information from Trash
>
>
> Key: HDFS-16749
> URL:
[jira] [Updated] (HDFS-16749) RBF: Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Summary: RBF: Gets the wrong directory information from Trash (was:
RBF:Gets the wrong directory information from Trash)
> RBF: Gets the wrong directory information from Trash
>
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Xiping Zhang
>Priority: Critical
>
> // Current User ：zhangxiping
> // router =》 ns0 ，ns1
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
> Found 4 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/a
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/b
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/c
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
> hdfs://ns0/user/zhangxiping
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
> ls: `hdfs://ns1/user': No such file or directory
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
> Found 1 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> /user/zhangxiping/.Trash/Current/user //Requests to the router{color}
> Found 4 items
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/a{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/b{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it
> shouldn't exist*{color}
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> /user/zhangxiping/.Trash/Current/user/d
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619205#comment-17619205
]
Xiping Zhang commented on HDFS-16749:
-
{code:java}
//代码占位符 MountTableResolver.java
public List getMountPoints(final String str) throws IOException {
verifyMountTable();
String path = RouterAdmin.normalizeFileSystemPath(str);
//if (isTrashPath(path)) {
// path = subtractTrashCurrentPath(path); // do not need to process
the trash path to get the real mount point
// }
readLock.lock();
try {
String from = path;
String to = path + Character.MAX_VALUE;
SortedMap subMap = this.tree.subMap(from, to);
return FileSubclusterResolver.getMountPoints(path, subMap.keySet());
} finally {
readLock.unlock();
}
} {code}
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Xiping Zhang
>Priority: Critical
>
> // Current User ：zhangxiping
> // router =》 ns0 ，ns1
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
> Found 4 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/a
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/b
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/c
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
> hdfs://ns0/user/zhangxiping
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
> ls: `hdfs://ns1/user': No such file or directory
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
> Found 1 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
> {*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
> /user/zhangxiping/.Trash/Current/user //Requests to the router{color}
> Found 4 items
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/a{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/b{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it
> shouldn't exist*{color}
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> /user/zhangxiping/.Trash/Current/user/d
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//The records on it shouldn't
exist*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
drwxrwxrwx - zhangxiping supergroup 0 1970-01-01 08:00
/user/zhangxiping/.Trash/Current/user/a
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c {color:#de350b}*//The records
on it shouldn't exist*{color}{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
>
[jira] [Updated] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
drwxrwxrwx - zhangxiping supergroup 0 1970-01-01 08:00
/user/zhangxiping/.Trash/Current/user/a
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c {color:#de350b}*//The records
on it shouldn't exist*{color}{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user {color:#505f79} //Requests to the
router{color}{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//{color:#de350b}The records
on it shouldn't exist{color}*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
>
[jira] [Updated] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user {color:#505f79} //Requests to the
router{color}{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *//{color:#de350b}The records
on it shouldn't exist{color}*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c {color:#de350b}*//The records
on it shouldn't exist*{color}{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL:
[jira] [Updated] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c {color:#de350b}*//The records
on it shouldn't exist*{color}{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c //The records on it shouldn't
exist{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop
[jira] [Updated] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user {color:#505f79}//Requests to the
router{color}{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *{color:#de350b}//The records
on it shouldn't exist{color}*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Xiping Zhang
>Priority: Critical
>
> // Current User ：zhangxiping
> // router =》 ns0 ，ns1
> {*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> /user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota:
> -/-]
> {*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls hdfs://ns0/user{color}
> Found 4 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/a
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/b
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
> hdfs://ns0/user/c
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
> hdfs://ns0/user/zhangxiping
> {*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls hdfs://ns1/user{color}
> ls: `hdfs://ns1/user': No such file or directory
> {*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls
> hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
> Found 1 items
> drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
> hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
> {*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls
> /user/zhangxiping/.Trash/Current/user {color:#505f79}//Requests to the
> router{color}{color}
> Found 4 items
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/a {color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
> 08:00 /user/zhangxiping/.Trash/Current/user/b{color}
> {color:#00875a}drwxrwxrwx - zhangxiping supergroup
[jira] [Updated] (HDFS-16749) RBF:Gets the wrong directory information from Trash
[
https://issues.apache.org/jira/browse/HDFS-16749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16749:
Description:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#ff}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user //Requests to the router{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c //The records on it shouldn't
exist{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
was:
// Current User ：zhangxiping
// router =》 ns0 ，ns1
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/user/a ns0->/user/a(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/b ns0->/user/b(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
/user/c ns0->/user/c(Priority:0,Readonly:false) zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls hdfs://ns0/user{color}
Found 4 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/a
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/b
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:17
hdfs://ns0/user/c
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:11
hdfs://ns0/user/zhangxiping
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls hdfs://ns1/user{color}
ls: `hdfs://ns1/user': No such file or directory
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls
hdfs://ns0/user/zhangxiping/.Trash/Current/user{color}
Found 1 items
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
hdfs://ns0/user/zhangxiping/.Trash/Current/user/d
{*}\project\hadoop3.3.0{*}>{color:#FF}hdfs dfs -ls
/user/zhangxiping/.Trash/Current/user {color:#505f79}//Requests to the
router{color}{color}
Found 4 items
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/a {color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/b{color}
{color:#00875a}drwxrwxrwx - zhangxiping supergroup 0 1970-01-01
08:00 /user/zhangxiping/.Trash/Current/user/c *{color:#de350b}//The records
on it shouldn't exist{color}*{color}
drwxr-xr-x - zhangxiping supergroup 0 2022-10-18 10:14
/user/zhangxiping/.Trash/Current/user/d
> RBF:Gets the wrong directory information from Trash
> ---
>
> Key: HDFS-16749
> URL: https://issues.apache.org/jira/browse/HDFS-16749
>
[jira] [Created] (HDFS-16749) RBF:Gets the wrong directory information from Trash
Xiping Zhang created HDFS-16749: --- Summary: RBF:Gets the wrong directory information from Trash Key: HDFS-16749 URL: https://issues.apache.org/jira/browse/HDFS-16749 Project: Hadoop HDFS Issue Type: Bug Reporter: Xiping Zhang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16628) RBF: kerberos user remove Non-default namespace data failed
[ https://issues.apache.org/jira/browse/HDFS-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16628: Summary: RBF: kerberos user remove Non-default namespace data failed (was: RBF: kerbose user remove Non-default namespace data failed) > RBF: kerberos user remove Non-default namespace data failed > --- > > Key: HDFS-16628 > URL: https://issues.apache.org/jira/browse/HDFS-16628 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.4.0 >Reporter: Xiping Zhang >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 1h > Remaining Estimate: 0h > > remove data from the router will fail using such a user > username/d...@hadoop.com -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16628) RBF: kerbose user remove Non-default namespace data failed
[ https://issues.apache.org/jira/browse/HDFS-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16628: Description: remove data from the router will fail using such a user username/d...@hadoop.com > RBF: kerbose user remove Non-default namespace data failed > -- > > Key: HDFS-16628 > URL: https://issues.apache.org/jira/browse/HDFS-16628 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.4.0 >Reporter: Xiping Zhang >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 10m > Remaining Estimate: 0h > > remove data from the router will fail using such a user > username/d...@hadoop.com -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16628) RBF: kerbose user remove Non-default namespace data failed
[ https://issues.apache.org/jira/browse/HDFS-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16628: Fix Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: kerbose user remove Non-default namespace data failed > -- > > Key: HDFS-16628 > URL: https://issues.apache.org/jira/browse/HDFS-16628 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.4.0 >Reporter: Xiping Zhang >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16628) RBF: kerbose user remove Non-default namespace data failed
[
https://issues.apache.org/jira/browse/HDFS-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552509#comment-17552509
]
Xiping Zhang commented on HDFS-16628:
-
MountTableResolver.java
{code:java}
//代码占位符
@VisibleForTesting
public static String getTrashRoot() throws IOException {
// Gets the Trash directory for the current user.
return FileSystem.USER_HOME_PREFIX + "/" +
RouterRpcServer.getRemoteUser().getUserName() + "/" + // should get
shortUserName
FileSystem.TRASH_PREFIX;
} {code}
Should be consistent with FileSytem.java
{code:java}
//代码占位符
/** Return the current user's home directory in this FileSystem.
* The default implementation returns {@code "/user/$USER/"}.
*/
public Path getHomeDirectory() {
String username;
try {
username = UserGroupInformation.getCurrentUser().getShortUserName();
} catch(IOException ex) {
LOGGER.warn("Unable to get user name. Fall back to system property " +
"user.name", ex);
username = System.getProperty("user.name");
}
return this.makeQualified(
new Path(USER_HOME_PREFIX + "/" + username));
} {code}
> RBF: kerbose user remove Non-default namespace data failed
> --
>
> Key: HDFS-16628
> URL: https://issues.apache.org/jira/browse/HDFS-16628
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Reporter: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-16628) RBF: kerbose user remove Non-default namespace data failed
Xiping Zhang created HDFS-16628: --- Summary: RBF: kerbose user remove Non-default namespace data failed Key: HDFS-16628 URL: https://issues.apache.org/jira/browse/HDFS-16628 Project: Hadoop HDFS Issue Type: Bug Components: rbf Reporter: Xiping Zhang -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16570) RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed
[
https://issues.apache.org/jira/browse/HDFS-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533198#comment-17533198
]
Xiping Zhang commented on HDFS-16570:
-
cc [~fengnanli] [~ayushtkn] [~zhuxiangyi] , could you please review this issue?
> RBF: The router using MultipleDestinationMountTableResolver remove Multiple
> subcluster data under the mount point failed
>
>
> Key: HDFS-16570
> URL: https://issues.apache.org/jira/browse/HDFS-16570
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Reporter: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Please look at the following example :
> hadoop>{color:#FF}hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data
> -order RANDOM{color}
> Successfully removed mount point /home/data
> hadoop>{color:#FF}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /home/data ns0->/home/data,ns1->/home/data zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns0/home/data/test/fileNs0.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns1/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://127.0.0.1:40250/home/data/test{color}
> Found 2 items
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -rm -r
> hdfs://127.0.0.1:40250/home/data/test{color}
> rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename
> destination parent /user/zhangxiping/.Trash/Current/home/data/test not found.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-16570) RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed
[
https://issues.apache.org/jira/browse/HDFS-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang reopened HDFS-16570:
-
> RBF: The router using MultipleDestinationMountTableResolver remove Multiple
> subcluster data under the mount point failed
>
>
> Key: HDFS-16570
> URL: https://issues.apache.org/jira/browse/HDFS-16570
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Reporter: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Please look at the following example :
> hadoop>{color:#FF}hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data
> -order RANDOM{color}
> Successfully removed mount point /home/data
> hadoop>{color:#FF}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /home/data ns0->/home/data,ns1->/home/data zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns0/home/data/test/fileNs0.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns1/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://127.0.0.1:40250/home/data/test{color}
> Found 2 items
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -rm -r
> hdfs://127.0.0.1:40250/home/data/test{color}
> rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename
> destination parent /user/zhangxiping/.Trash/Current/home/data/test not found.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-16570) RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed
[
https://issues.apache.org/jira/browse/HDFS-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533169#comment-17533169
]
Xiping Zhang commented on HDFS-16570:
-
The trash path is resolved by removing the prefix of the trash path. In the
isPathAll() function, the prefix of the Trash path also needs to be processed,
but I think it is only necessary to determine whether it is the Trash path.
> RBF: The router using MultipleDestinationMountTableResolver remove Multiple
> subcluster data under the mount point failed
>
>
> Key: HDFS-16570
> URL: https://issues.apache.org/jira/browse/HDFS-16570
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Reporter: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Please look at the following example :
> hadoop>{color:#FF}hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data
> -order RANDOM{color}
> Successfully removed mount point /home/data
> hadoop>{color:#FF}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /home/data ns0->/home/data,ns1->/home/data zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns0/home/data/test/fileNs0.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns1/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://127.0.0.1:40250/home/data/test{color}
> Found 2 items
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -rm -r
> hdfs://127.0.0.1:40250/home/data/test{color}
> rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename
> destination parent /user/zhangxiping/.Trash/Current/home/data/test not found.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-16570) RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed
[
https://issues.apache.org/jira/browse/HDFS-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang resolved HDFS-16570.
-
Resolution: Implemented
> RBF: The router using MultipleDestinationMountTableResolver remove Multiple
> subcluster data under the mount point failed
>
>
> Key: HDFS-16570
> URL: https://issues.apache.org/jira/browse/HDFS-16570
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Reporter: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Please look at the following example :
> hadoop>{color:#FF}hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data
> -order RANDOM{color}
> Successfully removed mount point /home/data
> hadoop>{color:#FF}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /home/data ns0->/home/data,ns1->/home/data zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns0/home/data/test/fileNs0.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns1/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://127.0.0.1:40250/home/data/test{color}
> Found 2 items
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt
> hadoop>{color:#FF}hdfs dfs -rm -r
> hdfs://127.0.0.1:40250/home/data/test{color}
> rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename
> destination parent /user/zhangxiping/.Trash/Current/home/data/test not found.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16570) RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed
[
https://issues.apache.org/jira/browse/HDFS-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiping Zhang updated HDFS-16570:
Description:
Please look at the following example :
hadoop>{color:#FF}hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data
-order RANDOM{color}
Successfully removed mount point /home/data
hadoop>{color:#FF}hdfs dfsrouteradmin -ls{color}
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/home/data ns0->/home/data,ns1->/home/data zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
hadoop>{color:#FF}hdfs dfs -touch
hdfs://ns0/home/data/test/fileNs0.txt{color}
hadoop>{color:#FF}hdfs dfs -touch
hdfs://ns1/home/data/test/fileNs1.txt{color}
hadoop>{color:#FF}hdfs dfs -ls hdfs://ns0/home/data/test/fileNs0.txt{color}
{-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://ns0/home/data/test/fileNs0.txt
hadoop>{color:#FF}hdfs dfs -ls hdfs://ns1/home/data/test/fileNs1.txt{color}
{-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://ns1/home/data/test/fileNs1.txt
hadoop>{color:#FF}hdfs dfs -ls hdfs://127.0.0.1:40250/home/data/test{color}
Found 2 items
{-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt
{-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt
hadoop>{color:#FF}hdfs dfs -rm -r
hdfs://127.0.0.1:40250/home/data/test{color}
rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename
destination parent /user/zhangxiping/.Trash/Current/home/data/test not found.
was:
hadoop>hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data -order RANDOM
Successfully removed mount point /home/data
hadoop>hdfs dfsrouteradmin -ls
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/home/data ns0->/home/data,ns1->/home/data zhangxiping
Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
hadoop>hdfs dfs -touch hdfs://ns0/home/data/test/fileNs0.txt
hadoop>hdfs dfs -touch hdfs://ns1/home/data/test/fileNs1.txt
hadoop>hdfs dfs -ls hdfs://ns0/home/data/test/fileNs0.txt
-rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://ns0/home/data/test/fileNs0.txt
hadoop>hdfs dfs -ls hdfs://ns1/home/data/test/fileNs1.txt
-rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://ns1/home/data/test/fileNs1.txt
hadoop>hdfs dfs -ls hdfs://127.0.0.1:40250/home/data/test
Found 2 items
-rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt
-rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01
hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt
hadoop>hdfs dfs -rm -r hdfs://127.0.0.1:40250/home/data/test
rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename
destination parent /user/zhangxiping/.Trash/Current/home/data/test not found.
> RBF: The router using MultipleDestinationMountTableResolver remove Multiple
> subcluster data under the mount point failed
>
>
> Key: HDFS-16570
> URL: https://issues.apache.org/jira/browse/HDFS-16570
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: rbf
>Reporter: Xiping Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Please look at the following example :
> hadoop>{color:#FF}hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data
> -order RANDOM{color}
> Successfully removed mount point /home/data
> hadoop>{color:#FF}hdfs dfsrouteradmin -ls{color}
> Mount Table Entries:
> Source Destinations Owner
> Group Mode Quota/Usage
> /home/data ns0->/home/data,ns1->/home/data zhangxiping
> Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> hadoop>{color:#FF}hdfs dfs -touch
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns0/home/data/test/fileNs0.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping supergroup 0 2022-05-06 18:01
> hdfs://ns0/home/data/test/fileNs0.txt
> hadoop>{color:#FF}hdfs dfs -ls
> hdfs://ns1/home/data/test/fileNs1.txt{color}
> {-}rw-r{-}{-}r{-}- 3 zhangxiping
[jira] [Created] (HDFS-16570) RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed
Xiping Zhang created HDFS-16570: --- Summary: RBF: The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed Key: HDFS-16570 URL: https://issues.apache.org/jira/browse/HDFS-16570 Project: Hadoop HDFS Issue Type: Bug Components: rbf Reporter: Xiping Zhang hadoop>hdfs dfsrouteradmin -add /home/data ns0,ns1 /home/data -order RANDOM Successfully removed mount point /home/data hadoop>hdfs dfsrouteradmin -ls Mount Table Entries: Source Destinations Owner Group Mode Quota/Usage /home/data ns0->/home/data,ns1->/home/data zhangxiping Administrators rwxr-xr-x [NsQuota: -/-, SsQuota: -/-] hadoop>hdfs dfs -touch hdfs://ns0/home/data/test/fileNs0.txt hadoop>hdfs dfs -touch hdfs://ns1/home/data/test/fileNs1.txt hadoop>hdfs dfs -ls hdfs://ns0/home/data/test/fileNs0.txt -rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01 hdfs://ns0/home/data/test/fileNs0.txt hadoop>hdfs dfs -ls hdfs://ns1/home/data/test/fileNs1.txt -rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01 hdfs://ns1/home/data/test/fileNs1.txt hadoop>hdfs dfs -ls hdfs://127.0.0.1:40250/home/data/test Found 2 items -rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01 hdfs://127.0.0.1:40250/home/data/test/fileNs0.txt -rw-r--r-- 3 zhangxiping supergroup 0 2022-05-06 18:01 hdfs://127.0.0.1:40250/home/data/test/fileNs1.txt hadoop>hdfs dfs -rm -r hdfs://127.0.0.1:40250/home/data/test rm: Failed to move to trash: hdfs://127.0.0.1:40250/home/data/test: rename destination parent /user/zhangxiping/.Trash/Current/home/data/test not found. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
