[jira] [Created] (HDFS-15625) Namenode trashEmptier should not init ViewFs on startup

2020-10-09 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15625: -- Summary: Namenode trashEmptier should not init ViewFs on startup Key: HDFS-15625 URL: https://issues.apache.org/jira/browse/HDFS-15625 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15468) Active namenode crashed when no edit recover

2020-10-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211561#comment-17211561 ] Ayush Saxena edited comment on HDFS-15468 at 10/10/20, 5:50 AM: ---

[jira] [Commented] (HDFS-15468) Active namenode crashed when no edit recover

2020-10-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211561#comment-17211561 ] Ayush Saxena commented on HDFS-15468: - Thanx [~kpalanisamy] for the report. Not sure

[jira] [Created] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-09 Thread YaYun Wang (Jira)
YaYun Wang created HDFS-15624: - Summary: Fix the SetQuotaByStorageTypeOp problem after updating hadoop Key: HDFS-15624 URL: https://issues.apache.org/jira/browse/HDFS-15624 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211500#comment-17211500 ] Hadoop QA commented on HDFS-15622: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15622: - Attachment: HDFS-15622.001.patch Status: Patch Available (was: In Progress) > Deleted bl

[jira] [Work started] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15622 started by Ahmed Hussein. > Deleted blocks linger in the replications queue >

[jira] [Created] (HDFS-15623) Respect configured values of rpc.engine

2020-10-09 Thread Hector Sandoval Chaverri (Jira)
Hector Sandoval Chaverri created HDFS-15623: --- Summary: Respect configured values of rpc.engine Key: HDFS-15623 URL: https://issues.apache.org/jira/browse/HDFS-15623 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211241#comment-17211241 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15601) Batch listing: gracefully fallback to use non-batched listing when NameNode doesn't support the feature

2020-10-09 Thread Aihua Xu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211161#comment-17211161 ] Aihua Xu commented on HDFS-15601: - Seems I won't have time to work on this. Assign back.

[jira] [Assigned] (HDFS-15601) Batch listing: gracefully fallback to use non-batched listing when NameNode doesn't support the feature

2020-10-09 Thread Aihua Xu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu reassigned HDFS-15601: --- Assignee: (was: Aihua Xu) > Batch listing: gracefully fallback to use non-batched listing when N

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=498639&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498639 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211122#comment-17211122 ] Steve Loughran commented on HDFS-15620: --- aah, sorry. We'd deliberately added a blan

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2020-10-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211086#comment-17211086 ] Stephen O'Donnell commented on HDFS-15621: -- [~belugabehr] That is a good idea. I

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2020-10-09 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211069#comment-17211069 ] David Mollitor commented on HDFS-15621: --- Another option would be to multi-thread th

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Status: Patch Available (was: In Progress) > Improve datanode shutdown latency > ---

[jira] [Created] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-09 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15622: Summary: Deleted blocks linger in the replications queue Key: HDFS-15622 URL: https://issues.apache.org/jira/browse/HDFS-15622 Project: Hadoop HDFS Issue Typ

[jira] [Comment Edited] (HDFS-15618) Improve datanode shutdown latency

2020-10-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211046#comment-17211046 ] Ahmed Hussein edited comment on HDFS-15618 at 10/9/20, 2:23 PM: ---

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211046#comment-17211046 ] Ahmed Hussein commented on HDFS-15618: -- I added a configuration key {{dfs.block.scan

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2020-10-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Attachment: Screenshot 2020-10-09 at 15.20.56.png > Datanode DirectoryScanner uses excess

[jira] [Created] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2020-10-09 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15621: Summary: Datanode DirectoryScanner uses excessive memory Key: HDFS-15621 URL: https://issues.apache.org/jira/browse/HDFS-15621 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2020-10-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Attachment: Screenshot 2020-10-09 at 14.11.36.png > Datanode DirectoryScanner uses excess

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=498555&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498555 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498500&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498500 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=498418&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498418 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=498401&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498401 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=498365&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498365 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498316&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498316 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498313&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498313 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498284&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498284 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498264&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498264 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15610) Reduce datanode upgrade/hardlink thread

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15610?focusedWorklogId=498258&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498258 ] ASF GitHub Bot logged work on HDFS-15610: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15610) Reduce datanode upgrade/hardlink thread

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15610?focusedWorklogId=498226&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498226 ] ASF GitHub Bot logged work on HDFS-15610: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498088&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498088 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498034&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498034 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498029&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498029 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498005&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498005 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=497919&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497919 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=497873&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497873 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=497874&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497874 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HDFS-15620: Assignee: Akira Ajisaka > RBF: Fix test failures after HADOOP-17281 >

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15620: -- Labels: pull-request-available (was: ) > RBF: Fix test failures after HADOOP-17281 > -

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=497860&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497860 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-13293: --- Fix Version/s: (was: 3.4.) 3.4.0 > RBF: The RouterRPCServer should transfer client IP

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210722#comment-17210722 ] Hui Fei commented on HDFS-13293: Merged. [~maobaolong] Thanks for report, [~aajisaka] [~e

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-13293: --- Fix Version/s: 3.4. Resolution: Fixed Status: Resolved (was: Patch Available) > RBF: The R

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2020-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=497810&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497810 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15620: - Target Version/s: 3.3.1, 3.4.0 > RBF: Fix test failures after HADOOP-17281 >

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15620: - Parent: HDFS-14603 Issue Type: Sub-task (was: Bug) > RBF: Fix test failures after HADOOP

[jira] [Created] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

2020-10-09 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-15620: Summary: RBF: Fix test failures after HADOOP-17281 Key: HDFS-15620 URL: https://issues.apache.org/jira/browse/HDFS-15620 Project: Hadoop HDFS Issue Type: Bug