[jira] [Created] (HDFS-15138) Use RDBStore and TypedTable to manage the inode of namenode

2020-01-22 Thread maobaolong (Jira)
maobaolong created HDFS-15138: - Summary: Use RDBStore and TypedTable to manage the inode of namenode Key: HDFS-15138 URL: https://issues.apache.org/jira/browse/HDFS-15138 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-15139) Use RDBStore and TypedTable to manage the blockinfo of namenode

2020-01-22 Thread maobaolong (Jira)
maobaolong created HDFS-15139: - Summary: Use RDBStore and TypedTable to manage the blockinfo of namenode Key: HDFS-15139 URL: https://issues.apache.org/jira/browse/HDFS-15139 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor reassigned HDFS-15115: - Assignee: David Mollitor > Namenode crash caused by NPE in BlockPlacementPolicyDefault w

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-15115: -- Attachment: HDFS-14103.1.patch > Namenode crash caused by NPE in BlockPlacementPolicyDefault wh

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-15115: -- Attachment: (was: HDFS-14103.1.patch) > Namenode crash caused by NPE in BlockPlacementPolic

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-15115: -- Attachment: (was: HDFS-15115.1.patch) > Namenode crash caused by NPE in BlockPlacementPolic

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-15115: -- Attachment: HDFS-15115.2.patch > Namenode crash caused by NPE in BlockPlacementPolicyDefault wh

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-15115: -- Attachment: HDFS-15115.1.patch > Namenode crash caused by NPE in BlockPlacementPolicyDefault wh

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-15115: -- Status: Patch Available (was: Open) > Namenode crash caused by NPE in BlockPlacementPolicyDefa

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021120#comment-17021120 ] David Mollitor commented on HDFS-15115: --- Thanks for looping me in.   I've never l

[jira] [Resolved] (HDFS-4935) add symlink support to HttpFS server side

2020-01-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-4935. -- Resolution: Won't Fix Symlink is currently disabled due to security reasons and bugs. > add symlink sup

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

2020-01-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021165#comment-17021165 ] Kihwal Lee commented on HDFS-14968: --- +1 we have been running production with this. > A

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

2020-01-22 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021200#comment-17021200 ] Hudson commented on HDFS-14968: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-14968: -- Fix Version/s: 2.10.1 3.2.2 3.1.4 3.3.0 > Add

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-14968: -- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) > Add

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

2020-01-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021201#comment-17021201 ] Kihwal Lee commented on HDFS-14968: --- Committed this to trunk, branch-3.2, branch-3.1 an

[jira] [Commented] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021216#comment-17021216 ] Stephen O'Donnell commented on HDFS-15131: -- I created a simple test program that

[jira] [Comment Edited] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021216#comment-17021216 ] Stephen O'Donnell edited comment on HDFS-15131 at 1/22/20 3:45 PM:

[jira] [Commented] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-22 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021217#comment-17021217 ] Kihwal Lee commented on HDFS-15119: --- Long running clients like HBase sometimes are havi

[jira] [Assigned] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15131: Assignee: Stephen O'Donnell > FoldedTreeSet appears to degrade over time > ---

[jira] [Created] (HDFS-15140) Replace FoldedTreeSet in Datanode with SortedSet or TreeMap

2020-01-22 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15140: Summary: Replace FoldedTreeSet in Datanode with SortedSet or TreeMap Key: HDFS-15140 URL: https://issues.apache.org/jira/browse/HDFS-15140 Project: Hadoop HDF

[jira] [Updated] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15117: Attachment: HDFS-15117-08.patch > EC: Add getECTopologyResultForPolicies to DistributedFileSystem >

[jira] [Commented] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-22 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021264#comment-17021264 ] Brahma Reddy Battula commented on HDFS-15133: - [~maobaolong] thanks for propo

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021267#comment-17021267 ] Ayush Saxena commented on HDFS-15117: - {{TestReadOnly}} was related. Fixed it. Other

[jira] [Commented] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021272#comment-17021272 ] Ayush Saxena commented on HDFS-15133: - Thanx [~maobaolong] for the initiative, seems

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021312#comment-17021312 ] Hadoop QA commented on HDFS-15115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-13179: - Status: Patch Available (was: Open) > TestLazyPersistReplicaRecovery#testDnRestartWithSavedRepli

[jira] [Assigned] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-13179: Assignee: Ahmed Hussein > TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fa

[jira] [Updated] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-13179: - Attachment: HDFS-13179.001.patch > TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

[jira] [Work started] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15136 started by Renukaprasad C. - > In secure mode when Cookies are not set in request header leads to exception

[jira] [Updated] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renukaprasad C updated HDFS-15136: -- Attachment: HDFS-15136.0001.patch > In secure mode when Cookies are not set in request header l

[jira] [Updated] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renukaprasad C updated HDFS-15136: -- Attachment: (was: HDFS-15136.0001.patch) > In secure mode when Cookies are not set in reque

[jira] [Updated] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renukaprasad C updated HDFS-15136: -- Attachment: HDFS-15136.0001.patch Status: Patch Available (was: In Progress) > In secu

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and crashed future Maven test run

2020-01-22 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Attachment: HDFS-15128-000.patch Status: Patch Available (was: Open) > Unit test failing to clean testin

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021462#comment-17021462 ] Hadoop QA commented on HDFS-15117: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021629#comment-17021629 ] Hadoop QA commented on HDFS-15136: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021693#comment-17021693 ] Hadoop QA commented on HDFS-13179: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15128) Unit test failing to clean testing data and crashed future Maven test run

2020-01-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021712#comment-17021712 ] Hadoop QA commented on HDFS-15128: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renukaprasad C updated HDFS-15136: -- Attachment: HDFS-15136.0002.patch > In secure mode when Cookies are not set in request header l

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-22 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021786#comment-17021786 ] Vinayakumar B commented on HDFS-15117: -- Looks good to me. +1 Thanks [~ayushtkn] for

[jira] [Commented] (HDFS-15136) In secure mode when Cookies are not set in request header leads to exception flood in DEBUG log

2020-01-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021799#comment-17021799 ] Hadoop QA commented on HDFS-15136: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-15141) Support for getFileChecksum in OzoneFS

2020-01-22 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasu Majeti updated HDFS-15141: Summary: Support for getFileChecksum in OzoneFS (was: Support for getFileChecksum) > Supp

[jira] [Created] (HDFS-15141) Support for getFileChecksum

2020-01-22 Thread Srinivasu Majeti (Jira)
Srinivasu Majeti created HDFS-15141: --- Summary: Support for getFileChecksum Key: HDFS-15141 URL: https://issues.apache.org/jira/browse/HDFS-15141 Project: Hadoop HDFS Issue Type: New Feature