[jira] [Updated] (HDFS-13215) RBF: Move Router to its own module

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13215: --- Status: Patch Available (was: Open) > RBF: Move Router to its own module >

[jira] [Updated] (HDFS-13215) RBF: Move Router to its own module

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13215: --- Attachment: HDFS-13215.001.patch > RBF: Move Router to its own module > -- >

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13275: -- Component/s: datanode > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13275: -- Labels: logs (was: ) > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Comment Edited] (HDFS-13278) RBF: Correct the logic of mount validate to avoid the bad mountPoint

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398061#comment-16398061 ] Íñigo Goiri edited comment on HDFS-13278 at 3/14/18 3:58 AM: - I'm not sure if

[jira] [Commented] (HDFS-13278) RBF: Correct the logic of mount validate to avoid the bad mountPoint

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398061#comment-16398061 ] Íñigo Goiri commented on HDFS-13278: I'm not sure if it should go here, but I have a couple nits for

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398053#comment-16398053 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13276: --- Status: Patch Available (was: Open) > TestDistributedFileSystem doesn't cleanup MiniDFSCluster if

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12773: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.0.2

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12773: - Affects Version/s: 3.0.0 > RBF: Improve State Store FS implementation >

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398035#comment-16398035 ] Íñigo Goiri commented on HDFS-12773: {quote} Failed unit test are not related. I'd like to help commit

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398034#comment-16398034 ] Íñigo Goiri commented on HDFS-12723: Thanks [~ajayydv]. The indentation of

[jira] [Assigned] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-12723: -- Assignee: Ajay Kumar > TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398023#comment-16398023 ] Yiqun Lin commented on HDFS-12773: -- Failed unit test are not related. I'd like to help commit this. >

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398007#comment-16398007 ] Yiqun Lin commented on HDFS-12773: -- LGTM, +1. > RBF: Improve State Store FS implementation >

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398008#comment-16398008 ] Ajay Kumar commented on HDFS-12723: --- submitting patch with below changes: * moved cluster setup and

[jira] [Updated] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12723: -- Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12723: -- Attachment: HDFS-12723.000.patch > TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks

[jira] [Updated] (HDFS-13278) RBF: Correct the logic of mount validate to avoid the bad mountPoint

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13278: --- Labels: RBF (was: ) > RBF: Correct the logic of mount validate to avoid the bad mountPoint >

[jira] [Updated] (HDFS-13278) RBF: Correct the logic of mount validate to avoid the bad mountPoint

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13278: --- Summary: RBF: Correct the logic of mount validate to avoid the bad mountPoint (was: Correct the

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.008.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397991#comment-16397991 ] Íñigo Goiri commented on HDFS-13224: In [^HDFS-13224.008.patch], I added {{TestLocalResolver}}; I

[jira] [Assigned] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-13258: --- Assignee: Elek, Marton > Ozone: restructure Hdsl/Ozone code to separated maven subprojects >

[jira] [Commented] (HDFS-11434) Remove PathUtils#getTestPath() as it's not usable for hdfs path in windows

2018-03-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397974#comment-16397974 ] Brahma Reddy Battula commented on HDFS-11434: - if anybody gets chance to review, kindly look

[jira] [Commented] (HDFS-13270) RBF: Router audit logger

2018-03-13 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397968#comment-16397968 ] maobaolong commented on HDFS-13270: --- [~ywskycn] Thank you for the quick reply. I have a couple of reason

[jira] [Commented] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397963#comment-16397963 ] genericqa commented on HDFS-13258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397956#comment-16397956 ] genericqa commented on HDFS-13265: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13278) Correct the logic of mount validate to avoid the bad mountPoint

2018-03-13 Thread maobaolong (JIRA)
maobaolong created HDFS-13278: - Summary: Correct the logic of mount validate to avoid the bad mountPoint Key: HDFS-13278 URL: https://issues.apache.org/jira/browse/HDFS-13278 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13226) RBF: Throw the exception if mount table entry validated failed

2018-03-13 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397949#comment-16397949 ] maobaolong commented on HDFS-13226: --- [~linyiqun] [~elgoiri] Thank you for your review and commit for me,

[jira] [Commented] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397944#comment-16397944 ] Hudson commented on HDFS-13235: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13832 (See

[jira] [Commented] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397945#comment-16397945 ] Hudson commented on HDFS-336: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13832 (See

[jira] [Created] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-13 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13277: - Summary: Improve move to account for usage (number of files) to limit trash dir size Key: HDFS-13277 URL: https://issues.apache.org/jira/browse/HDFS-13277

[jira] [Work started] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13277 started by Bharat Viswanadham. - > Improve move to account for usage (number of files) to limit trash

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397943#comment-16397943 ] Bharat Viswanadham commented on HDFS-13163: --- [~arpitagarwal] Thank You for review. Addressed

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Attachment: HDFS-13163-HDFS-12996.02.patch > Move invalidated blocks to replica-trash

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397919#comment-16397919 ] genericqa commented on HDFS-13251: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13137) Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key

2018-03-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13137: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-13268) TestWebHdfsFileContextMainOperations fails on Windows

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397906#comment-16397906 ] genericqa commented on HDFS-13268: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397902#comment-16397902 ] genericqa commented on HDFS-13275: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-13137) Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key

2018-03-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-13137: --- Assignee: Anu Engineer (was: Mukul Kumar Singh) > Ozone: Ozonefs read fails because

[jira] [Assigned] (HDFS-13137) Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key

2018-03-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-13137: --- Assignee: Mukul Kumar Singh (was: Anu Engineer) > Ozone: Ozonefs read fails because

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397888#comment-16397888 ] Arpit Agarwal commented on HDFS-13055: -- I think this patch will benefit from splitting into smaller

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397884#comment-16397884 ] Arpit Agarwal commented on HDFS-13055: -- Thanks for updating the patch [~ajayydv]. I have not reviewed

[jira] [Updated] (HDFS-13108) Ozone: OzoneFileSystem: Simplified url schema for Ozone File System

2018-03-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13108: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-336: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status: Resolved

[jira] [Commented] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397857#comment-16397857 ] Arpit Agarwal commented on HDFS-336: +1 for the patch. The failed unit tests are known flaky tests. I

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Component/s: documentation > DiskBalancer: Update Documentation to add newly added options >

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Issue Type: Improvement (was: Bug) > DiskBalancer: Update Documentation to add newly added

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Component/s: diskbalancer > DiskBalancer: Update Documentation to add newly added options >

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13235: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397823#comment-16397823 ] Arpit Agarwal commented on HDFS-13163: -- Thanks for this patch [~bharatviswa]. A few comments: #

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.007.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397798#comment-16397798 ] genericqa commented on HDFS-12977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Description: When Blocks are invalidated, move the blocks to replica-trash directory

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Description: When Blocks are invalidated, move the blocks to replica-trash directory

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Description: When Blocks are invalidated, move the blocks to replica-trash directory   

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: HDFS-13265.000.patch > MiniDFSCluster should set reasonable defaults to reduce resource

[jira] [Updated] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-13 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13258: Attachment: HDFS-13258-HDFS-7240.005.patch > Ozone: restructure Hdsl/Ozone code to separated maven

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: (was: HDFS-13265.000.patch) > MiniDFSCluster should set reasonable defaults to reduce

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397739#comment-16397739 ] Xiaoyu Yao commented on HDFS-13251: --- Thanks [~ajayydv] for the update. +1 pending Jenkins. > Avoid

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: HDFS-13265.000.patch > MiniDFSCluster should set reasonable defaults to reduce resource

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: HDFS-13265-branch-2.000.patch > MiniDFSCluster should set reasonable defaults to reduce

[jira] [Commented] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397738#comment-16397738 ] Erik Krogen commented on HDFS-13265: Attaching v000 patch (trunk & branch-2) which incorporates

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Status: Patch Available (was: In Progress) > MiniDFSCluster should set reasonable defaults to reduce

[jira] [Commented] (HDFS-13150) Create fast path for SbNN tailing edits from JNs

2018-03-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397731#comment-16397731 ] Konstantin Shvachko commented on HDFS-13150: As a reminder, the two approaches for SBN /

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397710#comment-16397710 ] Wei Yan commented on HDFS-13215: {quote}I'm leaning towards having our own hdfs-rbf-site.xml. {quote} I'm

[jira] [Updated] (HDFS-13268) TestWebHdfsFileContextMainOperations fails on Windows

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13268: --- Status: Patch Available (was: Open) > TestWebHdfsFileContextMainOperations fails on Windows >

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397689#comment-16397689 ] Ajay Kumar commented on HDFS-13251: --- Patch v3 to adress [~xyao] suggestions. Removed below changes as

[jira] [Updated] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13251: -- Attachment: HDFS-13251.003.patch > Avoid using hard coded datanode data dirs in unit tests >

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397660#comment-16397660 ] Lukas Majercak commented on HDFS-12514: --- Fixed the trunk patch and added one for branch-2. >

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: HDFS-12514-branch-2.000.patch > Cancelled HedgedReads cause block to be marked as

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Attachment: HDFS-13275.000.patch > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Attachment: (was: HDFS-13275.000.patch) > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Status: Patch Available (was: Open) > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Updated] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13275: -- Attachment: HDFS-13275.000.patch > Adding logs for BlockPoolManager#refreshNamenodes >

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397645#comment-16397645 ] Íñigo Goiri commented on HDFS-13276: Thanks [~lukmajercak] for [^HDFS-13276.000.patch]. The patch is

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13276: -- Attachment: HDFS-13276.000.patch > TestDistributedFileSystem doesn't cleanup MiniDFSCluster if

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397641#comment-16397641 ] Lukas Majercak commented on HDFS-13276: --- Submitted a patch to clean up the MiniDFSCluster after each

[jira] [Created] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
Íñigo Goiri created HDFS-13276: -- Summary: TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out Key: HDFS-13276 URL: https://issues.apache.org/jira/browse/HDFS-13276 Project: Hadoop

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397636#comment-16397636 ] Íñigo Goiri commented on HDFS-13276: The culprit for us was {{testDFSClientPeerReadTimeout()}} which

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-13 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: HDFS-12514.003.patch > Cancelled HedgedReads cause block to be marked as suspect on

[jira] [Created] (HDFS-13275) Adding logs for BlockPoolManager#refreshNamenodes

2018-03-13 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-13275: - Summary: Adding logs for BlockPoolManager#refreshNamenodes Key: HDFS-13275 URL: https://issues.apache.org/jira/browse/HDFS-13275 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-13 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397596#comment-16397596 ] genericqa commented on HDFS-12773: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397545#comment-16397545 ] Íñigo Goiri commented on HDFS-13198: Wait, Yetus reported on [^HDFS-13198.002.patch] instead of

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397539#comment-16397539 ] Íñigo Goiri commented on HDFS-13198: Failed unit tests are unrelated. Committing

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397536#comment-16397536 ] genericqa commented on HDFS-13198: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: (was: HDFS-13265.000.patch) > MiniDFSCluster should set reasonable defaults to reduce

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397518#comment-16397518 ] Xiaoyu Yao commented on HDFS-13251: --- [~ajayydv] , thanks for the update. The new patch looks pretty good

[jira] [Commented] (HDFS-13273) Fix compilation issue in trunk

2018-03-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397516#comment-16397516 ] genericqa commented on HDFS-13273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: HDFS-13265.000.patch > MiniDFSCluster should set reasonable defaults to reduce resource

[jira] [Commented] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

2018-03-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397468#comment-16397468 ] Chris Douglas commented on HDFS-12780: -- Failure is unrelated. {noformat} [ERROR] Failed to execute

[jira] [Assigned] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13274: -- Assignee: Íñigo Goiri > RBF: Extend RouterRpcClient to use multiple sockets >

[jira] [Updated] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13274: --- Description: HADOOP-13144 introduces the ability to create multiple connections for the same user and

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397462#comment-16397462 ] Íñigo Goiri commented on HDFS-13274: As commented in HADOOP-13144, we would be able to create

[jira] [Created] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2018-03-13 Thread JIRA
Íñigo Goiri created HDFS-13274: -- Summary: RBF: Extend RouterRpcClient to use multiple sockets Key: HDFS-13274 URL: https://issues.apache.org/jira/browse/HDFS-13274 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-13272) DataNodeHttpServer to have configurable HttpServer2 threads

2018-03-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397454#comment-16397454 ] Erik Krogen commented on HDFS-13272: This is mostly motivated by the desire to reduce the thread

[jira] [Work started] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12977 started by Plamen Jeliazkov. --- > Add stateId to RPC headers. > --- > >

[jira] [Commented] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

2018-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397442#comment-16397442 ] Hudson commented on HDFS-12780: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13829 (See

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397440#comment-16397440 ] Plamen Jeliazkov commented on HDFS-12977: - I think with this edition of the patch we are now ready

  1   2   >