[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399497#comment-16399497 ] Wei Yan commented on HDFS-13198: [~elgoiri] thanks for the review. > RBF: RouterHeartbeat

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399495#comment-16399495 ] Íñigo Goiri commented on HDFS-13283: I think the documentation in hdfs-default.xml sho

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399492#comment-16399492 ] Íñigo Goiri commented on HDFS-13276: The output from Yetus for [^HDFS-13276.002.patch

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399490#comment-16399490 ] Lukas Majercak commented on HDFS-13283: --- We've been running this in production for 4

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399458#comment-16399458 ] Hudson commented on HDFS-13198: --- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399444#comment-16399444 ] Íñigo Goiri commented on HDFS-13283: Thanks [~lukmajercak] for [^HDFS-13283.000.patch

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Description: Currently, the only way to configure reserved disk space for non-HDFS data on a Da

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Status: Patch Available (was: Open) > Percentage based Reserved Space Calculation for DataNode

[jira] [Work started] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13283 started by Lukas Majercak. - > Percentage based Reserved Space Calculation for DataNode > --

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.000.patch > Percentage based Reserved Space Calculation for DataNode > --

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399437#comment-16399437 ] genericqa commented on HDFS-13163: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work stopped] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13283 stopped by Lukas Majercak. - > Percentage based Reserved Space Calculation for DataNode > --

[jira] [Commented] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399434#comment-16399434 ] Elek, Marton commented on HDFS-13258: - The final patch is tested with docker-compose a

[jira] [Commented] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399433#comment-16399433 ] Elek, Marton commented on HDFS-13258: - This is a refactor with a lot of rename. All of

[jira] [Updated] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13258: Attachment: HDFS-13258-HDFS-7240.006.patch > Ozone: restructure Hdsl/Ozone code to separated maven s

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399424#comment-16399424 ] genericqa commented on HDFS-12977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399408#comment-16399408 ] genericqa commented on HDFS-13277: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399403#comment-16399403 ] Lukas Majercak commented on HDFS-13283: --- Will send a patch momentarily. > Percentag

[jira] [Created] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-13283: - Summary: Percentage based Reserved Space Calculation for DataNode Key: HDFS-13283 URL: https://issues.apache.org/jira/browse/HDFS-13283 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399398#comment-16399398 ] Íñigo Goiri commented on HDFS-12886: Thanks [~giovanni.fumarola]. We had this working

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.010.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399371#comment-16399371 ] genericqa commented on HDFS-13276: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399358#comment-16399358 ] Íñigo Goiri commented on HDFS-13198: Thanks [~ywskycn] for the contribution! Committed

[jira] [Updated] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13198: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.0.2

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399247#comment-16399247 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13276: -- Attachment: HDFS-13276-branch-2.000.patch > TestDistributedFileSystem doesn't cleanup MiniDFSClu

[jira] [Commented] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399239#comment-16399239 ] Bharat Viswanadham commented on HDFS-13277: --- In this Jira also add the testcase 

[jira] [Updated] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13277: -- Attachment: HDFS-13277-HDFS-12996.00.patch > Improve move to account for usage (number o

[jira] [Updated] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13277: -- Status: Patch Available (was: In Progress) > Improve move to account for usage (number

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399235#comment-16399235 ] Lukas Majercak commented on HDFS-12422: --- Added patch 002 after rebasing. > Replace

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399230#comment-16399230 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399226#comment-16399226 ] Íñigo Goiri commented on HDFS-12723: I tested [^HDFS-12723.001.patch] and I still see

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399212#comment-16399212 ] Hudson commented on HDFS-13251: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Attachment: HDFS-12422.002.patch > Replace DataNode in Pipeline when waiting for Last Packet fai

[jira] [Commented] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399174#comment-16399174 ] genericqa commented on HDFS-13280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399170#comment-16399170 ] Ajay Kumar commented on HDFS-12723: --- [~elgoiri] ya, i am also not sure if 2 or 4 data bl

[jira] [Comment Edited] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399170#comment-16399170 ] Ajay Kumar edited comment on HDFS-12723 at 3/14/18 7:34 PM: [~

[jira] [Updated] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13280: --- Attachment: HDFS-13280.003.patch > WebHDFS: Fix NPE in get snasphottable directory list call > ---

[jira] [Comment Edited] (HDFS-12886) Ignore minReplication for block recovery

2018-03-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399122#comment-16399122 ] Giovanni Matteo Fumarola edited comment on HDFS-12886 at 3/14/18 7:01 PM: --

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399122#comment-16399122 ] Giovanni Matteo Fumarola commented on HDFS-12886: - Thanks [~lukmajercak] f

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399115#comment-16399115 ] genericqa commented on HDFS-13198: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399110#comment-16399110 ] Íñigo Goiri commented on HDFS-12723: If we reduce the size of the file, will we still

[jira] [Commented] (HDFS-13275) Adding log for BlockPoolManager#refreshNamenodes failures

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399081#comment-16399081 ] Hudson commented on HDFS-13275: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399080#comment-16399080 ] Ajay Kumar commented on HDFS-12723: --- [~elgoiri] Only other two options i can think of is

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399076#comment-16399076 ] genericqa commented on HDFS-12723: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13251: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.1.0

[jira] [Commented] (HDFS-13275) Adding log for BlockPoolManager#refreshNamenodes failures

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399031#comment-16399031 ] Ajay Kumar commented on HDFS-13275: --- failed tests passed locally. > Adding log for Bloc

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399017#comment-16399017 ] Xiaoyu Yao commented on HDFS-13251: --- +1, I will commit it shortly. > Avoid using hard c

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399005#comment-16399005 ] Lukas Majercak commented on HDFS-13276: --- Removed > TestDistributedFileSystem doesn'

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13276: -- Attachment: HDFS-13276.002.patch > TestDistributedFileSystem doesn't cleanup MiniDFSCluster if t

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399002#comment-16399002 ] Íñigo Goiri commented on HDFS-13276: Thanks [~lukmajercak] for [^HDFS-13276.001.patch

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399001#comment-16399001 ] Lukas Majercak commented on HDFS-13276: --- Fixed all the checkstyles apart from AvoidN

[jira] [Updated] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13276: -- Attachment: HDFS-13276.001.patch > TestDistributedFileSystem doesn't cleanup MiniDFSCluster if t

[jira] [Updated] (HDFS-13275) Adding log for BlockPoolManager#refreshNamenodes failures

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13275: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.1.0

[jira] [Created] (HDFS-13282) Create UT for ReplicaFileDeleteTask without minidfs cluster

2018-03-14 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13282: - Summary: Create UT for ReplicaFileDeleteTask without minidfs cluster Key: HDFS-13282 URL: https://issues.apache.org/jira/browse/HDFS-13282 Project: Hadoop H

[jira] [Updated] (HDFS-13282) Create UT for ReplicaFileDeleteTask without minidfs cluster

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13282: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-12996 > Create UT for ReplicaFileD

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398985#comment-16398985 ] Arpit Agarwal commented on HDFS-13163: -- +1 pending Jenkins. Thanks [~bharatviswa]. >

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Attachment: HDFS-13163-HDFS-12996.03.patch > Move invalidated blocks to replica-trash wi

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398979#comment-16398979 ] Bharat Viswanadham commented on HDFS-13163: --- Attached patch v03 again, in previo

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Attachment: (was: HDFS-13163-HDFS-12996.03.patch) > Move invalidated blocks to repli

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398975#comment-16398975 ] genericqa commented on HDFS-12422: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398971#comment-16398971 ] Bharat Viswanadham commented on HDFS-13163: --- Attached patch v03 to address revie

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398968#comment-16398968 ] genericqa commented on HDFS-13215: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Attachment: HDFS-13163-HDFS-12996.03.patch > Move invalidated blocks to replica-trash wi

[jira] [Updated] (HDFS-13275) Adding log for BlockPoolManager#refreshNamenodes failures

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13275: -- Summary: Adding log for BlockPoolManager#refreshNamenodes failures (was: Adding logs for BlockPoolManag

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398950#comment-16398950 ] Íñigo Goiri commented on HDFS-12422: Thanks [~lukmajercak] for the ping. The whole fi

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398940#comment-16398940 ] Lukas Majercak commented on HDFS-12422: --- Ping to trigger build. > Replace DataNode

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398931#comment-16398931 ] Ajay Kumar commented on HDFS-13251: --- test failures are unrelated. TestDataNodeVolumeFail

[jira] [Commented] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398924#comment-16398924 ] Hudson commented on HDFS-13257: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13280: --- Attachment: HDFS-13280.002.patch > WebHDFS: Fix NPE in get snasphottable directory list call > ---

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398897#comment-16398897 ] Plamen Jeliazkov commented on HDFS-12977: - Attached new patch with whitespace chan

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977.trunk.005.patch > Add stateId to RPC headers. > -

[jira] [Comment Edited] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398853#comment-16398853 ] Íñigo Goiri edited comment on HDFS-13276 at 3/14/18 4:52 PM: -

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398877#comment-16398877 ] Íñigo Goiri commented on HDFS-13224: I uploaded [^HDFS-13224.009.patch] with the fix

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.009.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13257: - Component/s: (was: snapshots) > Code cleanup: INode never throws QuotaExceededException >

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13257: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status: Resolv

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13257: - Component/s: snapshots > Code cleanup: INode never throws QuotaExceededException > ---

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398853#comment-16398853 ] Íñigo Goiri commented on HDFS-13276: We cna fix most of those checkstyles now we are d

[jira] [Commented] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398849#comment-16398849 ] Hudson commented on HDFS-13249: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398847#comment-16398847 ] Íñigo Goiri commented on HDFS-12723: Thanks [~ajayydv] for the description; basically

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398826#comment-16398826 ] Ajay Kumar commented on HDFS-12723: --- [~elgoiri], corrected the indentation in patch v2.

[jira] [Updated] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13249: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Commented] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398805#comment-16398805 ] Erik Krogen commented on HDFS-13265: Looks like the set of failed tests is very manage

[jira] [Updated] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

2018-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13265: --- Attachment: HDFS-13265-branch-2.000.patch > MiniDFSCluster should set reasonable defaults to reduce re

[jira] [Updated] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12723: -- Attachment: HDFS-12723.001.patch > TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks fa

[jira] [Updated] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-13281: -- Description: If I want to write to /.reserved/raw/ and if that directory happens to be in EZ, t

[jira] [Created] (HDFS-13281) Namenode#createFile should be /.reserved/raw/ aware.

2018-03-14 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-13281: - Summary: Namenode#createFile should be /.reserved/raw/ aware. Key: HDFS-13281 URL: https://issues.apache.org/jira/browse/HDFS-13281 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398766#comment-16398766 ] Xiaoyu Yao commented on HDFS-13249: --- +1 for the latest patch. I will commit it shortly.

[jira] [Commented] (HDFS-12564) Add the documents of swebhdfs configurations on the client side

2018-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398762#comment-16398762 ] Xiaoyu Yao commented on HDFS-12564: --- Thanks [~tasanuma0829] for the heads up. I will spe

[jira] [Commented] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398749#comment-16398749 ] Wei Yan commented on HDFS-13198: Yetus confused resubmitted 005 patch > RBF: RouterHe

[jira] [Updated] (HDFS-13198) RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

2018-03-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13198: --- Attachment: HDFS-13198.005.patch > RBF: RouterHeartbeatService throws out CachedStateStore related exceptions

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398722#comment-16398722 ] genericqa commented on HDFS-12723: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398710#comment-16398710 ] genericqa commented on HDFS-13163: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398686#comment-16398686 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398683#comment-16398683 ] genericqa commented on HDFS-13276: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398700#comment-16398700 ] genericqa commented on HDFS-13280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398664#comment-16398664 ] Arpit Agarwal commented on HDFS-13163: -- Thanks [~bharatviswa]. Very minor comments: #

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-03-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Attachment: HDFS-13166-HDFS-10285-07.patch > [SPS]: Collects successfully moved block details via IBR >

[jira] [Commented] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398524#comment-16398524 ] genericqa commented on HDFS-13249: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

<    1   2   3   >