[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951656#comment-14951656 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #519 (See [htt

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951657#comment-14951657 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #519 (See [htt

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951647#comment-14951647 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #508 (See

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951646#comment-14951646 ] Hadoop QA commented on HDFS-9184: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951648#comment-14951648 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #508 (See

[jira] [Resolved] (HDFS-8558) Remove the use of hard-coded cell size value in balancer Dispatcher

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8558. - Resolution: Duplicate fixed by HDFS-8882. > Remove the use of hard-coded cell size value in balancer Dispa

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951637#comment-14951637 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2453 (See [htt

[jira] [Updated] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-9157: Attachment: HDFS-9157_3.patch Patch updated to remove white space Removed unwanted file in patch please review > [O

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951625#comment-14951625 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-trunk-Commit #8606 (See [https:

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951621#comment-14951621 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-trunk-Commit #8605 (See [https:

[jira] [Updated] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9222: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951615#comment-14951615 ] Haohui Mai commented on HDFS-9222: -- +1 > Add hadoop-hdfs-client as a dependency of hadoop

[jira] [Updated] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9215: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951605#comment-14951605 ] Hadoop QA commented on HDFS-9157: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (HDFS-9199) rename dfs.namenode.replication.min to dfs.replication.min

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9199. - Resolution: Not A Problem > rename dfs.namenode.replication.min to dfs.replication.min > --

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951602#comment-14951602 ] Mingliang Liu commented on HDFS-9145: - The release audit is unrelated. All failing tes

[jira] [Commented] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951600#comment-14951600 ] Hadoop QA commented on HDFS-9223: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951591#comment-14951591 ] Hadoop QA commented on HDFS-4015: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951584#comment-14951584 ] Hadoop QA commented on HDFS-9215: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951579#comment-14951579 ] nijel commented on HDFS-9157: - thanks [~liuml07] for the comments Updated patch with the commen

[jira] [Updated] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-9157: Attachment: HDFS-9157_2.patch > [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option > is spe

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951576#comment-14951576 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi] after check source code, maybe {{get

[jira] [Updated] (HDFS-8438) Erasure Coding: support concat files in same EC zone

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8438: Attachment: HDFS-8438.01.patch > Erasure Coding: support concat files in same EC zone > -

[jira] [Updated] (HDFS-8438) Erasure Coding: Allow concat striped files if they have the same ErasureCodingPolicy

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8438: Summary: Erasure Coding: Allow concat striped files if they have the same ErasureCodingPolicy (was: Erasure

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951575#comment-14951575 ] Hadoop QA commented on HDFS-9145: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8438) Erasure Coding: Allow concat striped files if they have the same ErasureCodingPolicy

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8438: Status: Patch Available (was: Open) > Erasure Coding: Allow concat striped files if they have the same > Er

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951537#comment-14951537 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #478 (See [htt

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951530#comment-14951530 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See [https://

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951528#comment-14951528 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See [https://

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951527#comment-14951527 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See [https://

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951529#comment-14951529 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2416 (See [https://

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951511#comment-14951511 ] Hadoop QA commented on HDFS-3059: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951508#comment-14951508 ] Hadoop QA commented on HDFS-9221: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951500#comment-14951500 ] Hadoop QA commented on HDFS-7087: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951498#comment-14951498 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1244 (See [https://

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951493#comment-14951493 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2451 (See [htt

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951474#comment-14951474 ] Uma Maheswara Rao G commented on HDFS-8988: --- Thanks Yi. Yes, I think we don't nee

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951471#comment-14951471 ] Mingliang Liu commented on HDFS-9222: - We don't need new test as this patch is for depe

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Status: Patch Available (was: Open) > Logging HDFS operation's caller context into audit logs >

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951467#comment-14951467 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #506 (See

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.002.patch To address some offline comments, the v2 patch makes the caller conte

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Attachment: HDFS-8988.002.patch Rebase the patch. > Use LightWeightHashSet instead of LightWeightLinkedSet in > B

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Priority: Major (was: Minor) > Use LightWeightHashSet instead of LightWeightLinkedSet in > BlockManager#excessRep

[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951460#comment-14951460 ] Hadoop QA commented on HDFS-9222: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951451#comment-14951451 ] Andrew Wang commented on HDFS-7087: --- Hi Xiao, thanks for working on this! Some review com

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951441#comment-14951441 ] Walter Su commented on HDFS-9173: - -algorithm- Calculation. > Erasure Coding: Lease recove

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951440#comment-14951440 ] Walter Su commented on HDFS-9173: - bq. Actually the patch is already considering data and p

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951435#comment-14951435 ] Yi Liu commented on HDFS-9053: -- The Jenkins conflicts with other builds, let me re-trigger it

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951431#comment-14951431 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #517 (See [htt

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951430#comment-14951430 ] Zhe Zhang commented on HDFS-9173: - {code} for (int stripeIdx = 0; stripeIdx < totalSt

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.014.patch bq. Only nit is we can change the following if condition to if

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951390#comment-14951390 ] Lei (Eddy) Xu commented on HDFS-9188: - Some of the test failures are relevant. Working

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951380#comment-14951380 ] Hadoop QA commented on HDFS-1172: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951376#comment-14951376 ] Hadoop QA commented on HDFS-9188: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951374#comment-14951374 ] Walter Su commented on HDFS-9173: - Jing, that's a good case. In my plan for this case, I'll

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Status: Patch Available (was: Open) > Reconfigure DN concurrent move on the fly > --

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.001.patch I posted the 001 patch with a hope someone can review it. Thanks. >

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951360#comment-14951360 ] Walter Su commented on HDFS-9173: - Great work Walter! It's probably simpler to treat data a

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951352#comment-14951352 ] Hudson commented on HDFS-9085: -- FAILURE: Integrated in Hadoop-trunk-Commit #8603 (See [https:

[jira] [Commented] (HDFS-8664) Allow wildcards in dfs.datanode.data.dir

2015-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951350#comment-14951350 ] Hadoop QA commented on HDFS-8664: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951345#comment-14951345 ] Hudson commented on HDFS-9110: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1243 (See [https://

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951344#comment-14951344 ] Hudson commented on HDFS-8941: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1243 (See [https://

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951341#comment-14951341 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2450 (See [htt

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951342#comment-14951342 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2450 (See [htt

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951340#comment-14951340 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2450 (See [htt

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951322#comment-14951322 ] Zhe Zhang commented on HDFS-9205: - Thanks Nicholas. bq. Those blocks have zero replicas so

[jira] [Updated] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9145: Attachment: HDFS-9145.002.patch Thank you [~jingzhao] for your review. The idea to track longest lock

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: HDFS-4015.004.patch > Safemode should count and report orphaned blocks > --

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-10-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951312#comment-14951312 ] Haohui Mai commented on HDFS-9170: -- {noformat} [exec] CMake Error at CMakeLists.txt:1

[jira] [Commented] (HDFS-9220) ChecksumException after writing less than 512 bytes

2015-10-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951303#comment-14951303 ] Daniel Templeton commented on HDFS-9220: I saw a similar issue, and it went away wh

[jira] [Commented] (HDFS-9220) ChecksumException after writing less than 512 bytes

2015-10-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951287#comment-14951287 ] Kihwal Lee commented on HDFS-9220: -- It looks like it fails only when append is involved. I

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9223: Status: Patch Available (was: Open) > Code cleanup for DatanodeDescriptor and HeartbeatManager > ---

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951276#comment-14951276 ] Xiaobing Zhou commented on HDFS-8855: - Benchmarked the two approaches based on real tok

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9223: Attachment: HDFS-9223.000.patch The patch also makes the following changes in {{heartbeatCheck}}. {code} -

[jira] [Updated] (HDFS-8755) Fix typos in hadoop-hdfs-project module

2015-10-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8755: - Assignee: Neelesh Srinivas Salian (was: Ray Chiang) > Fix typos in hadoop-hdfs-project module > --

[jira] [Updated] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-10-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-9170: - Attachment: native-package-build-fails-with-cmake-2.5.log bq. Eric Payne, do you mind posting the error log

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: (was: HDFS-4015.004.patch) > Safemode should count and report orphaned blocks > ---

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: HDFS-4015.004.patch update documentation > Safemode should count and report orphaned block

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951261#comment-14951261 ] Andrew Wang commented on HDFS-9215: --- +1 again, thx! > Suppress the RAT warnings in hdfs-

[jira] [Created] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9223: --- Summary: Code cleanup for DatanodeDescriptor and HeartbeatManager Key: HDFS-9223 URL: https://issues.apache.org/jira/browse/HDFS-9223 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951260#comment-14951260 ] Hudson commented on HDFS-9181: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951257#comment-14951257 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951258#comment-14951258 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951259#comment-14951259 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #505 (See

[jira] [Updated] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9222: Status: Patch Available (was: Open) > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-c

[jira] [Updated] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9222: Attachment: HDFS-9222.000.patch Thanks [~wheat9] for reporting this. The v0 patch adds the {{hadoop-

[jira] [Commented] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951239#comment-14951239 ] zhihai xu commented on HDFS-9085: - Thanks [~cnauroth] for reviewing and committing the patc

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951237#comment-14951237 ] Daryn Sharp commented on HDFS-9221: --- +1 > HdfsServerConstants#ReplicaState#getState shou

[jira] [Updated] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9085: Release Note: The output of the "hdfs fetchdt --print" command now includes the token renewer appende

[jira] [Updated] (HDFS-9085) Show renewer information in DelegationTokenIdentifier#toString

2015-10-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9085: Resolution: Fixed Fix Version/s: 3.0.0 Release Note: The output of the {{hdfs fetchdt --pr

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951222#comment-14951222 ] Hudson commented on HDFS-9181: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2415 (See [https://

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-09 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951219#comment-14951219 ] Jitendra Nath Pandey commented on HDFS-9184: [~liuml07], I would suggest to mak

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951196#comment-14951196 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #477 (See [htt

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951198#comment-14951198 ] Hudson commented on HDFS-9181: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #477 (See [htt

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951197#comment-14951197 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #477 (See [htt

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951195#comment-14951195 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #477 (See [htt

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951188#comment-14951188 ] Hudson commented on HDFS-8941: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #516 (See [htt

[jira] [Commented] (HDFS-9201) Namenode Performance Improvement : Using for loop without iterator

2015-10-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951190#comment-14951190 ] Haohui Mai commented on HDFS-9201: -- My understanding is that they are simply syntactic sug

[jira] [Commented] (HDFS-9110) Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951189#comment-14951189 ] Hudson commented on HDFS-9110: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #516 (See [htt

[jira] [Commented] (HDFS-9142) Separating Configuration object for namenode(s) in MiniDFSCluster

2015-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951187#comment-14951187 ] Hudson commented on HDFS-9142: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #516 (See [htt

  1   2   >