[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935928#comment-14935928 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #435 (See [htt

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935932#comment-14935932 ] Xiaobing Zhou commented on HDFS-8696: - Checked the test failures are not related. > Re

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935911#comment-14935911 ] Hadoop QA commented on HDFS-8696: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935894#comment-14935894 ] Haohui Mai commented on HDFS-8971: -- The patch looks good to me. +1 after fixing the checks

[jira] [Commented] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935889#comment-14935889 ] Hadoop QA commented on HDFS-8971: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935852#comment-14935852 ] Haohui Mai commented on HDFS-9000: -- This leads to a much more general discussion -- have y

[jira] [Commented] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935843#comment-14935843 ] Daniel Templeton commented on HDFS-9174: The changes look good to me. +1 (non-bind

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935832#comment-14935832 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2375 (See [https://

[jira] [Updated] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8971: Status: Patch Available (was: Open) > Remove guards when calling LOG.debug() and LOG.trace() in clie

[jira] [Updated] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8971: Attachment: HDFS-8971.000.patch The v0 patch removes the guards when calling {{LOG.trace}} and {{LOG.

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-1172: Assignee: Masatake Iwasaki > Blocks in newly completed files are considered under-replicated too quickly > --

[jira] [Commented] (HDFS-488) Implement moveToLocal HDFS command

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935744#comment-14935744 ] Hadoop QA commented on HDFS-488: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935726#comment-14935726 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2403 (See [htt

[jira] [Commented] (HDFS-488) Implement moveToLocal HDFS command

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935680#comment-14935680 ] Hadoop QA commented on HDFS-488: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935653#comment-14935653 ] Casey Brotherton commented on HDFS-9100: Patch is limited to Dispatcher.java pre-

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935648#comment-14935648 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1199 (See [https://

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935630#comment-14935630 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #468 (See [htt

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935621#comment-14935621 ] Hadoop QA commented on HDFS-9100: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

2015-09-29 Thread Pooja Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pooja Gupta updated HDFS-488: - Attachment: HDFS-448-1.patch > Implement moveToLocal HDFS command > --- > >

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

2015-09-29 Thread Pooja Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pooja Gupta updated HDFS-488: - Attachment: (was: HDFS-488.001.patch) > Implement moveToLocal HDFS command > --

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

2015-09-29 Thread Pooja Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pooja Gupta updated HDFS-488: - Attachment: HDFS-488.001.patch Recursive delete of directory from HDFS after moveToLocal. > Implement moveT

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935566#comment-14935566 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #434 (See [htt

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935523#comment-14935523 ] Xiaobing Zhou commented on HDFS-8696: - New patch HDFS-8696.010.patch uploaded, thanks!

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Attachment: HDFS-8696.010.patch > Reduce the variances of latency of WebHDFS > --

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935519#comment-14935519 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2374 (See [https://

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935510#comment-14935510 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #460 (See

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935480#comment-14935480 ] Tsz Wo Nicholas Sze commented on HDFS-9053: --- > So totally 12+4+4+4+4+4+4 = 32 byt

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935472#comment-14935472 ] Haohui Mai commented on HDFS-8696: -- The patch no longer applies to trunk anymore. Can you

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935463#comment-14935463 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2402 (See [htt

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935455#comment-14935455 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-trunk-Commit #8541 (See [https:

[jira] [Updated] (HDFS-9166) Move hftp / hsftp filesystem to hfds-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9166: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935450#comment-14935450 ] Surendra Singh Lilhore commented on HDFS-9151: -- Thanks [~templedf] for reviews

[jira] [Commented] (HDFS-9166) Move hftp / hsftp filesystem to hfds-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935451#comment-14935451 ] Haohui Mai commented on HDFS-9166: -- +1. Looks like test-patch somehow fails to recognizes

[jira] [Updated] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9172: --- Assignee: Zhe Zhang (was: Rakesh R) > Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-

[jira] [Updated] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9165: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935427#comment-14935427 ] Haohui Mai commented on HDFS-9165: -- +1 > Move entries in META-INF/services/o.a.h.fs.FileS

[jira] [Updated] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9165: - Summary: Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client (was: Move the rest of the e

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935404#comment-14935404 ] Haohui Mai commented on HDFS-9170: -- The main benefit that (2) offers is that the implement

[jira] [Commented] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935392#comment-14935392 ] Hadoop QA commented on HDFS-9174: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935346#comment-14935346 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #459 (See

[jira] [Created] (HDFS-9177) TestTextCommand: use mkdirs rather than mkdir to create test directory

2015-09-29 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9177: -- Summary: TestTextCommand: use mkdirs rather than mkdir to create test directory Key: HDFS-9177 URL: https://issues.apache.org/jira/browse/HDFS-9177 Projec

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935327#comment-14935327 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1197 (See [https://

[jira] [Assigned] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-9176: -- Assignee: Daniel Templeton > TestDirectoryScanner#testThrottling often fails. >

[jira] [Commented] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935305#comment-14935305 ] Daniel Templeton commented on HDFS-9176: It's probably the timing-based nature of t

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935304#comment-14935304 ] Yongjun Zhang commented on HDFS-9100: - Thanks [~caseyjbrotherton]. +1 on rev3 pending

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Status: Patch Available (was: Open) > HDFS Balancer does not respect dfs.client.use.datanode.h

[jira] [Commented] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935281#comment-14935281 ] Yongjun Zhang commented on HDFS-8384: - HI [~szetszwo], [~jingzhao] , Thanks for your e

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935275#comment-14935275 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #466 (See [htt

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Attachment: HDFS-9100.003.patch > HDFS Balancer does not respect dfs.client.use.datanode.hostna

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935239#comment-14935239 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-trunk-Commit #8539 (See [https:

[jira] [Updated] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9141: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935228#comment-14935228 ] Yi Liu commented on HDFS-9141: -- The test failures are unrelated, and checkstyle is about the f

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935212#comment-14935212 ] Yi Liu commented on HDFS-9053: -- The three test failures are not related. > Support large dire

[jira] [Updated] (HDFS-9175) Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public

2015-09-29 Thread Santhosh G Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh G Nayak updated HDFS-9175: --- Attachment: HDFS-9175.1.patch Attaching a patch containing the proposed changes. > Change scop

[jira] [Created] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Yi Liu (JIRA)
Yi Liu created HDFS-9176: Summary: TestDirectoryScanner#testThrottling often fails. Key: HDFS-9176 URL: https://issues.apache.org/jira/browse/HDFS-9176 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9175) Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public

2015-09-29 Thread Santhosh G Nayak (JIRA)
Santhosh G Nayak created HDFS-9175: -- Summary: Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public Key: HDFS-9175 URL: https:

[jira] [Updated] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9174: - Status: Patch Available (was: Open) > Fix the latest findbugs of FSOutputSummer.tracer and > DirectoryScanner$Rep

[jira] [Updated] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9174: - Attachment: HDFS-9174.001.patch > Fix the latest findbugs of FSOutputSummer.tracer and > DirectoryScanner$ReportCo

[jira] [Created] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
Yi Liu created HDFS-9174: Summary: Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread Key: HDFS-9174 URL: https://issues.apache.org/jira/browse/HDFS-9174 Projec

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Status: Open (was: Patch Available) > HDFS Balancer does not respect dfs.client.use.datanode.h

[jira] [Commented] (HDFS-7663) Erasure Coding: Append on striped file

2015-09-29 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935119#comment-14935119 ] Walter Su commented on HDFS-7663: - Thank you for your detail information. Extending writeBl

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935117#comment-14935117 ] Daniel Templeton commented on HDFS-9151: +1 (non-binding) > Mover should print the

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935101#comment-14935101 ] Hadoop QA commented on HDFS-9053: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935071#comment-14935071 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2373 (See [https://

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935046#comment-14935046 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #433 (See [htt

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935008#comment-14935008 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #458 (See

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934986#comment-14934986 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2401 (See [htt

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934958#comment-14934958 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1196 (See [https://

[jira] [Resolved] (HDFS-8603) in NN WEBUI,some point which show time is using the system local language.in Chinese env,will have Chinese in NN UI

2015-09-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore resolved HDFS-8603. -- Resolution: Implemented This is fixed as part of HDFS-8388 > in NN WEBUI,some po

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934933#comment-14934933 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #465 (See [htt

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934931#comment-14934931 ] Rakesh R commented on HDFS-8449: Nice work, thanks [~libo-intel] for the patch. I've few co

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934926#comment-14934926 ] Hadoop QA commented on HDFS-8676: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934922#comment-14934922 ] Hadoop QA commented on HDFS-9141: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934904#comment-14934904 ] Hadoop QA commented on HDFS-8941: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9165) Move the rest of the entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934875#comment-14934875 ] Hadoop QA commented on HDFS-9165: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Component/s: tracing > update htrace version to 4.0.1 > --

[jira] [Commented] (HDFS-9114) NameNode and DataNode metric log file name should follow the other log file name format.

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934870#comment-14934870 ] Hadoop QA commented on HDFS-9114: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934863#comment-14934863 ] Yi Liu commented on HDFS-8859: -- Committed to trunk and branch-2, thanks [~szetszwo], [~umamahe

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934861#comment-14934861 ] Hudson commented on HDFS-8859: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8538 (See [https:

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934862#comment-14934862 ] Yi Liu commented on HDFS-9053: -- Update the patch to address Jing's comments: 1. Call {{addOrRe

[jira] [Commented] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Zhe Zhang (JIRA)
m/zhe-thoughts/hadoop/tree/HDFS-7285-20150929 I think we can use this JIRA to track some non-ideal code changes. For example, I added {{StripedBlockUtil#getBlockIndex}} to avoid creating a whole new {{BlockIdManagerClient}} just for this method. Another case is in {{ErasureCodingWorker#newBlockRe

[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Attachment: HDFS-9053.003.patch > Support large directories efficiently using B-Tree >

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934852#comment-14934852 ] Hadoop QA commented on HDFS-9151: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9158) [OEV-Doc] : Document does not mention about "-f" and "-r" options

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934839#comment-14934839 ] Hadoop QA commented on HDFS-9158: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934836#comment-14934836 ] Yi Liu commented on HDFS-8859: -- Thanks Uma, since the new patch only removes the unused import

[jira] [Updated] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2015-09-29 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8449: Attachment: HDFS-8449-002.patch reduce metrics number from 3 to 2. The count of failed tasks can be calculated by to

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934826#comment-14934826 ] Hadoop QA commented on HDFS-1172: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934783#comment-14934783 ] Yi Liu commented on HDFS-9141: -- +1 pending Jenkins, Thanks Uma. > Thread leak in Datanode#ref

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934782#comment-14934782 ] Colin Patrick McCabe commented on HDFS-9170: I don't have any objections to mov

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934768#comment-14934768 ] Uma Maheswara Rao G commented on HDFS-8859: --- Thanks Yi, +1 on the latest patch

[jira] [Updated] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8941: --- Attachment: HDFS-8941-03.patch Rebased the patch and attached to the jira, as HDFS-8740 has moved the {{Distri

[jira] [Commented] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934747#comment-14934747 ] Rakesh R commented on HDFS-9172: Great, that looks fine to me. > Erasure Coding: Move DFSS

<    1   2