[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693574#comment-14693574 ] Hudson commented on HDFS-8805: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #282 (See

[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693655#comment-14693655 ] Hudson commented on HDFS-8805: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #274 (See

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693657#comment-14693657 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #274 (See

[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693586#comment-14693586 ] Hudson commented on HDFS-8805: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2231 (See

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693588#comment-14693588 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2231 (See

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693576#comment-14693576 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #282 (See

[jira] [Commented] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693629#comment-14693629 ] Yi Liu commented on HDFS-8859: -- {{TestRestartDFS}} is related to {{003}} patch, but {{002}}

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693681#comment-14693681 ] Allen Wittenauer commented on HDFS-8078: [~nkedel]: please take a second to check

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Description: The log in FSNamesystem.getCorruptFiles will print out whole stack trace, which makes

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694104#comment-14694104 ] Xiaobing Zhou commented on HDFS-8855: - [~bobhansen] I was using the sequential work

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

2015-08-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Attachment: HDFS-8823.004.patch Move replication factor into individual blocks

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694192#comment-14694192 ] Xiaobing Zhou commented on HDFS-8861: - Removed inaccurate description. Remove

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

2015-08-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Attachment: HDFS-8823.003.patch Move replication factor into individual blocks

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694416#comment-14694416 ] Chris Douglas commented on HDFS-8155: - Minor points; someone should look at the OAuth

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8861: -- Priority: Minor (was: Major) Component/s: (was: HDFS)

[jira] [Created] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

2015-08-12 Thread Chris Trezzo (JIRA)
Chris Trezzo created HDFS-8890: -- Summary: Allow admin to specify which blockpools the balancer should run on Key: HDFS-8890 URL: https://issues.apache.org/jira/browse/HDFS-8890 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-08-12 Thread Victor Malov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694310#comment-14694310 ] Victor Malov commented on HDFS-8052: - Am I correct that this WebHdfsFilesystem

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8879: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694134#comment-14694134 ] Tsz Wo Nicholas Sze commented on HDFS-8861: --- The log in

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694220#comment-14694220 ] Jitendra Nath Pandey commented on HDFS-8861: It seems HDFS-8522 addresses this

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694247#comment-14694247 ] Xiaobing Zhou commented on HDFS-8861: - No, HDFS-8522 didn't handle getCorruptFiles.

[jira] [Commented] (HDFS-8883) NameNode Metrics : Add FSNameSystem lock Queue Length

2015-08-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694273#comment-14694273 ] Anu Engineer commented on HDFS-8883: None of the test failures seem to be related to

[jira] [Commented] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-08-12 Thread Victor Malov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694314#comment-14694314 ] Victor Malov commented on HDFS-8052: - In this way it could just install one simple

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694121#comment-14694121 ] Tsz Wo Nicholas Sze commented on HDFS-8861: --- {code} - LOG.warn(Get corrupt

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694137#comment-14694137 ] Nate Edel commented on HDFS-8078: - Ouch! My apologies. HDFS client gets errors trying to

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Release Note: was: Resubmitting NetUtils version of patch, with bugfixes. Older version of patch

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Description: The log in FSNamesystem.getCorruptFiles will print out too many messages mixed with

[jira] [Commented] (HDFS-8883) NameNode Metrics : Add FSNameSystem lock Queue Length

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694229#comment-14694229 ] Hadoop QA commented on HDFS-8883: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Work started] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

2015-08-12 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8890 started by Chris Trezzo. -- Allow admin to specify which blockpools the balancer should run on

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694339#comment-14694339 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-trunk-Commit #8289 (See

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Open (was: Patch Available) HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: dummy.patch Dummy patch to NetUtils.java to see if we break the same tests with no functional

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Patch Available (was: Open) HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694637#comment-14694637 ] Hadoop QA commented on HDFS-7649: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-08-12 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694504#comment-14694504 ] Joep Rottinghuis commented on HDFS-8791: Seems related to (or perhaps dup of)

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694568#comment-14694568 ] Brahma Reddy Battula commented on HDFS-7649: [~arpitagarwal] Based on your

[jira] [Updated] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7649: --- Status: Patch Available (was: Open) Multihoming docs should emphasize using

[jira] [Updated] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7649: --- Attachment: HDFS-7649.patch Multihoming docs should emphasize using hostnames in

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694575#comment-14694575 ] Akira AJISAKA commented on HDFS-8622: - +1, the test failure looks unrelated to the

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694522#comment-14694522 ] Hadoop QA commented on HDFS-8078: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694556#comment-14694556 ] Hadoop QA commented on HDFS-8823: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694557#comment-14694557 ] Nate Edel commented on HDFS-8078: - OK, the tests above are clearly broken in trunk, since

[jira] [Created] (HDFS-8891) HDFS concat should keep srcs order

2015-08-12 Thread Yong Zhang (JIRA)
Yong Zhang created HDFS-8891: Summary: HDFS concat should keep srcs order Key: HDFS-8891 URL: https://issues.apache.org/jira/browse/HDFS-8891 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694728#comment-14694728 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-trunk-Commit #8292 (See

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694545#comment-14694545 ] Allen Wittenauer commented on HDFS-8854: That's because the JIRA is also a branch

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Open (was: Patch Available) HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693024#comment-14693024 ] Hadoop QA commented on HDFS-8854: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-08-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287-HDFS-7285.02.patch DFSStripedOutputStream.writeChunk should not wait for writing

[jira] [Updated] (HDFS-8808) dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby

2015-08-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8808: Attachment: HDFS-8808-02.patch The failed tests are unrelated and all pass locally. Updating patch to fix

[jira] [Commented] (HDFS-8880) NameNode metrics logging

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692990#comment-14692990 ] Hadoop QA commented on HDFS-8880: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8854: Attachment: HDFS-8854-HDFS-7285-merge.03.patch Thanks Walter for the update! +1 on the latest patch, pending

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693005#comment-14693005 ] Akira AJISAKA commented on HDFS-8388: - bq. Is it possible to use moment.js to parse the

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693052#comment-14693052 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-trunk-Commit #8287 (See

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693067#comment-14693067 ] Hadoop QA commented on HDFS-8854: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693093#comment-14693093 ] Rakesh R commented on HDFS-8854: While applying patch jenkins is not picking the

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: HDFS-8078.14.patch HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-08-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693096#comment-14693096 ] Kai Sasaki commented on HDFS-8287: -- [~rakeshr] Thank you so much for great advice!

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693111#comment-14693111 ] Akira AJISAKA commented on HDFS-8388: - I'm thinking moment-timezone.js can parse the

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Release Note: Resubmitting NetUtils version of patch, with bugfixes. Older version of patch seems to need

[jira] [Updated] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8887: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8887: -- Attachment: HDFS-8887.002.patch Whitespace-only changes patch attached. javac warnings are all because

[jira] [Updated] (HDFS-8889) Erasure Coding: cover more test situations of datanode failure during client writing

2015-08-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8889: Description: Currently 9 streamers are working together for the client writing. A small number of failed datanodes

[jira] [Commented] (HDFS-8889) Erasure Coding: cover more test situations of datanode failure during client writing

2015-08-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693047#comment-14693047 ] Li Bo commented on HDFS-8889: - Currently 9 streamers are working together for the client

[jira] [Updated] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8863: Summary: The remaining space check in BlockPlacementPolicyDefault is flawed (was: The remiaing

[jira] [Commented] (HDFS-8852) HDFS architecture documentation of version 2.x is outdated about append write support

2015-08-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693200#comment-14693200 ] Akira AJISAKA commented on HDFS-8852: - Thanks [~ajithshetty] for updating the patch.

[jira] [Commented] (HDFS-8808) dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693226#comment-14693226 ] Hadoop QA commented on HDFS-8808: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693223#comment-14693223 ] Akira AJISAKA commented on HDFS-8622: - Thanks [~jagadesh.kiran] for updating the patch.

[jira] [Commented] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693857#comment-14693857 ] Tsz Wo Nicholas Sze commented on HDFS-8859: --- The idea sound good. Some comments:

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693339#comment-14693339 ] Hadoop QA commented on HDFS-8078: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693340#comment-14693340 ] Hadoop QA commented on HDFS-8859: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693355#comment-14693355 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #285 (See

[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693353#comment-14693353 ] Hudson commented on HDFS-8805: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #285 (See

[jira] [Updated] (HDFS-7492) If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads

2015-08-12 Thread Kiran Kumar M R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kiran Kumar M R updated HDFS-7492: -- Assignee: (was: Kiran Kumar M R) If multiple threads call FsVolumeList#checkDirs at the

[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693349#comment-14693349 ] Hudson commented on HDFS-8805: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1015 (See

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693351#comment-14693351 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1015 (See

[jira] [Updated] (HDFS-7899) Improve EOF error message

2015-08-12 Thread Kiran Kumar M R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kiran Kumar M R updated HDFS-7899: -- Assignee: (was: Kiran Kumar M R) Improve EOF error message -

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2015-08-12 Thread Kiran Kumar M R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kiran Kumar M R updated HDFS-8312: -- Assignee: (was: Kiran Kumar M R) Trash does not descent into child directories to check for

[jira] [Updated] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-12 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8622: --- Attachment: HDFS-8622-10.patch Hi [~ajisakaa] updated the review comment. Pls check

[jira] [Commented] (HDFS-8887) Expose storage type and storage ID in BlockLocation

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693478#comment-14693478 ] Hudson commented on HDFS-8887: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2212 (See

[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693476#comment-14693476 ] Hudson commented on HDFS-8805: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2212 (See

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693961#comment-14693961 ] Hadoop QA commented on HDFS-8622: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8775) SASL support for data transfer protocol in libhdfspp

2015-08-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694015#comment-14694015 ] Haohui Mai commented on HDFS-8775: -- Thanks for the reviews. The code basically blindly

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693887#comment-14693887 ] Surendra Singh Lilhore commented on HDFS-8388: -- Thanks [~ajisakaa] for

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694000#comment-14694000 ] Allen Wittenauer commented on HDFS-8854: Caveat: this comment applies to the

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694009#comment-14694009 ] Zhe Zhang commented on HDFS-8854: - Thanks Allen for the comment. We did try different

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693958#comment-14693958 ] Zhe Zhang commented on HDFS-8833: - Thanks Jing for the helpful feedback. bq. Will we allow

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693973#comment-14693973 ] Zhe Zhang commented on HDFS-8854: - Thanks Rakesh for pointing this out. Since this is a

[jira] [Updated] (HDFS-8883) NameNode Metrics : Add FSNameSystem lock Queue Length

2015-08-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8883: --- Status: Patch Available (was: Open) NameNode Metrics : Add FSNameSystem lock Queue Length