[jira] [Updated] (HDFS-9793) upgrade or remove guava dependency

2016-02-11 Thread PJ Fanning (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PJ Fanning updated HDFS-9793: - Description: http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-hdfs/2.7.1 indicates a dependency

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: HDFS-9787-v004.patch > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to

[jira] [Commented] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144197#comment-15144197 ] Hadoop QA commented on HDFS-9797: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-7326) Add documentation for hdfs debug commands

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7326: --- Release Note: (was: Added documentation for the hdfs debug commands to the following URL in t

[jira] [Commented] (HDFS-9773) Remove dead code related to SimulatedFSDataset in tests

2016-02-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144187#comment-15144187 ] Akira AJISAKA commented on HDFS-9773: - Thanks [~brahmareddy] for creating the patch. Wo

[jira] [Commented] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144182#comment-15144182 ] Inigo Goiri commented on HDFS-9797: --- Thanks [~asuresh] for the feedback, I attached an up

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Status: In Progress (was: Patch Available) > RequestHedgingProxyProvider is too verbose with Standby exc

[jira] [Commented] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2016-02-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144171#comment-15144171 ] Vinayakumar B commented on HDFS-7452: - [~brahmareddy], I think you can exclude the Log

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Attachment: HDFS-9797-v001.patch Tackling [~asuresh] comments (and refixing javadoc issues, even though t

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Attachment: (was: HDFS-9797-v001.patch) > RequestHedgingProxyProvider is too verbose with Standby exc

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Attachment: HDFS-9797-v001.patch Tackling [~asuresh]'s comments > RequestHedgingProxyProvider is too ver

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Attachment: (was: HDFS-9797-v001.patch) > RequestHedgingProxyProvider is too verbose with Standby exc

[jira] [Commented] (HDFS-9768) Reuse objectMapper instance in HDFS to improve the performance

2016-02-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144163#comment-15144163 ] Akira AJISAKA commented on HDFS-9768: - Thanks [~linyiqun] for creating the patch. The f

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2016-02-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144160#comment-15144160 ] Vinayakumar B commented on HDFS-9038: - Ping [~cnauroth]. > DFS reserved space is erron

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Attachment: HDFS-9797-v001.patch Tackling [~asuresh]'s comments. > RequestHedgingProxyProvider is too ve

[jira] [Commented] (HDFS-9425) Expose number of blocks per volume as a metric

2016-02-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144153#comment-15144153 ] Vinayakumar B commented on HDFS-9425: - Thanks [~brahmareddy] for the update. I have ju

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144142#comment-15144142 ] Hadoop QA commented on HDFS-9787: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144096#comment-15144096 ] Chris Nauroth commented on HDFS-9711: - Hi [~lmccay]. I hear you! I was unsure about v

[jira] [Commented] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144090#comment-15144090 ] Arun Suresh commented on HDFS-9797: --- Makes Sense.. Thanks for raising this [~elgoiri] !!

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Status: Patch Available (was: In Progress) > RequestHedgingProxyProvider is too verbose with Standby exc

[jira] [Commented] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144043#comment-15144043 ] Hudson commented on HDFS-9790: -- FAILURE: Integrated in Hadoop-trunk-Commit #9289 (See [https:

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Attachment: HDFS-9797-v000.patch Proposal to check if it is caused by an standby exception and just show

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Status: In Progress (was: Patch Available) > RequestHedgingProxyProvider is too verbose with Standby exc

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Status: Patch Available (was: Open) > RequestHedgingProxyProvider is too verbose with Standby exceptions

[jira] [Commented] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144029#comment-15144029 ] Hudson commented on HDFS-9795: -- FAILURE: Integrated in Hadoop-trunk-Commit #9288 (See [https:

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144030#comment-15144030 ] Hudson commented on HDFS-9780: -- FAILURE: Integrated in Hadoop-trunk-Commit #9288 (See [https:

[jira] [Updated] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9790: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144027#comment-15144027 ] Inigo Goiri commented on HDFS-9797: --- With HDFS-6440, now we can have more than two NNs. W

[jira] [Commented] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144025#comment-15144025 ] Hadoop QA commented on HDFS-9549: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-11 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-9797: - Summary: RequestHedgingProxyProvider is too verbose with Standby exceptions Key: HDFS-9797 URL: https://issues.apache.org/jira/browse/HDFS-9797 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9795: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) The

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144019#comment-15144019 ] Karthik Kambatla commented on HDFS-9780: Checking this in. > RollingFileSystemSin

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-11 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144011#comment-15144011 ] Larry McCay commented on HDFS-9711: --- Hey [~cnauroth] - I love the objectives of this and

[jira] [Commented] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144004#comment-15144004 ] Hadoop QA commented on HDFS-9790: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: HDFS-9787-v003.patch > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9549: -- Labels: unittest (was: ) > TestCacheDirectives#testExceedsCapacity is flaky > --

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143989#comment-15143989 ] Hadoop QA commented on HDFS-9787: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143983#comment-15143983 ] Daniel Templeton commented on HDFS-9780: The test failure is unrelated. [~rkanter]

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143978#comment-15143978 ] Hadoop QA commented on HDFS-9787: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143969#comment-15143969 ] Hadoop QA commented on HDFS-9794: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143945#comment-15143945 ] Hadoop QA commented on HDFS-9795: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143944#comment-15143944 ] Arpit Agarwal commented on HDFS-9790: - +1 for the v2 patch, pending Jenkins. > HDFS Ba

[jira] [Updated] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9796: -- Affects Version/s: 2.7.0 > Add throttler for datanode bandwidth > >

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-02-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143908#comment-15143908 ] Junping Du commented on HDFS-9629: -- Add 2.7.3 and 2.8.0 in fix version given it is already

[jira] [Updated] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-02-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9629: - Fix Version/s: 2.7.3 2.8.0 > Update the footer of Web UI to show year 2016 > ---

[jira] [Commented] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143903#comment-15143903 ] Hadoop QA commented on HDFS-9754: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9549: Attachment: (was: HDFS-9549.01.patch) > TestCacheDirectives#testExceedsCapacity is flaky > --

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9549: Status: Patch Available (was: Open) > TestCacheDirectives#testExceedsCapacity is flaky > ---

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9549: Attachment: TestCacheDirectives.rtf > TestCacheDirectives#testExceedsCapacity is flaky >

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9549: Attachment: HDFS-9549.01.patch > TestCacheDirectives#testExceedsCapacity is flaky > -

[jira] [Commented] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143901#comment-15143901 ] Xiao Chen commented on HDFS-9549: - Below is the excerpt from the log, HTH. {noformat} -- ca

[jira] [Updated] (HDFS-6297) Add CLI testcases to reflect new features of dfs and dfsadmin

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6297: --- Release Note: (was: Committed to the trunk and branch-2. Thanks Dasha!) > Add CLI testcases t

[jira] [Updated] (HDFS-6471) Make moveFromLocal CLI testcases to be non-disruptive

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6471: --- Release Note: (was: Committed to trunk and merged into branch-2. Thanks Dasha!) > Make moveF

[jira] [Updated] (HDFS-7046) HA NN can NPE upon transition to active

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7046: --- Release Note: (was: Thanks for the reviews, gentlemen. It's been committed to trunk and branc

[jira] [Updated] (HDFS-7091) Add forwarding constructor for INodeFile for existing callers

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7091: --- Release Note: (was: Thanks Nicholas! Revised title and committed to the feature branch.) > A

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9549: Attachment: HDFS-9549.01.patch This one is a bit tricky to me. IIUC: - {{testExceedsCapacity}} waits for DNs

[jira] [Updated] (HDFS-8866) Typo in docs: Rumtime -> Runtime

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8866: --- Release Note: (was: HDFS-8866 Correct typo in WebHDFS.md) > Typo in docs: Rumtime -> Runtime

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143870#comment-15143870 ] Hadoop QA commented on HDFS-9780: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-11 Thread Guocui Mi (JIRA)
Guocui Mi created HDFS-9796: --- Summary: Add throttler for datanode bandwidth Key: HDFS-9796 URL: https://issues.apache.org/jira/browse/HDFS-9796 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9790: Attachment: HDFS-9790.002.patch Thanks [~arpitagarwal] for review. I posted patch V002 for it. > HDF

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143848#comment-15143848 ] Jing Zhao commented on HDFS-9794: - Yeah, I think we should check if {{DFSOutputStream}} has

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143844#comment-15143844 ] Mingliang Liu commented on HDFS-9794: - Thanks for working on this, [~jingzhao]. Determi

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: HDFS-9787-v002.patch > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143833#comment-15143833 ] Guocui Mi commented on HDFS-9787: - Sure, Just submit new patch with unittest. > SNNs stop

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: (was: HDFS-9787-v001.patch) > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer c

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: HDFS-9787-v001.patch > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: (was: HDFS-9786-v000.patch) > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer c

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-11 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: HDFS-9787-v001.patch > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to

[jira] [Commented] (HDFS-9644) Update encryption documentation to reflect nested EZs

2016-02-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143821#comment-15143821 ] Andrew Wang commented on HDFS-9644: --- LGTM, nice work here. +1. > Update encryption docum

[jira] [Updated] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9795: Attachment: HDFS-9795.02.patch Thanks, [~andrew.wang]. I updated the patch to address your comment..

[jira] [Updated] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9795: Status: Patch Available (was: Open) > OIV Delimited should show which files are ACL-enabled. > -

[jira] [Updated] (HDFS-9637) Tests for RollingFileSystemSink

2016-02-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-9637: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Res

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143794#comment-15143794 ] Andrew Wang commented on HDFS-9688: --- The other thing is that we might add a test for dele

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143792#comment-15143792 ] Andrew Wang commented on HDFS-9688: --- This looks good overall, but what are we going to do

[jira] [Commented] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143783#comment-15143783 ] Andrew Wang commented on HDFS-9795: --- LGTM except for one nit, I think we should print ""

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143778#comment-15143778 ] Zhe Zhang commented on HDFS-9603: - Thanks Rui for the work. With this JIRA and HDFS-8020, I

[jira] [Updated] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9795: Attachment: HDFS-9795.01.patch Upload the patch to indicate the file has ACL entries in OIV delimited

[jira] [Commented] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143759#comment-15143759 ] Hadoop QA commented on HDFS-9790: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9795) OIV Delimited should show which files are ACL-enabled.

2016-02-11 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-9795: --- Summary: OIV Delimited should show which files are ACL-enabled. Key: HDFS-9795 URL: https://issues.apache.org/jira/browse/HDFS-9795 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143749#comment-15143749 ] Hadoop QA commented on HDFS-9688: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9794: Attachment: HDFS-9794.001.patch The 001 patch includes a change in BlockManager so that we can run EC related

[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: HDFS-9688-branch-2.8.03.patch Attaching a duplicate patch, renamed with 2.8 suffix to work with Y

[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: (was: HDFS-9688-branch-2.8.02.patch) > Test the effect of nested encryption zones in HDFS dow

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143733#comment-15143733 ] Hadoop QA commented on HDFS-9794: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2016-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9754: Attachment: HDFS-9754.002.patch Thanks again for the review, Nicholas! Rebase the patch. > Avoid unnecessary

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143725#comment-15143725 ] Robert Kanter commented on HDFS-9780: - +1 will commit once Jenkins says it's okay. > R

[jira] [Commented] (HDFS-9790) HDFS Balancer should exit with a proper message if upgrade is not finalized

2016-02-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143714#comment-15143714 ] Arpit Agarwal commented on HDFS-9790: - Hi [~xiaobingo], thanks for fixing this. # Error

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143706#comment-15143706 ] Jing Zhao commented on HDFS-9794: - The fix is to move the {{closeThreads}} call into the fi

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-02-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143703#comment-15143703 ] Arpit Agarwal commented on HDFS-9534: - Thanks for updating the patch [~xiaobingo]. My c

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143702#comment-15143702 ] Hadoop QA commented on HDFS-9688: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9794: Status: Patch Available (was: Open) > Streamer threads may leak if failure happens when closing the striped

[jira] [Updated] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9794: Attachment: HDFS-9794.000.patch > Streamer threads may leak if failure happens when closing the striped > ou

[jira] [Created] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9794: --- Summary: Streamer threads may leak if failure happens when closing the striped outputstream Key: HDFS-9794 URL: https://issues.apache.org/jira/browse/HDFS-9794 Project: Hadoop

[jira] [Updated] (HDFS-8226) Non-HA rollback compatibility broken

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8226: --- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Non-HA rollback compatibility bro

[jira] [Updated] (HDFS-7457) DatanodeID generates excessive garbage

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7457: --- Release Note: (was: Thanks for the reviews, gentlemen. I've committed this to trunk and branc

[jira] [Updated] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8001: --- Release Note: (was: patch is fully backward compatible.) > RpcProgramNfs3 : wrong parsing of

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8486: --- Release Note: Public service notice: * Every restart of a 2.6.x or 2.7.0 DN incurs a risk of u

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143678#comment-15143678 ] Karthik Kambatla commented on HDFS-9780: +1 pending Jenkins. > RollingFileSystemS

[jira] [Updated] (HDFS-9667) StorageType: SSD precede over DISK

2016-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9667: --- Fix Version/s: (was: 2.6.0) > StorageType: SSD precede over DISK >

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143633#comment-15143633 ] Zhe Zhang commented on HDFS-9688: - I also updated target versions to the maint releases of

  1   2   >