[jira] [Updated] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11737: - Priority: Critical (was: Major) > Backport HDFS-7964 to branch-2.7: add support for async edit logging >

[jira] [Updated] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11643: - Attachment: HDFS-11643.007.patch Add SHOULD_REPLICATE CreateFlag to indicate create a replicate file > Ba

[jira] [Updated] (HDFS-11674) reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered

2017-05-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11674: - Attachment: HDFS-11674-02.patch Updated the patch. Please review. > reserveSpaceForReplicas is no

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-05-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Attachment: HDFS-11708-03.patch Updated the patch. > positional read will fail if replicas moved

[jira] [Commented] (HDFS-11710) hadoop-hdfs-native-client build fails in trunk in Windows after HDFS-11529

2017-05-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992355#comment-15992355 ] Hudson commented on HDFS-11710: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11710) hadoop-hdfs-native-client build fails in trunk in Windows after HDFS-11529

2017-05-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11710: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Status:

[jira] [Resolved] (HDFS-9900) The implication of auth-conf is not followed in optimized HDFS data transfer encryption

2017-05-01 Thread Jerry Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Chen resolved HDFS-9900. -- Resolution: Duplicate > The implication of auth-conf is not followed in optimized HDFS data transfer > e

[jira] [Updated] (HDFS-11710) hadoop-hdfs-native-client build fails in trunk in Windows after HDFS-11529

2017-05-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11710: - Summary: hadoop-hdfs-native-client build fails in trunk in Windows after HDFS-11529 (was: hadoop-

[jira] [Commented] (HDFS-11710) hadoop-hdfs-native-client build fails in trunk after HDFS-11529

2017-05-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992335#comment-15992335 ] Vinayakumar B commented on HDFS-11710: -- +1, Compilation and unit tests both passed.

[jira] [Assigned] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HDFS-11687: Assignee: Lei (Eddy) Xu > Add new public encryption APIs required by Hive > ---

[jira] [Commented] (HDFS-11693) Ozone: Add archive support to containers

2017-05-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992291#comment-15992291 ] Weiwei Yang commented on HDFS-11693: Thanks [~anu] for working on this. I have some co

[jira] [Commented] (HDFS-11728) Ozone: add the DB names to OzoneConsts

2017-05-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992119#comment-15992119 ] Weiwei Yang commented on HDFS-11728: Committed to the feature branch, thanks [~vagaryc

[jira] [Updated] (HDFS-11728) Ozone: add the DB names to OzoneConsts

2017-05-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11728: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target Versi

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992111#comment-15992111 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-11728) Ozone: add the DB names to OzoneConsts

2017-05-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992106#comment-15992106 ] Weiwei Yang commented on HDFS-11728: Straightforward change, looks good to me. +1. I w

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992065#comment-15992065 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992073#comment-15992073 ] Hadoop QA commented on HDFS-11732: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991981#comment-15991981 ] Konstantin Shvachko commented on HDFS-11717: Well if it is an error, then thro

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991964#comment-15991964 ] SammiChen commented on HDFS-11643: -- Thanks [~jojochuang] & [~andrew.wang] for review the

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Status: Open (was: Patch Available) > In Hadoop 3, make FileStatus serialize itself via protobuf > -

[jira] [Commented] (HDFS-7048) Incorrect Dispatcher#Source wait/notify leads to early termination

2017-05-01 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991943#comment-15991943 ] Chengbing Liu commented on HDFS-7048: - Thanks [~shv] > Incorrect Dispatcher#Source wai

[jira] [Commented] (HDFS-7048) Incorrect Dispatcher#Source wait/notify leads to early termination

2017-05-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991924#comment-15991924 ] Konstantin Shvachko commented on HDFS-7048: --- Hey [~chengbing.liu]. I added you to

[jira] [Assigned] (HDFS-7048) Incorrect Dispatcher#Source wait/notify leads to early termination

2017-05-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reassigned HDFS-7048: - Assignee: Chengbing Liu > Incorrect Dispatcher#Source wait/notify leads to early t

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991914#comment-15991914 ] Chris Douglas commented on HDFS-10630: -- Thanks for the update. Only a few, minor poin

[jira] [Commented] (HDFS-9005) Provide configuration support for upgrade domain

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991877#comment-15991877 ] Hadoop QA commented on HDFS-9005: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-11735) Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11735: --- Component/s: ozone > Ozone: In Ratis, leader should validate ContainerCommandRequestPr

[jira] [Updated] (HDFS-11735) Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11735: --- Attachment: HDFS-11735-HDFS-7240.20170501.patch HDFS-11735-HDFS-7240.20170501.patch: 1

[jira] [Commented] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-05-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991849#comment-15991849 ] Konstantin Shvachko commented on HDFS-11736: We should instead use something b

[jira] [Commented] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991855#comment-15991855 ] Zhe Zhang commented on HDFS-11732: -- I tested all unit test failures in the HDFS-8498 [re

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991842#comment-15991842 ] Zhe Zhang commented on HDFS-7964: - Sorry for keeping this JIRA open for long time. I create

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7964: Resolution: Fixed Status: Resolved (was: Patch Available) > Add support for async edit logging > ---

[jira] [Commented] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991840#comment-15991840 ] Hudson commented on HDFS-11593: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Created] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

2017-05-01 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-11737: Summary: Backport HDFS-7964 to branch-2.7: add support for async edit logging Key: HDFS-11737 URL: https://issues.apache.org/jira/browse/HDFS-11737 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991825#comment-15991825 ] Zhe Zhang commented on HDFS-8498: - It's actually valuable to add a similar test as in HDFS-

[jira] [Commented] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991824#comment-15991824 ] Wei-Chiu Chuang commented on HDFS-11732: Thanks for picking this up [~zhz]! > Bac

[jira] [Created] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-05-01 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-11736: -- Summary: OIV tests should not write outside 'target' directory. Key: HDFS-11736 URL: https://issues.apache.org/jira/browse/HDFS-11736 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11732: - Status: Patch Available (was: Open) > Backport HDFS-8498 to branch-2.7: Blocks can be committed with wron

[jira] [Commented] (HDFS-11734) Ozone: provide a way to validate ContainerCommandRequestProto

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991823#comment-15991823 ] Tsz Wo Nicholas Sze commented on HDFS-11734: I suggest we add the API to the C

[jira] [Updated] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11732: - Attachment: HDFS-11732-branch-2.7.00.patch > Backport HDFS-8498 to branch-2.7: Blocks can be committed wit

[jira] [Updated] (HDFS-11735) Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11735: --- Description: The leader should use the API provided by HDFS-11734 to check if a Contai

[jira] [Created] (HDFS-11735) Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11735: -- Summary: Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers Key: HDFS-11735 URL: https://issues.apache.org/jira/br

[jira] [Created] (HDFS-11734) Ozone: provide a way to validate ContainerCommandRequestProto

2017-05-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11734: -- Summary: Ozone: provide a way to validate ContainerCommandRequestProto Key: HDFS-11734 URL: https://issues.apache.org/jira/browse/HDFS-11734 Project: Hado

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.008.patch > In Hadoop 3, make FileStatus serialize itself via protobuf > --

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991782#comment-15991782 ] Andrew Wang commented on HDFS-11723: Thanks for the link. It's interesting that HDP re

[jira] [Updated] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11593: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 2.9.0

[jira] [Commented] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991741#comment-15991741 ] Xiaoyu Yao commented on HDFS-11593: --- +1 I will commit it shortly. > Change SimpleHttpP

[jira] [Commented] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991719#comment-15991719 ] Hadoop QA commented on HDFS-11593: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991713#comment-15991713 ] Xiaoyu Yao commented on HDFS-11723: --- [~andrew.wang], thanks for the linked document. Thi

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8498: Component/s: (was: namenode) hdfs-client > Blocks can be committed with wrong size > ---

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991705#comment-15991705 ] Hudson commented on HDFS-11714: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11714: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1 3.0.0-alpha3

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991684#comment-15991684 ] Andrew Wang commented on HDFS-11723: Looks like our comments raced, sorry didn't see y

[jira] [Created] (HDFS-11733) TestGetBlocks.getBlocksWithException() ignores datanode and size parameters.

2017-05-01 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-11733: -- Summary: TestGetBlocks.getBlocksWithException() ignores datanode and size parameters. Key: HDFS-11733 URL: https://issues.apache.org/jira/browse/HDFS-11733

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991682#comment-15991682 ] Zhe Zhang commented on HDFS-11714: -- [~kihwal] In most other JIRAs we don't wait for pre-c

[jira] [Comment Edited] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991670#comment-15991670 ] Kihwal Lee edited comment on HDFS-11714 at 5/1/17 10:24 PM: th

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991670#comment-15991670 ] Kihwal Lee commented on HDFS-11714: --- the branch-2 patch is identical except for the vari

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8498: Resolution: Fixed Target Version/s: 2.9.0, 3.0.0-alpha3, 2.8.1 (was: 2.9.0, 2.7.4, 3.0.0-alpha3)

[jira] [Commented] (HDFS-11731) Balancer.run() prints redundant included, excluded, source nodes.

2017-05-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991661#comment-15991661 ] Konstantin Shvachko commented on HDFS-11731: Introduced in HDFS-8826. Interest

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991665#comment-15991665 ] Kihwal Lee commented on HDFS-11714: --- You beat me. Thanks. > Newly added NN storage dire

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991664#comment-15991664 ] Kihwal Lee commented on HDFS-11714: --- TestPipelinesFailover, TestBalancer are passing. Th

[jira] [Commented] (HDFS-11730) libhdfs++: RPC connection should handle authorization error call id

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991662#comment-15991662 ] Hadoop QA commented on HDFS-11730: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-01 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-11732: Summary: Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size Key: HDFS-11732 URL: https://issues.apache.org/jira/browse/HDFS-11732 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991658#comment-15991658 ] Xiaoyu Yao commented on HDFS-11723: --- Thanks [~andrew.wang] and [~vagarychen] for the dis

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991659#comment-15991659 ] Andrew Wang commented on HDFS-11723: Hi [~vagarychen], thanks for the comment, Whethe

[jira] [Created] (HDFS-11731) Balancer.run() prints redundant included, excluded, source nodes.

2017-05-01 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-11731: -- Summary: Balancer.run() prints redundant included, excluded, source nodes. Key: HDFS-11731 URL: https://issues.apache.org/jira/browse/HDFS-11731 Project:

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991656#comment-15991656 ] Zhe Zhang commented on HDFS-11714: -- Thanks Kihwal! +1 on v3 trunk patch. > Newly added N

[jira] [Updated] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11717: --- Description: As a follow on to HDFS-11709 which made the StandbyCheckpointer more gracefully handle th

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709

2017-05-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991649#comment-15991649 ] Erik Krogen commented on HDFS-11717: [~shv], this log message is only if both the OIV

[jira] [Updated] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11717: --- Summary: Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991645#comment-15991645 ] Andrew Wang commented on HDFS-5042: --- It seems like Lucene has figured out how to fsync a

[jira] [Commented] (HDFS-11693) Ozone: Add archive support to containers

2017-05-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991635#comment-15991635 ] Xiaoyu Yao commented on HDFS-11693: --- Thanks [~anu] for working on the this. The patch lo

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991627#comment-15991627 ] Hadoop QA commented on HDFS-11714: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991595#comment-15991595 ] Chen Liang commented on HDFS-11723: --- Thanks [~andrew.wang] for the comments! Yes, this

[jira] [Reopened] (HDFS-9005) Provide configuration support for upgrade domain

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-9005: - > Provide configuration support for upgrade domain > > >

[jira] [Updated] (HDFS-9005) Provide configuration support for upgrade domain

2017-05-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9005: Status: Patch Available (was: Reopened) Thanks [~mingma]! Triggering pre-commit Jenkins. > Provide configur

[jira] [Commented] (HDFS-11728) Ozone: add the DB names to OzoneConsts

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991575#comment-15991575 ] Hadoop QA commented on HDFS-11728: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11593: - Status: Patch Available (was: Open) > Change SimpleHttpProxyHandler#exceptionCaught log level fro

[jira] [Commented] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991573#comment-15991573 ] Xiaobing Zhou commented on HDFS-11593: -- Posted initial patch for review. > Change Si

[jira] [Updated] (HDFS-11593) Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug

2017-05-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11593: - Attachment: HDFS-11593.000.patch > Change SimpleHttpProxyHandler#exceptionCaught log level from in

[jira] [Commented] (HDFS-11730) libhdfs++: RPC connection should handle authorization error call id

2017-05-01 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991535#comment-15991535 ] Xiaowei Zhu commented on HDFS-11730: +1. The fix looks good and useful. > libhdfs++:

[jira] [Commented] (HDFS-7541) Upgrade Domains in HDFS

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991533#comment-15991533 ] Kihwal Lee commented on HDFS-7541: -- Just found out I somehow clicked the evil "Assign to m

[jira] [Updated] (HDFS-11730) libhdfs++: RPC connection should handle authorization error call id

2017-05-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11730: --- Status: Patch Available (was: Open) > libhdfs++: RPC connection should handle authorization e

[jira] [Updated] (HDFS-11730) libhdfs++: RPC connection should handle authorization error call id

2017-05-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11730: --- Attachment: HDFS-11730.HDFS-8707.000.patch Simple fix. Not sure how to write a test that easi

[jira] [Created] (HDFS-11730) libhdfs++: RPC connection should handle authorization error call id

2017-05-01 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11730: -- Summary: libhdfs++: RPC connection should handle authorization error call id Key: HDFS-11730 URL: https://issues.apache.org/jira/browse/HDFS-11730 Project: Hadoop

[jira] [Assigned] (HDFS-7541) Upgrade Domains in HDFS

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-7541: Assignee: Ming Ma (was: Kihwal Lee) > Upgrade Domains in HDFS > --- > >

[jira] [Commented] (HDFS-11724) libhdfs compilation is broken on OS X

2017-05-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991520#comment-15991520 ] Hudson commented on HDFS-11724: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991505#comment-15991505 ] Andrew Wang commented on HDFS-11721: Hi Thomas, could you provide more information abo

[jira] [Commented] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991500#comment-15991500 ] Andrew Wang commented on HDFS-11723: Doesn't this depend on the EZ setup and applicati

[jira] [Updated] (HDFS-11724) libhdfs compilation is broken on OS X

2017-05-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11724: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-7850) distribute-excludes and refresh-namenodes update to new shell framework

2017-05-01 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991482#comment-15991482 ] Allen Wittenauer commented on HDFS-7850: HADOOP-9902 introduced hadoop-functions.sh

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991469#comment-15991469 ] Kihwal Lee commented on HDFS-11714: --- Filed HDFS-11729. > Newly added NN storage directo

[jira] [Created] (HDFS-11729) Improve NNStorageRetentionManager failure handling.

2017-05-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11729: - Summary: Improve NNStorageRetentionManager failure handling. Key: HDFS-11729 URL: https://issues.apache.org/jira/browse/HDFS-11729 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991459#comment-15991459 ] Andrew Wang commented on HDFS-11643: Thanks for reviewing Wei-chiu, Despite what down

[jira] [Updated] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11714: -- Attachment: HDFS-11714.v3.trunk.patch HDFS-11714.v3.branch-2.patch Attaching new patches

[jira] [Commented] (HDFS-11377) Balancer hung due to no available mover threads

2017-05-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991448#comment-15991448 ] Wei-Chiu Chuang commented on HDFS-11377: The relevant code was introduced by HDFS-

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-05-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991439#comment-15991439 ] Hadoop QA commented on HDFS-9807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991420#comment-15991420 ] Kihwal Lee commented on HDFS-11714: --- I will file a jira for the retention manager improv

[jira] [Commented] (HDFS-11609) Some blocks can be permanently lost if nodes are decommissioned while dead

2017-05-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991386#comment-15991386 ] Hudson commented on HDFS-11609: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11724) libhdfs compilation is broken on OS X

2017-05-01 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991376#comment-15991376 ] Allen Wittenauer commented on HDFS-11724: - +1 > libhdfs compilation is broken on

[jira] [Updated] (HDFS-11609) Some blocks can be permanently lost if nodes are decommissioned while dead

2017-05-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11609: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1 3.0.0-alpha3

  1   2   >