[jira] [Updated] (HDFS-11898) DFSClient#isHedgedReadsEnabled() should be per client flag

2017-06-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11898: - Attachment: HDFS-11898-02.patch Attached the patch to add the flag per client. May be discussion

[jira] [Updated] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-06-01 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11822: - Attachment: (was: HDFS-11822-HDFS-7240.003.patch) > Block Storage: Fix TestCBlockCLI,

[jira] [Updated] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-06-01 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11822: - Attachment: HDFS-11822-HDFS-7240.003.patch > Block Storage: Fix TestCBlockCLI, failing

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-06-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034160#comment-16034160 ] Vinayakumar B commented on HDFS-5042: - Thanks a lot [~kihwal] for reviews and commit. Thanks everyone

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-06-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034156#comment-16034156 ] Vinayakumar B commented on HDFS-11856: -- Thanks a lot [~kihwal] for reviews and commit. > Ability to

[jira] [Commented] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034148#comment-16034148 ] Hudson commented on HDFS-11359: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11817 (See

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-06-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034143#comment-16034143 ] John Zhuge commented on HDFS-11856: --- Thanks [~vinayrpet]. > Ability to re-add Upgrading Nodes (remote)

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-06-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034142#comment-16034142 ] Vinayakumar B commented on HDFS-11856: -- bq. Will this patch help clusters with more than 3 DNs? Yes,

[jira] [Updated] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11359: - Priority: Major (was: Minor) > DFSAdmin report command supports displaying maintenance state datanodes >

[jira] [Updated] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11359: - Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4 2.9.0 > DFSAdmin report

[jira] [Updated] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11359: - Resolution: Fixed Status: Resolved (was: Patch Available) > DFSAdmin report command supports

[jira] [Commented] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034136#comment-16034136 ] Yiqun Lin commented on HDFS-11359: -- Have verified the unit test in my local, it ran okay. Committed this

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034131#comment-16034131 ] Weiwei Yang commented on HDFS-11779: UT failure in class {{TestKeySpaceManager}} was not related to

[jira] [Updated] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11913: --- Description: HDFS-11774 introduces an UT failure, {{TestKeySpaceManager#testDeleteVolume}}, error as

[jira] [Updated] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11913: --- Status: Patch Available (was: Open) > Ozone: TestKeySpaceManager#testDeleteVolume fails >

[jira] [Updated] (HDFS-11893) Fix TestDFSShell.testMoveWithTargetPortEmpty failure.

2017-06-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11893: - Fix Version/s: (was: 2.8.2) > Fix TestDFSShell.testMoveWithTargetPortEmpty failure. >

[jira] [Updated] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11913: --- Attachment: HDFS-11913-HDFS-7240.001.patch > Ozone: TestKeySpaceManager#testDeleteVolume fails >

[jira] [Created] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-01 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11913: -- Summary: Ozone: TestKeySpaceManager#testDeleteVolume fails Key: HDFS-11913 URL: https://issues.apache.org/jira/browse/HDFS-11913 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034079#comment-16034079 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034072#comment-16034072 ] Hadoop QA commented on HDFS-11359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11359: - Attachment: (was: HDFS-11359-branch-2.patch) > DFSAdmin report command supports displaying

[jira] [Updated] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11359: - Attachment: HDFS-11359-branch-2.patch > DFSAdmin report command supports displaying maintenance state

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and TextFileRegionProvider into one.

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034063#comment-16034063 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034059#comment-16034059 ] Hadoop QA commented on HDFS-11359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11359: - Attachment: HDFS-11359-branch-2.patch The failure tests are not related and ASF License warnings are also

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034052#comment-16034052 ] Hadoop QA commented on HDFS-11472: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11899) ASF License warnings generated intermittently in trunk

2017-06-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034049#comment-16034049 ] Yiqun Lin commented on HDFS-11899: -- Hi [~ajisakaa], I found ASF License warnings generated intermittently

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034021#comment-16034021 ] Andrew Wang commented on HDFS-11907: Thanks for the reply [~vagarychen]. Just thought I'd mention the

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034006#comment-16034006 ] Hadoop QA commented on HDFS-11907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034012#comment-16034012 ] Weiwei Yang commented on HDFS-11779: Rebased to latest code base. [~xyao], [~anu], [~linyiqun],

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.011.patch > Ozone: KSM: add listBuckets >

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11472: --- Attachment: HDFS-11472.002.patch Updated the patch to address the comment. Also had a minor

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033968#comment-16033968 ] Arpit Agarwal commented on HDFS-11907: -- I am +1 on the v4 patch. I will hold off committing, pending

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033960#comment-16033960 ] Chen Liang commented on HDFS-11907: --- Thanks [~andrew.wang] for the comments! We prefer not to use it

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and TextFileRegionProvider into one.

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033938#comment-16033938 ] Virajith Jalaparti commented on HDFS-11902: --- Thanks for taking a look [~chris.douglas]! Posting

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and TextFileRegionProvider into one.

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and TextFileRegionProvider into one.

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and TextFileRegionProvider into one.

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.002.patch > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033927#comment-16033927 ] Andrew Wang commented on HDFS-11907: Sorry for coming to this late, but is DFCachingGetSpaceUsed

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033920#comment-16033920 ] Hadoop QA commented on HDFS-11912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.004.patch Thanks [~arpitagarwal] and [~kihwal] for the comments! Post v004 patch

[jira] [Comment Edited] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033879#comment-16033879 ] Virajith Jalaparti edited comment on HDFS-11673 at 6/1/17 11:08 PM:

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Handle

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033879#comment-16033879 ] Virajith Jalaparti commented on HDFS-11673: --- Committed v5 to the feature branch! Thanks

[jira] [Updated] (HDFS-11597) Ozone: Add Ratis management API

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11597: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11383) Intern strings in BlockLocation and ExtendedBlock

2017-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033839#comment-16033839 ] Hudson commented on HDFS-11383: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11815 (See

[jira] [Commented] (HDFS-11909) Ozone: KSM : Support for simulated file system operations

2017-06-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033835#comment-16033835 ] Mingliang Liu commented on HDFS-11909: -- Thanks [~anu] for the design doc. Nice discussion here. I

[jira] [Commented] (HDFS-11597) Ozone: Add Ratis management API

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033834#comment-16033834 ] Anu Engineer commented on HDFS-11597: - +1, I will commit this shortly. > Ozone: Add Ratis management

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-06-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033830#comment-16033830 ] John Zhuge commented on HDFS-11856: --- [~vinayrpet] and [~kihwal] Will this patch help clusters with more

[jira] [Commented] (HDFS-11909) Ozone: KSM : Support for simulated file system operations

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033828#comment-16033828 ] Anu Engineer commented on HDFS-11909: - bq. with name "key1/" and another "key1//" In the web

[jira] [Comment Edited] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033821#comment-16033821 ] Manoj Govindassamy edited comment on HDFS-11912 at 6/1/17 10:27 PM:

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033821#comment-16033821 ] Manoj Govindassamy commented on HDFS-11912: --- Thanks for contributing this patch [~ghuangups].

[jira] [Commented] (HDFS-11909) Ozone: KSM : Support for simulated file system operations

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033818#comment-16033818 ] Weiwei Yang commented on HDFS-11909: Hi [~yuanbo] and [~anu], for file system APIs, we certainly can

[jira] [Updated] (HDFS-11383) Intern strings in BlockLocation and ExtendedBlock

2017-06-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11383: --- Summary: Intern strings in BlockLocation and ExtendedBlock (was: String duplication in

[jira] [Updated] (HDFS-11383) Intern strings in BlockLocation and ExtendedBlock

2017-06-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11383: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha4 2.9.0 Status:

[jira] [Commented] (HDFS-11894) Ozone: Cleanup imports

2017-06-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033809#comment-16033809 ] Weiwei Yang commented on HDFS-11894: Thanks [~anu] for manually triggering the jenkins job and

[jira] [Commented] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-06-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033807#comment-16033807 ] Andrew Wang commented on HDFS-11383: LGTM thanks Misha, will commit shortly. > String duplication in

[jira] [Updated] (HDFS-11789) Maintain Short-Circuit Read Statistics

2017-06-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11789: - Target Version/s: 2.9.0 > Maintain Short-Circuit Read Statistics >

[jira] [Updated] (HDFS-11789) Maintain Short-Circuit Read Statistics

2017-06-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11789: - Component/s: hdfs-client > Maintain Short-Circuit Read Statistics >

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033803#comment-16033803 ] Wei-Chiu Chuang commented on HDFS-11741: Thanks [~xiaochen] and [~yzhangal] for pushing the patch

[jira] [Commented] (HDFS-11789) Maintain Short-Circuit Read Statistics

2017-06-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033796#comment-16033796 ] Arpit Agarwal commented on HDFS-11789: -- Thanks for contributing this improvement [~hanishakoneru]. A

[jira] [Commented] (HDFS-11904) Reuse iip in unprotectedRemoveXAttrs calls

2017-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033792#comment-16033792 ] Hudson commented on HDFS-11904: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11814 (See

[jira] [Updated] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2017-06-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10816: --- Status: Patch Available (was: Open) > TestComputeInvalidateWork#testDatanodeReRegistration fails due

[jira] [Updated] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2017-06-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10816: --- Status: Open (was: Patch Available) > TestComputeInvalidateWork#testDatanodeReRegistration fails due

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033774#comment-16033774 ] Hadoop QA commented on HDFS-11673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-06-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11856: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4 Status: Resolved

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-06-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033758#comment-16033758 ] Kihwal Lee commented on HDFS-11856: --- +1 for the branch-2.7 patch. I've just committed it. > Ability to

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033737#comment-16033737 ] Hudson commented on HDFS-11741: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11813 (See

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-01 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Status: Patch Available (was: Open) > Add a snapshot unit test with randomized file IO operations

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-01 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.001.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Created] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-01 Thread George Huang (JIRA)
George Huang created HDFS-11912: --- Summary: Add a snapshot unit test with randomized file IO operations Key: HDFS-11912 URL: https://issues.apache.org/jira/browse/HDFS-11912 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11904) Reuse iip in unprotectedRemoveXAttrs calls

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11904: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4 2.9.0

[jira] [Updated] (HDFS-11904) Reuse iip in unprotectedRemoveXAttrs calls

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11904: - Target Version/s: 2.9.0 (was: 2.8.2) > Reuse iip in unprotectedRemoveXAttrs calls >

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11741: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 3.0.0-alpha4

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033709#comment-16033709 ] Xiao Chen commented on HDFS-11741: -- Compiled and ran {{TestBlockToken}} & {{TestKeyManager}} locally on

[jira] [Commented] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033672#comment-16033672 ] Anu Engineer commented on HDFS-11771: - {code} String userName; if (acl.getName() == null) {

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-01 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033667#comment-16033667 ] Rushabh S Shah commented on HDFS-11804: --- bq. Correct. So we should treat AuthenticationException

[jira] [Updated] (HDFS-11894) Ozone: Cleanup imports

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11894: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Assigned] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client

2017-06-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-11873: - Assignee: Xiaoyu Yao (was: Anu Engineer) > Ozone: Object store handler cannot serve multiple

[jira] [Commented] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033565#comment-16033565 ] Hadoop QA commented on HDFS-11771: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033551#comment-16033551 ] Xiao Chen commented on HDFS-11804: -- Thanks Rushabh. bq. This means user doesn't have access to key. Even

[jira] [Commented] (HDFS-11911) SnapshotDiff should maintain the order of file/dir creation and deletion

2017-06-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033530#comment-16033530 ] Manoj Govindassamy commented on HDFS-11911: --- [~jingzhao], [~yzhangal], any thoughts on

[jira] [Created] (HDFS-11911) SnapshotDiff should maintain the order of file/dir creation and deletion

2017-06-01 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11911: - Summary: SnapshotDiff should maintain the order of file/dir creation and deletion Key: HDFS-11911 URL: https://issues.apache.org/jira/browse/HDFS-11911

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033513#comment-16033513 ] Virajith Jalaparti commented on HDFS-11673: --- Posting patch v5 which essentially rebases v4 on

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Status: Patch Available (was: Open) > [READ] Handle failures of Datanode with PROVIDED

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Status: Open (was: Patch Available) > [READ] Handle failures of Datanode with PROVIDED

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-06-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Attachment: HDFS-11673-HDFS-9806.005.patch > [READ] Handle failures of Datanode with

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033506#comment-16033506 ] Xiao Chen commented on HDFS-11741: -- Turns out YETUS-515 is the same as HADOOP-14474. Commented there to

[jira] [Commented] (HDFS-11894) Ozone: Cleanup imports

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033505#comment-16033505 ] Anu Engineer commented on HDFS-11894: - I will commit this shortly. The findbugs warnings are not from

[jira] [Commented] (HDFS-11894) Ozone: Cleanup imports

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033497#comment-16033497 ] Hadoop QA commented on HDFS-11894: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-06-01 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-11383: -- Hi Andrew, I think this time I've addressed all your concerns and there is nothing from findbugs or

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033444#comment-16033444 ] Xiao Chen commented on HDFS-11741: -- INFRA-14261 is fixed, but YETUS-515 surfaced > Long running

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033424#comment-16033424 ] Hadoop QA commented on HDFS-11741: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-06-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033405#comment-16033405 ] Chen Liang commented on HDFS-11822: --- Thanks [~msingh] for the update, +1 for v003 patch, pending

[jira] [Updated] (HDFS-5042) Completed files lost after power failure

2017-06-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5042: - Fix Version/s: 2.8.2 2.7.4 > Completed files lost after power failure >

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-06-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033367#comment-16033367 ] Kihwal Lee commented on HDFS-5042: -- The patches look good. Now the fix is in branch-2.8 and branch-2.7.

[jira] [Comment Edited] (HDFS-11909) Ozone: KSM : Support for simulated file system operations

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033328#comment-16033328 ] Anu Engineer edited comment on HDFS-11909 at 6/1/17 5:28 PM: - bq. The path

[jira] [Commented] (HDFS-11909) Ozone: KSM : Support for simulated file system operations

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033328#comment-16033328 ] Anu Engineer commented on HDFS-11909: - bq. The path name is not allowed to contain extra slashes, or

[jira] [Commented] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033318#comment-16033318 ] Anu Engineer commented on HDFS-11771: - Force building the patch --

[jira] [Commented] (HDFS-11894) Ozone: Cleanup imports

2017-06-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033320#comment-16033320 ] Anu Engineer commented on HDFS-11894: - Force building the patch --

  1   2   >