[jira] [Updated] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-05-23 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-11754: --- Attachment: HDFS-11754.004.patch > Make FsServerDefaults cache configurable. >

[jira] [Commented] (HDFS-11790) Decommissioning of a DataNode after MaintenanceState takes a very long time to complete

2017-05-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022321#comment-16022321 ] Ming Ma commented on HDFS-11790: Thanks [~manojg] for reporting this. Hmm, the existing code should take

[jira] [Commented] (HDFS-11778) Ozone: KSM: add getBucketInfo

2017-05-23 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022320#comment-16022320 ] Nandakumar commented on HDFS-11778: --- Thanks for the review [~xyao]. bq. I think we can just keep using

[jira] [Created] (HDFS-11874) [SPS]: Document the SPS feature

2017-05-23 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11874: -- Summary: [SPS]: Document the SPS feature Key: HDFS-11874 URL: https://issues.apache.org/jira/browse/HDFS-11874 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022300#comment-16022300 ] Hadoop QA commented on HDFS-11682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11794) Add ec sub command -listCodec to show currently supported ec codecs

2017-05-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022255#comment-16022255 ] SammiChen commented on HDFS-11794: -- Thanks [~rakeshr] for review the patch. Thanks [~drankye] for the

[jira] [Commented] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022250#comment-16022250 ] Hadoop QA commented on HDFS-11846: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11873) Ozone: Object store handler cannot serve requests from same http client

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022232#comment-16022232 ] Weiwei Yang commented on HDFS-11873: Attached a test case to reproduce this issue. There are two tests

[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve requests from same http client

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11873: --- Attachment: HDFS-11873-HDFS-7240.testcase.patch > Ozone: Object store handler cannot serve requests

[jira] [Commented] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022218#comment-16022218 ] Brahma Reddy Battula commented on HDFS-11864: - Oh,Yes.. will cherry-pick to

[jira] [Commented] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022216#comment-16022216 ] Hadoop QA commented on HDFS-11865: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022205#comment-16022205 ] Yiqun Lin edited comment on HDFS-11864 at 5/24/17 2:12 AM: --- Thanks

[jira] [Commented] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022205#comment-16022205 ] Yiqun Lin commented on HDFS-11864: -- Thanks [~brahmareddy] for the review and commit. Why not merge this

[jira] [Updated] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-11383: -- Attachment: hs2-crash-2.txt > String duplication in org.apache.hadoop.fs.BlockLocation >

[jira] [Commented] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022204#comment-16022204 ] Misha Dmitriev commented on HDFS-11383: --- Hi Andrew, I understand your concerns. Unit tests could be

[jira] [Commented] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

2017-05-23 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022199#comment-16022199 ] Vinitha Reddy Gankidi commented on HDFS-11837: -- [~shv] ReplaceDatanodeOnFailure is used here

[jira] [Comment Edited] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022171#comment-16022171 ] Weiwei Yang edited comment on HDFS-11846 at 5/24/17 1:51 AM: - Thanks [~xyao]

[jira] [Created] (HDFS-11873) Ozone: Object store handler cannot serve requests from same http client

2017-05-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11873: -- Summary: Ozone: Object store handler cannot serve requests from same http client Key: HDFS-11873 URL: https://issues.apache.org/jira/browse/HDFS-11873 Project: Hadoop

[jira] [Updated] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-05-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11682: - Status: Patch Available (was: Open) > TestBalancer#testBalancerWithStripedFile is flaky >

[jira] [Updated] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-05-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11682: - Attachment: HDFS-11682.00.patch Added retry logic to {{TestBalancer#waitForBalancer}}. >

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-05-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022194#comment-16022194 ] Lei (Eddy) Xu commented on HDFS-11682: -- In {{TestBalancer#testBalancerWithStripedFile}}, it creates

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-05-23 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022190#comment-16022190 ] Surendra Singh Lilhore commented on HDFS-11726: --- Thanks [~umamaheswararao] and [~rakeshr]

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-23 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022187#comment-16022187 ] Surendra Singh Lilhore commented on HDFS-11695: --- Thanks [~umamaheswararao] for review and

[jira] [Resolved] (HDFS-11871) balance include Parameter Usage Error

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-11871. Resolution: Not A Problem > balance include Parameter Usage Error >

[jira] [Commented] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022171#comment-16022171 ] Weiwei Yang commented on HDFS-11846: Thanks [~xyao] for reviewing this. I uploaded v2 patch which has

[jira] [Updated] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11846: --- Attachment: HDFS-11846-HDFS-7240.002.patch > Ozone: Potential http connection leaks in ozone clients

[jira] [Updated] (HDFS-11597) Ozone: Add Ratis management API

2017-05-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11597: --- Description: We need APIs to manage Ratis clusters for the following operations: -

[jira] [Updated] (HDFS-11597) Ozone: Add Ratis management API

2017-05-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11597: --- Attachment: HDFS-11597-HDFS-7240.20170523.patch HDFS-11597-HDFS-7240.20170523.patch:

[jira] [Commented] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

2017-05-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022153#comment-16022153 ] Konstantin Shvachko commented on HDFS-11837: Minor nit for your patch, that you can remove

[jira] [Commented] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022136#comment-16022136 ] Hadoop QA commented on HDFS-11446: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022130#comment-16022130 ] Hadoop QA commented on HDFS-11446: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11872) Ozone : implement StorageContainerManager#getStorageContainerLocations

2017-05-23 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11872: - Summary: Ozone : implement StorageContainerManager#getStorageContainerLocations Key: HDFS-11872 URL: https://issues.apache.org/jira/browse/HDFS-11872 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11778) Ozone: KSM: add getBucketInfo

2017-05-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022078#comment-16022078 ] Xiaoyu Yao commented on HDFS-11778: --- Thanks [~nandakumar131] for working on this. The patch looks good

[jira] [Updated] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11865: --- Attachment: HDFS-11865-HDFS-7240.20170523.patch HDFS-11865-HDFS-7240.20170523.patch:

[jira] [Commented] (HDFS-2538) option to disable fsck dots

2017-05-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021982#comment-16021982 ] Konstantin Shvachko commented on HDFS-2538: --- Hey guys, I think if we reverse the default to

[jira] [Commented] (HDFS-11655) Ozone: CLI: Guarantees user runs SCM commands has appropriate permission

2017-05-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021947#comment-16021947 ] Xiaoyu Yao commented on HDFS-11655: --- Thanks [~cheersyang] for reporting the issue and posting the fix.

[jira] [Commented] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021929#comment-16021929 ] Xiaoyu Yao commented on HDFS-11846: --- Thanks [~cheersyang] for reporting the issue and posting the fix.

[jira] [Comment Edited] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020653#comment-16020653 ] Uma Maheswara Rao G edited comment on HDFS-11695 at 5/23/17 9:13 PM: -

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021837#comment-16021837 ] Hadoop QA commented on HDFS-5042: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021788#comment-16021788 ] Hadoop QA commented on HDFS-11754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021760#comment-16021760 ] Hadoop QA commented on HDFS-10785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11599) distcp interrupt does not kill hadoop job

2017-05-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-11599. - Resolution: Not A Problem Yes. The program running on the command line is just a client

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Attachment: HDFS-10785.HDFS-8707.008.patch Another attempt for this patch since yetus failed. >

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-05-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021679#comment-16021679 ] Erik Krogen commented on HDFS-11472: Hey [~jojochuang], trying to make sure I understand this patch.

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021680#comment-16021680 ] Wei-Chiu Chuang commented on HDFS-11661: Heads up I am going to revert both commits EOD. I believe

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-23 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021669#comment-16021669 ] Sailesh Mukil commented on HDFS-11851: -- [~jzhuge] Apologies for the slow response. It seems

[jira] [Commented] (HDFS-5970) callers of NetworkTopology's chooseRandom method to expect null return value

2017-05-23 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021654#comment-16021654 ] zhangyubiao commented on HDFS-5970: --- [~olegd], what action you do to reproduced ? > callers of

[jira] [Commented] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

2017-05-23 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021617#comment-16021617 ] Vinitha Reddy Gankidi commented on HDFS-11837: -- [~shv] Please take a look. I've verified that

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021605#comment-16021605 ] Hadoop QA commented on HDFS-10785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-23 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021588#comment-16021588 ] Hanisha Koneru commented on HDFS-11866: --- Thanks [~arpitagarwal] for committing the patch. >

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-05-23 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021586#comment-16021586 ] Mikhail Erofeev commented on HDFS-11754: Thanks for looking into my patch! [~shahrs87], I did

[jira] [Updated] (HDFS-11859) Ozone: SCM: Separate BlockLocationProtocol from ContainerLocationProtocol

2017-05-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11859: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Updated] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-05-23 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-11754: --- Attachment: HDFS-11754.003.patch > Make FsServerDefaults cache configurable. >

[jira] [Commented] (HDFS-11727) Block Storage: Retry Blocks should be requeued when cblock is restarted

2017-05-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021542#comment-16021542 ] Chen Liang commented on HDFS-11727: --- v002 patch looks pretty good to me, will commit this shortly. This

[jira] [Updated] (HDFS-11859) Ozone: SCM: Separate BlockLocationProtocol from ContainerLocationProtocol

2017-05-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11859: -- Summary: Ozone: SCM: Separate BlockLocationProtocol from ContainerLocationProtocol (was: Ozone :

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-05-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021531#comment-16021531 ] Vinayakumar B commented on HDFS-5042: - Mentioned directory sync will be called on block close() if

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-05-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021532#comment-16021532 ] Rakesh R commented on HDFS-11726: - I'm wondering how come both src & destin storage type is {{ARCHIVE}}

[jira] [Assigned] (HDFS-5042) Completed files lost after power failure

2017-05-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HDFS-5042: --- Assignee: Vinayakumar B > Completed files lost after power failure >

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Attachment: HDFS-10785.HDFS-8707.007.patch Reattaching. Some files got excluded from the previous

[jira] [Updated] (HDFS-5042) Completed files lost after power failure

2017-05-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5042: Attachment: HDFS-5042-03.patch updated patch > Completed files lost after power failure >

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021505#comment-16021505 ] Hadoop QA commented on HDFS-10785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021503#comment-16021503 ] Hudson commented on HDFS-11864: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11770 (See

[jira] [Commented] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021468#comment-16021468 ] Chen Liang commented on HDFS-11859: --- Thanks [~xyao] for updating the patch! +1 on v007 patch. > Ozone

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-23 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Attachment: HDFS-10785.HDFS-8707.006.patch New patch (rebased on HDFS-8707). > libhdfs++:

[jira] [Commented] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021418#comment-16021418 ] Hadoop QA commented on HDFS-11771: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11864: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

[jira] [Commented] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021372#comment-16021372 ] Brahma Reddy Battula commented on HDFS-11864: - +1, on {{trunk}} patch, will commit shortly. >

[jira] [Commented] (HDFS-11778) Ozone: KSM: add getBucketInfo

2017-05-23 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021360#comment-16021360 ] Nandakumar commented on HDFS-11778: --- Thanks for the review [~msingh]. BuckerManagerImpl: 85, 129 please

[jira] [Updated] (HDFS-11778) Ozone: KSM: add getBucketInfo

2017-05-23 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-11778: -- Attachment: HDFS-11778-HDFS-7240.001.patch > Ozone: KSM: add getBucketInfo >

[jira] [Updated] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-05-23 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11771: - Status: Patch Available (was: Open) > Ozone: KSM: Add checkVolumeAccess >

[jira] [Updated] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-05-23 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11771: - Attachment: HDFS-11771-HDFS-7240.001.patch > Ozone: KSM: Add checkVolumeAccess >

[jira] [Commented] (HDFS-11639) [READ] Encode the BlockAlias in the client protocol

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021142#comment-16021142 ] Hadoop QA commented on HDFS-11639: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11794) Add ec sub command -listCodec to show currently supported ec codecs

2017-05-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11794: Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Target Version/s: (was: 3.0.0-alpha3)

[jira] [Comment Edited] (HDFS-11794) Add ec sub command -listCodec to show currently supported ec codecs

2017-05-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021047#comment-16021047 ] Rakesh R edited comment on HDFS-11794 at 5/23/17 12:11 PM: --- Thanks [~Sammi] for

[jira] [Commented] (HDFS-11794) Add ec sub command -listCodec to show currently supported ec codecs

2017-05-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021105#comment-16021105 ] Hudson commented on HDFS-11794: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11769 (See

[jira] [Commented] (HDFS-11794) Add ec sub command -listCodec to show currently supported ec codecs

2017-05-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021047#comment-16021047 ] Rakesh R commented on HDFS-11794: - Thanks [~Sammi] for the contribution. +1 LGTM, I'll commit the patch

[jira] [Commented] (HDFS-11727) Block Storage: Retry Blocks should be requeued when cblock is restarted

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021014#comment-16021014 ] Hadoop QA commented on HDFS-11727: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11640) [READ] Datanodes should use a unique identifier when reading from external stores

2017-05-23 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020979#comment-16020979 ] Ewan Higgs commented on HDFS-11640: --- I ran into compilation errors when trying to build this. I suppose

[jira] [Commented] (HDFS-11871) balance include Parameter Usage Error

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020977#comment-16020977 ] Weiwei Yang commented on HDFS-11871: Hi [~kevy] Thanks for reporting this. I just have a quick look

[jira] [Commented] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020973#comment-16020973 ] Hadoop QA commented on HDFS-11864: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Assigned] (HDFS-11871) balance include Parameter Usage Error

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11871: -- Assignee: Weiwei Yang > balance include Parameter Usage Error >

[jira] [Comment Edited] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020961#comment-16020961 ] Weiwei Yang edited comment on HDFS-11846 at 5/23/17 9:46 AM: - This patch

[jira] [Updated] (HDFS-11871) balance include Parameter Usage Error

2017-05-23 Thread kevy liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevy liu updated HDFS-11871: Summary: balance include Parameter Usage Error (was: Parameter Usage Error) > balance include Parameter

[jira] [Updated] (HDFS-11871) Parameter Usage Error

2017-05-23 Thread kevy liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevy liu updated HDFS-11871: Status: Open (was: Patch Available) > Parameter Usage Error > -- > >

[jira] [Commented] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020961#comment-16020961 ] Weiwei Yang commented on HDFS-11846: This patch includes following fixes # Fixed http connection

[jira] [Updated] (HDFS-11871) Parameter Usage Error

2017-05-23 Thread kevy liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevy liu updated HDFS-11871: Status: Patch Available (was: Open) > Parameter Usage Error > -- > >

[jira] [Updated] (HDFS-11639) [READ] Encode the BlockAlias in the client protocol

2017-05-23 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11639: -- Attachment: HDFS-11639-HDFS-9806.005.patch Attaching a patch that removes the {{BlockAlias}} from the

[jira] [Created] (HDFS-11871) Parameter Usage Error

2017-05-23 Thread kevy liu (JIRA)
kevy liu created HDFS-11871: --- Summary: Parameter Usage Error Key: HDFS-11871 URL: https://issues.apache.org/jira/browse/HDFS-11871 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Commented] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020951#comment-16020951 ] Hadoop QA commented on HDFS-11859: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020952#comment-16020952 ] Brahma Reddy Battula commented on HDFS-11864: - bq.Brahma Reddy Battula, the trunk, branch-2

[jira] [Updated] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11864: - Status: Patch Available (was: Open) > Document Metrics to track usage of memory for writes >

[jira] [Updated] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11864: - Attachment: HDFS-11864.001.patch Attach the initial patch. The metrics description based on the infos

[jira] [Commented] (HDFS-11846) Ozone: Potential http connection leaks in ozone clients

2017-05-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020932#comment-16020932 ] Hadoop QA commented on HDFS-11846: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9905) WebHdfsFileSystem#runWithRetry should display original stack trace on error

2017-05-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020824#comment-16020824 ] Brahma Reddy Battula commented on HDFS-9905: Note: it's committed to {{2.7.3}} and

[jira] [Updated] (HDFS-9905) WebHdfsFileSystem#runWithRetry should display original stack trace on error

2017-05-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9905: --- Fix Version/s: 2.7.3 > WebHdfsFileSystem#runWithRetry should display original stack

[jira] [Commented] (HDFS-11778) Ozone: KSM: add getBucketInfo

2017-05-23 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020818#comment-16020818 ] Mukul Kumar Singh commented on HDFS-11778: -- Hi [~nandakumar131], Thanks for the patch. Please

[jira] [Comment Edited] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-05-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020781#comment-16020781 ] SammiChen edited comment on HDFS-7337 at 5/23/17 8:07 AM: -- Thanks [~eddyxu] and

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-05-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020781#comment-16020781 ] SammiChen commented on HDFS-7337: - Thanks [~eddyxu] and [~andrew.wang] for the discussion and feedback!

[jira] [Updated] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-05-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11870: - Labels: hdfs-ec-3.0-nice-to-have (was: ) Component/s: erasure-coding > Add CLI cmd to

[jira] [Created] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-05-23 Thread SammiChen (JIRA)
SammiChen created HDFS-11870: Summary: Add CLI cmd to enable/disable an erasure code policy Key: HDFS-11870 URL: https://issues.apache.org/jira/browse/HDFS-11870 Project: Hadoop HDFS Issue Type:

  1   2   >