[jira] [Updated] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11251: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Target

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11248: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784738#comment-15784738 ] Uma Maheswara Rao G commented on HDFS-11248: +1 on the latest patch > [SPS]: Handle partial

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784665#comment-15784665 ] Hudson commented on HDFS-11274: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11053 (See

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2016-12-28 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784660#comment-15784660 ] Gang Xie commented on HDFS-7784: After make the AclStorage synchronized, it could works. the loading time

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11274: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784626#comment-15784626 ] Arpit Agarwal commented on HDFS-11274: -- Pushed to trunk with the following trivial changes to address

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784603#comment-15784603 ] Arpit Agarwal commented on HDFS-11274: -- The test failure looks unrelated and didn't repro locally

[jira] [Commented] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784554#comment-15784554 ] Hadoop QA commented on HDFS-11281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784508#comment-15784508 ] Hadoop QA commented on HDFS-11194: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784486#comment-15784486 ] Hadoop QA commented on HDFS-11248: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784483#comment-15784483 ] Hudson commented on HDFS-11278: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11052 (See

[jira] [Updated] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11281: - Description: After HDFS-10959, it added disk IO statistics and metrics in DataNode. This metrics was

[jira] [Updated] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11281: - Description: After HDFS-10959, The metric of fileIoErrorRate not counted in {{DataNodeVolumeMetrics}}.

[jira] [Updated] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-11278: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Comment Edited] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784386#comment-15784386 ] Yiqun Lin edited comment on HDFS-11281 at 12/29/16 3:27 AM: Attach a simple

[jira] [Updated] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11281: - Attachment: HDFS-11281.001.patch > The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics >

[jira] [Updated] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11281: - Status: Patch Available (was: Open) Attach a simple patch to have a quick fix. > The metric of

[jira] [Created] (HDFS-11281) The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics

2016-12-28 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11281: Summary: The metric of fileIoErrorRate not counted in DataNodeVolumeMetrics Key: HDFS-11281 URL: https://issues.apache.org/jira/browse/HDFS-11281 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784306#comment-15784306 ] Manoj Govindassamy commented on HDFS-11267: --- Thanks for the review [~linyiqun]. > Avoid

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11194: - Status: Patch Available (was: Open) > Maintain aggregated peer performance metrics on NameNode >

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11194: - Attachment: HDFS-11194.01.patch Attached a patch. This builds upon the downstream peer latencies

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2016-12-28 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784285#comment-15784285 ] Gang Xie commented on HDFS-7784: Found a potential issue while trying to back port this patch to 2.4. Pls

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784282#comment-15784282 ] Hadoop QA commented on HDFS-11274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784281#comment-15784281 ] Rakesh R commented on HDFS-11248: - Thanks [~umamaheswararao] for the detailed reviews. IIUC, the following

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Attachment: HDFS-11248-HDFS-10285-05.patch > [SPS]: Handle partial block location movements >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Description: WebHDFSClient calls "conn.disconnect()", which disconnects from the NameNode. When we

[jira] [Commented] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784252#comment-15784252 ] Hadoop QA commented on HDFS-11280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.7.and.below.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP

[jira] [Created] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
Zheng Shao created HDFS-11280: - Summary: Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) Key: HDFS-11280 URL: https://issues.apache.org/jira/browse/HDFS-11280 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

2016-12-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784243#comment-15784243 ] Yiqun Lin commented on HDFS-11267: -- The latest patch LGTM, +1. Thanks [~manojg] for the follow-up work of

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784160#comment-15784160 ] Arpit Agarwal commented on HDFS-11274: -- +1 for the v6 patch. Thanks [~xyao]. > Datanode should only

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-12-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784154#comment-15784154 ] Uma Maheswara Rao G commented on HDFS-11150: [~yuanbo] Its a good point. Since this JIRA

[jira] [Updated] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11279: - Description: After HDFS-11274, we will not trigger checking all datanode volumes upon IO failure

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784134#comment-15784134 ] Xiaoyu Yao commented on HDFS-11274: --- Created HDFS-11279 to cleanup unused code

[jira] [Updated] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11279: - Assignee: Hanisha Koneru > Cleanup unused DataNode#checkDiskErrorAsync() >

[jira] [Created] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2016-12-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11279: - Summary: Cleanup unused DataNode#checkDiskErrorAsync() Key: HDFS-11279 URL: https://issues.apache.org/jira/browse/HDFS-11279 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784119#comment-15784119 ] Xiaoyu Yao commented on HDFS-11274: --- Thanks [~arpitagarwal] for the review and discussion. Update patch

[jira] [Commented] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784120#comment-15784120 ] Hadoop QA commented on HDFS-11278: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11274: -- Attachment: HDFS-11274.06.patch > Datanode should only check the failed volume upon IO errors >

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784111#comment-15784111 ] Hadoop QA commented on HDFS-11274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784094#comment-15784094 ] Uma Maheswara Rao G commented on HDFS-11248: [~rakeshr], Looks like my comment 2 still exist.

[jira] [Resolved] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code

2016-12-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10891. -- Resolution: Fixed > Über-jira: Test Improvement by adding missing test cases for existing code

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784081#comment-15784081 ] Hadoop QA commented on HDFS-11274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-11194: Assignee: Arpit Agarwal (was: Xiaobing Zhou) > Maintain aggregated peer performance

[jira] [Updated] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-11278: Status: Patch Available (was: Open) > Add missing @Test annotation for

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11274: -- Attachment: HDFS-11274.05.patch > Datanode should only check the failed volume upon IO errors >

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11274: -- Attachment: (was: HDFS-11274.05.patch) > Datanode should only check the failed volume upon IO

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11274: -- Attachment: HDFS-11274.05.patch Thanks [~arpitagarwal] for the review. Upload patch v5 to address the

[jira] [Updated] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11278: -- Attachment: HDFS-11278.001.patch > Add missing @Test annotation for

[jira] [Updated] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11267: -- Attachment: HDFS-11267.02.patch Attached v02 patch to address previous review comments.

[jira] [Comment Edited] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783620#comment-15783620 ] Manoj Govindassamy edited comment on HDFS-11267 at 12/28/16 8:14 PM: -

[jira] [Commented] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783620#comment-15783620 ] Manoj Govindassamy commented on HDFS-11267: --- Thanks for the review [~eddyxu]. {noformat} index

[jira] [Commented] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783513#comment-15783513 ] Daniel Templeton commented on HDFS-11278: - [~lukmajercak], thanks for the patch. LGTM. Can you

[jira] [Updated] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11251: -- Attachment: HDFS-11251.04.patch Fixed the DEFAULT_STORAGES_PER_DATANODE to 2 in

[jira] [Commented] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783455#comment-15783455 ] ASF GitHub Bot commented on HDFS-11278: --- Github user templedf commented on the issue:

[jira] [Updated] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-11278: Assignee: Lukas Majercak (was: Daniel Templeton) > Add missing @Test annotation for

[jira] [Commented] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783445#comment-15783445 ] ASF GitHub Bot commented on HDFS-11278: --- GitHub user lukmajercak opened a pull request:

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783443#comment-15783443 ] Manoj Govindassamy commented on HDFS-11251: --- Thanks for verifying the fix. The latest patch has

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783440#comment-15783440 ] Manoj Govindassamy commented on HDFS-11251: --- Oops, not intentional. Copy paste from the previous

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2016-12-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783413#comment-15783413 ] Wei-Chiu Chuang commented on HDFS-7060: --- BlockPoolSplice objects in FsVolumeImpl are stored in

[jira] [Assigned] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-11278: --- Assignee: Daniel Templeton > Add missing @Test annotation for

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783407#comment-15783407 ] Hadoop QA commented on HDFS-7060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2016-12-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783405#comment-15783405 ] Wei-Chiu Chuang commented on HDFS-7060: --- I am trying to revive this thread. The heartbeat issue with

[jira] [Updated] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11278: -- Priority: Trivial (was: Major) > Add missing @Test annotation for

[jira] [Created] (HDFS-11278) Add missing @Test annotation for TestSafeMode.testSafeModeUtils()

2016-12-28 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-11278: - Summary: Add missing @Test annotation for TestSafeMode.testSafeModeUtils() Key: HDFS-11278 URL: https://issues.apache.org/jira/browse/HDFS-11278 Project: Hadoop

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783183#comment-15783183 ] Hadoop QA commented on HDFS-11274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783171#comment-15783171 ] Arpit Agarwal commented on HDFS-11277: -- I added you as an HDFS contributor so you will be able to

[jira] [Commented] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783160#comment-15783160 ] Arpit Agarwal commented on HDFS-11277: -- [~manju_hadoop], there shouldn't be multiple FsVolumeImpl

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-12-28 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783004#comment-15783004 ] Yuanbo Liu commented on HDFS-11150: --- [~rakeshr] / [~umamaheswararao] Sorry to interrupt. The satisfier

[jira] [Commented] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Manjunath Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782611#comment-15782611 ] Manjunath Anand commented on HDFS-11277: Hi [~arpitagarwal] if the above explaination is fair

[jira] [Comment Edited] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Manjunath Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782603#comment-15782603 ] Manjunath Anand edited comment on HDFS-11277 at 12/28/16 10:33 AM: --- Hi

[jira] [Commented] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Manjunath Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782603#comment-15782603 ] Manjunath Anand commented on HDFS-11277: Hi [~arpitagarwal] , can you please review this subtask

[jira] [Updated] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Manjunath Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manjunath Anand updated HDFS-11277: --- Description: Certain of the implementations of FsVolumeSpi say for eg:- FsVolumeImpl can

[jira] [Created] (HDFS-11277) Implement equals and hashcode in FsVolumeSpi implementations

2016-12-28 Thread Manjunath Anand (JIRA)
Manjunath Anand created HDFS-11277: -- Summary: Implement equals and hashcode in FsVolumeSpi implementations Key: HDFS-11277 URL: https://issues.apache.org/jira/browse/HDFS-11277 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11276) The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode

2016-12-28 Thread Reid Chan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reid Chan resolved HDFS-11276. -- Resolution: Duplicate > The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode >

[jira] [Commented] (HDFS-11276) The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode

2016-12-28 Thread Reid Chan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782499#comment-15782499 ] Reid Chan commented on HDFS-11276: -- yes. sorry for the noise. > The "TransactionsSinceLastCheckpoint"

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782493#comment-15782493 ] Hadoop QA commented on HDFS-11150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11276) The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode

2016-12-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782486#comment-15782486 ] Brahma Reddy Battula commented on HDFS-11276: - Dupe of HDFS-7501..? > The

[jira] [Commented] (HDFS-11275) Check groupEntryIndex and throw a helpful exception on failures when removing ACL.

2016-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782406#comment-15782406 ] Hadoop QA commented on HDFS-11275: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11276) The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode

2016-12-28 Thread Reid Chan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reid Chan updated HDFS-11276: - Attachment: In Standby NameNode.png > The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby

[jira] [Created] (HDFS-11276) The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode

2016-12-28 Thread Reid Chan (JIRA)
Reid Chan created HDFS-11276: Summary: The "TransactionsSinceLastCheckpoint" metrics is wrong in Standby NameNode Key: HDFS-11276 URL: https://issues.apache.org/jira/browse/HDFS-11276 Project: Hadoop

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2016-12-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v5.patch 1. add unsetErasureCodingPolicy API 2. add "-unsetPolicy" sub-command to