[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11150: -- Attachment: HDFS-11150-HDFS-10285.004.patch > [SPS]: Provide persistence when satisfying storage

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1578#comment-1578 ] Hadoop QA commented on HDFS-11150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11150: -- Attachment: HDFS-11150-HDFS-10285.003.patch Upload a new patch to find potential test failures. I will

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782204#comment-15782204 ] Hadoop QA commented on HDFS-11251: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782158#comment-15782158 ] Yiqun Lin commented on HDFS-11251: -- It seems this change lead this {code} + private static final int

[jira] [Commented] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782135#comment-15782135 ] Hudson commented on HDFS-11252: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11046 (See

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782123#comment-15782123 ] Arpit Agarwal commented on HDFS-11274: -- The potential shutdown issue in saveDfsUsed is a nice find

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782124#comment-15782124 ] Lei (Eddy) Xu commented on HDFS-11251: -- Hi, [~manojg] The latest patch hangs on my local machine:

[jira] [Updated] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11252: Affects Version/s: (was: 3.0.0-alpha2) >

[jira] [Updated] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11252: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11270) Document the missing options of NameNode bootstrap command

[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782032#comment-15782032 ] Yiqun Lin commented on HDFS-11270: -- Thanks [~liuml07] for the commit, and thanks [~brahmareddy] for the

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11274: -- Attachment: HDFS-11274.04.patch > Datanode should only check the failed volume upon IO errors >

[jira] [Commented] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781957#comment-15781957 ] Lei (Eddy) Xu commented on HDFS-11267: -- Hi, [~manojg] Thanks a lot for cleaning the code. I have a

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781913#comment-15781913 ] Manoj Govindassamy commented on HDFS-11251: --- Thanks for the review [~linyiqun]. Updated the

[jira] [Updated] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11251: -- Attachment: HDFS-11251.03.patch > ConcurrentModificationException during

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781900#comment-15781900 ] Wei Zhou commented on HDFS-11186: - This is a good way to bypass the issue, but I had add codes to other

[jira] [Commented] (HDFS-11121) Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping

[ https://issues.apache.org/jira/browse/HDFS-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781883#comment-15781883 ] Hadoop QA commented on HDFS-11121: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781867#comment-15781867 ] Wei Zhou commented on HDFS-11186: - Sorry, {{In order to trigger Jenkins to work}} this comment is not

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781861#comment-15781861 ] Rakesh R commented on HDFS-11186: - OK, good catch. It looks like this thread.join timeout was added by

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781846#comment-15781846 ] Hadoop QA commented on HDFS-10899: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-11186: Comment: was deleted (was: Hi [~rakeshr], thanks for reviewing the patch! The reason is that it takes

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781841#comment-15781841 ] Wei Zhou commented on HDFS-11186: - Hi [~rakeshr], thanks for reviewing the patch! The reason is that it

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781840#comment-15781840 ] Wei Zhou commented on HDFS-11186: - Hi [~rakeshr], thanks for reviewing the patch! The reason is that it

[jira] [Comment Edited] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781823#comment-15781823 ] Yiqun Lin edited comment on HDFS-11251 at 12/28/16 2:21 AM: Thanks [~manojg]

[jira] [Comment Edited] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781818#comment-15781818 ] Rakesh R edited comment on HDFS-11186 at 12/28/16 2:20 AM: --- Do you meant, that

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781823#comment-15781823 ] Yiqun Lin commented on HDFS-11251: -- Thanks [~manojg] for updating the patch. The latest patch looks

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781818#comment-15781818 ] Rakesh R commented on HDFS-11186: - Do you meant, that the current patch is causing the testing time for

[jira] [Comment Edited] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781804#comment-15781804 ] Rakesh R edited comment on HDFS-11186 at 12/28/16 2:14 AM: --- Thanks [~zhouwei]

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-11186: Status: Open (was: Patch Available) In order to trigger Jenkins to work. > [SPS]: Daemon thread of SPS

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-11186: Status: Patch Available (was: Open) > [SPS]: Daemon thread of SPS should start only in Active NN >

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781804#comment-15781804 ] Rakesh R commented on HDFS-11186: - Thanks [~zhouwei] for the updates. Overall the patch looks good to me.

[jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors

[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781787#comment-15781787 ] Hadoop QA commented on HDFS-11274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11267: -- Attachment: HDFS-11267.01.patch Attaching v01 patch to address the following: 1. Avoid

[jira] [Commented] (HDFS-11267) Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage

[ https://issues.apache.org/jira/browse/HDFS-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781739#comment-15781739 ] Manoj Govindassamy commented on HDFS-11267: --- The fix for HDFS-11251

[jira] [Updated] (HDFS-11121) Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping

[ https://issues.apache.org/jira/browse/HDFS-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11121: Attachment: HDFS-11121.2.patch I rebased the last patch with the latest trunk and uploaded

[jira] [Commented] (HDFS-11121) Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping

[ https://issues.apache.org/jira/browse/HDFS-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781732#comment-15781732 ] Takanobu Asanuma commented on HDFS-11121: - Thanks for your thoughts. I agree with you. So let's

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.02.patch > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: (was: HDFS-10899.02.patch) > Add functionality to re-encrypt EDEKs. >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781619#comment-15781619 ] Hadoop QA commented on HDFS-10899: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781584#comment-15781584 ] Manoj Govindassamy commented on HDFS-9391: -- [~eddyxu], [~mingma], Are you ok leaving

[jira] [Updated] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11251: -- Attachment: HDFS-11251.02.patch Attached v02 patch to address the following: 1. Added a

[jira] [Comment Edited] (HDFS-11274) Datanode should only check the failed volume upon IO errors

[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781508#comment-15781508 ] Xiaoyu Yao edited comment on HDFS-11274 at 12/27/16 11:49 PM: -- Delta from

[jira] [Updated] (HDFS-11274) Datanode should only check the failed volume upon IO errors

[ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11274: -- Attachment: HDFS-11274.03.patch Delta from patch 02: 1. Add a ScheduleResult interface to get the

[jira] [Commented] (HDFS-11239) [SPS]: Check Mover file ID lease also to determine whether Mover is running

[ https://issues.apache.org/jira/browse/HDFS-11239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781485#comment-15781485 ] Uma Maheswara Rao G commented on HDFS-11239: # . {code} + public boolean

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.02.patch Rebased on latest trunk, and fixed precommits. > Add functionality to

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781391#comment-15781391 ] Wei-Chiu Chuang commented on HDFS-10759: I like the proposal and retriggered the Jenkins build for

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781388#comment-15781388 ] Hadoop QA commented on HDFS-10759: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11268) Persist erasure coding policy ID in FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781380#comment-15781380 ] Wei-Chiu Chuang commented on HDFS-11268: I thought EC policy ID is stored using replication factor

[jira] [Commented] (HDFS-11121) Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping

[ https://issues.apache.org/jira/browse/HDFS-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781372#comment-15781372 ] Wei-Chiu Chuang commented on HDFS-11121: Hi [~tasanuma0829] I don't feel that's necessary as long

[jira] [Commented] (HDFS-11270) Document the missing options of NameNode bootstrap command

[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781172#comment-15781172 ] Hudson commented on HDFS-11270: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11041 (See

[jira] [Updated] (HDFS-11270) Document the missing options of NameNode bootstrap command

[ https://issues.apache.org/jira/browse/HDFS-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11270: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11271) Typo in NameNode UI

[ https://issues.apache.org/jira/browse/HDFS-11271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781004#comment-15781004 ] Wei-Chiu Chuang commented on HDFS-11271: Thanks, Akira and Brahma! > Typo in NameNode UI >

[jira] [Updated] (HDFS-11275) Check groupEntryIndex and throw a helpful exception on failures when removing ACL.

[ https://issues.apache.org/jira/browse/HDFS-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11275: - Status: Patch Available (was: Open) > Check groupEntryIndex and throw a helpful exception on failures

[jira] [Updated] (HDFS-11275) Check groupEntryIndex and throw a helpful exception on failures when removing ACL.

[ https://issues.apache.org/jira/browse/HDFS-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11275: - Attachment: HDFS-11275.01.patch Patch 1 to add the check, don't think unit test is necessary. Manually

[jira] [Updated] (HDFS-11275) Check groupEntryIndex and throw a helpful exception on failures when removing ACL.

[ https://issues.apache.org/jira/browse/HDFS-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11275: - Description: We only have the logs to the exception but not the metadata, so hard to reproduce. The log

[jira] [Created] (HDFS-11275) Check groupEntryIndex and throw a helpful exception on failures when removing ACL.

Xiao Chen created HDFS-11275: Summary: Check groupEntryIndex and throw a helpful exception on failures when removing ACL. Key: HDFS-11275 URL: https://issues.apache.org/jira/browse/HDFS-11275 Project:

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15780118#comment-15780118 ] Yuanbo Liu commented on HDFS-11150: --- come back from chrismas holiday. Will upload a new patch this week.