[jira] [Updated] (HDFS-10804) Use separate lock for ReplicaMap

2016-09-27 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-003.patch > Use separate lock for ReplicaMap > >

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528629#comment-15528629 ] Mingliang Liu commented on HDFS-10810: -- Thanks for your confirmation, [~szetszwo]. I'

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528616#comment-15528616 ] Tsz Wo Nicholas Sze commented on HDFS-10810: Thanks for the explanation. It s

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-09-27 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528613#comment-15528613 ] Takanobu Asanuma commented on HDFS-10826: - [~jingzhao] Thank you for your review a

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-27 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528584#comment-15528584 ] Fenghua Hu commented on HDFS-10690: --- This fix doesn't change any interface, and I have r

[jira] [Issue Comment Deleted] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-27 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Comment: was deleted (was: Hi [~arpitagarwal], I read the code in HDFS-10828. I think the callers of t

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-27 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528580#comment-15528580 ] Fenghua Hu commented on HDFS-9668: -- hi [~jingcheng...@intel.com], regarding ReplicaMap loc

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-27 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528522#comment-15528522 ] Jingcheng Du edited comment on HDFS-9668 at 9/28/16 6:21 AM: - H

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-27 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528522#comment-15528522 ] Jingcheng Du commented on HDFS-9668: Hi [~arpitagarwal], I read the code in HDFS-10828.

[jira] [Updated] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9444: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Created] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

2016-09-27 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10919: Summary: Provide admin/debug tool to dump out info of a given block Key: HDFS-10919 URL: https://issues.apache.org/jira/browse/HDFS-10919 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528473#comment-15528473 ] Hudson commented on HDFS-9850: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1050

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528455#comment-15528455 ] Hadoop QA commented on HDFS-10883: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528437#comment-15528437 ] Mingliang Liu commented on HDFS-10892: -- Thank you [~aw] for your explanation. That is

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893-branch-2.000.patch Now attach the patch for {{branch-2}}. > Refactor TestD

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9850: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status: Reso

[jira] [Commented] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528359#comment-15528359 ] Hudson commented on HDFS-10915: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528355#comment-15528355 ] Hadoop QA commented on HDFS-10690: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528338#comment-15528338 ] Manoj Govindassamy commented on HDFS-9850: -- Unit test failures are not related to

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528317#comment-15528317 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10915: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528292#comment-15528292 ] Hadoop QA commented on HDFS-10910: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528260#comment-15528260 ] Hadoop QA commented on HDFS-10915: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-27 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10690: -- Attachment: HDFS-10690.006.patch Re-submit patch v6 so as to trigger Jenkins build. > Optimize insertio

[jira] [Updated] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-27 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10690: -- Attachment: (was: HDFS-10690.006.patch) > Optimize insertion/removal of replica in ShortCircuitCache

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528230#comment-15528230 ] Hadoop QA commented on HDFS-9850: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528219#comment-15528219 ] Hudson commented on HDFS-10900: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Comment Edited] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528191#comment-15528191 ] Yiqun Lin edited comment on HDFS-10910 at 9/28/16 2:52 AM: --- Atta

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10910: - Attachment: HDFS-10910.001.patch > HDFS Erasure Coding doc should state its currently supported erasure co

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10910: - Status: Patch Available (was: Open) Attach a initial patch for this. I found that some sequence number no

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-09-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528179#comment-15528179 ] Yuanbo Liu commented on HDFS-10756: --- I'm working on a related jira( HDFS-10883 ), and I

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528169#comment-15528169 ] Yongjun Zhang commented on HDFS-10314: -- HI [~jingzhao], I tried to provide details i

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-09-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Attachment: HDFS-10883.003.patch Upload v3 patch to address test failure. > `getTrashRoot`'s behavior i

[jira] [Updated] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10900: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: 3.0.0-alpha2

[jira] [Comment Edited] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527010#comment-15527010 ] Anu Engineer edited comment on HDFS-10900 at 9/28/16 2:16 AM: --

[jira] [Commented] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528102#comment-15528102 ] Yiqun Lin commented on HDFS-10900: -- Thanks [~anu] for the patient explaination. It seems

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-09-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528082#comment-15528082 ] Yiqun Lin commented on HDFS-10426: -- Thanks [~liuml07] for pointing this. It seem that {{T

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528092#comment-15528092 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10918: - Attachment: HDFS-10918.01.patch Attaching a patch to express the idea. Some explanations: - Client can al

[jira] [Updated] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10918: - Status: Patch Available (was: Open) > Add a tool to get FileEncryptionInfo from CLI > ---

[jira] [Commented] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528091#comment-15528091 ] Hadoop QA commented on HDFS-10914: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-27 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15528033#comment-15528033 ] Fenghua Hu commented on HDFS-10690: --- looks like patch v6 hasn't been built and verified

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527991#comment-15527991 ] Manoj Govindassamy commented on HDFS-9850: -- Thanks a lot for the quick review. >

[jira] [Created] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-27 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10918: Summary: Add a tool to get FileEncryptionInfo from CLI Key: HDFS-10918 URL: https://issues.apache.org/jira/browse/HDFS-10918 Project: Hadoop HDFS Issue Type: New Fea

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527986#comment-15527986 ] Anu Engineer commented on HDFS-9850: +1, Pending Jenkins. The changes in v4 patch look

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.005.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' > -

[jira] [Commented] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527963#comment-15527963 ] Mingliang Liu commented on HDFS-10915: -- +1 pending on Jenkins. > Fix time measuremen

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: (was: HDFS-10915.001.patch) > Fix time measurement bug in > TestDatanodeRestart#t

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: HDFS-10915.001.patch > Fix time measurement bug in > TestDatanodeRestart#testWaitForR

[jira] [Assigned] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-10910: Assignee: Yiqun Lin > HDFS Erasure Coding doc should state its currently supported erasure coding

[jira] [Commented] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527938#comment-15527938 ] Xiaobing Zhou commented on HDFS-10915: -- Thanks [~liuml07], quite good input. I posted

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: HDFS-10915.001.patch > Fix time measurement bug in > TestDatanodeRestart#testWaitForR

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: HDFS-10913.001.patch > Fix time measurement bug in > TestDatanodeRestart#testWaitForR

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: (was: HDFS-10915.000.patch) > Fix time measurement bug in > TestDatanodeRestart#t

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9850: - Attachment: HDFS-9850.004.patch Attaching v04 patch to address following. [~anu], kindly ta

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: HDFS-10915.000.patch > Fix time measurement bug in > TestDatanodeRestart#testWaitForR

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527928#comment-15527928 ] Hadoop QA commented on HDFS-10892: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: (was: HDFS-10913.001.patch) > Fix time measurement bug in > TestDatanodeRestart#t

[jira] [Commented] (HDFS-10916) Switch from "raw" to "system" namespace for erasure coding policy

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527909#comment-15527909 ] Hadoop QA commented on HDFS-10916: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10915: - Summary: Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart (was: f

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527890#comment-15527890 ] Konstantin Shvachko commented on HDFS-10301: ??removing single-rpc FBRs.?? Dar

[jira] [Commented] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527878#comment-15527878 ] Mingliang Liu commented on HDFS-10915: -- Thanks for the patch. Can you also replace t

[jira] [Updated] (HDFS-10917) Maintain various peer performance statistics on DataNode

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Description: DataNodes already detect if replication pipeline operations are slow and log warnings

[jira] [Created] (HDFS-10917) Maintain various peer performance statistics on DataNode

2016-09-27 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10917: Summary: Maintain various peer performance statistics on DataNode Key: HDFS-10917 URL: https://issues.apache.org/jira/browse/HDFS-10917 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10915: - Priority: Minor (was: Major) Component/s: test > fix typo in TestDatanodeRestart#testWaitF

[jira] [Updated] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Status: Patch Available (was: Open) > Refactor BlockReceiver by introducing faults injector to en

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527831#comment-15527831 ] Xiaobing Zhou commented on HDFS-10913: -- I posted patch v000, please kindly review. >

[jira] [Updated] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.000.patch > Refactor BlockReceiver by introducing faults injector to enhanc

[jira] [Commented] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527820#comment-15527820 ] Hadoop QA commented on HDFS-10915: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527821#comment-15527821 ] Konstantin Shvachko commented on HDFS-10301: Talking to Arpit, I think I under

[jira] [Commented] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527772#comment-15527772 ] Lei (Eddy) Xu commented on HDFS-10914: -- The patch is mostly moving code around. +1 pe

[jira] [Updated] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10914: --- Attachment: hdfs-10914.002.patch New rev attached. Apparently checkstyle doesn't like those new import

[jira] [Comment Edited] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527755#comment-15527755 ] Allen Wittenauer edited comment on HDFS-10892 at 9/27/16 11:23 PM: -

[jira] [Commented] (HDFS-10376) Enhance setOwner testing

2016-09-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527757#comment-15527757 ] John Zhuge commented on HDFS-10376: --- Thanks [~yzhangal] for the review and commit! > En

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527755#comment-15527755 ] Allen Wittenauer commented on HDFS-10892: - The Dockerfile that ships with Hadoop d

[jira] [Commented] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527730#comment-15527730 ] Hadoop QA commented on HDFS-10914: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10376) Enhance setOwner testing

2016-09-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527722#comment-15527722 ] Yongjun Zhang commented on HDFS-10376: -- Committed to trunk. Thanks [~jzhuge] for the

[jira] [Updated] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10531: --- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 > Add EC policy and storage policy

[jira] [Updated] (HDFS-10376) Enhance setOwner testing

2016-09-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10376: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527693#comment-15527693 ] Mingliang Liu commented on HDFS-10893: -- Test failure is not related. Specially, [HDFS

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527691#comment-15527691 ] Mingliang Liu commented on HDFS-10426: -- Is https://builds.apache.org/job/PreCommit-H

[jira] [Commented] (HDFS-10376) Enhance setOwner testing

2016-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527683#comment-15527683 ] Hudson commented on HDFS-10376: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-09-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10650: - Release Note: If the caller does not supply a permission, DFSClient#mkdirs and DFSClient#primitiveMkdir wi

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527651#comment-15527651 ] Hadoop QA commented on HDFS-10893: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10916) Switch from "raw" to "system" namespace for erasure coding policy

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10916: --- Release Note: EC policy is now stored in the "system" extended attribute namespace rather than "raw".

[jira] [Updated] (HDFS-10916) Switch from "raw" to "system" namespace for erasure coding policy

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10916: --- Status: Patch Available (was: Open) > Switch from "raw" to "system" namespace for erasure coding poli

[jira] [Created] (HDFS-10916) Switch from "raw" to "system" namespace for erasure coding policy

2016-09-27 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-10916: -- Summary: Switch from "raw" to "system" namespace for erasure coding policy Key: HDFS-10916 URL: https://issues.apache.org/jira/browse/HDFS-10916 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10916) Switch from "raw" to "system" namespace for erasure coding policy

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10916: --- Attachment: HDFS-10916.001.patch Trivial patch attached. > Switch from "raw" to "system" namespace fo

[jira] [Comment Edited] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527560#comment-15527560 ] Mingliang Liu edited comment on HDFS-10892 at 9/27/16 10:12 PM:

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.004.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' > -

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Description: I did not find unit test in {{trunk}} code for following cases: - HDFS command {{dfs

[jira] [Updated] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: HDFS-10915.000.patch > fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestar

[jira] [Updated] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: (was: HDFS-10915.000.patch) > fix typo in TestDatanodeRestart#testWaitForRegistrat

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527499#comment-15527499 ] Xiaobing Zhou commented on HDFS-10913: -- [~jojochuang] thanks for the correction. > R

[jira] [Updated] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Status: Patch Available (was: Open) > fix typo in TestDatanodeRestart#testWaitForRegistrationOnRe

[jira] [Updated] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10915: - Attachment: HDFS-10915.000.patch v000 is posted, please kindly review it, thanks. > fix typo in T

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527488#comment-15527488 ] Kai Zheng commented on HDFS-10828: -- Thanks [~arpiagariu]. The minor wasn't new and I thou

[jira] [Created] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-27 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10915: Summary: fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart Key: HDFS-10915 URL: https://issues.apache.org/jira/browse/HDFS-10915 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527481#comment-15527481 ] Andrew Wang commented on HDFS-10914: FWIW, verified that HdfsAdmin was present in the

[jira] [Updated] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10914: --- Status: Patch Available (was: Open) > Move remnants of oah.hdfs.client to hadoop-hdfs-client > --

  1   2   >