[jira] [Commented] (HDFS-10683) Make class Token$PrivateToken private

2016-09-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531839#comment-15531839 ] Wei-Chiu Chuang commented on HDFS-10683: +1 > Make class Token$PrivateToken private >

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531781#comment-15531781 ] SammiChen commented on HDFS-10910: -- Thanks Yiqun for update the patch. The v2 patch seems good to me. >

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531709#comment-15531709 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

2016-09-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531670#comment-15531670 ] Weiwei Yang commented on HDFS-10922: Hello [~xyao] I recently worked on some JIRAs about Trash, I can

[jira] [Commented] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531580#comment-15531580 ] Hadoop QA commented on HDFS-10923: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531554#comment-15531554 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10629) Federation Router

2016-09-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531543#comment-15531543 ] Ming Ma commented on HDFS-10629: Sorry for [~elgoiri] and [~jakace] for the late reply. Yes let us take

[jira] [Updated] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10918: - Attachment: HDFS-10918.03.patch I see sorry that was a stupid question, thanks a lot for explaining

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531447#comment-15531447 ] Arpit Agarwal commented on HDFS-9668: - Hi [~jingcheng...@intel.com], You can probably split out the

[jira] [Updated] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10923: - Status: Patch Available (was: Open) > Make InstrumentedLock require ReentrantLock >

[jira] [Updated] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10923: - Attachment: HDFS-10923.01.patch The patch also renames InstrumentedLock to

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531432#comment-15531432 ] Jing Zhao commented on HDFS-10797: -- [~mackrorysd], I agree it will be great to have a consistent and

[jira] [Moved] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal moved HADOOP-13668 to HDFS-10923: --- Key: HDFS-10923 (was: HADOOP-13668) Project: Hadoop HDFS

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531405#comment-15531405 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531394#comment-15531394 ] Andrew Wang commented on HDFS-10918: I think we still are missing handling relative paths and

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531397#comment-15531397 ] Xiaobing Zhou commented on HDFS-10913: -- [~xyao] thank you for reviews. I posted patch v002 with some

[jira] [Updated] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.002.patch > Refactor BlockReceiver by introducing faults injector to

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531377#comment-15531377 ] Andrew Wang commented on HDFS-10850: Agree about throwing a specific rename exception. I poked around

[jira] [Updated] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10918: - Attachment: HDFS-10918.02.patch Thanks for the review and the interesting offline chat Andrew. :) Patch

[jira] [Commented] (HDFS-10629) Federation Router

2016-09-28 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531269#comment-15531269 ] Inigo Goiri commented on HDFS-10629: [~jakace], we should remove the JMX related code and leave it for

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531259#comment-15531259 ] Jing Zhao commented on HDFS-10897: -- Thanks for the reply, Anu. bq. The reason of breaking up these data

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531228#comment-15531228 ] stack commented on HDFS-10690: -- Skimmed. Patch LGTM. Unfortunate we leave behind some perf but agree on

[jira] [Commented] (HDFS-9390) Block management for maintenance states

2016-09-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531219#comment-15531219 ] Lei (Eddy) Xu commented on HDFS-9390: - Hi, [~mingma] Thanks so much for posting this patch. It looks

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531199#comment-15531199 ] Sean Mackrory commented on HDFS-10797: -- Thanks for pointing that out [~jingzhao]. I added test cases

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531189#comment-15531189 ] Hudson commented on HDFS-10892: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10509 (See

[jira] [Commented] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531186#comment-15531186 ] Hudson commented on HDFS-10914: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10509 (See

[jira] [Commented] (HDFS-10779) Rename does not need to re-solve destination

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531185#comment-15531185 ] Hudson commented on HDFS-10779: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10509 (See

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531151#comment-15531151 ] Daryn Sharp commented on HDFS-10850: I'll try to dig out the stacktrace, but the code in question was

[jira] [Updated] (HDFS-10779) Rename does not need to re-solve destination

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10779: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10914: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Release Note: The

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10824: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531104#comment-15531104 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10779) Rename does not need to re-solve destination

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531097#comment-15531097 ] Kihwal Lee commented on HDFS-10779: --- +1 nice improvement to not re-resolve the same thing multiple

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531081#comment-15531081 ] Andrew Wang commented on HDFS-10918: Thanks for working on this Xiao, a few comments: * I don't think

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-28 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531057#comment-15531057 ] Fenghua Hu commented on HDFS-10690: --- [~xyao], thanks for the help! > Optimize insertion/removal of

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531044#comment-15531044 ] Arpit Agarwal commented on HDFS-10912: -- bq. Arpit also made the same comment, and suggested that I

[jira] [Commented] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

2016-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531033#comment-15531033 ] Andrew Wang commented on HDFS-10916: Test failures look unrelated. > Switch from "raw" to "system"

[jira] [Updated] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

2016-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10916: --- Summary: Switch from "raw" to "system" xattr namespace for erasure coding policy (was: Switch from

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

2016-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530970#comment-15530970 ] Anu Engineer commented on HDFS-10912: - [~jingzhao] Thanks for your comments. bq. the first one is to

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

2016-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530965#comment-15530965 ] Xiaoyu Yao commented on HDFS-10922: --- Propose to add the following test cases: # test users can delete

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530949#comment-15530949 ] Anu Engineer commented on HDFS-10897: - [~jingzhao] Thanks for taking time out to review the code and

[jira] [Created] (HDFS-10922) Adding additional unit tests for Trash

2016-09-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10922: - Summary: Adding additional unit tests for Trash Key: HDFS-10922 URL: https://issues.apache.org/jira/browse/HDFS-10922 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

2016-09-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530843#comment-15530843 ] Jing Zhao commented on HDFS-10912: -- Thanks for the work, [~anu]. For SCM, I think we may have two

[jira] [Comment Edited] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530818#comment-15530818 ] Jing Zhao edited comment on HDFS-10897 at 9/28/16 8:43 PM: --- Thanks for working

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530818#comment-15530818 ] Jing Zhao commented on HDFS-10897: -- Thanks for working on this, [~anu]. The patch looks good to me

[jira] [Commented] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530790#comment-15530790 ] Xiaobing Zhou commented on HDFS-10915: -- Thank you [~liuml07] for committing it. > Fix time

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530788#comment-15530788 ] Xiaobing Zhou commented on HDFS-10824: -- Thank you [~arpiagariu], [~cnauroth] and [~anu] for

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824-branch-2.006.patch > MiniDFSCluster#storageCapacities has no effects on

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Status: Patch Available (was: Reopened) > MiniDFSCluster#storageCapacities has no effects on

[jira] [Reopened] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reopened HDFS-10824: -- > MiniDFSCluster#storageCapacities has no effects on real capacity >

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530774#comment-15530774 ] Jitendra Nath Pandey commented on HDFS-10892: - I think it makes sense to track utf8 tests

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530725#comment-15530725 ] Hanisha Koneru commented on HDFS-10896: --- +1 for v3 patch. Thanks [~xkrogen] for including changes

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-09-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530710#comment-15530710 ] Jing Zhao commented on HDFS-10826: -- # The failure of TestLeaseRecoveryStriped seems related. Could you

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530628#comment-15530628 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530612#comment-15530612 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530601#comment-15530601 ] Hudson commented on HDFS-10824: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10508 (See

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530595#comment-15530595 ] Yongjun Zhang commented on HDFS-10314: -- Had a discussion with [~jingzhao], and we had the following

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10824: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530458#comment-15530458 ] Xiao Chen commented on HDFS-10918: -- Hi [~andrew.wang], Could you take a look and see if this makes sense

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530416#comment-15530416 ] Xiaoyu Yao commented on HDFS-10913: --- Thanks [~xiaobingo] for reporting the issue and posting the patch

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530405#comment-15530405 ] Hadoop QA commented on HDFS-10810: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896.003.patch Attached v003 patch with checkstyle fix. Thanks for the review,

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530382#comment-15530382 ] Manoj Govindassamy commented on HDFS-9850: -- Thanks [~anu], [~eddyxu] for the review and commit

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530342#comment-15530342 ] Xiaobing Zhou commented on HDFS-10913: -- v001 patch added brand new injector instance to avoid side

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530343#comment-15530343 ] Lei (Eddy) Xu commented on HDFS-10896: -- The patch is mostly moving code to the new classes. +1

[jira] [Updated] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

2016-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.001.patch > Refactor BlockReceiver by introducing faults injector to

[jira] [Updated] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

2016-09-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10919: - Target Version/s: 3.0.0-alpha2 > Provide admin/debug tool to dump out info of a given block >

[jira] [Commented] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

2016-09-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530311#comment-15530311 ] Yongjun Zhang commented on HDFS-10919: -- Many thanks [~kihwal]! I was not aware of this fsck switch

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530300#comment-15530300 ] Xiaoyu Yao commented on HDFS-10906: --- Agree. Regrading adding Kerberos enabled trash related unit test

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530249#comment-15530249 ] Mingliang Liu commented on HDFS-10906: -- Thanks for the to do list, [~xyao]. +1 for the proposal. It

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530236#comment-15530236 ] Mingliang Liu commented on HDFS-10810: -- Thanks [~brahmareddy]. That's true that [HDFS-10666] has not

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530234#comment-15530234 ] Hadoop QA commented on HDFS-10921: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530221#comment-15530221 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu]: the patch v06 looks good. I plan to commit it by EOD

[jira] [Commented] (HDFS-10911) Change edit log OP_UPDATE_BLOCKS to store delta blocks only.

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530215#comment-15530215 ] Kihwal Lee commented on HDFS-10911: --- IIRC, namenode didn't use to log all blocks all the time, but it

[jira] [Commented] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530196#comment-15530196 ] Kihwal Lee commented on HDFS-10919: --- Given a block ID you can use {{fsck -blockId}} to get the file it

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10810: Attachment: HDFS-10810-003.patch Uploaded the patch to remove the fixed time

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530148#comment-15530148 ] Anu Engineer commented on HDFS-10824: - I am good with the changes. Thanks [~cnauroth] and

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530131#comment-15530131 ] Brahma Reddy Battula commented on HDFS-10810: - Thanks [~szetszwo]. > Setreplication removing

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530075#comment-15530075 ] Hadoop QA commented on HDFS-10921: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530014#comment-15530014 ] Eric Badger commented on HDFS-10921: [~rushabh.shah], [~daryn], [~kihwal], do you think it's

[jira] [Commented] (HDFS-10804) Use separate lock for ReplicaMap

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530010#comment-15530010 ] Hadoop QA commented on HDFS-10804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Status: Patch Available (was: Open) > TestDiskspaceQuotaUpdate doesn't wait for NN to get out of

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Attachment: HDFS-10921.002.patch Looked deeper into this and saw that {{cluster = new

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Status: Open (was: Patch Available) > TestDiskspaceQuotaUpdate doesn't wait for NN to get out of

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529771#comment-15529771 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9509) Add new metrics for measuring datanode storage statistics

2016-09-28 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529840#comment-15529840 ] Jagadesh Kiran N commented on HDFS-9509: [~szetszwo] ,Currently along with {code}

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Status: Patch Available (was: Open) > TestDiskspaceQuotaUpdate doesn't wait for NN to get out of

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Attachment: HDFS-10921.001.patch Attaching patch that makes the cluster wait until the NN is active

[jira] [Created] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10921: -- Summary: TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode Key: HDFS-10921 URL: https://issues.apache.org/jira/browse/HDFS-10921 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529791#comment-15529791 ] Eric Badger commented on HDFS-10921: Stack trace of test failure {noformat} Cannot create directory

[jira] [Updated] (HDFS-10804) Use separate lock for ReplicaMap

2016-09-28 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: (was: HDFS-10804-003.patch) > Use separate lock for ReplicaMap >

[jira] [Updated] (HDFS-10804) Use separate lock for ReplicaMap

2016-09-28 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-003.patch Re-attach to trigger Jenkins build. > Use separate lock for

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10824: - Hadoop Flags: Reviewed +1 for patch 006. Thank you, Xiaobing. [~anu] or [~arpitagarwal], do you

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529666#comment-15529666 ] Hadoop QA commented on HDFS-9668: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529510#comment-15529510 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10920) TestStorageMover#testNoSpaceDisk is failing intermittently

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529427#comment-15529427 ] Hadoop QA commented on HDFS-10920: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-15.patch Upload a new patch V15 to fix the newly added checkstyle warning. >

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-14.patch The failure of unit tests should not be related with this patch.

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529304#comment-15529304 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >