[jira] [Commented] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525233#comment-15525233 ] Hadoop QA commented on HDFS-9482: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525167#comment-15525167 ] Xiaoyu Yao commented on HDFS-10690: --- Thanks [~fenghua_hu] for updating the patch. +1 for

[jira] [Comment Edited] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525143#comment-15525143 ] Xiaoyu Yao edited comment on HDFS-10906 at 9/27/16 5:50 AM: Be

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525143#comment-15525143 ] Xiaoyu Yao commented on HDFS-10906: --- Below is a proposed test plan for list of test case

[jira] [Commented] (HDFS-9885) Correct the distcp counters name while displaying counters

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525141#comment-15525141 ] Hudson commented on HDFS-9885: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1049

[jira] [Created] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10906: - Summary: Add unit tests for Trash with HDFS encryption zones Key: HDFS-10906 URL: https://issues.apache.org/jira/browse/HDFS-10906 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9885) Correct the distcp counters name while displaying counters

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9885: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.7.4

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525118#comment-15525118 ] Hadoop QA commented on HDFS-10713: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-9885) Correct the distcp counters name while displaying counters

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9885: --- Summary: Correct the distcp counters name while displaying counters (was: Correct the

[jira] [Updated] (HDFS-9885) Correct the distcp counters name wh

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9885: --- Summary: Correct the distcp counters name wh (was: In distcp cmd ouput, Display name s

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525081#comment-15525081 ] Anu Engineer commented on HDFS-10828: - [~arpitagarwal] Thanks for the patch. +1, LGTM.

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Attachment: HDFS-9482-002.patch Uploaded the patch to fix applicable checksystyle and f

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525002#comment-15525002 ] Hadoop QA commented on HDFS-9850: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524963#comment-15524963 ] Anu Engineer edited comment on HDFS-9850 at 9/27/16 3:59 AM: - [

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524980#comment-15524980 ] Xiaobing Zhou commented on HDFS-10824: -- The test failure is not related to the patch.

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524968#comment-15524968 ] Arpit Agarwal commented on HDFS-10301: -- bq. As all storage reports in the single RPC

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524963#comment-15524963 ] Anu Engineer commented on HDFS-9850: [~manojg] Thanks for quick turnaround. I was readi

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524943#comment-15524943 ] Arpit Agarwal commented on HDFS-10713: -- +1 for the branch-2 patch, pending Jenkins.

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524878#comment-15524878 ] Hudson commented on HDFS-9444: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1049

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524856#comment-15524856 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-09-26 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-10905: - Assignee: Yuanbo Liu > Refactor DataStreamer#createBlockOutputStream > --

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524824#comment-15524824 ] Hadoop QA commented on HDFS-10892: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9895: Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) Tha

[jira] [Updated] (HDFS-10804) Use separate lock for ReplicaMap

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Summary: Use separate lock for ReplicaMap (was: Use finer-granularity lock for ReplicaMap) > Use separ

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524786#comment-15524786 ] Fenghua Hu commented on HDFS-10828: --- [~arpitagarwal], Actually, i opened another JIRA

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-09-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524781#comment-15524781 ] Weiwei Yang commented on HDFS-8312: --- Hello [~daryn] bq. The NN should not be deleting di

[jira] [Updated] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10828: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) > Fix usage of FsDatasetImpl object lock in Re

[jira] [Updated] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10828: - Priority: Blocker (was: Major) > Fix usage of FsDatasetImpl object lock in ReplicaMap > -

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524766#comment-15524766 ] Arpit Agarwal commented on HDFS-10828: -- Hi [~fenghua_hu], that probably makes sense a

[jira] [Comment Edited] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524766#comment-15524766 ] Arpit Agarwal edited comment on HDFS-10828 at 9/27/16 1:54 AM: -

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524750#comment-15524750 ] Fenghua Hu commented on HDFS-10690: --- Removed unnessary "if (eldestKey == null)" statemen

[jira] [Updated] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10690: -- Attachment: HDFS-10690.006.patch > Optimize insertion/removal of replica in ShortCircuitCache.java > ---

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10713: - Status: Patch Available (was: Reopened) > Throttle FsNameSystem lock warnings > -

[jira] [Reopened] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-10713: -- > Throttle FsNameSystem lock warnings > --- > > Key:

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524733#comment-15524733 ] Brahma Reddy Battula commented on HDFS-9444: Committed to trunk...[~iwasakims]

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9850: - Attachment: HDFS-9850.003.patch Attaching v03 patch to address checkstyle and review commen

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524718#comment-15524718 ] Manoj Govindassamy commented on HDFS-9850: -- Thanks for the review and comments [~a

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524699#comment-15524699 ] Fenghua Hu commented on HDFS-10690: --- Thanks [~xyao] for your suggestion. How about we ju

[jira] [Comment Edited] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524698#comment-15524698 ] Yiqun Lin edited comment on HDFS-10900 at 9/27/16 1:18 AM: --- Than

[jira] [Commented] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524698#comment-15524698 ] Yiqun Lin commented on HDFS-10900: -- Thanks [~anu] for the review. One comment from me: {q

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524693#comment-15524693 ] Hudson commented on HDFS-10713: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524671#comment-15524671 ] Hadoop QA commented on HDFS-10897: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524658#comment-15524658 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.branch-2.000.patch Thank you [~arpitagarwal] for reviewing and committing

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524599#comment-15524599 ] Xiaobing Zhou commented on HDFS-10824: -- Thanks [~cnauroth] for review. v005 is posted

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.005.patch > MiniDFSCluster#storageCapacities has no effects on real capacit

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10713: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Targe

[jira] [Comment Edited] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524583#comment-15524583 ] Arpit Agarwal edited comment on HDFS-10713 at 9/27/16 12:17 AM:

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524553#comment-15524553 ] Hadoop QA commented on HDFS-10897: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.003.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' > -

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-09-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524408#comment-15524408 ] Jing Zhao commented on HDFS-10826: -- Thanks for working on this, [~tasanuma0829]. And than

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524395#comment-15524395 ] Hudson commented on HDFS-10609: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.009.patch Thanks [~eddyxu] for the clarification. I am posting a

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524363#comment-15524363 ] Chen Liang commented on HDFS-10903: --- Thanks [~xyao] and [~liuml07] for the comments! It

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524359#comment-15524359 ] Yongjun Zhang commented on HDFS-10314: -- Hi [~jingzhao], To better address your comme

[jira] [Commented] (HDFS-10887) Provide admin/debug tool to dump block map

2016-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524347#comment-15524347 ] Yongjun Zhang commented on HDFS-10887: -- Many thanks [~kihwal]! Very helpful informati

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10903: - Status: Open (was: Patch Available) > Replace config key literal strings with config key names II

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524331#comment-15524331 ] Mingliang Liu commented on HDFS-10903: -- Thanks [~xyao] for the review. We plan to ad

[jira] [Updated] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10897: Attachment: HDFS-10897-HDFS-7240.003.patch Addressed all comments from [~xyao] > Ozone: SCM: Add N

[jira] [Created] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10905: -- Summary: Refactor DataStreamer#createBlockOutputStream Key: HDFS-10905 URL: https://issues.apache.org/jira/browse/HDFS-10905 Project: Hadoop HDFS Issue T

[jira] [Comment Edited] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524298#comment-15524298 ] Xiaoyu Yao edited comment on HDFS-10903 at 9/26/16 9:58 PM: Th

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524298#comment-15524298 ] Xiaoyu Yao commented on HDFS-10903: --- Thanks [~liuml07] for reporting this and [~vagarych

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Release Note: If pipeline recovery fails due to expired encryption key, attempt to refresh the

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524276#comment-15524276 ] Wei-Chiu Chuang commented on HDFS-10609: Committed the last patch to trunk, branch

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524272#comment-15524272 ] Hadoop QA commented on HDFS-10892: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524258#comment-15524258 ] Chris Nauroth commented on HDFS-10824: -- [~xiaobingo], thank you for sharing patch 004

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524236#comment-15524236 ] Hudson commented on HDFS-10609: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896.001.patch Rebased for patch v001. > Move lock logging logic from FSNamesystem

[jira] [Commented] (HDFS-9390) Block management for maintenance states

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524221#comment-15524221 ] Hadoop QA commented on HDFS-9390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524223#comment-15524223 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524195#comment-15524195 ] Anu Engineer commented on HDFS-10900: - I was about to commit this, and I noticed that

[jira] [Updated] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10900: Fix Version/s: (was: 2.9.0) 3.0.0-alpha2 > DiskBalancer: Complete the documen

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524191#comment-15524191 ] Jing Zhao commented on HDFS-10797: -- Thanks for working on this, Sean. This is actually a

[jira] [Commented] (HDFS-8406) Lease recovery continually failed

2016-09-26 Thread Noe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524189#comment-15524189 ] Noe commented on HDFS-8406: --- for those that run into this, but need to get system working again:

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524169#comment-15524169 ] Anu Engineer commented on HDFS-10897: - [~xyao] Thanks for the comments, I will post an

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524153#comment-15524153 ] Xiaoyu Yao commented on HDFS-10897: --- Thanks [~anu] for working on this and post the patc

[jira] [Commented] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524104#comment-15524104 ] Hadoop QA commented on HDFS-9482: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524103#comment-15524103 ] Hadoop QA commented on HDFS-10903: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10897: Attachment: HDFS-10897-HDFS-7240.002.patch Fix the timeout issue in the test. > Ozone: SCM: Add Nod

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524006#comment-15524006 ] Hadoop QA commented on HDFS-10903: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Status: Patch Available (was: Open) > Move lock logging logic from FSNamesystem into FSNamesystemLock

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523899#comment-15523899 ] Wei-Chiu Chuang commented on HDFS-10609: Committing this based on Andrew's +1. >

[jira] [Updated] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-09-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10904: -- Description: * A DiskBalancer {{NodePlan}} might include a Single {{MoveStep}} or a list

[jira] [Created] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-09-26 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10904: - Summary: Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing Key: HDFS-10904 URL: https://issues.apache.org/j

[jira] [Commented] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

2016-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523789#comment-15523789 ] Yongjun Zhang commented on HDFS-9885: - Thanks for pinging me [~brahmareddy], I took a l

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Description: I did not find unit test in {{trunk}} code for following cases: - HDFS command {{dfs

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10903: - Description: In *Hadoop HDFS*, there are some places that use config key literal strings instead

[jira] [Moved] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu moved HADOOP-13644 to HDFS-10903: --- Target Version/s: 2.8.0 (was: 2.8.0) Component/s: (was:

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523771#comment-15523771 ] Anu Engineer commented on HDFS-9850: [~manojg] Thanks for updating the patch as well pr

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523763#comment-15523763 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu], thanks for updating the patch. The p

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.002.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' > -

[jira] [Updated] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9444: --- Affects Version/s: test > Add utility to find set of available ephemeral ports to Serve

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523757#comment-15523757 ] Hadoop QA commented on HDFS-10851: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-09-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523753#comment-15523753 ] Daryn Sharp commented on HDFS-8312: --- Encountered a minor conflict with this patch so I to

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-2.patch Updated patch to address the checkstyle and test code issues. > Block management f

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523745#comment-15523745 ] Brahma Reddy Battula commented on HDFS-9444: Ok.. will commit.. > Add utility

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Status: Patch Available (was: Open) uploaded the patch..[~arpitagarwal] can you plrea

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Description: As per [~arpitagarwal] comment [here|https://issues.apache.org/jira/brows

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Description: From [~arpitagarwal] comment [here|https://issues.apache.org/jira/browse/H

  1   2   >