[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.008.patch Thanks [~xyao] for the comments! post v008 patch. Also filed

[jira] [Updated] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11886: -- Summary: Ozone : improve error handling for putkey operation (was: Ozone : improving error handling for

[jira] [Commented] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16026534#comment-16026534 ] Chen Liang commented on HDFS-11886: --- Thanks [~anu] for looking at this! No decision has

[jira] [Created] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11891: - Summary: DU#refresh should print the path of the directory when an exception is caught Key: HDFS-11891 URL: https://issues.apache.org/jira/browse/HDFS-11891 Project: Hadoop

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11891: -- Status: Patch Available (was: Open) > DU#refresh should print the path of the directory when an excepti

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11891: -- Attachment: HDFS-11891.001.patch > DU#refresh should print the path of the directory when an exception i

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.001.patch Post initial v001 patch. This patch also includes a number of

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Status: Patch Available (was: Open) > Ozone: KSM: Add getKey > --- > >

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.002.patch The failed test {{TestKeySpaceManager}} is related, fixed in

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.003.patch Thanks [~xyao] for the comments! all addressed in v003 patch.

[jira] [Comment Edited] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027049#comment-16027049 ] Chen Liang edited comment on HDFS-11853 at 5/27/17 12:19 AM: -

[jira] [Commented] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-05-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16029844#comment-16029844 ] Chen Liang commented on HDFS-11887: --- Thanks [~msingh] for the patch! I have a question t

[jira] [Commented] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030007#comment-16030007 ] Chen Liang commented on HDFS-11853: --- The failed tests and the findbugs warnings are unre

[jira] [Commented] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030183#comment-16030183 ] Chen Liang commented on HDFS-11853: --- Any further comments on v003 patch? shall we commit

[jira] [Created] (HDFS-11906) Add log for NameNode#monitorHealth

2017-05-31 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11906: - Summary: Add log for NameNode#monitorHealth Key: HDFS-11906 URL: https://issues.apache.org/jira/browse/HDFS-11906 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-11906) Add log for NameNode#monitorHealth

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11906: -- Status: Patch Available (was: Open) > Add log for NameNode#monitorHealth >

[jira] [Updated] (HDFS-11906) Add log for NameNode#monitorHealth

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11906: -- Attachment: HDFS-11906.001.patch Post v001 patch with a simple time measurement log added. > Add log fo

[jira] [Created] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11907: - Summary: NameNodeResourceChecker should avoid calling df.getAvailable too frequently Key: HDFS-11907 URL: https://issues.apache.org/jira/browse/HDFS-11907 Project: Hadoop H

[jira] [Updated] (HDFS-11906) Add log for NameNode#monitorHealth

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11906: -- Attachment: HDFS-11906.002.patch Post v002 patch to change to log a warning if it's taking longer than a

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.001.patch Post v001 patch to only update call {{availableSpace = df.getAvailable(

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Status: Patch Available (was: Open) > NameNodeResourceChecker should avoid calling df.getAvailable too

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031765#comment-16031765 ] Chen Liang edited comment on HDFS-11907 at 5/31/17 7:13 PM: Po

[jira] [Updated] (HDFS-11906) Add log for NameNode#monitorHealth

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11906: -- Resolution: Duplicate Status: Resolved (was: Patch Available) Merge this change into HDFS-11907

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.002.patch Post v002 patch to merge the change from HDFS-11906, which adds a log w

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.003.patch Thanks [~arpitagarwal] for the comments! all addressed in v003 patch.

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032251#comment-16032251 ] Chen Liang edited comment on HDFS-11907 at 6/1/17 12:24 AM: Th

[jira] [Commented] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-06-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033405#comment-16033405 ] Chen Liang commented on HDFS-11822: --- Thanks [~msingh] for the update, +1 for v003 patch,

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.004.patch Thanks [~arpitagarwal] and [~kihwal] for the comments! Post v004 patch

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033960#comment-16033960 ] Chen Liang commented on HDFS-11907: --- Thanks [~andrew.wang] for the comments! We prefer n

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035112#comment-16035112 ] Chen Liang commented on HDFS-11907: --- Thanks [~andrew.wang] for the reply! df does seem

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035112#comment-16035112 ] Chen Liang edited comment on HDFS-11907 at 6/2/17 5:51 PM: --- Than

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035112#comment-16035112 ] Chen Liang edited comment on HDFS-11907 at 6/2/17 5:51 PM: --- Than

[jira] [Created] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11920: - Summary: Ozone : add key partition Key: HDFS-11920 URL: https://issues.apache.org/jira/browse/HDFS-11920 Project: Hadoop HDFS Issue Type: Sub-task Repo

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Status: Patch Available (was: Open) > Ozone : add key partition > - > >

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.001.patch Post initial v001 patch > Ozone : add key partition > --

[jira] [Comment Edited] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035204#comment-16035204 ] Chen Liang edited comment on HDFS-11920 at 6/2/17 6:33 PM: --- Post

[jira] [Comment Edited] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035204#comment-16035204 ] Chen Liang edited comment on HDFS-11920 at 6/2/17 6:34 PM: --- Post

[jira] [Commented] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035405#comment-16035405 ] Chen Liang commented on HDFS-11796: --- Thanks [~anu] for the updates! +1 on v002 patch.

[jira] [Created] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11923: - Summary: Stress test of DFSNetworkTopology Key: HDFS-11923 URL: https://issues.apache.org/jira/browse/HDFS-11923 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11923: -- Attachment: HDFS-11923.001.patch > Stress test of DFSNetworkTopology > -

[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11923: -- Status: Patch Available (was: Open) > Stress test of DFSNetworkTopology > -

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.002.patch Post v002 patch to fix findbug warning and asf license. > Oz

[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11923: -- Attachment: HDFS-11923.002.patch fix checkstyle in v002 patch. > Stress test of DFSNetworkTopology > --

[jira] [Commented] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037260#comment-16037260 ] Chen Liang commented on HDFS-11822: --- Failed tests all passed in my local run. Committed

[jira] [Updated] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11822: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: Fix TestCBlockCLI, f

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.003.patch Rebased with v003 patch. > Ozone : add key partition > -

[jira] [Created] (HDFS-11932) BPServiceActor thread name is not correctly set

2017-06-05 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11932: - Summary: BPServiceActor thread name is not correctly set Key: HDFS-11932 URL: https://issues.apache.org/jira/browse/HDFS-11932 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11932) BPServiceActor thread name is not correctly set

2017-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11932: -- Attachment: HDFS-11932.001.patch Post v001 patch to set the thread name after the thread gets started an

[jira] [Commented] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-06-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039353#comment-16039353 ] Chen Liang commented on HDFS-11921: --- This will be fixed when HDFS-11920 gets in. HDFS-11

[jira] [Commented] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-06-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039377#comment-16039377 ] Chen Liang commented on HDFS-11921: --- Yes, I already changed that part in HDFS-11920 :)

[jira] [Updated] (HDFS-11932) BPServiceActor thread name is not correctly set

2017-06-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11932: -- Attachment: HDFS-11932.002.patch Thanks [~hanishakoneru] for the catch! Post v002 patch. > BPServiceAct

[jira] [Updated] (HDFS-11932) BPServiceActor thread name is not correctly set

2017-06-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11932: -- Status: Patch Available (was: Open) > BPServiceActor thread name is not correctly set > ---

[jira] [Created] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-06 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11939: - Summary: Ozone : add read/write random access to Chunks of a key Key: HDFS-11939 URL: https://issues.apache.org/jira/browse/HDFS-11939 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043410#comment-16043410 ] Chen Liang commented on HDFS-11907: --- Thanks [~arpitagarwal] and [~andrew.wang] for the f

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Status: Patch Available (was: Open) > Ozone : add read/write random access to Chunks of a key > ---

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.001.patch > Ozone : add read/write random access to Chunks of a key > -

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044779#comment-16044779 ] Chen Liang commented on HDFS-11957: --- Thanks [~jzhuge] for the patch. The change itself i

[jira] [Commented] (HDFS-11933) The function composePolicyName should judge arguments not NULL

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044803#comment-16044803 ] Chen Liang commented on HDFS-11933: --- Thanks [~figo] for the patch. v001 patch looks reas

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.005.patch Thanks [~andrew.wang] for the comments. Based on Andrew's comments, ins

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044987#comment-16044987 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 8:37 PM: --- Than

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.002.patch Post v002 patch to fix checkstyle warnining. > Ozone : add r

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.006.patch Thanks [~arpitagarwal] for pointing out offline that, {{checkAvailable

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045096#comment-16045096 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 9:59 PM: --- Than

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.003.patch fixing a bug in v003 patch. > Ozone : add read/write random

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.007.patch Thansk [~arpitagarwal] for the catch! addressed in v007 patch. > Add m

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046809#comment-16046809 ] Chen Liang commented on HDFS-11907: --- Whoops... thanks [~arpitagarwal]! > Add metric for

[jira] [Commented] (HDFS-11967) TestJMXGet fails occasionally

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046854#comment-16046854 ] Chen Liang commented on HDFS-11967: --- v001 patch LGTM, thanks [~arpitagarwal] for the ana

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047093#comment-16047093 ] Chen Liang commented on HDFS-11907: --- The failed test are unrelated. > Add metric for ti

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.004.patch Had an offline discussion with [~anu], post v004 patch to add

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054494#comment-16054494 ] Chen Liang commented on HDFS-11992: --- Thanks [~xiaodong.hu] for the contribution! v001 pa

[jira] [Created] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11996: - Summary: Ozone : add partial read of chunks Key: HDFS-11996 URL: https://issues.apache.org/jira/browse/HDFS-11996 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054713#comment-16054713 ] Chen Liang commented on HDFS-11963: --- Thanks [~anu] for the update, v005 patch LGTM. > O

[jira] [Created] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11997: - Summary: ChunkManager functions do not use the argument keyName Key: HDFS-11997 URL: https://issues.apache.org/jira/browse/HDFS-11997 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054779#comment-16054779 ] Chen Liang commented on HDFS-11997: --- I think from the perspective of abstraction, {{Chun

[jira] [Created] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11998: - Summary: Enable DFSNetworkTopology as default Key: HDFS-11998 URL: https://issues.apache.org/jira/browse/HDFS-11998 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11996: -- Attachment: HDFS-11996-HDFS-7240.001.patch Turns out it is already possible to do partial read of a chun

[jira] [Updated] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11996: -- Status: Patch Available (was: Open) > Ozone : add partial read of chunks >

[jira] [Created] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12002: - Summary: Ozone : SCM cli misc fixes/improvements Key: HDFS-12002 URL: https://issues.apache.org/jira/browse/HDFS-12002 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Status: Patch Available (was: Open) > Enable DFSNetworkTopology as default > --

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Attachment: HDFS-11998.001.patch Post initial patch to set the config value to true by default. > Enabl

[jira] [Commented] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056453#comment-16056453 ] Chen Liang commented on HDFS-11679: --- Thanks [~yuanbo] for working on this, v003 patch lo

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Description: Currently there are a few minor issues with the SCM CLI: 1. some commands do not use -c op

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Attachment: HDFS-12002-HDFS-7240.001.patch Post initial patch. Thanks [~elek] for the comments! Added t

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Status: Patch Available (was: Open) > Ozone : SCM cli misc fixes/improvements > ---

[jira] [Comment Edited] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056630#comment-16056630 ] Chen Liang edited comment on HDFS-12002 at 6/20/17 11:06 PM: -

[jira] [Comment Edited] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056630#comment-16056630 ] Chen Liang edited comment on HDFS-12002 at 6/20/17 11:15 PM: -

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Description: Currently there are a few minor issues with the SCM CLI: 1. some commands do not use -c op

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056668#comment-16056668 ] Chen Liang commented on HDFS-11998: --- {{TestAvailableSpaceBlockPlacementPolicy}} fail see

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056705#comment-16056705 ] Chen Liang commented on HDFS-11998: --- {{TestAvailableSpaceBlockPlacementPolicy}} fails be

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Attachment: HDFS-11998.002.patch Thanks [~linyiqun] for the catch! updated in v002 patch which also made

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: HDFS-11580-HDFS-7240.008.patch I looked deeper into v007 patch, looks pretty good to me over

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: (was: HDFS-11580-HDFS-7240.008.patch) > Ozone: Support asynchronus client API for SCM an

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: HDFS-11580-HDFS-7240.008.patch > Ozone: Support asynchronus client API for SCM and container

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058466#comment-16058466 ] Chen Liang commented on HDFS-11580: --- To [~linyiqun] and anyone reviewing this. There are

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16059747#comment-16059747 ] Chen Liang commented on HDFS-12008: --- Hi [~kihwal] seem the {{TestAvailableSpaceBlockPla

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060005#comment-16060005 ] Chen Liang commented on HDFS-12008: --- Jenkins reports a strange "null" in assertion error

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060053#comment-16060053 ] Chen Liang commented on HDFS-12008: --- thanks [~kihwal] for the illustration! > Improve t

[jira] [Commented] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061279#comment-16061279 ] Chen Liang commented on HDFS-11993: --- Thanks [~candychencan] for the patch. Since this se

[jira] [Assigned] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12018: - Assignee: Chen Liang > Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml >

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.001.patch Post initial patch, also removed a few unused keys in CBlockC

<    8   9   10   11   12   13   14   15   >