[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: (was: HDFS-13898-HDFS-12943.003.patch) > Throw retriable exception for getBlockLocations wh

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.003.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Commented] (HDFS-13931) Backport HDFS-6440 to branch 2.8.2

2018-09-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623950#comment-16623950 ] Chao Sun commented on HDFS-13931: - cc [~zhz], [~vagarychen]: attached the initial patch v

[jira] [Updated] (HDFS-13931) Backport HDFS-6440 to branch 2.8.2

2018-09-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13931: Attachment: HDFS-13931.branch-2.8.2.000.patch > Backport HDFS-6440 to branch 2.8.2 > --

[jira] [Created] (HDFS-13931) Backport HDFS-6440 to branch 2.8.2

2018-09-21 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13931: --- Summary: Backport HDFS-6440 to branch 2.8.2 Key: HDFS-13931 URL: https://issues.apache.org/jira/browse/HDFS-13931 Project: Hadoop HDFS Issue Type: Bug Repo

[jira] [Commented] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622716#comment-16622716 ] Chao Sun commented on HDFS-13873: - [~vagarychen]: feel free to take it - I was waiting fo

[jira] [Commented] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622487#comment-16622487 ] Chao Sun commented on HDFS-13924: - [~xkrogen] brought up a good point in [HDFS-13898|htt

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622469#comment-16622469 ] Chao Sun commented on HDFS-13749: - Oh cool! Thanks for the help [~xkrogen]! BTW: you may

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.006.patch > Use getServiceStatus to discover observer namenodes > ---

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622350#comment-16622350 ] Chao Sun commented on HDFS-13749: - [~xkrogen]: could you take another look at this? The t

[jira] [Comment Edited] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622334#comment-16622334 ] Chao Sun edited comment on HDFS-13898 at 9/20/18 4:51 PM: -- Thank

[jira] [Commented] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622334#comment-16622334 ] Chao Sun commented on HDFS-13898: - Thanks [~xkrogen] for the explanation. I like the idea

[jira] [Commented] (HDFS-13923) Add a configuration to turn on/off observer reads

2018-09-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621327#comment-16621327 ] Chao Sun commented on HDFS-13923: - bq. Here you are talking, I believe, about a way of te

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620856#comment-16620856 ] Chao Sun commented on HDFS-13749: - Attached patch v5 to fix style issues. > Use getServi

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.005.patch > Use getServiceStatus to discover observer namenodes > ---

***UNCHECKED*** [jira] [Commented] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620240#comment-16620240 ] Chao Sun commented on HDFS-13924: - [~vagarychen] yes I think we can potentially fix on th

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.002.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Commented] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620163#comment-16620163 ] Chao Sun commented on HDFS-13898: - [~xkrogen]: hmm I'm not sure. Why it has to scan all o

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-09-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619910#comment-16619910 ] Chao Sun commented on HDFS-13790: - [~brahmareddy], [~elgoiri]: sure - attached patches fo

[jira] [Updated] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-09-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13790: Attachment: HDFS-13790-branch-3.1.001.patch > RBF: Move ClientProtocol APIs to its own module > ---

[jira] [Updated] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-09-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13790: Attachment: HDFS-13790-branch-2.000.patch > RBF: Move ClientProtocol APIs to its own module > -

[jira] [Commented] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618251#comment-16618251 ] Chao Sun commented on HDFS-13924: - [~vagarychen] yes the stack trace: {code:java} Caused

[jira] [Created] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-17 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13924: --- Summary: Handle BlockMissingException when reading from observer Key: HDFS-13924 URL: https://issues.apache.org/jira/browse/HDFS-13924 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-13923) Add a configuration to turn on/off observer reads

2018-09-17 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13923: --- Summary: Add a configuration to turn on/off observer reads Key: HDFS-13923 URL: https://issues.apache.org/jira/browse/HDFS-13923 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618153#comment-16618153 ] Chao Sun commented on HDFS-13749: - Thanks [~xkrogen]! bq. is there any rational behind

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.004.patch > Use getServiceStatus to discover observer namenodes > ---

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: (was: HDFS-13898-HDFS-12943.001.patch) > Throw retriable exception for getBlockLocations wh

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.001.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.001.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.001.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: (was: HDFS-13898-HDFS-12943.001.patch) > Throw retriable exception for getBlockLocations wh

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: (was: HDFS-13898-HDFS-12943.001.patch) > Throw retriable exception for getBlockLocations wh

[jira] [Commented] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618097#comment-16618097 ] Chao Sun commented on HDFS-13898: - Thanks [~vagarychen] and [~xkrogen]! You're right, we

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.001.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-09-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614095#comment-16614095 ] Chao Sun commented on HDFS-13790: - My apologies for the long delay [~brahmareddy]. Attach

[jira] [Updated] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-09-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13790: Attachment: HDFS-13790-branch-2.9.000.patch > RBF: Move ClientProtocol APIs to its own module > ---

[jira] [Updated] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-09-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13790: Attachment: HDFS-13790-branch-3.1.000.patch > RBF: Move ClientProtocol APIs to its own module > ---

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-12 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613035#comment-16613035 ] Chao Sun commented on HDFS-13749: - Actually, using {{RetryProxy}} in {{createNonHAProxyWi

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-12 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.003.patch > Use getServiceStatus to discover observer namenodes > ---

[jira] [Commented] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-12 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612499#comment-16612499 ] Chao Sun commented on HDFS-13898: - Thanks [~xkrogen] for taking a look! bq. I also don't

[jira] [Comment Edited] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-12 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612499#comment-16612499 ] Chao Sun edited comment on HDFS-13898 at 9/12/18 5:29 PM: -- Thank

[jira] [Commented] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611042#comment-16611042 ] Chao Sun commented on HDFS-13898: - cc [~xkrogen], [~shv], [~vagarychen]. > Throw retriab

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611039#comment-16611039 ] Chao Sun commented on HDFS-13749: - The test failure is because in {{testMultiObserver}},

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Status: Patch Available (was: Open) Attached patch v0. > Throw retriable exception for getBlockLocations

[jira] [Updated] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13898: Attachment: HDFS-13898-HDFS-12943.000.patch > Throw retriable exception for getBlockLocations when Observer

[jira] [Assigned] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-13898: --- Assignee: Chao Sun > Throw retriable exception for getBlockLocations when ObserverNameNode is in >

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16607305#comment-16607305 ] Chao Sun commented on HDFS-13749: - Good point. Let me change it. I still need to figure o

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606783#comment-16606783 ] Chao Sun commented on HDFS-13749: - Thanks [~xkrogen] for the comments. Attached patch v2.

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.002.patch > Use getServiceStatus to discover observer namenodes > ---

[jira] [Commented] (HDFS-13791) Limit logging frequency of edit tail related statements

2018-09-06 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606703#comment-16606703 ] Chao Sun commented on HDFS-13791: - Thanks [~xkrogen]! The patch v3 looks great. The idea

[jira] [Created] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-05 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13898: --- Summary: Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode Key: HDFS-13898 URL: https://issues.apache.org/jira/browse/HDFS-13898 Project: Had

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605304#comment-16605304 ] Chao Sun commented on HDFS-13749: - Thanks [~xkrogen]. Yes agree that it's better to put t

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605002#comment-16605002 ] Chao Sun commented on HDFS-13749: - Attached patch v1. [~xkrogen]: turns out it's not easy

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.001.patch > Use getServiceStatus to discover observer namenodes > ---

[jira] [Commented] (HDFS-13791) Limit logging frequency of edit tail related statements

2018-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604795#comment-16604795 ] Chao Sun commented on HDFS-13791: - Thanks [~xkrogen]. The change of using {{SummaryStatis

[jira] [Commented] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-08-31 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598379#comment-16598379 ] Chao Sun commented on HDFS-13873: - I'll grab this one since we've implemented the same lo

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-31 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598365#comment-16598365 ] Chao Sun commented on HDFS-13880: - [~vagarychen] I'm not sure HDFS-13749 is still a case

[jira] [Assigned] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-08-31 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-13873: --- Assignee: Chao Sun > ObserverNode should reject read requests when it is too far behind. > -

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-08-31 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598358#comment-16598358 ] Chao Sun commented on HDFS-13749: - Thanks [~xkrogen] and [~shv]. Good to know that conne

[jira] [Commented] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-08-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597735#comment-16597735 ] Chao Sun commented on HDFS-13749: - Attached patch v0. IMO it's a little rough and I'm not

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-08-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: HDFS-13749-HDFS-12943.000.patch > Use getServiceStatus to discover observer namenodes > ---

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-08-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Attachment: (was: HDFS-13749-HDFS-12943.000.patch) > Use getServiceStatus to discover observer namenode

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-08-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Description: In HDFS-12976 currently we discover NameNode state by calling {{reportBadBlocks}} as a tempora

[jira] [Updated] (HDFS-13749) Use getServiceStatus to discover observer namenodes

2018-08-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13749: Summary: Use getServiceStatus to discover observer namenodes (was: Implement a new client protocol method

[jira] [Commented] (HDFS-13749) Implement a new client protocol method to get NameNode state

2018-08-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594299#comment-16594299 ] Chao Sun commented on HDFS-13749: - [~xkrogen]: sorry for the delay. I'll post a patch for

[jira] [Commented] (HDFS-13791) Limit logging frequency of edit tail related statements

2018-08-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593936#comment-16593936 ] Chao Sun commented on HDFS-13791: - Thanks [~xkrogen]! I think the approach looks good to

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589108#comment-16589108 ] Chao Sun commented on HDFS-13790: - bq. are you planning update patches for branch-3.1 to

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586352#comment-16586352 ] Chao Sun commented on HDFS-13790: - Thanks [~brahmareddy], [~elgoiri] for reviewing and co

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584112#comment-16584112 ] Chao Sun commented on HDFS-13790: - [~brahmareddy]: seems you didn't include the new {{Rou

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16578628#comment-16578628 ] Chao Sun commented on HDFS-13790: - [~brahmareddy]: sure, attached patch v2 for that.  >

[jira] [Updated] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13790: Attachment: HDFS-13790.001.patch > RBF: Move ClientProtocol APIs to its own module > --

[jira] [Updated] (HDFS-13814) Remove super user privilege requirement for getServiceStatus in HAServiceProtocol

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13814: Summary: Remove super user privilege requirement for getServiceStatus in HAServiceProtocol (was: Remove su

[jira] [Commented] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575574#comment-16575574 ] Chao Sun commented on HDFS-13814: - Jenkins triggered. {quote}I think you mean NameNode#ge

[jira] [Updated] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13814: Description: See details in the discussion of HDFS-13749. Currently {{NameNode#getServiceStatus}} requires

[jira] [Updated] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13814: Status: Patch Available (was: Open) > Remove super user privilege requirement for HAServiceProtocol#getSer

[jira] [Commented] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575513#comment-16575513 ] Chao Sun commented on HDFS-13814: - Attached the trivial patch v0. > Remove super user pr

[jira] [Updated] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13814: Attachment: HDFS-13814.000.patch > Remove super user privilege requirement for HAServiceProtocol#getService

[jira] [Commented] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575459#comment-16575459 ] Chao Sun commented on HDFS-13814: - cc [~shv], [~zero45], also it will be great if [~jnp]

[jira] [Created] (HDFS-13814) Remove super user privilege requirement for HAServiceProtocol#getServiceStatus

2018-08-09 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13814: --- Summary: Remove super user privilege requirement for HAServiceProtocol#getServiceStatus Key: HDFS-13814 URL: https://issues.apache.org/jira/browse/HDFS-13814 Project: Hadoop HD

[jira] [Commented] (HDFS-13735) Make QJM HTTP URL connection timeout configurable

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575173#comment-16575173 ] Chao Sun commented on HDFS-13735: - Thanks [~shv], [~xkrogen] for the review and [~vagaryc

[jira] [Updated] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13790: Attachment: HDFS-13790.000.patch > RBF: Move ClientProtocol APIs to its own module > --

[jira] [Commented] (HDFS-13790) RBF: Move ClientProtocol APIs to its own module

2018-08-09 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575172#comment-16575172 ] Chao Sun commented on HDFS-13790: - Attached patch v0. > RBF: Move ClientProtocol APIs to

[jira] [Commented] (HDFS-13749) Implement a new client protocol method to get NameNode state

2018-08-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574011#comment-16574011 ] Chao Sun commented on HDFS-13749: - OK, I'll file a separate JIRA for this then. > Implem

[jira] [Commented] (HDFS-13749) Implement a new client protocol method to get NameNode state

2018-08-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573814#comment-16573814 ] Chao Sun commented on HDFS-13749: - Thanks both [~zero45] and [~shv]. I agree with both of

[jira] [Updated] (HDFS-13789) Reduce logging frequency of QuorumJournalManager#selectInputStreams

2018-08-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13789: Resolution: Fixed Fix Version/s: HDFS-12943 Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572150#comment-16572150 ] Chao Sun commented on HDFS-13792: - Thanks [~linyiqun] and [~lukmajercak] for the review!

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-08-06 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570559#comment-16570559 ] Chao Sun commented on HDFS-12976: - [~xkrogen]: to my understanding, there's 1-1 mapping b

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-06 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Attachment: HDFS-13792.001.patch > Fix FSN read/write lock metrics name > -

[jira] [Commented] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-06 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570540#comment-16570540 ] Chao Sun commented on HDFS-13792: - Thanks [~linyiqun]. Good catch! Attached patch v1 to a

[jira] [Updated] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-08-06 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13686: Attachment: HDFS-13792.001.patch > Add overall metrics for FSNamesystemLock > -

[jira] [Updated] (HDFS-13686) Add overall metrics for FSNamesystemLock

2018-08-06 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13686: Attachment: (was: HDFS-13792.001.patch) > Add overall metrics for FSNamesystemLock > --

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Description: The metrics name for FSN read/write lock should be in the format: {code} FSN(Read|Write)Lock`

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Attachment: (was: HDFS-13792.000.patch) > Fix FSN read/write lock metrics name > --

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Attachment: HDFS-13792.000.patch > Fix FSN read/write lock metrics name > -

[jira] [Commented] (HDFS-13749) Implement a new client protocol method to get NameNode state

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568761#comment-16568761 ] Chao Sun commented on HDFS-13749: - [~zero45]: the restriction came from HDFS-2917, which

[jira] [Commented] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568741#comment-16568741 ] Chao Sun commented on HDFS-13792: - [~linyiqun]: can you take a look at this patch? Thanks

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Attachment: HDFS-13792.000.patch > Fix FSN read/write lock metrics name > -

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Status: Patch Available (was: Open) > Fix FSN read/write lock metrics name > -

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Description: The metrics name for FSN read/write lock should be in the format: {code} FSN(Read|Write)Lock`

[jira] [Updated] (HDFS-13792) Fix FSN read/write lock metrics name

2018-08-03 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13792: Environment: (was: The metrics name for FSN read/write lock should be in the format: {code} FSN(Read|W

<    1   2   3   4   5   6   7   8   9   10   >