[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017634#comment-17017634 ] Konstantin Shvachko commented on HDFS-12943: Hey [~lindy_hopper] yes we currently recommend

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015234#comment-17015234 ] Chen Liang commented on HDFS-12943: --- [~lindy_hopper] access time update is a write call so it can not

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014996#comment-17014996 ] zhangkai commented on HDFS-12943: - When client use getBlockLocation to access the observer node, the

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964579#comment-16964579 ] Hudson commented on HDFS-12943: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17592 (See

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774857#comment-16774857 ] Zhe Zhang commented on HDFS-12943: -- [~vagarychen] has tested the current version of the feature on a

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749772#comment-16749772 ] xiangheng commented on HDFS-12943: -- There are still some issues that have not been solved, which may

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728473#comment-16728473 ] Konstantin Shvachko commented on HDFS-12943: I just merged HDFS-12943 branch to trunk. Thank

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727245#comment-16727245 ] Hadoop QA commented on HDFS-12943: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725379#comment-16725379 ] Chen Liang commented on HDFS-12943: --- Hi [~brahmareddy], Some more notes to add: 1. getHAServiceState()

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724465#comment-16724465 ] Chen Liang commented on HDFS-12943: --- Hi [~brahmareddy] bq. you can see this issue if

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723757#comment-16723757 ] Chao Sun commented on HDFS-12943: - [~brahmareddy] [~xkrogen]: unfortunately I can't provide enough data

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723631#comment-16723631 ] Brahma Reddy Battula commented on HDFS-12943: - Hi [~vagarychen] {quote}I have never seen the

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723295#comment-16723295 ] Erik Krogen commented on HDFS-12943: {quote}Bytheway My intent was when read/write are combined in

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723300#comment-16723300 ] Erik Krogen commented on HDFS-12943: Whoops, took too long writing my comment. Thanks for also

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723278#comment-16723278 ] Chao Sun commented on HDFS-12943: - I think we should document {{dfs.ha.tail-edits.period}} in the user

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723272#comment-16723272 ] Chen Liang commented on HDFS-12943: --- Hi [~brahmareddy], Thanks for testing! The timeout issue seems

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722550#comment-16722550 ] Brahma Reddy Battula commented on HDFS-12943: - {quote}I think when we discuss a "request", we

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721595#comment-16721595 ] Erik Krogen commented on HDFS-12943: Hey [~brahmareddy], thanks for trying it out and for the

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720914#comment-16720914 ] Brahma Reddy Battula commented on HDFS-12943: - Thanks all for great work here. I think,write

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711890#comment-16711890 ] Konstantin Shvachko commented on HDFS-12943: Hey [~goiri], see HDFS-14131 - the documentation

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711797#comment-16711797 ] Íñigo Goiri commented on HDFS-12943: Is there a JIRA tracking the documentation/user guide? I think

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689105#comment-16689105 ] xiangheng commented on HDFS-12943: -- Hi,[~csun],I am very glad to communicate this question with you,I

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688954#comment-16688954 ] xiangheng commented on HDFS-12943: -- Hi,[~csun],I am very glad to communicate this question with you.i

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688417#comment-16688417 ] Chao Sun commented on HDFS-12943: - [~xiangheng] you are right - one more patch is required to make this

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687651#comment-16687651 ] xiangheng commented on HDFS-12943: -- Thanks [~csun],I have tried this way but failed * one workaround is

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687438#comment-16687438 ] Chao Sun commented on HDFS-12943: - [~xiangheng]: we are still working on the support for state transition

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687416#comment-16687416 ] xiangheng commented on HDFS-12943: -- Thanks [~vagarychen](and sorry for the late response ),I have

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684222#comment-16684222 ] Chen Liang commented on HDFS-12943: --- [~xiangheng] thanks for trying Observer read! What was the full

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683363#comment-16683363 ] xiangheng commented on HDFS-12943: -- Thanks [~csun] ,I configured hdfs-site.xml according to the plan

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603722#comment-16603722 ] Konstantin Shvachko commented on HDFS-12943: Attached Test Plan document. > Consistent Reads

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504261#comment-16504261 ] Chao Sun commented on HDFS-12943: - [~xiaochen], on the second question, current the transition from SBN

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498739#comment-16498739 ] Xiao Chen commented on HDFS-12943: -- Thanks all for the for the work! (and sorry for the late response

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412125#comment-16412125 ] Konstantin Shvachko commented on HDFS-12943: Updated the design doc. Included a section in

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407336#comment-16407336 ] Konstantin Shvachko commented on HDFS-12943: Cut the branch {{origin/HDFS-12943}}. When

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308647#comment-16308647 ] Virajith Jalaparti commented on HDFS-12943: --- Thanks for the clarification [~shv] > Consistent

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300661#comment-16300661 ] Konstantin Shvachko commented on HDFS-12943: ??what's the function of the Observer Nodes??

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299398#comment-16299398 ] Virajith Jalaparti commented on HDFS-12943: --- Hi [~shv], thanks for posting the design document.

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298876#comment-16298876 ] Chao Sun commented on HDFS-12943: - bq. Thanks Chao Sun, interesting results! You used only 1 SBN to server

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298099#comment-16298099 ] Zhe Zhang commented on HDFS-12943: -- Thanks [~csun], interesting results! If I understand correctly, both

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297979#comment-16297979 ] Chao Sun commented on HDFS-12943: - [~chris.douglas] I did some experiment with the POC patch, on 2.8.3. It

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297939#comment-16297939 ] Konstantin Shvachko commented on HDFS-12943: Chris, I do not have POC numbers. I believe

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297516#comment-16297516 ] Chris Douglas commented on HDFS-12943: -- Thanks for the document and benchmarking. This is really

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297483#comment-16297483 ] Erik Krogen commented on HDFS-12943: We have been running some performance experiments (using