[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-28 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118421#comment-17118421 ] Hudson commented on HDFS-13183: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18304 (See

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118409#comment-17118409 ] Ayush Saxena commented on HDFS-13183: - Committed addendum to trunk and branch-3.3 Thanx [~hexiaoqiao]

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115072#comment-17115072 ] Ayush Saxena commented on HDFS-13183: - Thanx [~hexiaoqiao] and [~Jim_Brennan] for the quick fix. +1

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-21 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113467#comment-17113467 ] Jim Brennan commented on HDFS-13183: I am +1 (non-binding) on the second addendum patch. > Standby

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-21 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113218#comment-17113218 ] Jim Brennan commented on HDFS-13183: [~hexiaoqiao] thanks for checking TestBalancer and fixing the

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113049#comment-17113049 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112857#comment-17112857 ] Xiaoqiao He commented on HDFS-13183: After dig deep about BalancerWithObserver, the root cause of

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112463#comment-17112463 ] Xiaoqiao He commented on HDFS-13183: Thanks [~Jim_Brennan] for your information. I think TestBalancer

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112277#comment-17112277 ] Jim Brennan commented on HDFS-13183: Thanks [~hexiaoqiao]. It looks like there are still some

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112111#comment-17112111 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111744#comment-17111744 ] Xiaoqiao He commented on HDFS-13183: Hi [~weichiu],[~Jim_Brennan] I am sure the failed unit test

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111707#comment-17111707 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] and [~Jim_Brennan] for your reminder, I will

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111628#comment-17111628 ] Wei-Chiu Chuang commented on HDFS-13183: Thanks Jim [~hexiaoqiao] how do you think? I can revert

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111586#comment-17111586 ] Jim Brennan commented on HDFS-13183: More importantly, because it will never return NO_MOVE_PROGRESS,

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111578#comment-17111578 ] Jim Brennan commented on HDFS-13183: [~weichiu], [~hexiaoqiao], I believe this change is causing

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110460#comment-17110460 ] Wei-Chiu Chuang commented on HDFS-13183: Done. Pushed both to branch-3.3. Thanks! > Standby

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110450#comment-17110450 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your reminder here. branch-3.3 compile

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110442#comment-17110442 ] Wei-Chiu Chuang commented on HDFS-13183: Just realized the code doesn't compile in branch-3.3 so

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110422#comment-17110422 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your helps and push this feature forward.

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110327#comment-17110327 ] Hudson commented on HDFS-13183: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #18268 (See

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110306#comment-17110306 ] Wei-Chiu Chuang commented on HDFS-13183: +1 bq. BTW, I am not sure why configuration key

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110296#comment-17110296 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109977#comment-17109977 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109826#comment-17109826 ] Xiaoqiao He commented on HDFS-13183: code rebase and trigger yetus again. > Standby NameNode process

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108881#comment-17108881 ] Xiaoqiao He commented on HDFS-13183: Try to run failed unit test at local, both of them passed except

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108251#comment-17108251 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108132#comment-17108132 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your comments. {quote}does it work in

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099434#comment-17099434 ] Wei-Chiu Chuang commented on HDFS-13183: I am really sorry I meant to review but got distracted.

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070299#comment-17070299 ] Xiaoqiao He commented on HDFS-13183: [~ayushtkn] I totally agree that SBN read/Observer is more

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069333#comment-17069333 ] Ayush Saxena commented on HDFS-13183: - Thanx [~hexiaoqiao] for the patch, couldn't check the code.

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069272#comment-17069272 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069207#comment-17069207 ] Xiaoqiao He commented on HDFS-13183: v005 try to fix the findbugs and checkstyle. > Standby NameNode

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069006#comment-17069006 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068994#comment-17068994 ] Hadoop QA commented on HDFS-13183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068809#comment-17068809 ] Xiaoqiao He commented on HDFS-13183: Considering this feature is deployed and used by many users, I

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2019-12-30 Thread Max Xie (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005233#comment-17005233 ] Max Xie commented on HDFS-13183: - (y) > Standby NameNode process getBlocks request to reduce Active

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-07-15 Thread xiaoli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544463#comment-16544463 ] xiaoli commented on HDFS-13183: --- (y) > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503271#comment-16503271 ] He Xiaoqiao commented on HDFS-13183: Thanks [~elgoiri] and [~shv] for your comments. {quote} If we

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501194#comment-16501194 ] Konstantin Shvachko commented on HDFS-13183: I think once reads from StandbyNode HDFS-12943

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-06-04 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501003#comment-16501003 ] Íñigo Goiri commented on HDFS-13183: I came across this JIRA and I had a similar use case. For

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383114#comment-16383114 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] {quote}if the SbNN goes down, the ANN is not aware of

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382189#comment-16382189 ] Erik Krogen commented on HDFS-13183: I'm not sure that a specific new exception just for this

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381922#comment-16381922 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] Thanks for your comments and correct me. In patch

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380554#comment-16380554 ] Erik Krogen commented on HDFS-13183: An {{IOException}} thrown on the ANN side will return to the

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380139#comment-16380139 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] Thanks for your detailed comments, and sorry for slow

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377660#comment-16377660 ] Erik Krogen commented on HDFS-13183: [~hexiaoqiao], thanks for raising this issue! I was actually just

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377367#comment-16377367 ] Ajay Kumar commented on HDFS-13183: --- [~hexiaoqiao], there are broader efforts to utilize SNN in this

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375520#comment-16375520 ] He Xiaoqiao commented on HDFS-13183: [~ajayydv], Thanks for your comments, {quote}It would be good if

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374932#comment-16374932 ] Ajay Kumar commented on HDFS-13183: --- [~hexiaoqiao], this is good start but it will not redirect

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374325#comment-16374325 ] He Xiaoqiao commented on HDFS-13183: The WIP patch V1 demonstrates approach for Standby NameNode