[jira] [Commented] (YARN-9974) Large diagnostics may cause RM recover failed

2019-11-13 Thread Wilfred Spiegelenburg (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973803#comment-16973803
 ] 

Wilfred Spiegelenburg commented on YARN-9974:
-

This looks like a duplicate of YARN-6125 and YARN-6967.
Which version of hadoop are you using?

> Large diagnostics may cause RM recover failed
> -
>
> Key: YARN-9974
> URL: https://issues.apache.org/jira/browse/YARN-9974
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: resourcemanager
>Reporter: zhoukang
>Assignee: zhoukang
>Priority: Critical
>
> {code:java}
> 2019-09-04,16:37:32,224 DEBUG org.apache.zookeeper.ClientCnxn: Reading reply 
> sessionid:0x563398cdd5889a1, packet:: clientPath:null serverPath:null 
> finished:false header:: 1659,4  replyHeader:: 1659,27117069873,0  request:: 
> '/yarn-ha/zjyprc-hadoop/rm-state/ZKRMStateRoot/RMAppRoot/application_1531361280531_691245,F
>   response:: 
> #8ffd3ffeeff86ff9bffda2c12ffc33fab8ffadff982a10ff93ff84fffbffe1ffc82c122b636f6d2e7869616f6d692e796f7570696e2e7265636f6d6d656e642e747261696e696e672e476264744c721a26726f6f742e70726f64756374696f6e2e6d696f745f67726f75702e796f7570696e2e646174612affce3ea77aa776174636865722e73681269a59a46864667312f7a6a797072632d6861646f6f702d3018ffd43e223d2f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f736372697074732f776174636865722f706d61705f776174636865722e736810ffec718ff81ffbbffa1ff83fff02b202281a74ad6f6f6d5f7363726970742e73681263a53a46864667312f7a6a797072632d6861646f6f702d3018ffd43e22372f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f736372697074732f6f6f6d2f6f6f6d5f7363726970742e736810ffa8318ff87ffbaffa1ff83fff02b202281affc91ae5f5f737061726b5f6c6962735f5f12ffb61affa31a46864667312f7a6a797072632d6861646f6f702d3018ffd43e22ff8612f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f73746167696e672f735f6d696f7473746f72652f2e737061726b53746167696e672f6170706c69636174696f6e5f313533313336313238303533315f3639313234352f5f5f737061726b5f6c6962735f5f383236383134383736393931313939393637302e7a697010ffdfff8dffd26518ffeeffceff86ff9bffda2c201282affba1ae5f5f737061726b5f636f6e665f5f12ffa71aff951a46864667312d7a6a797072632d6861646f6f7018122732f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f73746167696e672f735f6d696f7473746f72652f2e737061726b53746167696e672f6170706c69636174696f6e5f313533313336313238303533315f3639313234352f5f5f737061726b5f636f6e665f5f2e7a697010fffbff88418ffeaffecff86ff9bffda2c201282affbc1ab5f5f6170705f5f2e6a617212ffac1aff991a46864667312f7a6a797072632d6861646f6f702d3018ffd43e227d2f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f73746167696e672f735f6d696f7473746f72652f2e737061726b53746167696e672f6170706c69636174696f6e5f313533313336313238303533315f3639313234352f7265636f6d6d656e642d706970656c696e652d302e302e312e6a617210ffbeff94ffdf5618ffedffe8ff86ff9bffda2c20228212fffa9484454530901cafab8ffadff982a10ff93ff84fffbffe1ffc82c10110ffdaff80ffdeffe8fffb1141322ffa0ff835efff5860ffa7ffbfffefff8a42ffabffbcffed321bffb045105941524e5f414d5f524d5f544f4b454e01768612d686466733a7a6a797072632d6861646f6f702d303a019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff88ff9aff8a16cfffb12ffb4ff9aff8d1affedff8e172142b313b8ffe07f35ff88ffa8ffc0ff874641536f1ac6c6aff9d15484446535f44454c45474154494f4e5f544f4b454e1768612d686466733a7a6a797072632d6861646f6f702d301768612d686466733a7a6a797072632d6861646f6f702d3639019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff8929ff8a16cfffb12ffb529ff8d1bffbe32ff8fffba144e49ff8bffadffd5784fff815ffe5b14f1c7463fffeffceffd6fff215484446535f44454c45474154494f4e5f544f4b454e1768612d686466733a7a6a797072632d6861646f6f702d361768612d686466733a7a6a797072632d6861646f6f702d353a019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff896ff8a16cfffb12ffb56ff8d1a55ff8e16c143aff846b22ffbb34ffa629ffd61fffe4ffb4ffd3ffc062ffa4ffc0ffa7ffb815484446535f44454c45474154494f4e5f544f4b454e1768612d686466733a7a6a797072632d6861646f6f702d351768612d686466733a7a6a797072632d6861646f6f702d3739019735f6d696f7473746f7265405849414f4d492e4841444f

[jira] [Commented] (YARN-9974) Large diagnostics may cause RM recover failed

2019-11-13 Thread zhoukang (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973331#comment-16973331
 ] 

zhoukang commented on YARN-9974:


I will post a patch later

> Large diagnostics may cause RM recover failed
> -
>
> Key: YARN-9974
> URL: https://issues.apache.org/jira/browse/YARN-9974
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: resourcemanager
>Reporter: zhoukang
>Assignee: zhoukang
>Priority: Critical
>
> {code:java}
> 2019-09-04,16:37:32,224 DEBUG org.apache.zookeeper.ClientCnxn: Reading reply 
> sessionid:0x563398cdd5889a1, packet:: clientPath:null serverPath:null 
> finished:false header:: 1659,4  replyHeader:: 1659,27117069873,0  request:: 
> '/yarn-ha/zjyprc-hadoop/rm-state/ZKRMStateRoot/RMAppRoot/application_1531361280531_691245,F
>   response:: 
> #8ffd3ffeeff86ff9bffda2c12ffc33fab8ffadff982a10ff93ff84fffbffe1ffc82c122b636f6d2e7869616f6d692e796f7570696e2e7265636f6d6d656e642e747261696e696e672e476264744c721a26726f6f742e70726f64756374696f6e2e6d696f745f67726f75702e796f7570696e2e646174612affce3ea77aa776174636865722e73681269a59a46864667312f7a6a797072632d6861646f6f702d3018ffd43e223d2f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f736372697074732f776174636865722f706d61705f776174636865722e736810ffec718ff81ffbbffa1ff83fff02b202281a74ad6f6f6d5f7363726970742e73681263a53a46864667312f7a6a797072632d6861646f6f702d3018ffd43e22372f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f736372697074732f6f6f6d2f6f6f6d5f7363726970742e736810ffa8318ff87ffbaffa1ff83fff02b202281affc91ae5f5f737061726b5f6c6962735f5f12ffb61affa31a46864667312f7a6a797072632d6861646f6f702d3018ffd43e22ff8612f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f73746167696e672f735f6d696f7473746f72652f2e737061726b53746167696e672f6170706c69636174696f6e5f313533313336313238303533315f3639313234352f5f5f737061726b5f6c6962735f5f383236383134383736393931313939393637302e7a697010ffdfff8dffd26518ffeeffceff86ff9bffda2c201282affba1ae5f5f737061726b5f636f6e665f5f12ffa71aff951a46864667312d7a6a797072632d6861646f6f7018122732f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f73746167696e672f735f6d696f7473746f72652f2e737061726b53746167696e672f6170706c69636174696f6e5f313533313336313238303533315f3639313234352f5f5f737061726b5f636f6e665f5f2e7a697010fffbff88418ffeaffecff86ff9bffda2c201282affbc1ab5f5f6170705f5f2e6a617212ffac1aff991a46864667312f7a6a797072632d6861646f6f702d3018ffd43e227d2f737061726b2f7a6a797072632d6861646f6f702d737061726b322e312f73746167696e672f735f6d696f7473746f72652f2e737061726b53746167696e672f6170706c69636174696f6e5f313533313336313238303533315f3639313234352f7265636f6d6d656e642d706970656c696e652d302e302e312e6a617210ffbeff94ffdf5618ffedffe8ff86ff9bffda2c20228212fffa9484454530901cafab8ffadff982a10ff93ff84fffbffe1ffc82c10110ffdaff80ffdeffe8fffb1141322ffa0ff835efff5860ffa7ffbfffefff8a42ffabffbcffed321bffb045105941524e5f414d5f524d5f544f4b454e01768612d686466733a7a6a797072632d6861646f6f702d303a019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff88ff9aff8a16cfffb12ffb4ff9aff8d1affedff8e172142b313b8ffe07f35ff88ffa8ffc0ff874641536f1ac6c6aff9d15484446535f44454c45474154494f4e5f544f4b454e1768612d686466733a7a6a797072632d6861646f6f702d301768612d686466733a7a6a797072632d6861646f6f702d3639019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff8929ff8a16cfffb12ffb529ff8d1bffbe32ff8fffba144e49ff8bffadffd5784fff815ffe5b14f1c7463fffeffceffd6fff215484446535f44454c45474154494f4e5f544f4b454e1768612d686466733a7a6a797072632d6861646f6f702d361768612d686466733a7a6a797072632d6861646f6f702d353a019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff896ff8a16cfffb12ffb56ff8d1a55ff8e16c143aff846b22ffbb34ffa629ffd61fffe4ffb4ffd3ffc062ffa4ffc0ffa7ffb815484446535f44454c45474154494f4e5f544f4b454e1768612d686466733a7a6a797072632d6861646f6f702d351768612d686466733a7a6a797072632d6861646f6f702d3739019735f6d696f7473746f7265405849414f4d492e4841444f4f5087961726e5f7072630ff8a165ffa361ff88ffc1ff8a16cfffb12ffb4ffc