RE: NN run progressively slower

2018-09-27 Thread Brahma Reddy Battula
ents between CDH5.5 ~ >CDH5.8 time frame. We have customers at/beyond your scale in your version but >I don't think I've heard similar symptoms. Thanks for sharing this. Thanks Yiqun 发件人: Wei-Chiu Chuang [mailto:weic...@cloudera.com] 发送时间: 2018年9月26日 11:14 收件人: 林意群[运营中心] 抄送: Hdfs-

Re: NN run progressively slower

2018-09-25 Thread Wei-Chiu Chuang
Yiqun, Is this related to HDFS-9260? Note that HDFS-9260 was backported since CDH5.7 and above. I'm interested to learn more. Did you observe clients failing to close file due to insufficient number of block replicas? Did NN fail over? Did you have gc logging enabled? Any chance to take a heap dum

Re: NN run progressively slower

2018-09-25 Thread Kihwal Lee
Are you using CMS? How big is young gen? How often does the NN do young gen collection when it is slow? On Tue, Sep 25, 2018 at 4:04 AM Lin,Yiqun(vip.com) wrote: > Hi hdfs developers: > > We meet a bad problem after rolling upgrade our hadoop version from > 2.5.0-cdh5.3.2 to 2.6.0-cdh5.13.1. The