[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389843#comment-16389843 ]
Íñigo Goiri commented on HDFS-13234: ------------------------------------ [~kihwal], you had some good points on HDFS-13195 to a somewhat related topic. Do you mind chiming in here? > Remove renew configuration instance in ConfiguredFailoverProxyProvider and > reduce memory footprint for client > ------------------------------------------------------------------------------------------------------------- > > Key: HDFS-13234 > URL: https://issues.apache.org/jira/browse/HDFS-13234 > Project: Hadoop HDFS > Issue Type: Improvement > Components: fs, ha, hdfs-client > Reporter: He Xiaoqiao > Priority: Major > Attachments: HDFS-13234.001.patch > > > The memory footprint of #DFSClient is very considerable in some special > scenario since there are many #Configuration instances and occupy much memory > resource (In an extreme case, org.apache.hadoop.conf.Configuration occupies > over 600MB we meet under HDFS Federation an HA with QJM and there are dozens > of NameNodes). I think some new Configuration instance is not necessary. Such > as #ConfiguredFailoverProxyProvider initialization. > {code:java} > public ConfiguredFailoverProxyProvider(Configuration conf, URI uri, > Class<T> xface, HAProxyFactory<T> factory) { > this.xface = xface; > this.conf = new Configuration(conf); > ...... > } > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org