He Xiaoqiao created HDFS-13234:
----------------------------------

             Summary: Remove renew configuration instance in 
ConfiguredFailoverProxyProvider and reduce memory footprint for client
                 Key: HDFS-13234
                 URL: https://issues.apache.org/jira/browse/HDFS-13234
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: fs, ha, hdfs-client
            Reporter: He Xiaoqiao


The memory footprint of #DFSClient is very considerable in some special 
scenario since there are many #Configuration instances and occupy much memory 
resource (In an extreme case, org.apache.hadoop.conf.Configuration occupies 
over 600MB we meet under HDFS Federation an HA with QJM and there are dozens of 
NameNodes). I think some new Configuration instance is not necessary. Such as  
#ConfiguredFailoverProxyProvider initialization.

{code:java}
  public ConfiguredFailoverProxyProvider(Configuration conf, URI uri,
      Class<T> xface, HAProxyFactory<T> factory) {
    this.xface = xface;
    this.conf = new Configuration(conf);
    ......
  }
{code}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to