Gopal V created HADOOP-9570:
-------------------------------

             Summary: Configuration.addResource() should only parse the new 
resource
                 Key: HADOOP-9570
                 URL: https://issues.apache.org/jira/browse/HADOOP-9570
             Project: Hadoop Common
          Issue Type: Bug
          Components: conf
         Environment: Ubuntu LXC
            Reporter: Gopal V
            Assignee: Gopal V
            Priority: Minor


Hadoop configuration parsing re-parses all configuration files when a new 
resource is added to the configuration object.

This is wasteful and runs through every deprecation check unnecessarily.

{code}
JobConf clone = new JobConf(job);
clone.addResource(...);
{code}

will reparse every file including core-site, hdfs-site etc.

Resource addition can be taken care of cleanly, if the addResourceObject() call 
applies the new resource, followed by applying the overlay, without re-parsing 
any of the older files already loaded into the hashtable.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to