[ https://issues.apache.org/jira/browse/YARN-6358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carlo Curino reassigned YARN-6358: ---------------------------------- Assignee: Jose Miguel Arreola > Cache the resolved hosts prevent calls to InetAddress.getByName and > normalizeHost > --------------------------------------------------------------------------------- > > Key: YARN-6358 > URL: https://issues.apache.org/jira/browse/YARN-6358 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager, security > Reporter: Jose Miguel Arreola > Assignee: Jose Miguel Arreola > Labels: performance > Original Estimate: 24h > Remaining Estimate: 24h > > When running performance tests, we noticed that a lot of time is taken in > resolving the host address. > In our specific scenario, we saw the function > org.apache.hadoop.security.SecurityUtil.getInetAddressByName taking a lot of > time to resolve the hosts, and the same function is called a lot of times. > I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has > a cached resolver already because of the same reason. > So, the proposal is, to make this cache generic and use it to save some time > in this functions that we already know, but have it available so the cache > can be used anywhere else. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org