[ https://issues.apache.org/jira/browse/YARN-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gopal V updated YARN-566: ------------------------- Labels: usability (was: ) > Add a misconfiguration diagnostic or highlight mismatched resource.mb vs -Xmx > ----------------------------------------------------------------------------- > > Key: YARN-566 > URL: https://issues.apache.org/jira/browse/YARN-566 > Project: Hadoop YARN > Issue Type: Improvement > Reporter: Gopal V > Priority: Minor > Labels: usability > > It is possible to misconfigure a pure-java MR application by setting > mapreduce resource size to 1536Mb, while leaving the -Xmx value at the > default 512Mb. > The AM UI can track over-all memory usage of an app either via > Runtime.maxMemory() or via the process watcher in YARN to report the actual > memory used by the application. > MR does not fail even when the memory -Xmx is set lower than the YARN > allocations, but it spills & GCs instead to keep it with in the memory sizes. > This is sub-optimal and would make sense for YARN to highlight in the AM UI > or JHS UI for tuning/debugging purposes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira