[ 
https://issues.apache.org/jira/browse/YARN-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated YARN-566:
-------------------------

    Labels: usability  (was: )
    
> Add a misconfiguration diagnostic or highlight mismatched resource.mb vs -Xmx
> -----------------------------------------------------------------------------
>
>                 Key: YARN-566
>                 URL: https://issues.apache.org/jira/browse/YARN-566
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Gopal V
>            Priority: Minor
>              Labels: usability
>
> It is possible to misconfigure a pure-java MR application by setting 
> mapreduce resource size to 1536Mb, while leaving the -Xmx value at the 
> default 512Mb.
> The AM UI can track over-all memory usage of an app either via 
> Runtime.maxMemory() or via the process watcher in YARN to report the actual 
> memory used by the application.
> MR does not fail even when the memory -Xmx is set lower than the YARN  
> allocations, but it spills & GCs instead to keep it with in the memory sizes.
> This is sub-optimal and would make sense for YARN to highlight in the AM UI 
> or JHS UI for tuning/debugging purposes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to