[ 
https://issues.apache.org/jira/browse/HCATALOG-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13555449#comment-13555449
 ] 

Thejas M Nair commented on HCATALOG-587:
----------------------------------------

bq. In AppConfig.controllerMRChildOpts we see the JVM args are hard-coded. Why 
embed these options in the code, rather than use the string provided in 
webhcat-default.xml. My understanding is all default values should be in the 
XML file, and the code provides access to the merged config.
I agree. I have also moved the notes about the memory issue to the default.xml 
file in HCATALOG-587.2.patch.

                
> webhcat controller map task takes too much memory
> -------------------------------------------------
>
>                 Key: HCATALOG-587
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-587
>             Project: HCatalog
>          Issue Type: Bug
>          Components: webhcat-svr
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.5, 0.6
>
>         Attachments: HCATALOG-587.1.patch, HCATALOG-587.2.patch
>
>
> The webhcat map only task does not need lot of memory. But when a java 
> application is started with -server option, it allocates the memory specified 
> as max heap size (-Xmx in oracle jre) upfront.
> When combined with the memory used by pig or hive client, this can sometimes 
> exceed the maximum memory limit for a map task (if configured).
> Being able to specify the java options for the map task will be useful to 
> avoid this issue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to