[
https://issues.apache.org/jira/browse/HIVE-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thejas M Nair updated HIVE-5113:
--------------------------------
Status: Open (was: Patch Available)
bq. 1. can templeton.controller.map.mem be named mapreduce.map.memory.mb, i.e.
the same as the Hadoop prop. I think it is easier to follow if prop are not
renamed. Or at least webhcat(templeton).mapreduce.map.memory.mb if you are
worried about namespace collisions. (same for other new props)
I think it will be useful to have the "templeton.controller" prefix to indicate
that it is only applicable to the controller job. I can rename rest of the
config param name.
(I think it will be better to switch everything to webhcat later in one step)
bq. 2. The description in webhcat-default.xml: Could it say that this is a
Hadoop option and is passed directly/as is to Templeton Controller MR job. (In
some cases default is specified as '512' and in others '-Xmx300m'). It would
tell users where to go get more doc that explains what these props do.
sure
bq. 3. templeton.controller.mr.child.opts is defined in the code but now
webhcat-default.xml. Is that intentional?
Yes, it was missing in webhcat-default.xml
bq. 4. Are there symbolic constants in Hadoop code base for these? Can they be
used here?
I thought of doing this, but they are in hadoop 2.0 codebase only, and we would
need to add shims code for that. Maybe, since we already have a shims layer, we
can add it.
> webhcat should allow configuring memory used by templetoncontroller map job
> in hadoop2
> --------------------------------------------------------------------------------------
>
> Key: HIVE-5113
> URL: https://issues.apache.org/jira/browse/HIVE-5113
> Project: Hive
> Issue Type: Improvement
> Components: WebHCat
> Reporter: Thejas M Nair
> Assignee: Thejas M Nair
> Attachments: HIVE-5113.1.patch
>
>
> Webhcat should allow the following hadoop2 config parameters to be set the
> templetoncontroller map-only job that actually runs the pig/hive/mr command.
> mapreduce.map.memory.mb
> yarn.app.mapreduce.am.resource.mb
> yarn.app.mapreduce.am.command-opts
> It should also be set to reasonable defaults.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
