[ https://issues.apache.org/jira/browse/HIVE-16735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022339#comment-16022339 ]
Lefty Leverenz commented on HIVE-16735: --------------------------------------- You're right, the doc needs to be fixed so you're not missing anything (except the desired fix). I'm just saying the parameter description should also be fixed in HiveConf.java. If anyone code-savvy wants to take a look at this, that would be great. If not, I'll just fix the docs and HiveConf.java. (Don't all speak at once now.) > Please add that hive.mapred.local.mem must be set in MBs in the documentation > ----------------------------------------------------------------------------- > > Key: HIVE-16735 > URL: https://issues.apache.org/jira/browse/HIVE-16735 > Project: Hive > Issue Type: Task > Components: Documentation > Reporter: Laurel Hale > Assignee: Lefty Leverenz > Priority: Minor > > Hi Lefty, > One of my developers noticed this and we do not document the local mode. > Thought I'd let you know. > Here's a good place where you could put this: > https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution > There's already a small subsection where hive.mapred.local.mem is documented, > but there isn't any information about how to set the value. My developer > discovered that when you set it in bytes, it throws the following error: > 2017-03-12 09:24:31,835 ERROR [HiveServer2-Background-Pool: Thread-22163()]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(341)) - Exception: > java.lang.NumberFormatException: For input string: "4294967296" > java.lang.NumberFormatException: For input string: "4294967296" > at > java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) > at java.lang.Integer.parseInt(Integer.java:495) > at java.lang.Integer.parseInt(Integer.java:527) > at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1259) > at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:2415) > at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:2424) > at > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask.executeInChildVM(MapredLocalTask.java:228) > Instead, this value should be set in MBs for success. > Thanks, > Laurel -- This message was sent by Atlassian JIRA (v6.3.15#6346)