[
https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072170#comment-14072170
]
Lefty Leverenz commented on HIVE-7397:
--------------------------------------
This changes the default for *hive.fetch.task.conversion* from "minimal" to
"more" and changes the default for *hive.fetch.task.conversion.threshold* from
"-1l" to "1073741824L" in HiveConf.java and the template file so the wiki needs
to be updated with version notes and links back to this JIRA ticket. (In
hive-site.xml, *hive.fetch.task.conversion* is set to "minimal".)
* [Configuration Properties -- hive.fetch.task.conversion |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.fetch.task.conversion
]
* [Configuration Properties -- hive.fetch.task.conversion.threshold |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.fetch.task.conversion.threshold
]
> Set the default threshold for fetch task conversion to 1Gb
> ----------------------------------------------------------
>
> Key: HIVE-7397
> URL: https://issues.apache.org/jira/browse/HIVE-7397
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.14.0, 0.13.1
> Reporter: Gopal V
> Assignee: Gopal V
> Labels: Performance, TODOC14
> Fix For: 0.14.0
>
> Attachments: HIVE-7397.1.patch, HIVE-7397.2.patch, HIVE-7397.3.patch,
> HIVE-7397.4.patch.txt, HIVE-7397.5.patch, HIVE-7397.6.patch.txt
>
>
> Currently, modifying the value of hive.fetch.task.conversion to "more"
> results in a dangerous setting where small scale queries function, but large
> scale queries crash.
> This occurs because the default threshold of -1 means apply this optimization
> for a petabyte table.
> I am testing a variety of queries with the setting "more" (to make it the
> default option as suggested by HIVE-887) change the default threshold for
> this feature to a reasonable 1Gb.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
