[
https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324405#comment-16324405
]
BELUGA BEHR commented on HIVE-14162:
------------------------------------
[~xuefuz] I am familiar with dynamic allocation. So at a minimum the client
will be reserving a container for the ApplicationMaster/Driver (which can be up
to 12GB in some environments) and the default value of 1 Executor (which can be
up to 32GB in some environments). Even if the user has stepped away from the
Hive client for some amount of time. These are resources which could be used
by other users and is compounded by the number of users one environment
supports.
Thanks for the consideration.
> Allow disabling of long running job on Hive On Spark On YARN
> ------------------------------------------------------------
>
> Key: HIVE-14162
> URL: https://issues.apache.org/jira/browse/HIVE-14162
> Project: Hive
> Issue Type: New Feature
> Components: Spark
> Reporter: Thomas Scott
> Assignee: Aihua Xu
> Priority: Minor
> Attachments: HIVE-14162.1.patch
>
>
> Hive On Spark launches a long running process on the first query to handle
> all queries for that user session. In some use cases this is not desired, for
> instance when using Hue with large intervals between query executions.
> Could we have a property that would cause long running spark jobs to be
> terminated after each query execution and started again for the next one?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
