[
https://issues.apache.org/jira/browse/HIVE-19763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523894#comment-16523894
]
Luis E Martinez-Poblete commented on HIVE-19763:
------------------------------------------------
[~sershe], I'm aware of the strict checks, however they do not help when the
query is during compilation phase as pointed out by [~pvary]
Hive should have a protection mechanism to avoid situations in which a query
can potentially exhaust memory or any other resources during compilation phase.
> Prevent execution of very large queries
> ---------------------------------------
>
> Key: HIVE-19763
> URL: https://issues.apache.org/jira/browse/HIVE-19763
> Project: Hive
> Issue Type: New Feature
> Components: HiveServer2
> Affects Versions: 2.3.2
> Reporter: Luis E Martinez-Poblete
> Priority: Minor
>
> Synopsis:
> =========
> Prevent execution of very large queries.
>
> Feature Request:
> ================
> Please enhance Hive with a parameter to restrict the execution of very large
> queries.
> Use case: User is trying to create a view with a size of 8 MB. Creation of
> this view was possible after increasing heap memory in several components
> (HMS, HS2, Zookeeper). However, this view caused major issues when it was
> used in a CTE query which resulted in GC pauses and eventually OOM of the HS2
> process.
>
> Although, it is possible to create the view, it may cause other issues when
> used in queries. From the Hadoop administrator point of view, it would be
> good to restrict this type of queries.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
