Gopinath created HIVE-26760:
-------------------------------
Summary: HiveServer2 hanging due to JVM Pauses or going down due
to OOM
Key: HIVE-26760
URL: https://issues.apache.org/jira/browse/HIVE-26760
Project: Hive
Issue Type: Bug
Components: HiveServer2
Reporter: Gopinath
The problem was HiveServer2 hanging or going down frequently due to OOM or JVM
pauses.
The issue was with a specific query on an External table. Hive did not load the
data and no statistics were generated for the same. Hence when running the
query (select * from ) on top of the table, HS2 requested a direct fetch, As
the amount of data present at the location was huge and Hive was trying to load
all the data in the memory directly because of the direct fetch, HiveServer2
was running out of memory and thus, leading to JVM Pauses/OOM.
To fix the issue as a workaround, after identifying the corresponding query,
try setting the below property or collecting stats for the table involved.
*SET hive.fetch.task.conversion=none;*
*Action Needed*
Avoid service level impact by considering a directory size or file size before
triggering a direct fetch if stats are empty or partial.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
