Hello Vihang Karajgaonkar,
I'd like you to do a code review. Please visit
http://gerrit.cloudera.org:8080/13113
to review the following change.
Change subject: Verify existence of HIVE_AUX_JARS before running HS2
......................................................................
Verify existence of HIVE_AUX_JARS before running HS2
I spent an hour today trying to debug the following issue:
- we pass $POSTGRES_JDBC_DRIVER as $HIVE_AUX_JARS_PATH when starting HS2
- the path to the JDBC driver is inside the fe/target/dependency/
directory
- if we haven't built the frontend yet, that jar won't exist yet
- at least on HS2 from Hive 3 (maybe on Hive 2 as well?) if you pass a
non-existent jar in this environment variable, it will fail with a
fairly uninintelligible error like:
tez.DagUtils: Localizing resource because it does not exist:
file:/data/1/todd/impala/fe/target/dependency/postgresql-42.2.5.jar to dest:
hdfs://localhost:20500/tmp/hive/todd/_tez_session_dir/9de357d5-59bf-4faa-8973-5212a08bc41a-resources/postgresql-42.2.5.jar
tez.DagUtils: Looks like another thread or process is writing the same file
tez.DagUtils: Waiting for the file
hdfs://localhost:20500/tmp/hive/todd/_tez_session_dir/9de357d5-59bf-4faa-8973-5212a08bc41a-resources/postgresql-42.2.5.jar
(5 attempts, with 5000ms interval)
tez.DagUtils: Could not find the jar that was being uploaded
tez.TezTask: Failed to execute tez graph.```
I filed HIVE-21649 to improve this logging.
Change-Id: I3a2458b9e92a9243fc00d1bd80791062c89496f7
---
M testdata/bin/run-hive-server.sh
1 file changed, 11 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/13/13113/1
--
To view, visit http://gerrit.cloudera.org:8080/13113
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I3a2458b9e92a9243fc00d1bd80791062c89496f7
Gerrit-Change-Number: 13113
Gerrit-PatchSet: 1
Gerrit-Owner: Todd Lipcon <[email protected]>
Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
