Miklos Gergely created HIVE-21516:
-------------------------------------
Summary: Fix spark downloading for q tests
Key: HIVE-21516
URL: https://issues.apache.org/jira/browse/HIVE-21516
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 3.1.1
Reporter: Miklos Gergely
Assignee: Miklos Gergely
Fix For: 4.0.0
Currently itests/pom.xml declares a command to generated the download script
for spark, thus it is re-generated every time any maven command is executed for
any sub project of itests. AS a side effect it is leaving download.sh files
everywhere. The download.sh file is almost totally static, no need to recreate
it every time, just requires $spark.version as a parameter.
Also it is only working properly under linux, as it relies on the md5sum
program which is not present in OS X. This means that if the spark tarball is
partially downloaded on OS X, then it would never be re-downloaded. This should
be fixed by making it work as well using md5 on OS X.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)