[
https://issues.apache.org/jira/browse/HIVE-18282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292052#comment-16292052
]
liyunzhang commented on HIVE-18282:
-----------------------------------
[~stakiar]:
http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-2.0.0-bin-hadoop2-without-hive.tgz.md5sum
exists. But
http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-2.2.0-bin-hadoop2-without-hive.tgz.md5sum
does not exist. Can you help upload the md5sum for spark2.2 package otherwise
spark tar will be downloaded even the package has been downloaded?
$HIVE_SOURCE/itests/pom.xml#Line 82
{code}
download() {
url=$1;
finalName=$2
tarName=$(basename $url)
rm -rf $BASE_DIR/$finalName
if [[ ! -f $DOWNLOAD_DIR/$tarName ]]
then
curl -Sso $DOWNLOAD_DIR/$tarName $url
else
local md5File="$tarName".md5sum
curl -Sso $DOWNLOAD_DIR/$md5File "$url".md5sum
cd $DOWNLOAD_DIR
if type md5sum >/dev/null && ! md5sum -c
$md5File; then // use md5sum to check if need to update package.
curl -Sso $DOWNLOAD_DIR/$tarName $url || return 1
fi
cd -
fi
tar -zxf $DOWNLOAD_DIR/$tarName -C $BASE_DIR
mv
$BASE_DIR/spark-${spark.version}-bin-hadoop2-without-hive $BASE_DIR/$finalName
}
{code}
> Spark tar is downloaded every time for itest
> --------------------------------------------
>
> Key: HIVE-18282
> URL: https://issues.apache.org/jira/browse/HIVE-18282
> Project: Hive
> Issue Type: Test
> Reporter: Rui Li
>
> Seems we missed the md5 file for spark-2.2.0?
> cc [~kellyzly], [~stakiar]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)