[ https://issues.apache.org/jira/browse/HIVE-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xuefu Zhang resolved HIVE-8795. ------------------------------- Resolution: Duplicate Dupe of HIVE-8836. Fix was evetually made in HIVE-8836 as well. > Switch precommit test from local to local-cluster [Spark Branch] > ---------------------------------------------------------------- > > Key: HIVE-8795 > URL: https://issues.apache.org/jira/browse/HIVE-8795 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Xuefu Zhang > Assignee: Szehon Ho > > It seems unlikely that Spark community will provide MRMiniCluster equivalent > (SPARK-3691), and Spark local-cluster was the recommendation. Latest research > shows that Spark local-cluster works with Hive. Therefore, for now, we use > Spark local-cluster (instead of current local) for our precommit test. > It's previous belived (HIVE-7382) that a Spark installation is required and > SPARK_HOME env variable needs to set. Since Spark pulls in Spark's assembly > jar, it's believed now we only need a few script from Spark installation > instead. -- This message was sent by Atlassian JIRA (v6.3.4#6332)