Re: spark-ec2 script to launch cluster running Spark 1.5.2 built with HIVE?

There is no codepath in the script /root/spark-ec2/spark/init.sh that can actually get to the version of spark 1.5.2 pre-built with Hadoop 2.6. I think the 2.4 version includes Hive as well... but setting hadoop major version to 2 won't actually get you there. Sigh. The documentation is the

spark-ec2 script to launch cluster running Spark 1.5.2 built with HIVE?

Hi all, As far as I can tell, the bundled spark-ec2 script provides no way to launch a cluster running Spark 1.5.2 pre-built with HIVE. That is to say, all of the pre-build versions of Spark 1.5.2 in the s3 bin spark-related-packages are missing HIVE. aws s3 ls s3://spark-related-packages/ |

Re: spark-ec2 script to launch cluster running Spark 1.5.2 built with HIVE?

Don't the Hadoop builds include Hive already? Like spark-1.5.2-bin-hadoop2.6.tgz? On Mon, Nov 23, 2015 at 7:49 PM Jeff Schecter wrote: > Hi all, > > As far as I can tell, the bundled spark-ec2 script provides no way to > launch a cluster running Spark 1.5.2 pre-built with