Hi all,
I've just launched a new Amazon EMR cluster and used the script at:
s3://support.elasticmapreduce/spark/install-spark
to install Spark (this script was upgraded to support 1.2).
I know there are tools to launch a Spark cluster in EC2, but I want to use
EMR.
Everything installs fine; ho
Just an update on this - I found that the script by Amazon was the culprit
- not exactly sure why. When I installed Spark manually onto the EMR (and
did the manual configuration of all the EMR stuff), it worked fine.
On Mon, Dec 22, 2014 at 11:37 AM, Adam Gilmore
wrote:
> Hi all,
>
> I've just
Can you confirm your emr version? Could it be because of the classpath
entries for emrfs? You might face issues with using S3 without them.
Thanks,
Aniket
On Mon, Jan 5, 2015, 11:16 AM Adam Gilmore wrote:
> Just an update on this - I found that the script by Amazon was the culprit
> - not exact
gt;>,
"user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Issue with Parquet on Spark 1.2 and Amazon EMR
Can you confirm your emr version? Could it be because of the classpath entries
for emrfs? You might face issues with
10:51 PM
> To: Adam Gilmore , "user@spark.apache.org" <
> user@spark.apache.org>
> Subject: Re: Issue with Parquet on Spark 1.2 and Amazon EMR
>
> Can you confirm your emr version? Could it be because of the classpath
> entries for emrfs? You might face issues
[mailto:aniket.bhatna...@gmail.com]
Sent: Monday, January 12, 2015 3:05 AM
To: Kelly, Jonathan; Adam Gilmore; user@spark.apache.org
Subject: Re: Issue with Parquet on Spark 1.2 and Amazon EMR
Meanwhile, I have submitted a pull request
(https://github.com/awslabs/emr-bootstrap-actions/pull/37) that
