Right, though that is something that could probably be fixed in a later
release. That is, the Zeppelin executor core/memory settings could be
defaulted to the same settings to which Spark defaults. Of course, you
might want Zeppelin's executor core/memory settings to differ from your
Spark defaults
That is great!
Note that executor settings needs to be configured manually in Zeppelin
though.
"Zeppelin does not use some of the settings defined in your cluster’s
spark-defaults.conf configuration file (though it will instruct YARN to
dynamically allocate executors if you have enabled that sett
Zeppelin is now supported on EMR in release emr-4.1.0 without the need for
any bootstrap action like this. See
https://aws.amazon.com/blogs/aws/amazon-emr-release-4-1-0-spark-1-5-0-hue-3-7-1-hdfs-encryption-presto-oozie-zeppelin-improved-resizing/
for the emr-4.1.0 announcement.
BTW, the version o
Did anyone else encountered that problem?
I removed the *--driver-class-path "${CLASSPATH}"* from bin/interpreter.sh
script and now it start the SparkContext as expected.
The problem is that it does not grab my local hive-site.xml that pointed to
an external metastore and try to use the local one
Hi Anders,
I also had the error you mention, overcame this with:
1. using spark installation from zeppelin
2. altering conf/interpreter.json with properties like
"spark.executor.instances", "spark.executor.cores",
"spark.default.parallelism" from spark-defaults.conf, parsed this file
Hi,
Thank you Phil for updating my script to support the latest version of EMR.
I have edited my gist so that it includes some of your updates plus added
some other additional changes.
https://gist.github.com/andershammar/224e1077021d0ea376dd
While on the subject, has anyone be able to get Zeppe
Here's a bit shorter alternative, too
https://gist.github.com/snowindy/008f3e8b878a23c00679
2015-09-09 18:58 GMT+04:00 shahab :
> Thanks Phil, it works. Great job and well done!
>
> best,
> /Shahab
>
> On Mon, Sep 7, 2015 at 6:32 PM, Phil Wills wrote:
>
>> Anders script is a bit out of date if
Thanks Phil, it works. Great job and well done!
best,
/Shahab
On Mon, Sep 7, 2015 at 6:32 PM, Phil Wills wrote:
> Anders script is a bit out of date if you're using the latest version of
> EMR. Here's my fork:
>
> https://gist.github.com/philwills/71539f833f57338236b5
>
> which worked OK for m
Anders script is a bit out of date if you're using the latest version of
EMR. Here's my fork:
https://gist.github.com/philwills/71539f833f57338236b5
which worked OK for me fairly recently.
Phil
On Mon, 7 Sep 2015 at 10:01 shahab wrote:
> Hi,
>
> I am trying to use Zeppelin to work with Spark
Hi,
I am trying to use Zeppelin to work with Spark on Amazon EMR. I used the
script provided by Anders (
https://gist.github.com/andershammar/224e1077021d0ea376dd) to setup
Zeppelin. The Zeppelin can connect to Spark but when I got error when I run
the tutorials. and I get the following error:
..
10 matches
Mail list logo
