Hi Zeppelin users,
I'v been presenting some demo on "Spark+Zeppelin on AWS EMR" at AWS Summit
Seoul yesterday. I'm so sad that the slides are written in Korean so it's
hard to share, but I'd like to share some essentials.
1. Running Z on EMR is super easy. (EMR team did really good job. You can
do that with only few clicks, took 8min to launch)
2. You can launch EMR with spot instances, it will save your money.
3. You can provide some configs when you launch EMR cluster, so you may
want to save your notebook on S3, proper config is as follow.
[
{
"Classification": "zeppelin-env",
"Properties": {},
"Configurations": [
{
"Classification": "export",
"Properties": {
“ZEPPELIN_NOTEBOOK_STORAGE"
:"org.apache.zeppelin.notebook.repo.S3NotebookRepo",
"ZEPPELIN_NOTEBOOK_S3_BUCKET": "BUCKET_NAME",
"ZEPPELIN_NOTEBOOK_S3_USER": "SOME_USER_NAME"
},
"Configurations": []
}
]
}
]
4. You need to set proper spark.executor.memory in Zeppelin interpreter
setting.
5. You can increase or decrease cluster size in cluster detail page.
6. Don't forget to terminate cluster when you're done your job :)
That's all!
If you have more tips, plz add it on this mail thread. Thanks!
- Kevin
