[
https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162663#comment-14162663
]
Nicholas Chammas commented on SPARK-3821:
-----------------------------------------
[~shivaram] / [~pwendell]:
# In a Spark cluster, what's the difference between what's installed on the
master and what's installed on the slaves? Is it basically the same stuff, just
with minor configuration changes?
# Starting from a base AMI, is the rough procedure for creating a fully built
Spark instance simply running
[{{create_image.sh}}|https://github.com/mesos/spark-ec2/blob/v3/create_image.sh]
followed by [{{setup.sh}}|https://github.com/mesos/spark-ec2/blob/v3/setup.sh]
(minus the stuff that connects to other instances)?
> Develop an automated way of creating Spark images (AMI, Docker, and others)
> ---------------------------------------------------------------------------
>
> Key: SPARK-3821
> URL: https://issues.apache.org/jira/browse/SPARK-3821
> Project: Spark
> Issue Type: Improvement
> Components: Build, EC2
> Reporter: Nicholas Chammas
>
> Right now the creation of Spark AMIs or Docker containers is done manually.
> With tools like [Packer|http://www.packer.io/], we should be able to automate
> this work, and do so in such a way that multiple types of machine images can
> be created from a single template.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
