[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263206#comment-14263206 ]
Nicholas Chammas commented on SPARK-3821: ----------------------------------------- I have Packer configured to run {{create_image.sh}}, as well as other scripts I added (e.g. to install Python 2.7), to generate the AMIs I am using. So testing Packer-generated AMIs against manually-generated ones (by running {{create_image.sh}} by hand) should show little difference. Packer is just tooling to automate the application of existing scripts like {{create_image.sh}} towards creating AMIs and other image types like GCE images and Docker images. The goal is to make it easy to generate and update Spark AMIs (and eventually Docker images too) in an automated fashion. > Develop an automated way of creating Spark images (AMI, Docker, and others) > --------------------------------------------------------------------------- > > Key: SPARK-3821 > URL: https://issues.apache.org/jira/browse/SPARK-3821 > Project: Spark > Issue Type: Improvement > Components: Build, EC2 > Reporter: Nicholas Chammas > Assignee: Nicholas Chammas > Attachments: packer-proposal.html > > > Right now the creation of Spark AMIs or Docker containers is done manually. > With tools like [Packer|http://www.packer.io/], we should be able to automate > this work, and do so in such a way that multiple types of machine images can > be created from a single template. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org