[jira] [Commented] (SPARK-3674) Add support for launching YARN clusters in spark-ec2
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335199#comment-14335199 ] Nicholas Chammas commented on SPARK-3674: - There is an open PR for this here: https://github.com/mesos/spark-ec2/pull/77 > Add support for launching YARN clusters in spark-ec2 > > > Key: SPARK-3674 > URL: https://issues.apache.org/jira/browse/SPARK-3674 > Project: Spark > Issue Type: Improvement > Components: EC2 >Reporter: Shivaram Venkataraman >Assignee: Shivaram Venkataraman > > Right now spark-ec2 only supports launching Spark Standalone clusters. While > this is sufficient for basic usage it is hard to test features or do > performance benchmarking on YARN. It will be good to add support for > installing, configuring a Apache YARN cluster at a fixed version -- say the > latest stable version 2.4.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3674) Add support for launching YARN clusters in spark-ec2
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557174#comment-14557174 ] Apache Spark commented on SPARK-3674: - User 'shivaram' has created a pull request for this issue: https://github.com/apache/spark/pull/6376 > Add support for launching YARN clusters in spark-ec2 > > > Key: SPARK-3674 > URL: https://issues.apache.org/jira/browse/SPARK-3674 > Project: Spark > Issue Type: Improvement > Components: EC2 >Reporter: Shivaram Venkataraman >Assignee: Shivaram Venkataraman > > Right now spark-ec2 only supports launching Spark Standalone clusters. While > this is sufficient for basic usage it is hard to test features or do > performance benchmarking on YARN. It will be good to add support for > installing, configuring a Apache YARN cluster at a fixed version -- say the > latest stable version 2.4.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3674) Add support for launching YARN clusters in spark-ec2
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560282#comment-14560282 ] Apache Spark commented on SPARK-3674: - User 'shivaram' has created a pull request for this issue: https://github.com/apache/spark/pull/6424 > Add support for launching YARN clusters in spark-ec2 > > > Key: SPARK-3674 > URL: https://issues.apache.org/jira/browse/SPARK-3674 > Project: Spark > Issue Type: Improvement > Components: EC2 >Reporter: Shivaram Venkataraman >Assignee: Shivaram Venkataraman > Fix For: 1.4.0 > > > Right now spark-ec2 only supports launching Spark Standalone clusters. While > this is sufficient for basic usage it is hard to test features or do > performance benchmarking on YARN. It will be good to add support for > installing, configuring a Apache YARN cluster at a fixed version -- say the > latest stable version 2.4.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
