[jira] [Commented] (SPARK-20277) Allow Spark on YARN to be launched with Docker
[ https://issues.apache.org/jira/browse/SPARK-20277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765929#comment-16765929 ] Fernando Racca commented on SPARK-20277: Any updates on this support? Hadoop's YARN supports the future now. > Allow Spark on YARN to be launched with Docker > -- > > Key: SPARK-20277 > URL: https://issues.apache.org/jira/browse/SPARK-20277 > Project: Spark > Issue Type: New Feature > Components: YARN >Affects Versions: 1.6.0, 2.0.0 >Reporter: Zhankun Tang >Priority: Major > > Currently YARN is going to support Docker(YARN-3611). > We want to empower Spark to support launching Executors via a Docker image > that resolving the user's dependencies. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-20277) Allow Spark on YARN to be launched with Docker
[ https://issues.apache.org/jira/browse/SPARK-20277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962787#comment-15962787 ] Zhankun Tang commented on SPARK-20277: -- It requires at least hadoop 2.8 Alpha1 from the roadmap. I think it won't be that long. > Allow Spark on YARN to be launched with Docker > -- > > Key: SPARK-20277 > URL: https://issues.apache.org/jira/browse/SPARK-20277 > Project: Spark > Issue Type: New Feature > Components: YARN >Affects Versions: 1.6.0, 2.0.0 >Reporter: Zhankun Tang > > Currently YARN is going to support Docker(YARN-3611). > We want to empower Spark to support launching Executors via a Docker image > that resolving the user's dependencies. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-20277) Allow Spark on YARN to be launched with Docker
[ https://issues.apache.org/jira/browse/SPARK-20277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962595#comment-15962595 ] Sean Owen commented on SPARK-20277: --- What version of YARN is that going to require? it may be a non-starter for the near future if it requires 2.9 or 3.0 or something. > Allow Spark on YARN to be launched with Docker > -- > > Key: SPARK-20277 > URL: https://issues.apache.org/jira/browse/SPARK-20277 > Project: Spark > Issue Type: New Feature > Components: YARN >Affects Versions: 1.6.0, 2.0.0 >Reporter: Zhankun Tang > > Currently YARN is going to support Docker(YARN-3611). > We want to empower Spark to support launching Executors via a Docker image > that resolving the user's dependencies. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
