[jira] [Assigned] (SPARK-11035) Launcher: allow apps to be launched in-process

2017-12-28 Thread Imran Rashid (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Imran Rashid reassigned SPARK-11035:


Assignee: Marcelo Vanzin

> Launcher: allow apps to be launched in-process
> --
>
> Key: SPARK-11035
> URL: https://issues.apache.org/jira/browse/SPARK-11035
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 1.6.0
>Reporter: Marcelo Vanzin
>Assignee: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child 
> processes. That is fine for a lot of cases, especially if the app is running 
> in client mode.
> But in certain cases, especially launching in cluster mode, it's more 
> efficient to avoid launching a new process, since that process won't be doing 
> much.
> We should add support for launching apps in process, even if restricted to 
> cluster mode at first. This will require some rework of the launch paths to 
> avoid using system properties to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-11035) Launcher: allow apps to be launched in-process

2017-12-28 Thread Imran Rashid (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Imran Rashid reassigned SPARK-11035:


Assignee: (was: Marcelo Vanzin)

> Launcher: allow apps to be launched in-process
> --
>
> Key: SPARK-11035
> URL: https://issues.apache.org/jira/browse/SPARK-11035
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 1.6.0
>Reporter: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child 
> processes. That is fine for a lot of cases, especially if the app is running 
> in client mode.
> But in certain cases, especially launching in cluster mode, it's more 
> efficient to avoid launching a new process, since that process won't be doing 
> much.
> We should add support for launching apps in process, even if restricted to 
> cluster mode at first. This will require some rework of the launch paths to 
> avoid using system properties to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-11035) Launcher: allow apps to be launched in-process

2017-12-28 Thread Imran Rashid (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Imran Rashid reassigned SPARK-11035:


Assignee: Marcelo Vanzin

> Launcher: allow apps to be launched in-process
> --
>
> Key: SPARK-11035
> URL: https://issues.apache.org/jira/browse/SPARK-11035
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 1.6.0
>Reporter: Marcelo Vanzin
>Assignee: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child 
> processes. That is fine for a lot of cases, especially if the app is running 
> in client mode.
> But in certain cases, especially launching in cluster mode, it's more 
> efficient to avoid launching a new process, since that process won't be doing 
> much.
> We should add support for launching apps in process, even if restricted to 
> cluster mode at first. This will require some rework of the launch paths to 
> avoid using system properties to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-11035) Launcher: allow apps to be launched in-process

2016-09-08 Thread Apache Spark (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-11035:


Assignee: (was: Apache Spark)

> Launcher: allow apps to be launched in-process
> --
>
> Key: SPARK-11035
> URL: https://issues.apache.org/jira/browse/SPARK-11035
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 1.6.0
>Reporter: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child 
> processes. That is fine for a lot of cases, especially if the app is running 
> in client mode.
> But in certain cases, especially launching in cluster mode, it's more 
> efficient to avoid launching a new process, since that process won't be doing 
> much.
> We should add support for launching apps in process, even if restricted to 
> cluster mode at first. This will require some rework of the launch paths to 
> avoid using system properties to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-11035) Launcher: allow apps to be launched in-process

2016-09-08 Thread Apache Spark (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-11035:


Assignee: Apache Spark

> Launcher: allow apps to be launched in-process
> --
>
> Key: SPARK-11035
> URL: https://issues.apache.org/jira/browse/SPARK-11035
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 1.6.0
>Reporter: Marcelo Vanzin
>Assignee: Apache Spark
>
> The launcher library is currently restricted to launching apps as child 
> processes. That is fine for a lot of cases, especially if the app is running 
> in client mode.
> But in certain cases, especially launching in cluster mode, it's more 
> efficient to avoid launching a new process, since that process won't be doing 
> much.
> We should add support for launching apps in process, even if restricted to 
> cluster mode at first. This will require some rework of the launch paths to 
> avoid using system properties to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org