[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980429#comment-14980429 ]
Sean Owen commented on SPARK-11402: ----------------------------------- I personally think this is an abstraction too far. When you do this, it sounds strictly helpful: why not just make it pluggable? but implicitly you are promising an entire API that it's not at all obvious you want to promise. > Allow to define a custom driver runner and executor runner > ---------------------------------------------------------- > > Key: SPARK-11402 > URL: https://issues.apache.org/jira/browse/SPARK-11402 > Project: Spark > Issue Type: Improvement > Components: Deploy, Spark Core > Reporter: Jacek Lewandowski > Priority: Minor > > {{DriverRunner}} and {{ExecutorRunner}} are used by Spark Worker in > standalone mode to spawn driver and executor processes respectively. When > integrating Spark with some environments, it would be useful to allow > providing a custom implementation of those components. > The idea is simple - provide factory class names for driver and executor > runners in Worker configuration. By default, the current implementations are > used. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org