[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2019-01-08 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737849#comment-16737849 ] luzengxiang commented on SPARK-24374: - I am tryging embedding MPI in barrier mode to

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2019-01-08 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737849#comment-16737849 ] luzengxiang edited comment on SPARK-24374 at 1/9/19 4:45 AM: -

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2019-02-11 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765694#comment-16765694 ] luzengxiang commented on SPARK-24374: - Hi [~mengxr], I am using Scala API.  > SPIP:

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Description: When Embedding Deeplearning Framework in spark, spark worker has to launch external

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Description: When Embedding Deeplearning Framework in spark, spark worker has to launch external

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: External issue URL: https://issues.apache.org/jira/browse/SPARK-24374 > Proper termination of exte

[jira] [Created] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
luzengxiang created SPARK-26886: --- Summary: Proper termination of external processes launched by the worker Key: SPARK-26886 URL: https://issues.apache.org/jira/browse/SPARK-26886 Project: Spark

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: External issue URL: (was: https://issues.apache.org/jira/browse/SPARK-24374) > Proper terminati

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Description: When Embedding Deeplearning Framework in spark, spark worker has to launch external

[jira] [Commented] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-15 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769165#comment-16769165 ] luzengxiang commented on SPARK-26886: - [~mengxr] Let's discuss about it. > Proper t

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-17 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Issue Type: Story (was: New JIRA Project) > Proper termination of external processes launched by

[jira] [Resolved] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-18 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang resolved SPARK-26886. - Resolution: Won't Do > Proper termination of external processes launched by the worker > ---

[jira] [Commented] (SPARK-24818) Ensure all the barrier tasks in the same stage are launched together

2019-02-20 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773729#comment-16773729 ] luzengxiang commented on SPARK-24818: - "cannot fulfill task locality requirements" k