[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519934#comment-16519934 ] Saisai Shao commented on SPARK-24374: - Hi [~mengxr] [~jiangxb1987] SPARK-24615 would be a part of

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519622#comment-16519622 ] Mingjie Tang commented on SPARK-24374: -- [~mengxr].  [~jerryshao] create a SISP [SPARK-24615] for

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507478#comment-16507478 ] Wangda Tan commented on SPARK-24374: [~mengxr],  Thanks for explanations, use cases look good to

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500900#comment-16500900 ] Xiangrui Meng commented on SPARK-24374: --- [~leftnoteasy] Thanks for your input! {quote} This JIRA

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498797#comment-16498797 ] Wangda Tan commented on SPARK-24374: Thanks [~mengxr] for filing the JIRA and ping from [~ywskycn].

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498772#comment-16498772 ] Jose Torres commented on SPARK-24374: - Yeah, continuous processing (SPARK-20928) is another good use

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493 ] Reynold Xin commented on SPARK-24374: - Just thought of this — Continuous Processing really requires

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488 ] Reynold Xin commented on SPARK-24374: - That breaks end to end FT right?   > SPIP: Support Barrier

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498465#comment-16498465 ] Henry Robinson commented on SPARK-24374: The use case in the SPIP isn't 100% convincing. I'm

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490307#comment-16490307 ] Wei Yan commented on SPARK-24374: - Thanks [~mengxr] for the initiative and the doc. cc [~leftnoteasy]

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489333#comment-16489333 ] Xiangrui Meng commented on SPARK-24374: --- [~galv] Thanks for your feedback! * SPARK-20327 allows

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488646#comment-16488646 ] Daniel Galvez commented on SPARK-24374: --- Some comments: * GPU scheduling for YARN is well under