[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-08-19 Thread Ashish Rawat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703595#comment-14703595 ] Ashish Rawat commented on SPARK-2389: - Hi [~pwendell], We are facing exactly the

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291818#comment-14291818 ] Robert Stupp commented on SPARK-2389: - [~srowen] yes, the problem is that drivers

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291797#comment-14291797 ] Robert Stupp commented on SPARK-2389: - bq. That aside, why doesn't it scale? Simply

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Murat Eken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291795#comment-14291795 ] Murat Eken commented on SPARK-2389: --- [~sowen], I think Robert is talking about fault

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291788#comment-14291788 ] Sean Owen commented on SPARK-2389: -- Yes, the SPOF problem makes sense. It doesn't seem to

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291798#comment-14291798 ] Robert Stupp commented on SPARK-2389: - bq. fault tolerance when he mentions

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291804#comment-14291804 ] Sean Owen commented on SPARK-2389: -- Yes, makes sense. Maxing out one driver isn't an

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Murat Eken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291724#comment-14291724 ] Murat Eken commented on SPARK-2389: --- +1. We're using a Spark cluster as a real-time

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291737#comment-14291737 ] Sean Owen commented on SPARK-2389: -- Why can't N front-ends talk to a process built around

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

2015-01-26 Thread Murat Eken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291755#comment-14291755 ] Murat Eken commented on SPARK-2389: --- Yes [~sowen], it's about HA for the driver. Our