[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-05-10 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278560#comment-15278560 ] Faisal commented on SPARK-14737: I am not sure if i am following you correctly. You mean to resubmit the

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278387#comment-15278387 ] Sean Owen commented on SPARK-14737: --- You could retry the entire app if it fails, in general. That's

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-05-10 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278375#comment-15278375 ] Faisal commented on SPARK-14737: {code} import java.io.Serializable; import java.util.Arrays; import

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-05-10 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278374#comment-15278374 ] Faisal commented on SPARK-14737: Hi Sean, Here are few points to note as per my original reported

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259745#comment-15259745 ] Sean Owen commented on SPARK-14737: --- I would expect that if Kafka is able to serve all partitions of

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-26 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258956#comment-15258956 ] Faisal commented on SPARK-14737: Should we expect the same behavior if only 1 node of broker is down?

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253751#comment-15253751 ] Sean Owen commented on SPARK-14737: --- I think it's most sensible to fail the application. It can't

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-21 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252773#comment-15252773 ] Faisal commented on SPARK-14737: Thanks for your response Sean, Can you please direct me how should we

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249586#comment-15249586 ] Sean Owen commented on SPARK-14737: --- If all brokers are down that's a fatal error. It's correct (IMHO)