Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-24 Thread Cody Koeninger
When you say the patch is not suitable, can you clarify why? Probably best to get the various findings centralized on https://issues.apache.org/jira/browse/SPARK-17147 Happy to help with getting the patch up to date and working. On Wed, Jan 24, 2018 at 1:19 AM, namesuperwood

Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-23 Thread namesuperwood
It seems this patch is not suitable for our problem。 https://github.com/apache/spark/compare/master...koeninger:SPARK-17147 wood.super 原始邮件 发件人:namesuperwoodnamesuperw...@gmail.com 收件人:Justin millerjustin.mil...@protectwise.com 抄送:useru...@spark.apache.org; Cody koeningerc...@koeninger.org

Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-23 Thread namesuperwood
Yes. My spark streaming application works with uncompacted topic. I will check the patch. wood.super 原始邮件 发件人:Justin millerjustin.mil...@protectwise.com 收件人:namesuperwoodnamesuperw...@gmail.com 抄送:useru...@spark.apache.org; Cody koeningerc...@koeninger.org 发送时间:2018年1月24日(周三) 14:23 主题:Re: