[ 
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441718#comment-16441718
 ] 

Jordan Moore edited comment on SPARK-18057 at 4/18/18 12:53 AM:
----------------------------------------------------------------

Hello Cody, 

No it is not. And no other specific configurations are applied to the topic. I 
have reason to believe the problem is not Spark specific (other than maybe the 
committed offset management by a producer).

On the consumer side, it seems to be an issue in just the Java client because 
that offset output given is from a plain Java consumer. All versions of 
kafka-clients 0.10.x demonstrated the same behavior. 


was (Author: cricket007):
Hello Cody, 

No it is not. And no other specific configurations are applied to the topic. I 
have reason to believe the problem is not Spark specific. It is an issue in 
just the Java client because that offset output given is from a plain Java 
consumer. All versions of kafka-clients 0.10.x demonstrated the same behavior. 

> Update structured streaming kafka from 0.10.0.1 to 1.1.0
> --------------------------------------------------------
>
>                 Key: SPARK-18057
>                 URL: https://issues.apache.org/jira/browse/SPARK-18057
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>            Reporter: Cody Koeninger
>            Priority: Major
>
> There are a couple of relevant KIPs here, 
> https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to