[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441718#comment-16441718 ]
Jordan Moore edited comment on SPARK-18057 at 4/18/18 12:53 AM: ---------------------------------------------------------------- Hello Cody, No it is not. And no other specific configurations are applied to the topic. I have reason to believe the problem is not Spark specific (other than maybe the committed offset management by a producer). On the consumer side, it seems to be an issue in just the Java client because that offset output given is from a plain Java consumer. All versions of kafka-clients 0.10.x demonstrated the same behavior. was (Author: cricket007): Hello Cody, No it is not. And no other specific configurations are applied to the topic. I have reason to believe the problem is not Spark specific. It is an issue in just the Java client because that offset output given is from a plain Java consumer. All versions of kafka-clients 0.10.x demonstrated the same behavior. > Update structured streaming kafka from 0.10.0.1 to 1.1.0 > -------------------------------------------------------- > > Key: SPARK-18057 > URL: https://issues.apache.org/jira/browse/SPARK-18057 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Reporter: Cody Koeninger > Priority: Major > > There are a couple of relevant KIPs here, > https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org