[ https://issues.apache.org/jira/browse/SPARK-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Armbrust updated SPARK-17345: ------------------------------------- Component/s: (was: DStreams) Structured Streaming > Prerequisites for Kafka 0.10 support in Structured Streaming > ------------------------------------------------------------ > > Key: SPARK-17345 > URL: https://issues.apache.org/jira/browse/SPARK-17345 > Project: Spark > Issue Type: Sub-task > Components: Structured Streaming > Reporter: Frederick Reiss > > This issue covers any API changes, refactoring, and utility classes/methods > that are necessary to make it possible to implement support for Kafka 0.10 > sources and sinks in Structured Streaming. > At a minimum, the changes in SPARK-16963 will be needed in order for the > Kafka commit protocol to work. Given that KIP-33 ("Add a time based log > index") is not yet in place, it may be necessary to make additional API > changes in Spark for commit to work efficiently. Some refactoring of the > existing KafkaRDD class is probably in order also. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org