[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259530#comment-15259530
]
Mario Briggs commented on SPARK-12177:
--------------------------------------
what's the thinking on this one with respect to Structured Streaming? Is the
thinking that Kafka0.9 be supported with the older Dstream API
(KafkaUtils.createDirectStream) AND the newer structured streaming way of doing
things ? or kafka 0.9 will only be supported only with the new structured
streaming way? I am going to assume only [~tdas] or [~rxin] have an good idea
on Structured streaming (sorry [~mgrover] , [~c...@koeninger.org] if i have
insulted you :-) ), so appreciate if they can chime in.
For my side i am assuming that 0.9 will be supported older DStream API as well.
[~mgrover] howz it going merging cody's changes and making a new subproject.
> Update KafkaDStreams to new Kafka 0.9 Consumer API
> --------------------------------------------------
>
> Key: SPARK-12177
> URL: https://issues.apache.org/jira/browse/SPARK-12177
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 1.6.0
> Reporter: Nikita Tarasenko
> Labels: consumer, kafka
>
> Kafka 0.9 already released and it introduce new consumer API that not
> compatible with old one. So, I added new consumer api. I made separate
> classes in package org.apache.spark.streaming.kafka.v09 with changed API. I
> didn't remove old classes for more backward compatibility. User will not need
> to change his old spark applications when he uprgade to new Spark version.
> Please rewiew my changes
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
