[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566244#comment-15566244
]
Cody Koeninger commented on SPARK-17344:
----------------------------------------
How long would it take CDH to distribute 0.10 if there was a compelling Spark
client for it?
How are you going to handle SSL?
You can't avoid the complexity of caching consumers if you still want the
benefits of prefetching, and doing an SSL handshake for every batch will kill
performance if they aren't cached.
Also note that this is a pretty prime example of what I'm talking about in my
dev mailing list discussion on SIPs. This issue has been brought up, and
decided against continuing support of 0.8, multiple times.
You guys started making promises about structured streaming for Kafka over half
a year ago, and still don't have it feature complete. This is a big potential
detour for uncertain gain. The real underlying problem is still how you're
going to do better than simply wrapping a DStream, and I don't see how this is
directly relevant.
> Kafka 0.8 support for Structured Streaming
> ------------------------------------------
>
> Key: SPARK-17344
> URL: https://issues.apache.org/jira/browse/SPARK-17344
> Project: Spark
> Issue Type: Sub-task
> Components: Streaming
> Reporter: Frederick Reiss
>
> Design and implement Kafka 0.8-based sources and sinks for Structured
> Streaming.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
