[
https://issues.apache.org/jira/browse/SPARK-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15126369#comment-15126369
]
Cody Koeninger commented on SPARK-13106:
----------------------------------------
My original intention was for the kafka offset api convenience methods to be
public, but the PR to expose them is stalled. Hopefully we can get some
closure on that one way or the other.
If the offset api isn't going to be exposed, making the change proposed in this
ticket would be straightforward, and I'm fine with doing it if a committer
would be willing to merge it.
> KafkaUtils.createDirectStream method with messageHandler and topics
> -------------------------------------------------------------------
>
> Key: SPARK-13106
> URL: https://issues.apache.org/jira/browse/SPARK-13106
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Reporter: Luis Alves
> Labels: newbie
>
> Regarding the KafkaUtils.createDirectStream method here:
> https://github.com/apache/spark/blob/master/external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala#L473
> I purpose to also allow to pass the a messageHandler as argument instead of
> using the one that is setted inside the method:
> {code}
> val messageHandler = (mmd: MessageAndMetadata[K, V]) => (mmd.key,
> mmd.message)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
