There's 1 topic per partition, so you're probably better off dealing
with topics that way rather than at the individual message level.
http://spark.apache.org/docs/latest/streaming-kafka-integration.html#approach-2-direct-approach-no-receivers
Look at the discussion of "HasOffsetRanges"
If you
Hi,
I'm just trying to process the data that come from the kafka source in my
spark streaming application. What I want to do is get the pair of topic and
message in a tuple from the message stream.
Here is my streams:
val streams = KafkaUtils.createDirectStream[String, Array[Byte],
>
Hi,
I'm just trying to process the data that come from the kafka source in my
spark streaming application. What I want to do is get the pair of topic and
message in a tuple from the message stream.
Here is my streams:
val streams = KafkaUtils.createDirectStream[String, Array[Byte],
>
