TD,
can you please comment on this code?
I am really interested in including this code in Spark.
But i am bothering about some point about persistence:
1. When we extend Receiver and call store,
is it blocking call? Does it return only when spark stores rdd as requested
(i.e. replicated or on
>> On 21 Aug 2014, at 20:25, Tim Smith wrote:
>>
>> Thanks. Discovering kafka metadata from zookeeper instead of brokers
>> is nicer. Saving metadata and offsets to HBase, is that optional or
>> mandatory?
>> Can it be made optional (default to zookeeper)?
>>
For now we implemented and somewhat
Hello,
we are glad to announce yet another kafka input stream.
Available at https://github.com/wgnet/spark-kafka-streaming
It is used in production for about 3 months.
We will be happy to hear your feedback.
Custom Spark Kafka consumer based on Kafka SimpleConsumer API.
Features
• dis