subject:"KafkaUtils.createDirectStream\(\) with kafka topic expanded"

Re: KafkaUtils.createDirectStream() with kafka topic expanded

2016-09-13 Thread Cody Koeninger

That version of createDirectStream doesn't handle partition changes. You can work around it by starting the job again. The spark 2.0 consumer for kafka 0.10 should handle partition changes via SubscribePattern. On Tue, Sep 13, 2016 at 7:13 PM, vinay gupta wrote: >

KafkaUtils.createDirectStream() with kafka topic expanded

2016-09-13 Thread vinay gupta

Hi we are using the following version of KafkaUtils.createDirectStream() from spark 1.5.0 createDirectStream(JavaStreamingContext jssc, Class keyClass, Class valueClass,