using dstream.checkpoint(checkpointInterval). Typically, a
checkpoint interval of 5 - 10 sliding intervals of a DStream is a good setting
to try.
Hope this helps,
-adrian
From: srungarapu vamsi
Date: Wednesday, September 23, 2015 at 10:51 PM
To: user
Subject: reduceByKeyAndWindow confusion
I create a
I create a stream from kafka as belows"
val kafkaDStream =
KafkaUtils.createDirectStream[String,KafkaGenericEvent,StringDecoder,KafkaGenericEventsDecoder](ssc,
kafkaConf, Set(topics))
.window(Minutes(WINDOW_DURATION),Minutes(SLIDER_DURATION))
I have a map ("intToStringList") which is a
