When I'm reading the API of spark streaming, I'm confused by the 3
different durations

StreamingContext(conf: SparkConf
<http://spark.apache.org/docs/latest/api/scala/org/apache/spark/SparkConf.html>
, batchDuration: Duration
<http://spark.apache.org/docs/latest/api/scala/org/apache/spark/streaming/Duration.html>
)

DStream window(windowDuration: Duration
<http://spark.apache.org/docs/latest/api/scala/org/apache/spark/streaming/Duration.html>
, slideDuration: Duration
<http://spark.apache.org/docs/latest/api/scala/org/apache/spark/streaming/Duration.html>
): DStream
<http://spark.apache.org/docs/latest/api/scala/org/apache/spark/streaming/dstream/DStream.html>
[T]


Can anyone please explain these 3 different durations


Best,
Siyuan

Reply via email to