jeanlyn created SPARK-13586:
-------------------------------
Summary: add config to skip generate down time batch when restart
StreamingContext
Key: SPARK-13586
URL: https://issues.apache.org/jira/browse/SPARK-13586
Project: Spark
Issue Type: Improvement
Components: Streaming
Affects Versions: 1.6.0
Reporter: jeanlyn
If we restart streaming, which using checkpoint and has stopped for hours, it
will generate a lot of batch to the queue, and it need to take a while to
handle this batches. So i propose to add a config to control whether generate
down time batch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
