Jungtaek Lim created SPARK-29581:
------------------------------------
Summary: Enable cleanup old event log files
Key: SPARK-29581
URL: https://issues.apache.org/jira/browse/SPARK-29581
Project: Spark
Issue Type: Sub-task
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Jungtaek Lim
This issue can be start only with SPARK-29579 is addressed properly.
After SPARK-29579 Spark would guarantee strong compatibility on both live
entities and snapshots, which means snapshot file could replace older origin
event log files. This issue tracks the efforts on automatically cleaning up old
event logs if snapshot file can replace them, which lets overall size of event
log on streaming query to be manageable.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
