[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643804#comment-17643804 ]
Ranga Reddy commented on SPARK-28869: ------------------------------------- Hi [~kabhwan] I have enabled the eventlog rolling for the spark streaming network word count example, but event log files are not compacted. *Configuration Parameters:* {code:java} spark.eventLog.rolling.enabled=true spark.eventLog.rolling.maxFileSize=10m spark.history.fs.eventLog.rolling.maxFilesToRetain=2 spark.history.fs.cleaner.interval=1800{code} *Event log file list:* [^application_1670216197043_0012.log] ^Could you please check the issue.^ > Roll over event log files > ------------------------- > > Key: SPARK-28869 > URL: https://issues.apache.org/jira/browse/SPARK-28869 > Project: Spark > Issue Type: Sub-task > Components: Spark Core > Affects Versions: 3.0.0 > Reporter: Jungtaek Lim > Assignee: Jungtaek Lim > Priority: Major > Fix For: 3.0.0 > > Attachments: application_1670216197043_0012.log > > > This issue tracks the effort on rolling over event log files in driver and > let SHS replay the multiple event log files correctly. > This issue doesn't deal with overall size of event log, as well as no > guarantee when deleting old event log files. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org