[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533313#comment-17533313 ] Itay Bittan commented on SPARK-28594: - Hi,   Just want to highlight the cost (in terms of money)

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127791#comment-17127791 ] Shuai Lu commented on SPARK-28594: -- Got it. Thanks. We manage a multi-tenant cluster and it is a

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127788#comment-17127788 ] Jungtaek Lim commented on SPARK-28594: -- Unfortunately that is most probably the guaranteed way if

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127783#comment-17127783 ] Shuai Lu commented on SPARK-28594: -- I see. Looks like the only way to bypass this in Spark 2.4 is to

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127776#comment-17127776 ] Jungtaek Lim commented on SPARK-28594: -- Actually it has been an issue with almost all of Spark

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127119#comment-17127119 ] Shuai Lu commented on SPARK-28594: -- Hi, [~kabhwan], are we planning to support this feature in Spark

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061101#comment-17061101 ] Dongjoon Hyun commented on SPARK-28594: --- `releasenotes` is added for 3.0.0 release. > Allow event

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056417#comment-17056417 ] Dongjoon Hyun commented on SPARK-28594: --- I assigned this umbrella to [~kabhwan] since he lead this

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026307#comment-17026307 ] Jungtaek Lim commented on SPARK-28594: -- While I commented some tasks for improvement, technically

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012562#comment-17012562 ] Jungtaek Lim commented on SPARK-28594: -- I'm enumerating the items which are "good to do", which

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958412#comment-16958412 ] Jungtaek Lim commented on SPARK-28594: -- Please note that SPARK-29579 and SPARK-29581 could be moved

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920534#comment-16920534 ] Jungtaek Lim commented on SPARK-28594: -- Thanks [~felixcheung] for reviewing and volunteering to

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920476#comment-16920476 ] Felix Cheung commented on SPARK-28594: -- Reviewed. looks reasonable to me. I can help shepherd this

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915383#comment-16915383 ] Jungtaek Lim commented on SPARK-28594: -- To ensure creating smaller PRs (easier reviews) I would

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915358#comment-16915358 ] Jungtaek Lim commented on SPARK-28594: -- I've raised priority as many end users are suffering with

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915357#comment-16915357 ] Jungtaek Lim commented on SPARK-28594: -- Coincidentally I was working on the design of this feature