[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215996#comment-15215996 ] Steve Loughran commented on SPARK-6270: --- There's actually some security implications too: the shared

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053810#comment-15053810 ] Josh Rosen commented on SPARK-6270: --- While I think that we should have this discussion about UI

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053915#comment-15053915 ] Andrew Or commented on SPARK-6270: -- +1 to removing history serving functionality from standalone Master

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053929#comment-15053929 ] Andrew Or commented on SPARK-6270: -- [~shivaram] That may be difficult to do because different

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053921#comment-15053921 ] Shivaram Venkataraman commented on SPARK-6270: -- Yeah I think thats a fair solution to this

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053395#comment-15053395 ] Andrew Or commented on SPARK-6270: -- Yeah, some regression tests would be helpful, though in my case I

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053399#comment-15053399 ] Andrew Or commented on SPARK-6270: -- Also, we should consider switching event log compression on by

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053400#comment-15053400 ] Shivaram Venkataraman commented on SPARK-6270: -- +1 on compression. Is there a flag to turn it

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053405#comment-15053405 ] Andrew Or commented on SPARK-6270: -- You can set `spark.eventLog.compress` to true > Standalone Master

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053512#comment-15053512 ] Steve Loughran commented on SPARK-6270: --- replay time itself is going to be steep, which, given that

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053223#comment-15053223 ] Shivaram Venkataraman commented on SPARK-6270: -- I looked into our log file more closely and

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053924#comment-15053924 ] Andrew Or commented on SPARK-6270: -- I have filed a JIRA for it:

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051753#comment-15051753 ] Steve Loughran commented on SPARK-6270: --- [~shivaram] : can you have a look @ the logs and see what

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051438#comment-15051438 ] Shivaram Venkataraman commented on SPARK-6270: -- FWIW this problem happens 1.5.2 as well --

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970915#comment-14970915 ] Jim Haughwout commented on SPARK-6270: -- [~tdas]: Can the team update this issue to reflect that this

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942483#comment-14942483 ] Josh Rosen commented on SPARK-6270: --- To my knowledge, this has _not_ been fixed in 1.5.0 / 1.5.1. >

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942108#comment-14942108 ] Jim Haughwout commented on SPARK-6270: -- [~tdas]: Was this fixed in 1.5.0? Affecting our team as well.