[jira] [Commented] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API

[ https://issues.apache.org/jira/browse/SPARK-28415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892888#comment-16892888 ] Michael Spector commented on SPARK-28415: - In this case I think it's a regressio

[jira] [Commented] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API

[ https://issues.apache.org/jira/browse/SPARK-28415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886906#comment-16886906 ] Michael Spector commented on SPARK-28415: - [~gsomogyi] Can you tell that Kafka 0

[jira] [Commented] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API

[ https://issues.apache.org/jira/browse/SPARK-28415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886900#comment-16886900 ] Michael Spector commented on SPARK-28415: - Well, it depends what's your perspect

[jira] [Created] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API

Michael Spector created SPARK-28415: --- Summary: Add messageHandler to Kafka 10 direct stream API Key: SPARK-28415 URL: https://issues.apache.org/jira/browse/SPARK-28415 Project: Spark Issue

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626790#comment-16626790 ] Michael Spector commented on SPARK-25380: - It's really difficult to extract a wo

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611606#comment-16611606 ] Michael Spector commented on SPARK-25380: - [~vanzin] Here's the breakdown: !Scr

[jira] [Updated] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-25380: Attachment: Screen Shot 2018-09-12 at 8.20.05.png > Generated plans occupy over 50% of Spa

[jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16608047#comment-16608047 ] Michael Spector commented on SPARK-23670: - Reported: SPARK-25380 > Memory leak

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16608045#comment-16608045 ] Michael Spector commented on SPARK-25380: - Originally reported in SPARK-23670  

[jira] [Created] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

Michael Spector created SPARK-25380: --- Summary: Generated plans occupy over 50% of Spark driver memory Key: SPARK-25380 URL: https://issues.apache.org/jira/browse/SPARK-25380 Project: Spark

[jira] [Updated] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-25380: Attachment: Screen Shot 2018-09-06 at 23.19.56.png > Generated plans occupy over 50% of Sp

[jira] [Updated] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-25380: Attachment: heapdump_OOM.png > Generated plans occupy over 50% of Spark driver memory > --

[jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606354#comment-16606354 ] Michael Spector commented on SPARK-23670: - !Screen Shot 2018-09-06 at 23.19.56.p

[jira] [Updated] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-23670: Attachment: Screen Shot 2018-09-06 at 23.19.56.png > Memory leak of SparkPlanGraphWrapper

[jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606295#comment-16606295 ] Michael Spector commented on SPARK-23670: - Not many: 7, 7 and 49. > Memory leak

[jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605642#comment-16605642 ] Michael Spector commented on SPARK-23670: - The bug still happens in Apache Spark

[jira] [Updated] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI

[ https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector updated SPARK-23670: Attachment: heapdump_OOM.png > Memory leak of SparkPlanGraphWrapper in sparkUI > -

[jira] [Created] (SPARK-21074) Parquet files are read fully even though only count() is requested

Michael Spector created SPARK-21074: --- Summary: Parquet files are read fully even though only count() is requested Key: SPARK-21074 URL: https://issues.apache.org/jira/browse/SPARK-21074 Project: Spa