[jira] [Commented] (SPARK-21219) Task retry occurs on same executor due to race condition with blacklisting

[ https://issues.apache.org/jira/browse/SPARK-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083082#comment-16083082 ] Jose Soltren commented on SPARK-21219: -- I think it would be good to backport this to

[jira] [Commented] (SPARK-21157) Report Total Memory Used by Spark Executors

[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061582#comment-16061582 ] Jose Soltren commented on SPARK-21157: -- Hello Marcelo - It's true, the design doc do

[jira] [Commented] (SPARK-20391) Properly rename the memory related fields in ExecutorSummary REST API

[ https://issues.apache.org/jira/browse/SPARK-20391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060097#comment-16060097 ] Jose Soltren commented on SPARK-20391: -- So, this is months old now and irrelevant, b

[jira] [Updated] (SPARK-21157) Report Total Memory Used by Spark Executors

[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren updated SPARK-21157: - Attachment: TotalMemoryReportingDesignDoc.pdf > Report Total Memory Used by Spark Executors > ---

[jira] [Created] (SPARK-21157) Report Total Memory Used by Spark Executors

Jose Soltren created SPARK-21157: Summary: Report Total Memory Used by Spark Executors Key: SPARK-21157 URL: https://issues.apache.org/jira/browse/SPARK-21157 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051942#comment-16051942 ] Jose Soltren commented on SPARK-20760: -- Hello Ravi - current thinking is that this i

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042177#comment-16042177 ] Jose Soltren commented on SPARK-20760: -- Hi Binzi: 1. If this is so then there is so

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16041027#comment-16041027 ] Jose Soltren commented on SPARK-20760: -- Hi - I've been researching this issue, and I

[jira] [Reopened] (SPARK-9103) Tracking spark's memory usage

[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren reopened SPARK-9103: - Work in progress. > Tracking spark's memory usage > - > >

[jira] [Commented] (SPARK-7200) Tungsten test suites should fail if memory leak is detected

[ https://issues.apache.org/jira/browse/SPARK-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940604#comment-15940604 ] Jose Soltren commented on SPARK-7200: - [~joshrosen] please have a look at my PR. Is th

[jira] [Commented] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

[ https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930094#comment-15930094 ] Jose Soltren commented on SPARK-19982: -- Pasting in the exception from the link in ca

[jira] [Commented] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

[ https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928660#comment-15928660 ] Jose Soltren commented on SPARK-19982: -- [~cloud_fan] added this test as some work re

[jira] [Created] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

Jose Soltren created SPARK-19982: Summary: JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class" Key: SPARK-19982 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871702#comment-15871702 ] Jose Soltren commented on SPARK-18091: -- FWIW, anyone pulling this fix in the future

[jira] [Commented] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

[ https://issues.apache.org/jira/browse/SPARK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850408#comment-15850408 ] Jose Soltren commented on SPARK-19181: -- https://github.com/apache/spark/pull/16586 m

[jira] [Commented] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828522#comment-15828522 ] Jose Soltren commented on SPARK-16554: -- Builds on some BlacklistTracker changes that

[jira] [Updated] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren updated SPARK-16554: - Shepherd: Imran Rashid > Spark should kill executors when they are blacklisted >

[jira] [Commented] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828520#comment-15828520 ] Jose Soltren commented on SPARK-16554: -- I have some changes ready, but I'm going to

[jira] [Commented] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

[ https://issues.apache.org/jira/browse/SPARK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819186#comment-15819186 ] Jose Soltren commented on SPARK-19181: -- SPARK-2208 disabled a similar metric previou

[jira] [Created] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

Jose Soltren created SPARK-19181: Summary: SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short. Key: SPARK-19181 URL: https://issues.apache.org/jira/browse/SPARK-19181

[jira] [Commented] (SPARK-16654) UI Should show blacklisted executors & nodes

[ https://issues.apache.org/jira/browse/SPARK-16654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15762067#comment-15762067 ] Jose Soltren commented on SPARK-16654: -- SPARK-8425 is resolved so I'll be working to

[jira] [Commented] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709080#comment-15709080 ] Jose Soltren commented on SPARK-16554: -- This is a nice idea but I'm not sure how fea

[jira] [Commented] (SPARK-16654) UI Should show blacklisted executors & nodes

[ https://issues.apache.org/jira/browse/SPARK-16654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422721#comment-15422721 ] Jose Soltren commented on SPARK-16654: -- Alex, I'm trying to understand your July 20t