[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941514#comment-16941514 ] L. C. Hsieh commented on SPARK-29302: - No, I meant this: {code:java} val jobId =

[jira] [Resolved] (SPARK-29307) Remove scalatest compile warnings

[ https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29307. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25982

[jira] [Assigned] (SPARK-29307) Remove scalatest compile warnings

[ https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29307: - Assignee: Dongjoon Hyun > Remove scalatest compile warnings >

[jira] [Created] (SPARK-29309) StreamingContext.binaryRecordsStream() is useless

Alberto Andreotti created SPARK-29309: - Summary: StreamingContext.binaryRecordsStream() is useless Key: SPARK-29309 URL: https://issues.apache.org/jira/browse/SPARK-29309 Project: Spark

[jira] [Commented] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory

[ https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941492#comment-16941492 ] Jungtaek Lim commented on SPARK-29301: -- [~ploya] This commit is for branch-2.4 : 

[jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming：The executor storage memory increasing over time

[ https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941491#comment-16941491 ] Jungtaek Lim commented on SPARK-27648: -- [~harichandan] This commit is for branch-2.4 : 

[jira] [Commented] (SPARK-29288) Spark SQL add jar can't support HTTP path.

[ https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941487#comment-16941487 ] angerszhu commented on SPARK-29288: --- [~dongjoon] Sorry for my mistake when report this issue. By the

[jira] [Resolved] (SPARK-29288) Spark SQL add jar can't support HTTP path.

[ https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-29288. --- Resolution: Not A Problem > Spark SQL add jar can't support HTTP path. >

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941485#comment-16941485 ] feiwang commented on SPARK-29302: - Yes, they are in a same stage, so they have a same jobId. > dynamic

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941483#comment-16941483 ] L. C. Hsieh commented on SPARK-29295: - I created a PR for this issue. > Duplicate result when

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941482#comment-16941482 ] L. C. Hsieh commented on SPARK-29302: - Will a speculation task have the same JobID as previous task

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941475#comment-16941475 ] feiwang commented on SPARK-29295: - Yes, how can we resolve this issue? Only by upgrading the hive

[jira] [Commented] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory

[ https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941473#comment-16941473 ] Jungtaek Lim commented on SPARK-29301: -- I'll push the branch-2.4 version of code in my repo and

[jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming：The executor storage memory increasing over time

[ https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941474#comment-16941474 ] Jungtaek Lim commented on SPARK-27648: -- I'll push the branch-2.4 version of code in my repo and

[jira] [Comment Edited] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941472#comment-16941472 ] feiwang edited comment on SPARK-29302 at 10/1/19 2:24 AM: -- For dynamic

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941472#comment-16941472 ] feiwang commented on SPARK-29302: - For dynamic partition overwrite, when execute a task, a determinable

[jira] [Updated] (SPARK-29308) dev/deps/spark-deps-hadoop-3.2 orc jar is incorrect

[ https://issues.apache.org/jira/browse/SPARK-29308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29308: -- Description: In hadoop 3.2, orc.classfier is empty.

[jira] [Created] (SPARK-29308) dev/deps/spark-deps-hadoop-3.2 orc jar is incorrect

angerszhu created SPARK-29308: - Summary: dev/deps/spark-deps-hadoop-3.2 orc jar is incorrect Key: SPARK-29308 URL: https://issues.apache.org/jira/browse/SPARK-29308 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941467#comment-16941467 ] feiwang commented on SPARK-29302: - You can add the code below into FileFormatWriterSuite. {code:java}

[jira] [Commented] (SPARK-27475) dev/deps/spark-deps-hadoop-3.2 is incorrect

[ https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941455#comment-16941455 ] Yuming Wang commented on SPARK-27475: - Sorry [~dongjoon] This is still incorrect:

[jira] [Commented] (SPARK-29055) Memory leak in Spark

[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941453#comment-16941453 ] Jungtaek Lim commented on SPARK-29055: -- I haven't observed increased memory usage even without the

[jira] [Resolved] (SPARK-25153) Improve error messages for columns with dots/periods

[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-25153. -- Fix Version/s: 3.0.0 Resolution: Fixed > Improve error messages for columns with

[jira] [Updated] (SPARK-29307) Remove scalatest compile warnings

[ https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29307: -- Component/s: Tests > Remove scalatest compile warnings > - >

[jira] [Assigned] (SPARK-25153) Improve error messages for columns with dots/periods

[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-25153: Assignee: Jeff Evans > Improve error messages for columns with dots/periods >

[jira] [Resolved] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-24077. -- Fix Version/s: 2.3.0 Assignee: Xiaochen Ouyang Resolution: Fixed

[jira] [Comment Edited] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941444#comment-16941444 ] Takeshi Yamamuro edited comment on SPARK-24077 at 10/1/19 1:20 AM: ---

[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941444#comment-16941444 ] Takeshi Yamamuro commented on SPARK-24077: -- Yea, its been fixed there; {code} scala>

[jira] [Assigned] (SPARK-29300) Compare `catalyst` and `avro` module benchmark in JDK8/11

[ https://issues.apache.org/jira/browse/SPARK-29300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29300: - Assignee: Dongjoon Hyun > Compare `catalyst` and `avro` module benchmark in JDK8/11 >

[jira] [Resolved] (SPARK-29300) Compare `catalyst` and `avro` module benchmark in JDK8/11

[ https://issues.apache.org/jira/browse/SPARK-29300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29300. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25972

[jira] [Updated] (SPARK-29307) Remove scalatest compile warnings

[ https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29307: -- Component/s: (was: Spark Core) Build > Remove scalatest compile warnings

[jira] [Created] (SPARK-29307) Remove scalatest compile warnings

Dongjoon Hyun created SPARK-29307: - Summary: Remove scalatest compile warnings Key: SPARK-29307 URL: https://issues.apache.org/jira/browse/SPARK-29307 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941404#comment-16941404 ] L. C. Hsieh commented on SPARK-29302: - Can you share a reproducer? or this sounds more like a

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941402#comment-16941402 ] L. C. Hsieh commented on SPARK-29302: - FileCommitProtocol will assign a filename based on task id,

[jira] [Comment Edited] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory

[ https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941401#comment-16941401 ] Puneet Loya edited comment on SPARK-29301 at 9/30/19 11:28 PM: --- I tried to

[jira] [Commented] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory

[ https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941401#comment-16941401 ] Puneet Loya commented on SPARK-29301: - I tried to cherry pick your patch on Spark 2.4.4, but looks

[jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming：The executor storage memory increasing over time

[ https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941399#comment-16941399 ] Harichandan Pulagam commented on SPARK-27648: - [~kabhwan] The changes in

[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941363#comment-16941363 ] Jeff Evans commented on SPARK-24077: Is this still relevant, given SPARK-20383 is done? > Issue a

[jira] [Commented] (SPARK-29041) Allow createDataFrame to accept bytes as binary type

[ https://issues.apache.org/jira/browse/SPARK-29041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941289#comment-16941289 ] Ruslan Dautkhanov commented on SPARK-29041: --- Thank you [~hyukjin.kwon] Our users say this

[jira] [Commented] (SPARK-29055) Memory leak in Spark

[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941220#comment-16941220 ] George Papa commented on SPARK-29055: - [~kabhwan] Good news!! I run the snippet code with your

[jira] [Commented] (SPARK-29211) Second invocation of custom UDF results in exception (when invoked from shell)

[ https://issues.apache.org/jira/browse/SPARK-29211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941173#comment-16941173 ] Dilip Biswal commented on SPARK-29211: -- Thanks [~dongjoon] > Second invocation of custom UDF

[jira] [Created] (SPARK-29306) Executors need to track what ResourceProfile they are created with

Thomas Graves created SPARK-29306: - Summary: Executors need to track what ResourceProfile they are created with Key: SPARK-29306 URL: https://issues.apache.org/jira/browse/SPARK-29306 Project: Spark

[jira] [Resolved] (SPARK-29291) Remove use of procedure-like method definition for 2.13

[ https://issues.apache.org/jira/browse/SPARK-29291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29291. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25968

[jira] [Updated] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-29295: Priority: Major (was: Minor) > Duplicate result when dropping partition of an external table and

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941060#comment-16941060 ] L. C. Hsieh commented on SPARK-29295: - I traced code last night, and yes it looks like a Hive bug.

[jira] [Updated] (SPARK-29305) Update LICENSE and NOTICE for hadoop 3.2

[ https://issues.apache.org/jira/browse/SPARK-29305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29305: -- Description: {code} com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.9.5

[jira] [Created] (SPARK-29305) Update LICENSE and NOTICE for hadoop 3.2

angerszhu created SPARK-29305: - Summary: Update LICENSE and NOTICE for hadoop 3.2 Key: SPARK-29305 URL: https://issues.apache.org/jira/browse/SPARK-29305 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-29304) Input Bytes Metric for Datasource v2 is absent

[ https://issues.apache.org/jira/browse/SPARK-29304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated SPARK-29304: Attachment: jira-spark.png > Input Bytes Metric for Datasource v2 is absent >

[jira] [Created] (SPARK-29304) Input Bytes Metric for Datasource v2 is absent

Kuhu Shukla created SPARK-29304: --- Summary: Input Bytes Metric for Datasource v2 is absent Key: SPARK-29304 URL: https://issues.apache.org/jira/browse/SPARK-29304 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-27396) SPIP: Public APIs for extended Columnar Processing Support

[ https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27396. --- Assignee: Robert Joseph Evans Resolution: Fixed > SPIP: Public APIs for extended

[jira] [Commented] (SPARK-27396) SPIP: Public APIs for extended Columnar Processing Support

[ https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940974#comment-16940974 ] Thomas Graves commented on SPARK-27396: --- The main objectives have actually already been

[jira] [Created] (SPARK-29303) UI updates for stage level scheduling

Thomas Graves created SPARK-29303: - Summary: UI updates for stage level scheduling Key: SPARK-29303 URL: https://issues.apache.org/jira/browse/SPARK-29303 Project: Spark Issue Type: Story

[jira] [Updated] (SPARK-28074) [SS] Document caveats on using multiple stateful operations in single query

[ https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28074: - Priority: Minor (was: Major) > [SS] Document caveats on using multiple stateful operations in

[jira] [Assigned] (SPARK-28074) [SS] Document caveats on using multiple stateful operations in single query

[ https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28074: Assignee: Jungtaek Lim > [SS] Document caveats on using multiple stateful operations in

[jira] [Resolved] (SPARK-28074) [SS] Document caveats on using multiple stateful operations in single query

[ https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28074. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24890

[jira] [Updated] (SPARK-29252) Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29252: - Priority: Minor (was: Major) > Upgrade zookeeper to 3.4.14 and fix vulnerabilities. >

[jira] [Resolved] (SPARK-29252) Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29252. -- Resolution: Fixed Issue resolved by pull request 25933

[jira] [Assigned] (SPARK-29252) Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29252: Assignee: jiaan.geng > Upgrade zookeeper to 3.4.14 and fix vulnerabilities. >

[jira] [Resolved] (SPARK-29289) Update scalatest, scalacheck, scopt, scala-parser-combinators, clapper classutil

[ https://issues.apache.org/jira/browse/SPARK-29289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29289. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25967

[jira] [Commented] (SPARK-29232) RandomForestRegressionModel does not update the parameter maps of the DecisionTreeRegressionModels underneath

[ https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940919#comment-16940919 ] Aman Omer commented on SPARK-29232: --- Thnaks [~jiaqig]  > RandomForestRegressionModel does not update

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29302: Description: Now, for a dynamic partition overwrite operation, the filename of a task output is

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29302: Description: Now, for a dynamic partition overwrite operation, the filename of a task output is

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29302: Description: Now, for a dynamic partition overwrite operation, the filename of a task output is

[jira] [Created] (SPARK-29302) dynamic partition overwrite with speculation enabled

feiwang created SPARK-29302: --- Summary: dynamic partition overwrite with speculation enabled Key: SPARK-29302 URL: https://issues.apache.org/jira/browse/SPARK-29302 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940754#comment-16940754 ] feiwang commented on SPARK-29295: - relative hive issue, https://issues.apache.org/jira/browse/HIVE-17063

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940718#comment-16940718 ] L. C. Hsieh commented on SPARK-29295: - Thanks for reporting this. Will take a look. > Duplicate

[jira] [Comment Edited] (SPARK-27648) In Spark2.4 Structured Streaming：The executor storage memory increasing over time

[ https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940692#comment-16940692 ] Jungtaek Lim edited comment on SPARK-27648 at 9/30/19 7:23 AM: ---

[jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming：The executor storage memory increasing over time

[ https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940692#comment-16940692 ] Jungtaek Lim commented on SPARK-27648: -- [~yy3b2007com] [~harichandan] Sorry I'm late on revisiting

[jira] [Commented] (SPARK-29055) Memory leak in Spark

[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940691#comment-16940691 ] Jungtaek Lim commented on SPARK-29055: -- [~Geopap] I guess you're hitting SPARK-29301. Please take

[jira] [Commented] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory

[ https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940672#comment-16940672 ] Jungtaek Lim commented on SPARK-29301: -- Will raise a patch soon. > Removing block is not reflected

[jira] [Created] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory

Jungtaek Lim created SPARK-29301: Summary: Removing block is not reflected to the driver/executor's storage memory Key: SPARK-29301 URL: https://issues.apache.org/jira/browse/SPARK-29301 Project: