[jira] [Commented] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204424#comment-17204424 ] Apache Spark commented on SPARK-33022: -- User 'duanmeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33022: Assignee: Apache Spark > partition length is wrong after merge partition segments in >

[jira] [Assigned] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33022: Assignee: (was: Apache Spark) > partition length is wrong after merge partition

[jira] [Updated] (SPARK-13704) TaskSchedulerImpl.createTaskSetManager can be expensive, and result in lost executors due to blocked heartbeats

[ https://issues.apache.org/jira/browse/SPARK-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13704: Description: In some cases, TaskSchedulerImpl.createTaskSetManager can be expensive. For

[jira] [Resolved] (SPARK-33032) Should throw SparkException if broadcast large table

[ https://issues.apache.org/jira/browse/SPARK-33032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33032. - Resolution: Not A Bug It is not a bug after increase driver memory to 20GB. > Should throw

[jira] [Created] (SPARK-33032) Should throw SparkException if broadcast large table

Yuming Wang created SPARK-33032: --- Summary: Should throw SparkException if broadcast large table Key: SPARK-33032 URL: https://issues.apache.org/jira/browse/SPARK-33032 Project: Spark Issue

[jira] [Updated] (SPARK-32947) Support top-N sort for Spark SQL window function

[ https://issues.apache.org/jira/browse/SPARK-32947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32947: Target Version/s: (was: 3.0.1) > Support top-N sort for Spark SQL window function >

[jira] [Commented] (SPARK-32947) Support top-N sort for Spark SQL window function

[ https://issues.apache.org/jira/browse/SPARK-32947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204325#comment-17204325 ] Andrew K Long commented on SPARK-32947: --- Has anyone started working on this? > Support top-N sort

[jira] [Commented] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204312#comment-17204312 ] Apache Spark commented on SPARK-32037: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Commented] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204311#comment-17204311 ] Apache Spark commented on SPARK-32037: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32037: Assignee: Apache Spark > Rename blacklisting feature to avoid language with racist

[jira] [Assigned] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32037: Assignee: (was: Apache Spark) > Rename blacklisting feature to avoid language with

[jira] [Assigned] (SPARK-33030) Add nth_value in SparkR API

[ https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33030: Assignee: Apache Spark > Add nth_value in SparkR API > --- > >

[jira] [Assigned] (SPARK-33030) Add nth_value in SparkR API

[ https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33030: Assignee: (was: Apache Spark) > Add nth_value in SparkR API >

[jira] [Commented] (SPARK-33030) Add nth_value in SparkR API

[ https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204291#comment-17204291 ] Apache Spark commented on SPARK-33030: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-33030) Add nth_value in SparkR API

[ https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204292#comment-17204292 ] Apache Spark commented on SPARK-33030: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204265#comment-17204265 ] Thomas Graves commented on SPARK-33031: --- I tried this again on yarn and now it seems to be working

[jira] [Updated] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33031: -- Description: I was running a test with blacklisting  standalone mode and all the executors

[jira] [Updated] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33031: -- Description: I was running a test with blacklisting on yarn (and standalone mode) and all

[jira] [Updated] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33031: -- Affects Version/s: 3.0.0 > scheduler with blacklisting doesn't appear to pick up new executor

[jira] [Updated] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33031: -- Affects Version/s: (was: 3.0.0) 3.1.0 > scheduler with

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204259#comment-17204259 ] Thomas Graves commented on SPARK-33029: --- NOte I filed

[jira] [Created] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

Thomas Graves created SPARK-33031: - Summary: scheduler with blacklisting doesn't appear to pick up new executor added Key: SPARK-33031 URL: https://issues.apache.org/jira/browse/SPARK-33031 Project:

[jira] [Assigned] (SPARK-33019) Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

[ https://issues.apache.org/jira/browse/SPARK-33019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33019: - Assignee: Dongjoon Hyun > Use

[jira] [Resolved] (SPARK-33019) Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

[ https://issues.apache.org/jira/browse/SPARK-33019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33019. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Created] (SPARK-33030) Add nth_value in SparkR API

Maciej Szymkiewicz created SPARK-33030: -- Summary: Add nth_value in SparkR API Key: SPARK-33030 URL: https://issues.apache.org/jira/browse/SPARK-33030 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33029: -- Description: I am running a spark shell on a 1 node standalone cluster.  I noticed that the

[jira] [Updated] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33029: -- Attachment: Screen Shot 2020-09-29 at 1.53.37 PM.png > Standalone mode blacklist executors

[jira] [Updated] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-33029: -- Attachment: Screen Shot 2020-09-29 at 1.52.09 PM.png > Standalone mode blacklist executors

[jira] [Created] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

Thomas Graves created SPARK-33029: - Summary: Standalone mode blacklist executors page UI marks driver as blacklisted Key: SPARK-33029 URL: https://issues.apache.org/jira/browse/SPARK-33029 Project:

[jira] [Created] (SPARK-33028) Fix ScalaReflection issue for Case Classes with complex type aliased data

Ahmed Metwally created SPARK-33028: -- Summary: Fix ScalaReflection issue for Case Classes with complex type aliased data Key: SPARK-33028 URL: https://issues.apache.org/jira/browse/SPARK-33028

[jira] [Created] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

Cheng Su created SPARK-33027: Summary: Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules Key: SPARK-33027 URL: https://issues.apache.org/jira/browse/SPARK-33027 Project: Spark

[jira] [Assigned] (SPARK-33018) Fix compute statistics issue

[ https://issues.apache.org/jira/browse/SPARK-33018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33018: --- Assignee: Yuming Wang > Fix compute statistics issue > > >

[jira] [Resolved] (SPARK-33018) Fix compute statistics issue

[ https://issues.apache.org/jira/browse/SPARK-33018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33018. - Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-33026) Add numRows to metric of BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204108#comment-17204108 ] Apache Spark commented on SPARK-33026: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33026) Add numRows to metric of BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204105#comment-17204105 ] Apache Spark commented on SPARK-33026: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33026) Add numRows to metric of BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33026: Assignee: Apache Spark > Add numRows to metric of BroadcastExchangeExec >

[jira] [Assigned] (SPARK-33026) Add numRows to metric of BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33026: Assignee: (was: Apache Spark) > Add numRows to metric of BroadcastExchangeExec >

[jira] [Created] (SPARK-33026) Add numRows to metric of BroadcastExchangeExec

Yuming Wang created SPARK-33026: --- Summary: Add numRows to metric of BroadcastExchangeExec Key: SPARK-33026 URL: https://issues.apache.org/jira/browse/SPARK-33026 Project: Spark Issue Type:

[jira] [Created] (SPARK-33025) Empty file for the first partition

Evgenii Samusenko created SPARK-33025: - Summary: Empty file for the first partition Key: SPARK-33025 URL: https://issues.apache.org/jira/browse/SPARK-33025 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203951#comment-17203951 ] Apache Spark commented on SPARK-33024: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33024: Assignee: (was: Apache Spark) > Fix CodeGen fallback issue of UDFSuite in Scala 2.13

[jira] [Assigned] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33024: Assignee: Apache Spark > Fix CodeGen fallback issue of UDFSuite in Scala 2.13 >

[jira] [Commented] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203950#comment-17203950 ] Apache Spark commented on SPARK-33024: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

Yang Jie created SPARK-33024: Summary: Fix CodeGen fallback issue of UDFSuite in Scala 2.13 Key: SPARK-33024 URL: https://issues.apache.org/jira/browse/SPARK-33024 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32723) Security Vulnerability due to JQuery version in Spark Master/Worker UI

[ https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203909#comment-17203909 ] Apache Spark commented on SPARK-32723: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-32723) Security Vulnerability due to JQuery version in Spark Master/Worker UI

[ https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32723: Assignee: (was: Apache Spark) > Security Vulnerability due to JQuery version in

[jira] [Assigned] (SPARK-32723) Security Vulnerability due to JQuery version in Spark Master/Worker UI

[ https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32723: Assignee: Apache Spark > Security Vulnerability due to JQuery version in Spark

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: The segment file may be empty even after writer committing caused by disk/kernel in heavy

[jira] [Created] (SPARK-33023) addJar use `Utils.isWindow` to judge windows system

angerszhu created SPARK-33023: - Summary: addJar use `Utils.isWindow` to judge windows system Key: SPARK-33023 URL: https://issues.apache.org/jira/browse/SPARK-33023 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32901) UnsafeExternalSorter may cause a SparkOutOfMemoryError to be thrown while spilling

[ https://issues.apache.org/jira/browse/SPARK-32901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-32901. --- Fix Version/s: 3.1.0 3.0.2 Assignee: Tom van Bussel

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Summary: Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE (was:

[jira] [Comment Edited] (SPARK-31617) support drop multiple functions

[ https://issues.apache.org/jira/browse/SPARK-31617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203806#comment-17203806 ] jiaan.geng edited comment on SPARK-31617 at 9/29/20, 9:23 AM: -- It seems

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in

[jira] [Commented] (SPARK-31617) support drop multiple functions

[ https://issues.apache.org/jira/browse/SPARK-31617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203806#comment-17203806 ] jiaan.geng commented on SPARK-31617: It seems deleting custom functions is a rare operation. So I

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in

[jira] [Created] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

duanmeng created SPARK-33022: Summary: partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter Key: SPARK-33022 URL: https://issues.apache.org/jira/browse/SPARK-33022

[jira] [Comment Edited] (SPARK-26862) assertion failed in ParquetRowConverter

[ https://issues.apache.org/jira/browse/SPARK-26862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203786#comment-17203786 ] Rahul Jaiswal edited comment on SPARK-26862 at 9/29/20, 8:31 AM: - is it

[jira] [Commented] (SPARK-26862) assertion failed in ParquetRowConverter

[ https://issues.apache.org/jira/browse/SPARK-26862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203786#comment-17203786 ] Rahul Jaiswal commented on SPARK-26862: --- is it resolved? I am facing the same issue. > assertion

[jira] [Commented] (SPARK-18496) java.lang.AssertionError: assertion failed

[ https://issues.apache.org/jira/browse/SPARK-18496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203785#comment-17203785 ] Rahul Jaiswal commented on SPARK-18496: --- I am facing the same issue, have we found the solution?

[jira] [Assigned] (SPARK-32970) Reduce the runtime of unit test for SPARK-32019

[ https://issues.apache.org/jira/browse/SPARK-32970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32970: Assignee: Tanel Kiis > Reduce the runtime of unit test for SPARK-32019 >

[jira] [Resolved] (SPARK-32970) Reduce the runtime of unit test for SPARK-32019

[ https://issues.apache.org/jira/browse/SPARK-32970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32970. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29842

[jira] [Commented] (SPARK-33015) Compute the current date only once

[ https://issues.apache.org/jira/browse/SPARK-33015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203760#comment-17203760 ] Apache Spark commented on SPARK-33015: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-33021) Move functions related test cases into test_functions.py

[ https://issues.apache.org/jira/browse/SPARK-33021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33021: - Fix Version/s: 3.0.2 > Move functions related test cases into test_functions.py >

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203753#comment-17203753 ] Dustin Smith commented on SPARK-32046: -- [~planga82] this works every time without issue

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203733#comment-17203733 ] Pablo Langa Blanco commented on SPARK-32046: When you cache a Dataframe, you do not save the

[jira] [Commented] (SPARK-32958) Column pruning for JsonToStructs

[ https://issues.apache.org/jira/browse/SPARK-32958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203695#comment-17203695 ] Apache Spark commented on SPARK-32958: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32958) Column pruning for JsonToStructs

[ https://issues.apache.org/jira/browse/SPARK-32958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32958: Assignee: Apache Spark (was: L. C. Hsieh) > Column pruning for JsonToStructs >

[jira] [Assigned] (SPARK-32958) Column pruning for JsonToStructs

[ https://issues.apache.org/jira/browse/SPARK-32958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32958: Assignee: L. C. Hsieh (was: Apache Spark) > Column pruning for JsonToStructs >

[jira] [Updated] (SPARK-31882) DAG-viz is not rendered correctly with pagination.

[ https://issues.apache.org/jira/browse/SPARK-31882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31882: --- Fix Version/s: 3.0.0 3.1.0 2.4.8 > DAG-viz is not