[jira] [Created] (SPARK-48774) Use SparkSession in SQLImplicits

Hyukjin Kwon created SPARK-48774: Summary: Use SparkSession in SQLImplicits Key: SPARK-48774 URL: https://issues.apache.org/jira/browse/SPARK-48774 Project: Spark Issue Type: Test C

[jira] [Created] (SPARK-48773) Document config "spark.default.parallelism"

Rui Wang created SPARK-48773: Summary: Document config "spark.default.parallelism" Key: SPARK-48773 URL: https://issues.apache.org/jira/browse/SPARK-48773 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48766) Document the behavior difference of `extraction` between element_at and try_element_at

[ https://issues.apache.org/jira/browse/SPARK-48766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48766. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47161 [https://

[jira] [Resolved] (SPARK-48768) Should not cache `explain`

[ https://issues.apache.org/jira/browse/SPARK-48768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48768. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47163 [https://

[jira] [Updated] (SPARK-48772) State Data Source Read Change Feed

[ https://issues.apache.org/jira/browse/SPARK-48772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuchen Liu updated SPARK-48772: --- Description: The current state reader can only return the entire state at a specific version. If an

[jira] [Created] (SPARK-48772) State Data Source Read Change Feed

Yuchen Liu created SPARK-48772: -- Summary: State Data Source Read Change Feed Key: SPARK-48772 URL: https://issues.apache.org/jira/browse/SPARK-48772 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17861276#comment-17861276 ] Dongjoon Hyun commented on SPARK-48292: --- This is backported via the following. - h

[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48292: -- Fix Version/s: 3.4.4 > Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort st

[jira] [Created] (SPARK-48771) Speed up LogicalPlanIntegrity.validateExprIdUniqueness for large query plans

Kelvin Jiang created SPARK-48771: Summary: Speed up LogicalPlanIntegrity.validateExprIdUniqueness for large query plans Key: SPARK-48771 URL: https://issues.apache.org/jira/browse/SPARK-48771 Project:

[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48292: -- Fix Version/s: 3.5.2 > Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort st

[jira] [Comment Edited] (SPARK-48770) Read operator metadata only once on driver for store read

[ https://issues.apache.org/jira/browse/SPARK-48770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17861252#comment-17861252 ] Anish Shrigondekar edited comment on SPARK-48770 at 7/1/24 7:13 PM: --

[jira] [Created] (SPARK-48770) Read operator metadata only once on driver for store read

Anish Shrigondekar created SPARK-48770: -- Summary: Read operator metadata only once on driver for store read Key: SPARK-48770 URL: https://issues.apache.org/jira/browse/SPARK-48770 Project: Spark

[jira] [Resolved] (SPARK-48697) Add collation aware string filters

[ https://issues.apache.org/jira/browse/SPARK-48697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48697. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47059 [https://gith

[jira] [Resolved] (SPARK-48737) Reduce number of exception creations for default expression analysis

[ https://issues.apache.org/jira/browse/SPARK-48737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48737. - Resolution: Fixed Issue resolved by pull request 47124 [https://github.com/apache/spark/pull/471

[jira] [Assigned] (SPARK-48737) Reduce number of exception creations for default expression analysis

[ https://issues.apache.org/jira/browse/SPARK-48737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48737: --- Assignee: Uros Stankovic > Reduce number of exception creations for default expression anal

[jira] [Assigned] (SPARK-48747) Add code point iterator to UTF8String

[ https://issues.apache.org/jira/browse/SPARK-48747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48747: --- Assignee: Uroš Bojanić > Add code point iterator to UTF8String > --

[jira] [Resolved] (SPARK-48747) Add code point iterator to UTF8String

[ https://issues.apache.org/jira/browse/SPARK-48747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48747. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47123 [https://gith

[jira] [Updated] (SPARK-48769) ScalaUDF should support constant folding

[ https://issues.apache.org/jira/browse/SPARK-48769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-48769: --- Description: There is no reason we can not support constant folding for ScalaUDF and allowin

[jira] [Created] (SPARK-48769) ScalaUDF should support constant folding

Emil Ejbyfeldt created SPARK-48769: -- Summary: ScalaUDF should support constant folding Key: SPARK-48769 URL: https://issues.apache.org/jira/browse/SPARK-48769 Project: Spark Issue Type: New

[jira] [Created] (SPARK-48768) Should not cache `explain`

Ruifeng Zheng created SPARK-48768: - Summary: Should not cache `explain` Key: SPARK-48768 URL: https://issues.apache.org/jira/browse/SPARK-48768 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-48767) Fix Variant error prompt

BingKun Pan created SPARK-48767: --- Summary: Fix Variant error prompt Key: SPARK-48767 URL: https://issues.apache.org/jira/browse/SPARK-48767 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-48765) Enhance default value evaluation for SPARK_IDENT_STRING

[ https://issues.apache.org/jira/browse/SPARK-48765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48765. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47160 [https://github.com

[jira] [Assigned] (SPARK-48765) Enhance default value evaluation for SPARK_IDENT_STRING

[ https://issues.apache.org/jira/browse/SPARK-48765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48765: Assignee: Cheng Pan > Enhance default value evaluation for SPARK_IDENT_STRING > -

[jira] [Commented] (SPARK-48765) Enhance default value evaluation for SPARK_IDENT_STRING

[ https://issues.apache.org/jira/browse/SPARK-48765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17861127#comment-17861127 ] Nikita Awasthi commented on SPARK-48765: User 'pan3793' has created a pull reque

[jira] [Assigned] (SPARK-48697) Add collation aware string filters

[ https://issues.apache.org/jira/browse/SPARK-48697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48697: -- Assignee: Apache Spark > Add collation aware string filters > ---

[jira] [Assigned] (SPARK-48697) Add collation aware string filters

[ https://issues.apache.org/jira/browse/SPARK-48697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48697: -- Assignee: (was: Apache Spark) > Add collation aware string filters >

[jira] [Assigned] (SPARK-48710) Incompatibilities with NumPy 2.0

[ https://issues.apache.org/jira/browse/SPARK-48710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48710: -- Assignee: Apache Spark > Incompatibilities with NumPy 2.0 > -

[jira] [Assigned] (SPARK-48766) Document the behavior difference of `extraction` between element_at and try_element_at

[ https://issues.apache.org/jira/browse/SPARK-48766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48766: -- Assignee: Apache Spark > Document the behavior difference of `extraction` between ele

[jira] [Assigned] (SPARK-48710) Incompatibilities with NumPy 2.0

[ https://issues.apache.org/jira/browse/SPARK-48710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48710: -- Assignee: (was: Apache Spark) > Incompatibilities with NumPy 2.0 > --

[jira] [Assigned] (SPARK-48766) Document the behavior difference of `extraction` between element_at and try_element_at

[ https://issues.apache.org/jira/browse/SPARK-48766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48766: -- Assignee: Apache Spark > Document the behavior difference of `extraction` between ele

[jira] [Created] (SPARK-48766) Document the behavior difference of `extraction` between element_at and try_element_at

Ruifeng Zheng created SPARK-48766: - Summary: Document the behavior difference of `extraction` between element_at and try_element_at Key: SPARK-48766 URL: https://issues.apache.org/jira/browse/SPARK-48766

[jira] [Created] (SPARK-48765) Enhance default value evaluation for SPARK_IDENT_STRING

Cheng Pan created SPARK-48765: - Summary: Enhance default value evaluation for SPARK_IDENT_STRING Key: SPARK-48765 URL: https://issues.apache.org/jira/browse/SPARK-48765 Project: Spark Issue Type: