[jira] [Resolved] (SPARK-40836) AnalyzeResult should use struct for schema

[ https://issues.apache.org/jira/browse/SPARK-40836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40836. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38301

[jira] [Resolved] (SPARK-40906) `Mode` should copy keys before inserting into Map

[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40906. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38383

[jira] [Assigned] (SPARK-40906) `Mode` should copy keys before inserting into Map

[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40906: --- Assignee: Ruifeng Zheng > `Mode` should copy keys before inserting into Map >

[jira] [Resolved] (SPARK-40899) UserContext should be extensible

[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40899. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38374

[jira] [Assigned] (SPARK-40899) UserContext should be extensible

[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40899: --- Assignee: Martin Grund > UserContext should be extensible >

[jira] [Resolved] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40857. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38320

[jira] [Assigned] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40857: --- Assignee: Martin Grund > Allow configurable GPRC interceptors for Spark Connect >

[jira] [Assigned] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34265: --- Assignee: Luca Canali > Instrument Python UDF execution using SQL Metrics >

[jira] [Resolved] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34265. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 33559

[jira] [Assigned] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40798: --- Assignee: XiDuo You > Alter partition should verify value >

[jira] [Resolved] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40798. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38257

[jira] [Resolved] (SPARK-40800) Always inline expressions in OptimizeOneRowRelationSubquery

[ https://issues.apache.org/jira/browse/SPARK-40800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40800. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38260

[jira] [Assigned] (SPARK-40800) Always inline expressions in OptimizeOneRowRelationSubquery

[ https://issues.apache.org/jira/browse/SPARK-40800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40800: --- Assignee: Allison Wang > Always inline expressions in OptimizeOneRowRelationSubquery >

[jira] [Assigned] (SPARK-36114) Support subqueries with correlated non-equality predicates

[ https://issues.apache.org/jira/browse/SPARK-36114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36114: --- Assignee: Allison Wang > Support subqueries with correlated non-equality predicates >

[jira] [Resolved] (SPARK-36114) Support subqueries with correlated non-equality predicates

[ https://issues.apache.org/jira/browse/SPARK-36114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36114. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38135

[jira] [Assigned] (SPARK-40812) Add Deduplicate to Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40812: --- Assignee: Rui Wang > Add Deduplicate to Connect proto > >

[jira] [Resolved] (SPARK-40812) Add Deduplicate to Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40812. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38276

[jira] [Assigned] (SPARK-40539) PySpark readwriter API parity for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-40539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40539: --- Assignee: Rui Wang > PySpark readwriter API parity for Spark Connect >

[jira] [Resolved] (SPARK-40539) PySpark readwriter API parity for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-40539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40539. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38086

[jira] [Assigned] (SPARK-40753) Fix bug in test case for catalog directory operation

[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40753: --- Assignee: xiaoping.huang > Fix bug in test case for catalog directory operation >

[jira] [Resolved] (SPARK-40753) Fix bug in test case for catalog directory operation

[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40753. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38206

[jira] [Resolved] (SPARK-40823) Connect Proto should carry unparsed identifiers

[ https://issues.apache.org/jira/browse/SPARK-40823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40823. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38264

[jira] [Assigned] (SPARK-40823) Connect Proto should carry unparsed identifiers

[ https://issues.apache.org/jira/browse/SPARK-40823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40823: --- Assignee: Rui Wang > Connect Proto should carry unparsed identifiers >

[jira] [Resolved] (SPARK-40615) Check unsupported data type when decorrelating subqueries

[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40615. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38050

[jira] [Assigned] (SPARK-40615) Check unsupported data type when decorrelating subqueries

[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40615: --- Assignee: Allison Wang > Check unsupported data type when decorrelating subqueries >

[jira] [Resolved] (SPARK-40360) Convert some DDL exception to new error framework

[ https://issues.apache.org/jira/browse/SPARK-40360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40360. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37887

[jira] [Resolved] (SPARK-40774) Add Sample to proto and DSL

[ https://issues.apache.org/jira/browse/SPARK-40774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40774. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38227

[jira] [Assigned] (SPARK-40774) Add Sample to proto and DSL

[ https://issues.apache.org/jira/browse/SPARK-40774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40774: --- Assignee: Rui Wang > Add Sample to proto and DSL > --- > >

[jira] [Resolved] (SPARK-40743) StructType should contain a list of StructField and each field should have a name

[ https://issues.apache.org/jira/browse/SPARK-40743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40743. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38200

[jira] [Assigned] (SPARK-40743) StructType should contain a list of StructField and each field should have a name

[ https://issues.apache.org/jira/browse/SPARK-40743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40743: --- Assignee: Rui Wang > StructType should contain a list of StructField and each field should

[jira] [Resolved] (SPARK-40611) Improve the performance for setInterval & getInterval of UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-40611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40611. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38046

[jira] [Assigned] (SPARK-40611) Improve the performance for setInterval & getInterval of UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-40611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40611: --- Assignee: jiaan.geng > Improve the performance for setInterval & getInterval of UnsafeRow

[jira] [Resolved] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40382. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37825

[jira] [Assigned] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40382: --- Assignee: Bruce Robbins > Reduce projections in Expand when multiple distinct aggregations

[jira] [Assigned] (SPARK-40773) Refactor checkCorrelationsInSubquery

[ https://issues.apache.org/jira/browse/SPARK-40773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40773: --- Assignee: Allison Wang > Refactor checkCorrelationsInSubquery >

[jira] [Resolved] (SPARK-40773) Refactor checkCorrelationsInSubquery

[ https://issues.apache.org/jira/browse/SPARK-40773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40773. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38226

[jira] [Resolved] (SPARK-40780) Add WHERE to Connect proto and DSL

[ https://issues.apache.org/jira/browse/SPARK-40780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40780. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38232

[jira] [Assigned] (SPARK-40780) Add WHERE to Connect proto and DSL

[ https://issues.apache.org/jira/browse/SPARK-40780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40780: --- Assignee: Rui Wang > Add WHERE to Connect proto and DSL >

[jira] [Assigned] (SPARK-40697) Add read-side char/varchar handling to cover external data files

[ https://issues.apache.org/jira/browse/SPARK-40697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40697: --- Assignee: Wenchen Fan > Add read-side char/varchar handling to cover external data files >

[jira] [Resolved] (SPARK-40697) Add read-side char/varchar handling to cover external data files

[ https://issues.apache.org/jira/browse/SPARK-40697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40697. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38151

[jira] [Resolved] (SPARK-40717) Support Column Alias in connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40717. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38174

[jira] [Assigned] (SPARK-40717) Support Column Alias in connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40717: --- Assignee: Rui Wang > Support Column Alias in connect DSL >

[jira] [Assigned] (SPARK-40667) Refactor File Data Source Options

[ https://issues.apache.org/jira/browse/SPARK-40667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40667: --- Assignee: Xiaonan Yang > Refactor File Data Source Options >

[jira] [Resolved] (SPARK-40667) Refactor File Data Source Options

[ https://issues.apache.org/jira/browse/SPARK-40667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40667. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38113

[jira] [Assigned] (SPARK-40707) Add groupby to connect DSL and test more than one grouping expressions

[ https://issues.apache.org/jira/browse/SPARK-40707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40707: --- Assignee: Rui Wang > Add groupby to connect DSL and test more than one grouping

[jira] [Resolved] (SPARK-40707) Add groupby to connect DSL and test more than one grouping expressions

[ https://issues.apache.org/jira/browse/SPARK-40707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40707. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38155

[jira] [Assigned] (SPARK-40534) Extend support for Join Relation

[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40534: --- Assignee: Rui Wang > Extend support for Join Relation > >

[jira] [Resolved] (SPARK-40534) Extend support for Join Relation

[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40534. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38157

[jira] [Assigned] (SPARK-39876) Unpivot / melt function for SQL

[ https://issues.apache.org/jira/browse/SPARK-39876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39876: --- Assignee: Enrico Minack > Unpivot / melt function for SQL >

[jira] [Resolved] (SPARK-39876) Unpivot / melt function for SQL

[ https://issues.apache.org/jira/browse/SPARK-39876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39876. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37407

[jira] [Assigned] (SPARK-40454) Initial DSL framework for protobuf testing

[ https://issues.apache.org/jira/browse/SPARK-40454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40454: --- Assignee: Rui Wang > Initial DSL framework for protobuf testing >

[jira] [Resolved] (SPARK-40454) Initial DSL framework for protobuf testing

[ https://issues.apache.org/jira/browse/SPARK-40454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40454. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37994

[jira] [Created] (SPARK-40697) Add read-side char/varchar handling to cover external data files

Wenchen Fan created SPARK-40697: --- Summary: Add read-side char/varchar handling to cover external data files Key: SPARK-40697 URL: https://issues.apache.org/jira/browse/SPARK-40697 Project: Spark

[jira] [Assigned] (SPARK-40216) Extract common `prepareWrite` method for `ParquetFileFormat` and `ParquetWrite` to eliminate duplicate code

[ https://issues.apache.org/jira/browse/SPARK-40216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40216: --- Assignee: Yang Jie > Extract common `prepareWrite` method for `ParquetFileFormat` and >

[jira] [Resolved] (SPARK-40216) Extract common `prepareWrite` method for `ParquetFileFormat` and `ParquetWrite` to eliminate duplicate code

[ https://issues.apache.org/jira/browse/SPARK-40216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40216. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37654

[jira] [Assigned] (SPARK-40660) Switch to XORShiftRandom to distribute elements

[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40660: --- Assignee: Yuming Wang > Switch to XORShiftRandom to distribute elements >

[jira] [Resolved] (SPARK-40660) Switch to XORShiftRandom to distribute elements

[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40660. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38106

[jira] [Assigned] (SPARK-40587) SELECT * shouldn't be empty project list in proto.

[ https://issues.apache.org/jira/browse/SPARK-40587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40587: --- Assignee: Rui Wang > SELECT * shouldn't be empty project list in proto. >

[jira] [Resolved] (SPARK-40587) SELECT * shouldn't be empty project list in proto.

[ https://issues.apache.org/jira/browse/SPARK-40587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40587. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38023

[jira] [Created] (SPARK-40603) throw the original error from catalog implementations

Wenchen Fan created SPARK-40603: --- Summary: throw the original error from catalog implementations Key: SPARK-40603 URL: https://issues.apache.org/jira/browse/SPARK-40603 Project: Spark Issue

[jira] [Created] (SPARK-40595) Improve error message for unused CTE relations

Wenchen Fan created SPARK-40595: --- Summary: Improve error message for unused CTE relations Key: SPARK-40595 URL: https://issues.apache.org/jira/browse/SPARK-40595 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35242) Support change catalog default database for spark

[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35242: --- Assignee: Gabor Roczei > Support change catalog default database for spark >

[jira] [Resolved] (SPARK-35242) Support change catalog default database for spark

[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35242. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37679

[jira] [Resolved] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

[ https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40501. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37941

[jira] [Assigned] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

[ https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40501: --- Assignee: BingKun Pan > Add PushProjectionThroughLimit for Optimizer >

[jira] [Resolved] (SPARK-40530) Add error-related developer APIs

[ https://issues.apache.org/jira/browse/SPARK-40530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40530. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37969

[jira] [Assigned] (SPARK-40530) Add error-related developer APIs

[ https://issues.apache.org/jira/browse/SPARK-40530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40530: --- Assignee: Wenchen Fan > Add error-related developer APIs >

[jira] [Assigned] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38717: --- Assignee: Peter Toth > Handle Hive's bucket spec case preserving behaviour >

[jira] [Resolved] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38717. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-40474) Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps

[ https://issues.apache.org/jira/browse/SPARK-40474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40474: --- Assignee: Xiaonan Yang > Correct CSV schema inference and data parsing behavior on columns

[jira] [Resolved] (SPARK-40474) Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps

[ https://issues.apache.org/jira/browse/SPARK-40474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40474. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37933

[jira] [Assigned] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

[ https://issues.apache.org/jira/browse/SPARK-40407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40407: --- Assignee: Bobby Wang > Repartition of DataFrame can result in severe data skew in some

[jira] [Resolved] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

[ https://issues.apache.org/jira/browse/SPARK-40407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40407. - Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-40488) Do not wrap exceptions thrown in FileFormatWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-40488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40488: --- Assignee: Bo Zhang > Do not wrap exceptions thrown in FileFormatWriter.write with

[jira] [Resolved] (SPARK-40488) Do not wrap exceptions thrown in FileFormatWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-40488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40488. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37931

[jira] [Created] (SPARK-40530) Add error-related developer APIs

Wenchen Fan created SPARK-40530: --- Summary: Add error-related developer APIs Key: SPARK-40530 URL: https://issues.apache.org/jira/browse/SPARK-40530 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-40494) Optimize the performance of `keys.zipWithIndex.toMap` code pattern

[ https://issues.apache.org/jira/browse/SPARK-40494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40494. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37940

[jira] [Assigned] (SPARK-40494) Optimize the performance of `keys.zipWithIndex.toMap` code pattern

[ https://issues.apache.org/jira/browse/SPARK-40494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40494: --- Assignee: Yang Jie > Optimize the performance of `keys.zipWithIndex.toMap` code pattern >

[jira] [Assigned] (SPARK-40496) Configs to control "enableDateTimeParsingFallback" are incorrectly swapped

[ https://issues.apache.org/jira/browse/SPARK-40496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40496: --- Assignee: Ivan Sadikov > Configs to control "enableDateTimeParsingFallback" are

[jira] [Resolved] (SPARK-40496) Configs to control "enableDateTimeParsingFallback" are incorrectly swapped

[ https://issues.apache.org/jira/browse/SPARK-40496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40496. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37942

[jira] [Resolved] (SPARK-40456) PartitionIterator.hasNext should be cheap to call repeatedly

[ https://issues.apache.org/jira/browse/SPARK-40456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40456. - Fix Version/s: 3.4.0 Resolution: Fixed > PartitionIterator.hasNext should be cheap to

[jira] [Assigned] (SPARK-40456) PartitionIterator.hasNext should be cheap to call repeatedly

[ https://issues.apache.org/jira/browse/SPARK-40456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40456: --- Assignee: Richard Chen (was: Wenchen Fan) > PartitionIterator.hasNext should be cheap to

[jira] [Assigned] (SPARK-40425) DROP TABLE does not need to do table lookup

[ https://issues.apache.org/jira/browse/SPARK-40425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40425: --- Assignee: Wenchen Fan > DROP TABLE does not need to do table lookup >

[jira] [Resolved] (SPARK-40425) DROP TABLE does not need to do table lookup

[ https://issues.apache.org/jira/browse/SPARK-40425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40425. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37879

[jira] [Resolved] (SPARK-40482) Revert SPARK-24544 Print actual failure cause when look up function failed

[ https://issues.apache.org/jira/browse/SPARK-40482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40482. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37896

[jira] [Assigned] (SPARK-40482) Revert SPARK-24544 Print actual failure cause when look up function failed

[ https://issues.apache.org/jira/browse/SPARK-40482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40482: --- Assignee: Wenchen Fan > Revert SPARK-24544 Print actual failure cause when look up

[jira] [Assigned] (SPARK-40175) Converting Tuple2 to Scala Map via `.toMap` is slow

[ https://issues.apache.org/jira/browse/SPARK-40175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40175: --- Assignee: Yang Jie > Converting Tuple2 to Scala Map via `.toMap` is slow >

[jira] [Resolved] (SPARK-40175) Converting Tuple2 to Scala Map via `.toMap` is slow

[ https://issues.apache.org/jira/browse/SPARK-40175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40175. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37876

[jira] [Created] (SPARK-40456) PartitionIterator.hasNext should be cheap to call repeatedly

Wenchen Fan created SPARK-40456: --- Summary: PartitionIterator.hasNext should be cheap to call repeatedly Key: SPARK-40456 URL: https://issues.apache.org/jira/browse/SPARK-40456 Project: Spark

[jira] [Assigned] (SPARK-40387) Improve the implementation of Spark Decimal

[ https://issues.apache.org/jira/browse/SPARK-40387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40387: --- Assignee: jiaan.geng > Improve the implementation of Spark Decimal >

[jira] [Resolved] (SPARK-40387) Improve the implementation of Spark Decimal

[ https://issues.apache.org/jira/browse/SPARK-40387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40387. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37830

[jira] [Created] (SPARK-40425) DROP TABLE does not need to do table lookup

Wenchen Fan created SPARK-40425: --- Summary: DROP TABLE does not need to do table lookup Key: SPARK-40425 URL: https://issues.apache.org/jira/browse/SPARK-40425 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40380. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40380: --- Assignee: Kris Mok > Constant-folding of InvokeLike should not result in non-serializable

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-40149: Fix Version/s: 3.2.3 > Star expansion after outer join asymmetrically includes joining key >

[jira] [Assigned] (SPARK-40185) Remove column suggestion when the candidate list is empty for unresolved column/attribute/map key

[ https://issues.apache.org/jira/browse/SPARK-40185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40185: --- Assignee: Vitalii Li > Remove column suggestion when the candidate list is empty for

[jira] [Resolved] (SPARK-40185) Remove column suggestion when the candidate list is empty for unresolved column/attribute/map key

[ https://issues.apache.org/jira/browse/SPARK-40185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40185. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37621

[jira] [Resolved] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40149. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40315: --- Assignee: Carmen Kwan > Non-deterministic hashCode() calculations for ArrayBasedMapData on

[jira] [Resolved] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40315. - Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

<    8   9   10   11   12   13   14   15   16   17   >