[jira] [Resolved] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47167. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45259

[jira] [Created] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

Wenchen Fan created SPARK-47247: --- Summary: use smaller target size when coalescing partitions with exploding joins Key: SPARK-47247 URL: https://issues.apache.org/jira/browse/SPARK-47247 Project: Spark

[jira] [Created] (SPARK-47241) fix rule order issues for ExtractGenerator

Wenchen Fan created SPARK-47241: --- Summary: fix rule order issues for ExtractGenerator Key: SPARK-47241 URL: https://issues.apache.org/jira/browse/SPARK-47241 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47145: --- Assignee: Uros Stankovic > Provide table identifier to scan node when DS v2 strategy is

[jira] [Resolved] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47145. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45200

[jira] [Resolved] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47191. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45289

[jira] [Assigned] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47191: --- Assignee: Wenchen Fan > avoid unnecessary relation lookup when uncaching table/view >

[jira] [Resolved] (SPARK-47144) Fix Spark Connect collation issue

[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47144. - Resolution: Fixed Issue resolved by pull request 45233

[jira] [Assigned] (SPARK-47144) Fix Spark Connect collation issue

[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47144: --- Assignee: Nikola Mandic > Fix Spark Connect collation issue >

[jira] [Created] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

Wenchen Fan created SPARK-47191: --- Summary: avoid unnecessary relation lookup when uncaching table/view Key: SPARK-47191 URL: https://issues.apache.org/jira/browse/SPARK-47191 Project: Spark

[jira] [Resolved] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

[ https://issues.apache.org/jira/browse/SPARK-47176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47176. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45270

[jira] [Resolved] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45105

[jira] [Assigned] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47009: --- Assignee: Stefan Kandic > Create table with collation > --- > >

[jira] [Assigned] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45599: --- Assignee: Nicholas Chammas > Percentile can produce a wrong answer if -0.0 and 0.0 are

[jira] [Resolved] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45599. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47044: --- Assignee: Uros Stankovic > Add JDBC query to explain formatted command >

[jira] [Resolved] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47044. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45102

[jira] [Resolved] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45789. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45077

[jira] [Assigned] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45789: --- Assignee: Terry Kim > Support DESCRIBE TABLE for clustering columns >

[jira] [Updated] (SPARK-47071) inline With expression if it contains special expression

[ https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47071: Summary: inline With expression if it contains special expression (was: inline With expression

[jira] [Created] (SPARK-47071) inline With expression if it contains aggregate/window expression

Wenchen Fan created SPARK-47071: --- Summary: inline With expression if it contains aggregate/window expression Key: SPARK-47071 URL: https://issues.apache.org/jira/browse/SPARK-47071 Project: Spark

[jira] [Created] (SPARK-47059) attach error context for ALTER COLUMN v1 command

Wenchen Fan created SPARK-47059: --- Summary: attach error context for ALTER COLUMN v1 command Key: SPARK-47059 URL: https://issues.apache.org/jira/browse/SPARK-47059 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39910: --- Assignee: Christophe Préaud > DataFrameReader API cannot read files from hadoop archives

[jira] [Resolved] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39910. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

[ https://issues.apache.org/jira/browse/SPARK-46999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46999. - Fix Version/s: 4.0.0 Assignee: Wenchen Fan Resolution: Fixed >

[jira] [Resolved] (SPARK-46993) Allow session variables in more places such as from_json for schema

[ https://issues.apache.org/jira/browse/SPARK-46993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46993. - Fix Version/s: 4.0.0 Assignee: Serge Rielau Resolution: Fixed > Allow session

[jira] [Assigned] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46922: --- Assignee: Wenchen Fan > Do not wrap runtime user-facing errors >

[jira] [Resolved] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46922. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44953

[jira] [Created] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

Wenchen Fan created SPARK-46999: --- Summary: ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree Key: SPARK-46999 URL: https://issues.apache.org/jira/browse/SPARK-46999

[jira] [Resolved] (SPARK-46526) Limit over certain correlated subqueries results in Nosuchelement exception

[ https://issues.apache.org/jira/browse/SPARK-46526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46526. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44514

[jira] [Resolved] (SPARK-46980) Avoid using internal APIs in dataframe end-to-end tests

[ https://issues.apache.org/jira/browse/SPARK-46980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46980. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45034

[jira] [Created] (SPARK-46980) Avoid using internal APIs in tests

Wenchen Fan created SPARK-46980: --- Summary: Avoid using internal APIs in tests Key: SPARK-46980 URL: https://issues.apache.org/jira/browse/SPARK-46980 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46980) Avoid using internal APIs in dataframe end-to-end tests

[ https://issues.apache.org/jira/browse/SPARK-46980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46980: Summary: Avoid using internal APIs in dataframe end-to-end tests (was: Avoid using internal APIs

[jira] [Assigned] (SPARK-46833) Using ICU library for collation tracking

[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46833: --- Assignee: Aleksandar Tomic > Using ICU library for collation tracking >

[jira] [Resolved] (SPARK-46833) Using ICU library for collation tracking

[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46833. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44968

[jira] [Resolved] (SPARK-46946) Supporting broadcast of multiple filtering keys in DynamicPruning

[ https://issues.apache.org/jira/browse/SPARK-46946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46946. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44988

[jira] [Assigned] (SPARK-46946) Supporting broadcast of multiple filtering keys in DynamicPruning

[ https://issues.apache.org/jira/browse/SPARK-46946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46946: --- Assignee: Thang Long Vu > Supporting broadcast of multiple filtering keys in

[jira] [Updated] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46922: Summary: Do not wrap runtime user-facing errors (was: better handling for runtime user errors)

[jira] [Created] (SPARK-46951) Define retry-able errors

Wenchen Fan created SPARK-46951: --- Summary: Define retry-able errors Key: SPARK-46951 URL: https://issues.apache.org/jira/browse/SPARK-46951 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-46908) Extend SELECT * support outside of select list

[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46908: --- Assignee: Serge Rielau > Extend SELECT * support outside of select list >

[jira] [Resolved] (SPARK-46908) Extend SELECT * support outside of select list

[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46908. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44938

[jira] [Resolved] (SPARK-46933) Add execution time metric for jdbc query

[ https://issues.apache.org/jira/browse/SPARK-46933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46933. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44969

[jira] [Created] (SPARK-46922) better handling for runtime user errors

Wenchen Fan created SPARK-46922: --- Summary: better handling for runtime user errors Key: SPARK-46922 URL: https://issues.apache.org/jira/browse/SPARK-46922 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44935

[jira] [Assigned] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46905: --- Assignee: Wenchen Fan > Add dedicated class to keep column definition instead of

[jira] [Created] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

Wenchen Fan created SPARK-46905: --- Summary: Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command Key: SPARK-46905 URL: https://issues.apache.org/jira/browse/SPARK-46905

[jira] [Resolved] (SPARK-46683) Write a subquery generator that generates subqueries of different variations to increase testing coverage in this area

[ https://issues.apache.org/jira/browse/SPARK-46683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46683. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44599

[jira] [Resolved] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes

[ https://issues.apache.org/jira/browse/SPARK-46763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46763. - Fix Version/s: 3.4.3 3.5.1 4.0.0 Resolution: Fixed

[jira] [Assigned] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes

[ https://issues.apache.org/jira/browse/SPARK-46763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46763: --- Assignee: Nikhil Sheoran > ReplaceDeduplicateWithAggregate fails when non-grouping keys

[jira] [Resolved] (SPARK-46590) Coalesce partiton assert error after skew join optimization

[ https://issues.apache.org/jira/browse/SPARK-46590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46590. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46590) Coalesce partiton assert error after skew join optimization

[ https://issues.apache.org/jira/browse/SPARK-46590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46590: --- Assignee: Jackey Lee > Coalesce partiton assert error after skew join optimization >

[jira] [Updated] (SPARK-46769) Refine timestamp related schema inference

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46769: Summary: Refine timestamp related schema inference (was: Fix inferring of TIMESTAMP_NTZ in

[jira] [Updated] (SPARK-46769) Refine timestamp related schema inference

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46769: Description: (was: After the PR https://github.com/apache/spark/pull/43243, the TIMESTAMP_NTZ

[jira] [Assigned] (SPARK-46769) Refine timestamp related schema inference

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46769: --- Assignee: Wenchen Fan (was: Max Gekk) > Refine timestamp related schema inference >

[jira] [Resolved] (SPARK-46769) Fix inferring of TIMESTAMP_NTZ in CSV/JSON

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46769. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46644) Fix add in SQLMetric

[ https://issues.apache.org/jira/browse/SPARK-46644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46644. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44649

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Nick Young (was: Kelvin Jiang) > Range operator computeStats() proper long

[jira] [Assigned] (SPARK-45435) Document that lazy checkpoint may not be a consistent

[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45435: --- Assignee: Juliusz Sompolski > Document that lazy checkpoint may not be a consistent >

[jira] [Resolved] (SPARK-45435) Document that lazy checkpoint may not be a consistent

[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45435. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43247

[jira] [Created] (SPARK-46700) count the last spilling for the shuffle disk spilling bytes metric

Wenchen Fan created SPARK-46700: --- Summary: count the last spilling for the shuffle disk spilling bytes metric Key: SPARK-46700 URL: https://issues.apache.org/jira/browse/SPARK-46700 Project: Spark

[jira] [Assigned] (SPARK-46052) Remove unnecessary TaskScheduler.killAllTaskAttempts

[ https://issues.apache.org/jira/browse/SPARK-46052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46052: --- Assignee: wuyi > Remove unnecessary TaskScheduler.killAllTaskAttempts >

[jira] [Resolved] (SPARK-46052) Remove unnecessary TaskScheduler.killAllTaskAttempts

[ https://issues.apache.org/jira/browse/SPARK-46052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46052. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43954

[jira] [Assigned] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46383: --- Assignee: Utkarsh Agarwal > Reduce Driver Heap Usage by Reducing the Lifespan of

[jira] [Resolved] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46383. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44321

[jira] [Resolved] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases

[ https://issues.apache.org/jira/browse/SPARK-46640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46640. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases

[ https://issues.apache.org/jira/browse/SPARK-46640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46640: --- Assignee: Nikhil Sheoran > RemoveRedundantAliases does not account for SubqueryExpression

[jira] [Created] (SPARK-46634) literal validation should not drill down to null fields

Wenchen Fan created SPARK-46634: --- Summary: literal validation should not drill down to null fields Key: SPARK-46634 URL: https://issues.apache.org/jira/browse/SPARK-46634 Project: Spark Issue

[jira] [Assigned] (SPARK-46331) Removing CodeGenFallback trait from subset of datetime and spark version functions

[ https://issues.apache.org/jira/browse/SPARK-46331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46331: --- Assignee: Aleksandar Tomic > Removing CodeGenFallback trait from subset of datetime and

[jira] [Resolved] (SPARK-46331) Removing CodeGenFallback trait from subset of datetime and spark version functions

[ https://issues.apache.org/jira/browse/SPARK-46331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46331. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44261

[jira] [Resolved] (SPARK-46610) Create table should throw exception when no value for a key in options

[ https://issues.apache.org/jira/browse/SPARK-46610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46610. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46581) AccumulatorV2 isZero doesn't do what its name implies

[ https://issues.apache.org/jira/browse/SPARK-46581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46581: --- Assignee: Davin Tjong > AccumulatorV2 isZero doesn't do what its name implies >

[jira] [Resolved] (SPARK-46581) AccumulatorV2 isZero doesn't do what its name implies

[ https://issues.apache.org/jira/browse/SPARK-46581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46581. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44583

[jira] [Resolved] (SPARK-45352) Eliminate foldable window partitions

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45352. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43144

[jira] [Assigned] (SPARK-45352) Eliminate foldable window partitions

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45352: --- Assignee: Mingliang Zhu > Eliminate foldable window partitions >

[jira] [Created] (SPARK-46609) avoid exponential explosion in PartitioningPreservingUnaryExecNode

Wenchen Fan created SPARK-46609: --- Summary: avoid exponential explosion in PartitioningPreservingUnaryExecNode Key: SPARK-46609 URL: https://issues.apache.org/jira/browse/SPARK-46609 Project: Spark

[jira] [Assigned] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

[ https://issues.apache.org/jira/browse/SPARK-46602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46602: --- Assignee: Xinyi Yu > CREATE VIEW IF NOT EXISTS should never throw

[jira] [Resolved] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

[ https://issues.apache.org/jira/browse/SPARK-46602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46602. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46179. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44084

[jira] [Assigned] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46179: --- Assignee: Andy Lam > Generate golden files for SQLQueryTestSuites with Postgres >

[jira] [Created] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

Wenchen Fan created SPARK-46598: --- Summary: OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column Key: SPARK-46598 URL:

[jira] [Created] (SPARK-46536) Support GROUP BY calendar_interval_type

Wenchen Fan created SPARK-46536: --- Summary: Support GROUP BY calendar_interval_type Key: SPARK-46536 URL: https://issues.apache.org/jira/browse/SPARK-46536 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46366) Use with expression to avoid duplicating expressions in BETWEEN operation

[ https://issues.apache.org/jira/browse/SPARK-46366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46366. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44299

[jira] [Assigned] (SPARK-46444) V2SessionCatalog#createTable should not load the table

[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46444: --- Assignee: Wenchen Fan > V2SessionCatalog#createTable should not load the table >

[jira] [Resolved] (SPARK-46444) V2SessionCatalog#createTable should not load the table

[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46444. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44377

[jira] [Resolved] (SPARK-46481) EXECUTE IMMEDIATE does not fold variables when given as parameters

[ https://issues.apache.org/jira/browse/SPARK-46481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46481. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44450

[jira] [Resolved] (SPARK-46485) V1Write should not add Sort when not needed

[ https://issues.apache.org/jira/browse/SPARK-46485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46485. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44458

[jira] [Updated] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

[ https://issues.apache.org/jira/browse/SPARK-46466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46466: Fix Version/s: 3.5.1 3.4.3 > vectorized parquet reader should never do rebase

[jira] [Resolved] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40876. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44368

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40876: --- Assignee: Johan Lasperas > Spark's Vectorized ParquetReader should support type promotions

[jira] [Created] (SPARK-46485) V1Write should not add Sort when not needed

Wenchen Fan created SPARK-46485: --- Summary: V1Write should not add Sort when not needed Key: SPARK-46485 URL: https://issues.apache.org/jira/browse/SPARK-46485 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46443) Decimal precision and scale should decided by JDBC dialect.

[ https://issues.apache.org/jira/browse/SPARK-46443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46443. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46468) COUNT bug in lateral/exists subqueries

[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46468. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44451

[jira] [Assigned] (SPARK-46468) COUNT bug in lateral/exists subqueries

[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46468: --- Assignee: Andrey Gubichev > COUNT bug in lateral/exists subqueries >

[jira] [Resolved] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45525. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43791

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45525: --- Assignee: Allison Wang > Initial support for Python data source write API >

[jira] [Resolved] (SPARK-46380) Replacing current time prior to inline table eval

[ https://issues.apache.org/jira/browse/SPARK-46380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46380. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

Wenchen Fan created SPARK-46466: --- Summary: vectorized parquet reader should never do rebase for timestamp ntz Key: SPARK-46466 URL: https://issues.apache.org/jira/browse/SPARK-46466 Project: Spark

[jira] [Resolved] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46452. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44410

[jira] [Assigned] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46452: --- Assignee: Allison Wang > Add a new API in DSv2 DataWriter to write an iterator of records

[jira] [Resolved] (SPARK-46272) Support CTAS using DSv2 sources

[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46272. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44190

<    1   2   3   4   5   6   7   8   9   10   >