[jira] [Resolved] (SPARK-45891) Support Variant data type

[ https://issues.apache.org/jira/browse/SPARK-45891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45891. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45539

[jira] [Resolved] (SPARK-47366) Implement parse_json

[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47366. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45479

[jira] [Assigned] (SPARK-47366) Implement parse_json

[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47366: --- Assignee: Chenhao Li > Implement parse_json > > >

[jira] [Resolved] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47385. - Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed

[jira] [Assigned] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47385: --- Assignee: Chenhao Li > Tuple encoder produces wrong results with Option inputs >

[jira] [Created] (SPARK-47376) AssertNotNull should throw USER_RAISED_EXCEPTION error

Wenchen Fan created SPARK-47376: --- Summary: AssertNotNull should throw USER_RAISED_EXCEPTION error Key: SPARK-47376 URL: https://issues.apache.org/jira/browse/SPARK-47376 Project: Spark Issue

[jira] [Assigned] (SPARK-47270) Dataset.isEmpty should not trigger job execution on CommandResults

[ https://issues.apache.org/jira/browse/SPARK-47270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47270: --- Assignee: Zhen Wang > Dataset.isEmpty should not trigger job execution on CommandResults >

[jira] [Resolved] (SPARK-47270) Dataset.isEmpty should not trigger job execution on CommandResults

[ https://issues.apache.org/jira/browse/SPARK-47270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47270. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45373

[jira] [Assigned] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47265: --- Assignee: BingKun Pan > Use `createTable(..., schema: StructType, ...)` instead of

[jira] [Resolved] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47265. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45368

[jira] [Assigned] (SPARK-47248) contains (non-binary collations)

[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47248: --- Assignee: Uroš Bojanić > contains (non-binary collations) >

[jira] [Resolved] (SPARK-47248) contains (non-binary collations)

[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47248. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45382

[jira] [Resolved] (SPARK-47241) fix rule order issues for ExtractGenerator

[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47241. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47241) fix rule order issues for ExtractGenerator

[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47241: --- Assignee: Wenchen Fan > fix rule order issues for ExtractGenerator >

[jira] [Resolved] (SPARK-47238) Reduce executor memory usage by making generated code in WSCG a broadcast variable

[ https://issues.apache.org/jira/browse/SPARK-47238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47238. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45348

[jira] [Created] (SPARK-47313) scala.MatchError should be treated as internal error

Wenchen Fan created SPARK-47313: --- Summary: scala.MatchError should be treated as internal error Key: SPARK-47313 URL: https://issues.apache.org/jira/browse/SPARK-47313 Project: Spark Issue

[jira] [Created] (SPARK-47300) quoteIfNeeded should quote identifier starts with digits

Wenchen Fan created SPARK-47300: --- Summary: quoteIfNeeded should quote identifier starts with digits Key: SPARK-47300 URL: https://issues.apache.org/jira/browse/SPARK-47300 Project: Spark Issue

[jira] [Resolved] (SPARK-46835) Join support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46835. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45389

[jira] [Assigned] (SPARK-46835) Join support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46835: --- Assignee: Aleksandar Tomic > Join support for strings with collation >

[jira] [Resolved] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47247. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45357

[jira] [Assigned] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47247: --- Assignee: Wenchen Fan > use smaller target size when coalescing partitions with exploding

[jira] [Resolved] (SPARK-47033) EXECUTE IMMEDIATE USING does not recognize session variable names

[ https://issues.apache.org/jira/browse/SPARK-47033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47033. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45293

[jira] [Resolved] (SPARK-47168) Disable parquet filter pushdown for non default collated strings

[ https://issues.apache.org/jira/browse/SPARK-47168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47168. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45262

[jira] [Assigned] (SPARK-47268) Repartition by column should respect collation

[ https://issues.apache.org/jira/browse/SPARK-47268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47268: --- Assignee: Aleksandar Tomic > Repartition by column should respect collation >

[jira] [Resolved] (SPARK-47268) Repartition by column should respect collation

[ https://issues.apache.org/jira/browse/SPARK-47268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47268. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45370

[jira] [Resolved] (SPARK-47070) Subquery rewrite inside an aggregation makes an aggregation invalid

[ https://issues.apache.org/jira/browse/SPARK-47070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47070. - Fix Version/s: 4.0.0 Resolution: Fixed > Subquery rewrite inside an aggregation makes an

[jira] [Resolved] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47131. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45216

[jira] [Assigned] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47131: --- Assignee: Uroš Bojanić > contains, startswith, endswith > -- >

[jira] [Resolved] (SPARK-46973) Skip V2 table lookup when a table is in V1 table cache

[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46973. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45176

[jira] [Assigned] (SPARK-46973) Skip V2 table lookup when a table is in V1 table cache

[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46973: --- Assignee: Allison Wang > Skip V2 table lookup when a table is in V1 table cache >

[jira] [Resolved] (SPARK-46834) Aggregate support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46834. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45290

[jira] [Assigned] (SPARK-46834) Aggregate support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46834: --- Assignee: Aleksandar Tomic > Aggregate support for strings with collation >

[jira] [Resolved] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47167. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45259

[jira] [Created] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

Wenchen Fan created SPARK-47247: --- Summary: use smaller target size when coalescing partitions with exploding joins Key: SPARK-47247 URL: https://issues.apache.org/jira/browse/SPARK-47247 Project: Spark

[jira] [Created] (SPARK-47241) fix rule order issues for ExtractGenerator

Wenchen Fan created SPARK-47241: --- Summary: fix rule order issues for ExtractGenerator Key: SPARK-47241 URL: https://issues.apache.org/jira/browse/SPARK-47241 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47145: --- Assignee: Uros Stankovic > Provide table identifier to scan node when DS v2 strategy is

[jira] [Resolved] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47145. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45200

[jira] [Resolved] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47191. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45289

[jira] [Assigned] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47191: --- Assignee: Wenchen Fan > avoid unnecessary relation lookup when uncaching table/view >

[jira] [Resolved] (SPARK-47144) Fix Spark Connect collation issue

[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47144. - Resolution: Fixed Issue resolved by pull request 45233

[jira] [Assigned] (SPARK-47144) Fix Spark Connect collation issue

[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47144: --- Assignee: Nikola Mandic > Fix Spark Connect collation issue >

[jira] [Created] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

Wenchen Fan created SPARK-47191: --- Summary: avoid unnecessary relation lookup when uncaching table/view Key: SPARK-47191 URL: https://issues.apache.org/jira/browse/SPARK-47191 Project: Spark

[jira] [Resolved] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

[ https://issues.apache.org/jira/browse/SPARK-47176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47176. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45270

[jira] [Resolved] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45105

[jira] [Assigned] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47009: --- Assignee: Stefan Kandic > Create table with collation > --- > >

[jira] [Assigned] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45599: --- Assignee: Nicholas Chammas > Percentile can produce a wrong answer if -0.0 and 0.0 are

[jira] [Resolved] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45599. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47044: --- Assignee: Uros Stankovic > Add JDBC query to explain formatted command >

[jira] [Resolved] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47044. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45102

[jira] [Resolved] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45789. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45077

[jira] [Assigned] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45789: --- Assignee: Terry Kim > Support DESCRIBE TABLE for clustering columns >

[jira] [Updated] (SPARK-47071) inline With expression if it contains special expression

[ https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47071: Summary: inline With expression if it contains special expression (was: inline With expression

[jira] [Created] (SPARK-47071) inline With expression if it contains aggregate/window expression

Wenchen Fan created SPARK-47071: --- Summary: inline With expression if it contains aggregate/window expression Key: SPARK-47071 URL: https://issues.apache.org/jira/browse/SPARK-47071 Project: Spark

[jira] [Created] (SPARK-47059) attach error context for ALTER COLUMN v1 command

Wenchen Fan created SPARK-47059: --- Summary: attach error context for ALTER COLUMN v1 command Key: SPARK-47059 URL: https://issues.apache.org/jira/browse/SPARK-47059 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39910: --- Assignee: Christophe Préaud > DataFrameReader API cannot read files from hadoop archives

[jira] [Resolved] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39910. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

[ https://issues.apache.org/jira/browse/SPARK-46999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46999. - Fix Version/s: 4.0.0 Assignee: Wenchen Fan Resolution: Fixed >

[jira] [Resolved] (SPARK-46993) Allow session variables in more places such as from_json for schema

[ https://issues.apache.org/jira/browse/SPARK-46993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46993. - Fix Version/s: 4.0.0 Assignee: Serge Rielau Resolution: Fixed > Allow session

[jira] [Assigned] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46922: --- Assignee: Wenchen Fan > Do not wrap runtime user-facing errors >

[jira] [Resolved] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46922. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44953

[jira] [Created] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

Wenchen Fan created SPARK-46999: --- Summary: ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree Key: SPARK-46999 URL: https://issues.apache.org/jira/browse/SPARK-46999

[jira] [Resolved] (SPARK-46526) Limit over certain correlated subqueries results in Nosuchelement exception

[ https://issues.apache.org/jira/browse/SPARK-46526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46526. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44514

[jira] [Resolved] (SPARK-46980) Avoid using internal APIs in dataframe end-to-end tests

[ https://issues.apache.org/jira/browse/SPARK-46980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46980. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45034

[jira] [Created] (SPARK-46980) Avoid using internal APIs in tests

Wenchen Fan created SPARK-46980: --- Summary: Avoid using internal APIs in tests Key: SPARK-46980 URL: https://issues.apache.org/jira/browse/SPARK-46980 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46980) Avoid using internal APIs in dataframe end-to-end tests

[ https://issues.apache.org/jira/browse/SPARK-46980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46980: Summary: Avoid using internal APIs in dataframe end-to-end tests (was: Avoid using internal APIs

[jira] [Assigned] (SPARK-46833) Using ICU library for collation tracking

[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46833: --- Assignee: Aleksandar Tomic > Using ICU library for collation tracking >

[jira] [Resolved] (SPARK-46833) Using ICU library for collation tracking

[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46833. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44968

[jira] [Resolved] (SPARK-46946) Supporting broadcast of multiple filtering keys in DynamicPruning

[ https://issues.apache.org/jira/browse/SPARK-46946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46946. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44988

[jira] [Assigned] (SPARK-46946) Supporting broadcast of multiple filtering keys in DynamicPruning

[ https://issues.apache.org/jira/browse/SPARK-46946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46946: --- Assignee: Thang Long Vu > Supporting broadcast of multiple filtering keys in

[jira] [Updated] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46922: Summary: Do not wrap runtime user-facing errors (was: better handling for runtime user errors)

[jira] [Created] (SPARK-46951) Define retry-able errors

Wenchen Fan created SPARK-46951: --- Summary: Define retry-able errors Key: SPARK-46951 URL: https://issues.apache.org/jira/browse/SPARK-46951 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-46908) Extend SELECT * support outside of select list

[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46908: --- Assignee: Serge Rielau > Extend SELECT * support outside of select list >

[jira] [Resolved] (SPARK-46908) Extend SELECT * support outside of select list

[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46908. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44938

[jira] [Resolved] (SPARK-46933) Add execution time metric for jdbc query

[ https://issues.apache.org/jira/browse/SPARK-46933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46933. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44969

[jira] [Created] (SPARK-46922) better handling for runtime user errors

Wenchen Fan created SPARK-46922: --- Summary: better handling for runtime user errors Key: SPARK-46922 URL: https://issues.apache.org/jira/browse/SPARK-46922 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44935

[jira] [Assigned] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46905: --- Assignee: Wenchen Fan > Add dedicated class to keep column definition instead of

[jira] [Created] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

Wenchen Fan created SPARK-46905: --- Summary: Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command Key: SPARK-46905 URL: https://issues.apache.org/jira/browse/SPARK-46905

[jira] [Resolved] (SPARK-46683) Write a subquery generator that generates subqueries of different variations to increase testing coverage in this area

[ https://issues.apache.org/jira/browse/SPARK-46683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46683. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44599

[jira] [Resolved] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes

[ https://issues.apache.org/jira/browse/SPARK-46763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46763. - Fix Version/s: 3.4.3 3.5.1 4.0.0 Resolution: Fixed

[jira] [Assigned] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes

[ https://issues.apache.org/jira/browse/SPARK-46763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46763: --- Assignee: Nikhil Sheoran > ReplaceDeduplicateWithAggregate fails when non-grouping keys

[jira] [Resolved] (SPARK-46590) Coalesce partiton assert error after skew join optimization

[ https://issues.apache.org/jira/browse/SPARK-46590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46590. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46590) Coalesce partiton assert error after skew join optimization

[ https://issues.apache.org/jira/browse/SPARK-46590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46590: --- Assignee: Jackey Lee > Coalesce partiton assert error after skew join optimization >

[jira] [Updated] (SPARK-46769) Refine timestamp related schema inference

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46769: Summary: Refine timestamp related schema inference (was: Fix inferring of TIMESTAMP_NTZ in

[jira] [Updated] (SPARK-46769) Refine timestamp related schema inference

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46769: Description: (was: After the PR https://github.com/apache/spark/pull/43243, the TIMESTAMP_NTZ

[jira] [Assigned] (SPARK-46769) Refine timestamp related schema inference

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46769: --- Assignee: Wenchen Fan (was: Max Gekk) > Refine timestamp related schema inference >

[jira] [Resolved] (SPARK-46769) Fix inferring of TIMESTAMP_NTZ in CSV/JSON

[ https://issues.apache.org/jira/browse/SPARK-46769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46769. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46644) Fix add in SQLMetric

[ https://issues.apache.org/jira/browse/SPARK-46644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46644. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44649

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Nick Young (was: Kelvin Jiang) > Range operator computeStats() proper long

[jira] [Assigned] (SPARK-45435) Document that lazy checkpoint may not be a consistent

[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45435: --- Assignee: Juliusz Sompolski > Document that lazy checkpoint may not be a consistent >

[jira] [Resolved] (SPARK-45435) Document that lazy checkpoint may not be a consistent

[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45435. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43247

[jira] [Created] (SPARK-46700) count the last spilling for the shuffle disk spilling bytes metric

Wenchen Fan created SPARK-46700: --- Summary: count the last spilling for the shuffle disk spilling bytes metric Key: SPARK-46700 URL: https://issues.apache.org/jira/browse/SPARK-46700 Project: Spark

[jira] [Assigned] (SPARK-46052) Remove unnecessary TaskScheduler.killAllTaskAttempts

[ https://issues.apache.org/jira/browse/SPARK-46052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46052: --- Assignee: wuyi > Remove unnecessary TaskScheduler.killAllTaskAttempts >

[jira] [Resolved] (SPARK-46052) Remove unnecessary TaskScheduler.killAllTaskAttempts

[ https://issues.apache.org/jira/browse/SPARK-46052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46052. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43954

[jira] [Assigned] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46383: --- Assignee: Utkarsh Agarwal > Reduce Driver Heap Usage by Reducing the Lifespan of

[jira] [Resolved] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46383. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44321

[jira] [Resolved] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases

[ https://issues.apache.org/jira/browse/SPARK-46640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46640. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases

[ https://issues.apache.org/jira/browse/SPARK-46640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46640: --- Assignee: Nikhil Sheoran > RemoveRedundantAliases does not account for SubqueryExpression

[jira] [Created] (SPARK-46634) literal validation should not drill down to null fields

Wenchen Fan created SPARK-46634: --- Summary: literal validation should not drill down to null fields Key: SPARK-46634 URL: https://issues.apache.org/jira/browse/SPARK-46634 Project: Spark Issue

[jira] [Assigned] (SPARK-46331) Removing CodeGenFallback trait from subset of datetime and spark version functions

[ https://issues.apache.org/jira/browse/SPARK-46331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46331: --- Assignee: Aleksandar Tomic > Removing CodeGenFallback trait from subset of datetime and

<    1   2   3   4   5   6   7   8   9   10   >