[jira] [Resolved] (SPARK-46331) Removing CodeGenFallback trait from subset of datetime and spark version functions

2024-01-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46331. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44261

[jira] [Resolved] (SPARK-46610) Create table should throw exception when no value for a key in options

2024-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46610. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46581) AccumulatorV2 isZero doesn't do what its name implies

2024-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46581: --- Assignee: Davin Tjong > AccumulatorV2 isZero doesn't do what its name implies >

[jira] [Resolved] (SPARK-46581) AccumulatorV2 isZero doesn't do what its name implies

2024-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46581. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44583

[jira] [Resolved] (SPARK-45352) Eliminate foldable window partitions

2024-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45352. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43144

[jira] [Assigned] (SPARK-45352) Eliminate foldable window partitions

2024-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45352: --- Assignee: Mingliang Zhu > Eliminate foldable window partitions >

[jira] [Created] (SPARK-46609) avoid exponential explosion in PartitioningPreservingUnaryExecNode

2024-01-05 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46609: --- Summary: avoid exponential explosion in PartitioningPreservingUnaryExecNode Key: SPARK-46609 URL: https://issues.apache.org/jira/browse/SPARK-46609 Project: Spark

[jira] [Assigned] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

2024-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46602: --- Assignee: Xinyi Yu > CREATE VIEW IF NOT EXISTS should never throw

[jira] [Resolved] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

2024-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46602. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

2024-01-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46179. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44084

[jira] [Assigned] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

2024-01-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46179: --- Assignee: Andy Lam > Generate golden files for SQLQueryTestSuites with Postgres >

[jira] [Created] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

2024-01-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46598: --- Summary: OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column Key: SPARK-46598 URL:

[jira] [Created] (SPARK-46536) Support GROUP BY calendar_interval_type

2023-12-28 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46536: --- Summary: Support GROUP BY calendar_interval_type Key: SPARK-46536 URL: https://issues.apache.org/jira/browse/SPARK-46536 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46366) Use with expression to avoid duplicating expressions in BETWEEN operation

2023-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46366. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44299

[jira] [Assigned] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46444: --- Assignee: Wenchen Fan > V2SessionCatalog#createTable should not load the table >

[jira] [Resolved] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46444. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44377

[jira] [Resolved] (SPARK-46481) EXECUTE IMMEDIATE does not fold variables when given as parameters

2023-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46481. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44450

[jira] [Resolved] (SPARK-46485) V1Write should not add Sort when not needed

2023-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46485. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44458

[jira] [Updated] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

2023-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46466: Fix Version/s: 3.5.1 3.4.3 > vectorized parquet reader should never do rebase

[jira] [Resolved] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

2023-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40876. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44368

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

2023-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40876: --- Assignee: Johan Lasperas > Spark's Vectorized ParquetReader should support type promotions

[jira] [Created] (SPARK-46485) V1Write should not add Sort when not needed

2023-12-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46485: --- Summary: V1Write should not add Sort when not needed Key: SPARK-46485 URL: https://issues.apache.org/jira/browse/SPARK-46485 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46443) Decimal precision and scale should decided by JDBC dialect.

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46443. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46468) COUNT bug in lateral/exists subqueries

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46468. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44451

[jira] [Assigned] (SPARK-46468) COUNT bug in lateral/exists subqueries

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46468: --- Assignee: Andrey Gubichev > COUNT bug in lateral/exists subqueries >

[jira] [Resolved] (SPARK-45525) Initial support for Python data source write API

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45525. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43791

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45525: --- Assignee: Allison Wang > Initial support for Python data source write API >

[jira] [Resolved] (SPARK-46380) Replacing current time prior to inline table eval

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46380. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

2023-12-20 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46466: --- Summary: vectorized parquet reader should never do rebase for timestamp ntz Key: SPARK-46466 URL: https://issues.apache.org/jira/browse/SPARK-46466 Project: Spark

[jira] [Resolved] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46452. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44410

[jira] [Assigned] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46452: --- Assignee: Allison Wang > Add a new API in DSv2 DataWriter to write an iterator of records

[jira] [Resolved] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46272. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44190

[jira] [Assigned] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46272: --- Assignee: Allison Wang > Support CTAS using DSv2 sources > ---

[jira] [Resolved] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

2023-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46446. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44401

[jira] [Assigned] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

2023-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46446: --- Assignee: Jack Chen > Correctness bug in correlated subquery with OFFSET >

[jira] [Created] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-18 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46444: --- Summary: V2SessionCatalog#createTable should not load the table Key: SPARK-46444 URL: https://issues.apache.org/jira/browse/SPARK-46444 Project: Spark Issue

[jira] [Resolved] (SPARK-45807) DataSourceV2: Improve ViewCatalog API

2023-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45807. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44330

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46417: Issue Type: Bug (was: Improvement) > do not fail when calling getTable and throwException is

[jira] [Created] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46417: --- Summary: do not fail when calling getTable and throwException is false Key: SPARK-46417 URL: https://issues.apache.org/jira/browse/SPARK-46417 Project: Spark

[jira] [Resolved] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46294. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44222

[jira] [Assigned] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46294: --- Assignee: Davin Tjong > Clean up initValue vs zeroValue semantics in SQLMetrics >

[jira] [Resolved] (SPARK-46394) spark.catalog.listDatabases() fails if containing schemas with special characters when spark.sql.legacy.keepCommandOutputSchema set to true

2023-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46394. - Fix Version/s: 4.0.0 Assignee: Xinyi Yu Resolution: Fixed >

[jira] [Resolved] (SPARK-46370) Fix bug when querying from table after changing defaults

2023-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46370. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44302

[jira] [Resolved] (SPARK-46378) still remove Sort after converting Aggregate to Project

2023-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46378. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44310

[jira] [Created] (SPARK-46378) still remove Sort after converting Aggregate to Project

2023-12-11 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46378: --- Summary: still remove Sort after converting Aggregate to Project Key: SPARK-46378 URL: https://issues.apache.org/jira/browse/SPARK-46378 Project: Spark Issue

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Kelvin Jiang > Range operator computeStats() proper long conversions >

[jira] [Resolved] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46274. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46173: --- Assignee: Aleksandar Tomic > Skipping trimAll call in stringToDate functions to avoid

[jira] [Resolved] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46173. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44110

[jira] [Assigned] (SPARK-46043) Support create table using DSv2 sources

2023-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46043: --- Assignee: Allison Wang > Support create table using DSv2 sources >

[jira] [Resolved] (SPARK-46043) Support create table using DSv2 sources

2023-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46043. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43949

[jira] [Created] (SPARK-46244) INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME

2023-12-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46244: --- Summary: INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME Key: SPARK-46244 URL: https://issues.apache.org/jira/browse/SPARK-46244 Project:

[jira] [Resolved] (SPARK-46141) Change default of spark.sql.legacy.ctePrecedencePolicy from EXCEPTION to CORRECTED

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46141. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44058

[jira] [Assigned] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46036: --- Assignee: Aleksandar Tomic > raise_error should only take the error class parameter for

[jira] [Resolved] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46036. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44004

[jira] [Resolved] (SPARK-46029) Escape the single quote, _ and % for DS V2 pushdown

2023-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46029. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46055) Refactor Catalog Database APIs implementation

2023-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46055. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43959

[jira] [Resolved] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45974. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45974: --- Assignee: Zhen Wang > Add scan.filterAttributes non-empty judgment for >

[jira] [Assigned] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43980: --- Assignee: Yash Kothari > Add support for EXCEPT in select clause, similar to what

[jira] [Resolved] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43980. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43843

[jira] [Created] (SPARK-46073) Remove the special resolution of UnresolvedNamespace for certain commands

2023-11-23 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46073: --- Summary: Remove the special resolution of UnresolvedNamespace for certain commands Key: SPARK-46073 URL: https://issues.apache.org/jira/browse/SPARK-46073 Project:

[jira] [Resolved] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46021. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43926

[jira] [Assigned] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46021: --- Assignee: Xinyi Yu > Support canceling future jobs belonging to a certain job group on >

[jira] [Created] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46036: --- Summary: raise_error should only take the error class parameter for internal usage Key: SPARK-46036 URL: https://issues.apache.org/jira/browse/SPARK-46036 Project:

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788306#comment-17788306 ] Wenchen Fan commented on SPARK-45649: - This has a bug. I've uploaded the test data. You can

[jira] [Updated] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-45649: Attachment: test_table.parquet.zip > Unify the prepare framework for `OffsetWindowFunctionFrame`

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788307#comment-17788307 ] Wenchen Fan commented on SPARK-45649: - I'm reverting the commit. > Unify the prepare framework for

[jira] [Reopened] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-45649: - > Unify the prepare framework for `OffsetWindowFunctionFrame` >

[jira] [Resolved] (SPARK-33393) Support SHOW TABLE EXTENDED in DSv2

2023-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33393. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 37588

[jira] [Resolved] (SPARK-45905) least common type between decimal types should retain integral digits first

2023-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43781

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43393: --- Assignee: Deepayan Patra > Sequence expression can overflow >

[jira] [Resolved] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43393. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-45932) GROUP BY ordinal should not replicate the grouping expression

2023-11-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45932: --- Summary: GROUP BY ordinal should not replicate the grouping expression Key: SPARK-45932 URL: https://issues.apache.org/jira/browse/SPARK-45932 Project: Spark

[jira] [Resolved] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45898. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43771

[jira] [Assigned] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45898: --- Assignee: Yihong He > Rewrite catalog table APIs to use unresolved logical plan >

[jira] [Created] (SPARK-45920) group by ordinal should be idempotent

2023-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45920: --- Summary: group by ordinal should be idempotent Key: SPARK-45920 URL: https://issues.apache.org/jira/browse/SPARK-45920 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-45892) Refactor the optimizer plan validation to decouple validateSchemaOutput and validateExprIdUniqueness

2023-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45892. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43761

[jira] [Assigned] (SPARK-45892) Refactor the optimizer plan validation to decouple validateSchemaOutput and validateExprIdUniqueness

2023-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45892: --- Assignee: Xi Liang > Refactor the optimizer plan validation to decouple

[jira] [Created] (SPARK-45905) least common type between decimal types should retain integral digits first

2023-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45905: --- Summary: least common type between decimal types should retain integral digits first Key: SPARK-45905 URL: https://issues.apache.org/jira/browse/SPARK-45905 Project:

[jira] [Assigned] (SPARK-45815) Provide an interface for Streaming sources to add _metadata columns

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45815: --- Assignee: Yaohua Zhao > Provide an interface for Streaming sources to add _metadata

[jira] [Resolved] (SPARK-45815) Provide an interface for Streaming sources to add _metadata columns

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45815. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43692

[jira] [Resolved] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44886. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42577

[jira] [Assigned] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44886: --- Assignee: Terry Kim > Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE >

[jira] [Resolved] (SPARK-45752) Unreferenced CTE should all be checked by CheckAnalysis0

2023-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45752. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43614

[jira] [Resolved] (SPARK-45760) Add With expression to avoid duplicating expressions

2023-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45760. - Fix Version/s: 4.0.0 Resolution: Fixed > Add With expression to avoid duplicating

[jira] [Created] (SPARK-45760) Add With expression to avoid duplicating expressions

2023-11-01 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45760: --- Summary: Add With expression to avoid duplicating expressions Key: SPARK-45760 URL: https://issues.apache.org/jira/browse/SPARK-45760 Project: Spark Issue

[jira] [Resolved] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45713. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43566

[jira] [Assigned] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45713: --- Assignee: Allison Wang > Support registering Python data sources >

[jira] [Resolved] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45592. - Fix Version/s: 4.0.0 3.5.1 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-45725) remove the non-default IN subquery runtime filter

2023-10-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45725: --- Summary: remove the non-default IN subquery runtime filter Key: SPARK-45725 URL: https://issues.apache.org/jira/browse/SPARK-45725 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43507

[jira] [Resolved] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows

2023-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45430. - Fix Version/s: 3.3.4 3.5.1 4.0.0 3.4.2

[jira] [Assigned] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows

2023-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45430: --- Assignee: Vitalii Li > FramelessOffsetWindowFunctionFrame fails when ignore nulls and

[jira] [Resolved] (SPARK-45616) Usages of ParVector are unsafe because it does not propagate ThreadLocals or SparkSession

2023-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45616. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-45595) Expose SQLSTATE in error message

2023-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45595. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43438

[jira] [Assigned] (SPARK-45595) Expose SQLSTATE in error message

2023-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45595: --- Assignee: Serge Rielau > Expose SQLSTATE in error message >

[jira] [Assigned] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45584: --- Assignee: Allison Wang > Execution fails when there are subqueries in

[jira] [Resolved] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45584. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45507) Correctness bug in correlated scalar subqueries with COUNT aggregates

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45507: --- Assignee: Andy Lam > Correctness bug in correlated scalar subqueries with COUNT aggregates

<    1   2   3   4   5   6   7   8   9   10   >