[jira] [Assigned] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46272: --- Assignee: Allison Wang > Support CTAS using DSv2 sources > ---

[jira] [Resolved] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

2023-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46446. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44401

[jira] [Assigned] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

2023-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46446: --- Assignee: Jack Chen > Correctness bug in correlated subquery with OFFSET >

[jira] [Created] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-18 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46444: --- Summary: V2SessionCatalog#createTable should not load the table Key: SPARK-46444 URL: https://issues.apache.org/jira/browse/SPARK-46444 Project: Spark Issue

[jira] [Resolved] (SPARK-45807) DataSourceV2: Improve ViewCatalog API

2023-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45807. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44330

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46417: Issue Type: Bug (was: Improvement) > do not fail when calling getTable and throwException is

[jira] [Created] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46417: --- Summary: do not fail when calling getTable and throwException is false Key: SPARK-46417 URL: https://issues.apache.org/jira/browse/SPARK-46417 Project: Spark

[jira] [Resolved] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46294. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44222

[jira] [Assigned] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46294: --- Assignee: Davin Tjong > Clean up initValue vs zeroValue semantics in SQLMetrics >

[jira] [Resolved] (SPARK-46394) spark.catalog.listDatabases() fails if containing schemas with special characters when spark.sql.legacy.keepCommandOutputSchema set to true

2023-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46394. - Fix Version/s: 4.0.0 Assignee: Xinyi Yu Resolution: Fixed >

[jira] [Resolved] (SPARK-46370) Fix bug when querying from table after changing defaults

2023-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46370. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44302

[jira] [Resolved] (SPARK-46378) still remove Sort after converting Aggregate to Project

2023-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46378. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44310

[jira] [Created] (SPARK-46378) still remove Sort after converting Aggregate to Project

2023-12-11 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46378: --- Summary: still remove Sort after converting Aggregate to Project Key: SPARK-46378 URL: https://issues.apache.org/jira/browse/SPARK-46378 Project: Spark Issue

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Kelvin Jiang > Range operator computeStats() proper long conversions >

[jira] [Resolved] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46274. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46173: --- Assignee: Aleksandar Tomic > Skipping trimAll call in stringToDate functions to avoid

[jira] [Resolved] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46173. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44110

[jira] [Assigned] (SPARK-46043) Support create table using DSv2 sources

2023-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46043: --- Assignee: Allison Wang > Support create table using DSv2 sources >

[jira] [Resolved] (SPARK-46043) Support create table using DSv2 sources

2023-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46043. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43949

[jira] [Created] (SPARK-46244) INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME

2023-12-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46244: --- Summary: INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME Key: SPARK-46244 URL: https://issues.apache.org/jira/browse/SPARK-46244 Project:

[jira] [Resolved] (SPARK-46141) Change default of spark.sql.legacy.ctePrecedencePolicy from EXCEPTION to CORRECTED

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46141. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44058

[jira] [Assigned] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46036: --- Assignee: Aleksandar Tomic > raise_error should only take the error class parameter for

[jira] [Resolved] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46036. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44004

[jira] [Resolved] (SPARK-46029) Escape the single quote, _ and % for DS V2 pushdown

2023-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46029. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46055) Refactor Catalog Database APIs implementation

2023-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46055. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43959

[jira] [Resolved] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45974. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45974: --- Assignee: Zhen Wang > Add scan.filterAttributes non-empty judgment for >

[jira] [Assigned] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43980: --- Assignee: Yash Kothari > Add support for EXCEPT in select clause, similar to what

[jira] [Resolved] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43980. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43843

[jira] [Created] (SPARK-46073) Remove the special resolution of UnresolvedNamespace for certain commands

2023-11-23 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46073: --- Summary: Remove the special resolution of UnresolvedNamespace for certain commands Key: SPARK-46073 URL: https://issues.apache.org/jira/browse/SPARK-46073 Project:

[jira] [Resolved] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46021. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43926

[jira] [Assigned] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46021: --- Assignee: Xinyi Yu > Support canceling future jobs belonging to a certain job group on >

[jira] [Created] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46036: --- Summary: raise_error should only take the error class parameter for internal usage Key: SPARK-46036 URL: https://issues.apache.org/jira/browse/SPARK-46036 Project:

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788306#comment-17788306 ] Wenchen Fan commented on SPARK-45649: - This has a bug. I've uploaded the test data. You can

[jira] [Updated] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-45649: Attachment: test_table.parquet.zip > Unify the prepare framework for `OffsetWindowFunctionFrame`

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788307#comment-17788307 ] Wenchen Fan commented on SPARK-45649: - I'm reverting the commit. > Unify the prepare framework for

[jira] [Reopened] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-45649: - > Unify the prepare framework for `OffsetWindowFunctionFrame` >

[jira] [Resolved] (SPARK-33393) Support SHOW TABLE EXTENDED in DSv2

2023-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33393. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 37588

[jira] [Resolved] (SPARK-45905) least common type between decimal types should retain integral digits first

2023-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43781

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43393: --- Assignee: Deepayan Patra > Sequence expression can overflow >

[jira] [Resolved] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43393. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-45932) GROUP BY ordinal should not replicate the grouping expression

2023-11-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45932: --- Summary: GROUP BY ordinal should not replicate the grouping expression Key: SPARK-45932 URL: https://issues.apache.org/jira/browse/SPARK-45932 Project: Spark

[jira] [Resolved] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45898. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43771

[jira] [Assigned] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45898: --- Assignee: Yihong He > Rewrite catalog table APIs to use unresolved logical plan >

[jira] [Created] (SPARK-45920) group by ordinal should be idempotent

2023-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45920: --- Summary: group by ordinal should be idempotent Key: SPARK-45920 URL: https://issues.apache.org/jira/browse/SPARK-45920 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-45892) Refactor the optimizer plan validation to decouple validateSchemaOutput and validateExprIdUniqueness

2023-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45892. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43761

[jira] [Assigned] (SPARK-45892) Refactor the optimizer plan validation to decouple validateSchemaOutput and validateExprIdUniqueness

2023-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45892: --- Assignee: Xi Liang > Refactor the optimizer plan validation to decouple

[jira] [Created] (SPARK-45905) least common type between decimal types should retain integral digits first

2023-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45905: --- Summary: least common type between decimal types should retain integral digits first Key: SPARK-45905 URL: https://issues.apache.org/jira/browse/SPARK-45905 Project:

[jira] [Assigned] (SPARK-45815) Provide an interface for Streaming sources to add _metadata columns

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45815: --- Assignee: Yaohua Zhao > Provide an interface for Streaming sources to add _metadata

[jira] [Resolved] (SPARK-45815) Provide an interface for Streaming sources to add _metadata columns

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45815. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43692

[jira] [Resolved] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44886. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42577

[jira] [Assigned] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44886: --- Assignee: Terry Kim > Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE >

[jira] [Resolved] (SPARK-45752) Unreferenced CTE should all be checked by CheckAnalysis0

2023-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45752. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43614

[jira] [Resolved] (SPARK-45760) Add With expression to avoid duplicating expressions

2023-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45760. - Fix Version/s: 4.0.0 Resolution: Fixed > Add With expression to avoid duplicating

[jira] [Created] (SPARK-45760) Add With expression to avoid duplicating expressions

2023-11-01 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45760: --- Summary: Add With expression to avoid duplicating expressions Key: SPARK-45760 URL: https://issues.apache.org/jira/browse/SPARK-45760 Project: Spark Issue

[jira] [Resolved] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45713. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43566

[jira] [Assigned] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45713: --- Assignee: Allison Wang > Support registering Python data sources >

[jira] [Resolved] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45592. - Fix Version/s: 4.0.0 3.5.1 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-45725) remove the non-default IN subquery runtime filter

2023-10-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45725: --- Summary: remove the non-default IN subquery runtime filter Key: SPARK-45725 URL: https://issues.apache.org/jira/browse/SPARK-45725 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43507

[jira] [Resolved] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows

2023-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45430. - Fix Version/s: 3.3.4 3.5.1 4.0.0 3.4.2

[jira] [Assigned] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows

2023-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45430: --- Assignee: Vitalii Li > FramelessOffsetWindowFunctionFrame fails when ignore nulls and

[jira] [Resolved] (SPARK-45616) Usages of ParVector are unsafe because it does not propagate ThreadLocals or SparkSession

2023-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45616. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-45595) Expose SQLSTATE in error message

2023-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45595. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43438

[jira] [Assigned] (SPARK-45595) Expose SQLSTATE in error message

2023-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45595: --- Assignee: Serge Rielau > Expose SQLSTATE in error message >

[jira] [Assigned] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45584: --- Assignee: Allison Wang > Execution fails when there are subqueries in

[jira] [Resolved] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45584. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45507) Correctness bug in correlated scalar subqueries with COUNT aggregates

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45507: --- Assignee: Andy Lam > Correctness bug in correlated scalar subqueries with COUNT aggregates

[jira] [Resolved] (SPARK-45507) Correctness bug in correlated scalar subqueries with COUNT aggregates

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45507. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43341

[jira] [Assigned] (SPARK-45586) Reduce compilation time for large expression trees

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45586: --- Assignee: Kelvin Jiang > Reduce compilation time for large expression trees >

[jira] [Resolved] (SPARK-45586) Reduce compilation time for large expression trees

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45586. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43420

[jira] [Assigned] (SPARK-44649) Runtime Filter supports passing equivalent creation side expressions

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44649: --- Assignee: Jiaan Geng > Runtime Filter supports passing equivalent creation side

[jira] [Resolved] (SPARK-44649) Runtime Filter supports passing equivalent creation side expressions

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42317

[jira] [Created] (SPARK-45575) support time travel options for df read API

2023-10-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45575: --- Summary: support time travel options for df read API Key: SPARK-45575 URL: https://issues.apache.org/jira/browse/SPARK-45575 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-45531) Add more comments and rename some variable name for InjectRuntimeFilter

2023-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45531. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43359

[jira] [Resolved] (SPARK-45491) Replace: _LEGACY_ERROR_TEMP_2196 with a better error class

2023-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45491. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43376

[jira] [Assigned] (SPARK-45009) Correlated EXISTS subqueries in join ON condition unsupported and fail with internal error

2023-10-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45009: --- Assignee: Jack Chen > Correlated EXISTS subqueries in join ON condition unsupported and

[jira] [Resolved] (SPARK-45009) Correlated EXISTS subqueries in join ON condition unsupported and fail with internal error

2023-10-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42725

[jira] [Resolved] (SPARK-45498) Followup: Ignore task completion from old stage after retrying indeterminate stages

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45498. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45498) Followup: Ignore task completion from old stage after retrying indeterminate stages

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45498: --- Assignee: Mayur Bhosale > Followup: Ignore task completion from old stage after retrying

[jira] [Resolved] (SPARK-45418) Change CURRENT_SCHEMA() column alias to match function name

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45418. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43235

[jira] [Assigned] (SPARK-45418) Change CURRENT_SCHEMA() column alias to match function name

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45418: --- Assignee: Michael Zhang > Change CURRENT_SCHEMA() column alias to match function name >

[jira] [Assigned] (SPARK-45132) Fix IDENTIFIER clause for functions

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45132: --- Assignee: Serge Rielau > Fix IDENTIFIER clause for functions >

[jira] [Resolved] (SPARK-45132) Fix IDENTIFIER clause for functions

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45132. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-45451) Make the default storage level of dataset cache configurable

2023-10-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45451. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43259

[jira] [Assigned] (SPARK-45451) Make the default storage level of dataset cache configurable

2023-10-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45451: --- Assignee: XiDuo You > Make the default storage level of dataset cache configurable >

[jira] [Assigned] (SPARK-45449) Cache Invalidation Issue with JDBC Table

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45449: --- Assignee: liangyongyuan > Cache Invalidation Issue with JDBC Table >

[jira] [Resolved] (SPARK-45449) Cache Invalidation Issue with JDBC Table

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45449. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45205) Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45205: --- Assignee: Qiang Yang > Since version 3.2.0, Spark SQL has taken longer to execute "show >

[jira] [Resolved] (SPARK-45205) Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45205. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-38341) Spark sql: 3.2.1 - Function of add_ Months returns an incorrect date

2023-10-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773146#comment-17773146 ] Wenchen Fan commented on SPARK-38341: - It seems like a common behavior to preserve the end-of-month

[jira] [Reopened] (SPARK-38341) Spark sql: 3.2.1 - Function of add_ Months returns an incorrect date

2023-10-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-38341: - > Spark sql: 3.2.1 - Function of add_ Months returns an incorrect date >

[jira] [Assigned] (SPARK-44219) Add extra per-rule validation for optimization rewrites.

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44219: --- Assignee: Yannis Sismanis > Add extra per-rule validation for optimization rewrites. >

[jira] [Resolved] (SPARK-44219) Add extra per-rule validation for optimization rewrites.

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44219. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41763

[jira] [Resolved] (SPARK-45421) Catch AnalysisException over InlineCTE

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45421. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43227

[jira] [Assigned] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36112: --- Assignee: Andrey Gubichev > Enable DecorrelateInnerQuery for IN/EXISTS subqueries >

[jira] [Resolved] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36112. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43111

[jira] [Resolved] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

2023-09-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45346. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

2023-09-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45346: --- Assignee: Wenchen Fan > Parquet schema inference should respect case sensitive flag when

[jira] [Resolved] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44780. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42467

<    1   2   3   4   5   6   7   8   9   10   >