[jira] [Resolved] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

2023-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40876. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44368 [https

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

2023-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40876: --- Assignee: Johan Lasperas > Spark's Vectorized ParquetReader should support type promoti

(spark) branch master updated: [SPARK-40876][SQL] Widening type promotions in Parquet readers

2023-12-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3361f25dc0ff [SPARK-40876][SQL] Widening type

[jira] [Created] (SPARK-46485) V1Write should not add Sort when not needed

2023-12-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46485: --- Summary: V1Write should not add Sort when not needed Key: SPARK-46485 URL: https://issues.apache.org/jira/browse/SPARK-46485 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46443) Decimal precision and scale should decided by JDBC dialect.

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46443. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-46443][SQL] Decimal precision and scale should decided by H2 dialect

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 286c469ad13 [SPARK-46443][SQL] Decimal

(spark) branch master updated: [SPARK-46443][SQL] Decimal precision and scale should decided by H2 dialect

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a921da8509a [SPARK-46443][SQL] Decimal

(spark) branch master updated: [SPARK-46380][SQL][FOLLOWUP] Simplify the code for ResolveInlineTables and ResolveInlineTablesSuite

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c63485189c [SPARK-46380][SQL][FOLLOWUP

[jira] [Resolved] (SPARK-46468) COUNT bug in lateral/exists subqueries

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46468. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44451 [https

[jira] [Assigned] (SPARK-46468) COUNT bug in lateral/exists subqueries

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46468: --- Assignee: Andrey Gubichev > COUNT bug in lateral/exists subquer

(spark) branch master updated: [SPARK-46468][SQL] Handle COUNT bug for EXISTS subqueries with Aggregate without grouping keys

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3432fd8dba5 [SPARK-46468][SQL] Handle COUNT bug

[jira] [Resolved] (SPARK-45525) Initial support for Python data source write API

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45525. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43791 [https

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45525: --- Assignee: Allison Wang > Initial support for Python data source write

(spark) branch master updated: [SPARK-45525][SQL][PYTHON] Support for Python data source write using DSv2

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4fcd5bfe003 [SPARK-45525][SQL][PYTHON] Support

(spark) branch master updated: [SPARK-46378][SQL][FOLLOWUP] Do not rely on TreeNodeTag in Project

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0e94f340a63a [SPARK-46378][SQL][FOLLOWUP] Do

[jira] [Resolved] (SPARK-46380) Replacing current time prior to inline table eval

2023-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46380. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-46380][SQL] Replace current time/date prior to evaluating inline table expressions

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d7534a3ec1ea [SPARK-46380][SQL] Replace

(spark) branch master updated: [SPARK-46380][SQL] Replace current time/date prior to evaluating inline table expressions

2023-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5fe963f8560e [SPARK-46380][SQL] Replace current

(spark) branch master updated: [SPARK-46179][SQL] Pull out code into reusable functions in SQLQueryTestSuite

2023-12-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e804f5360144 [SPARK-46179][SQL] Pull out code

[jira] [Created] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

2023-12-20 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46466: --- Summary: vectorized parquet reader should never do rebase for timestamp ntz Key: SPARK-46466 URL: https://issues.apache.org/jira/browse/SPARK-46466 Project: Spark

[jira] [Resolved] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46452. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44410 [https

[jira] [Assigned] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46452: --- Assignee: Allison Wang > Add a new API in DSv2 DataWriter to write an iterator of reco

(spark) branch master updated: [SPARK-46452][SQL] Add a new API in DataWriter to write an iterator of records

2023-12-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c9cfaac90fd4 [SPARK-46452][SQL] Add a new API

[jira] [Resolved] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46272. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44190 [https

(spark) branch master updated: [SPARK-46272][SQL] Support CTAS using DSv2 sources

2023-12-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cc9d9911d7ed [SPARK-46272][SQL] Support CTAS

[jira] [Assigned] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46272: --- Assignee: Allison Wang > Support CTAS using DSv2 sour

(spark) branch master updated: [SPARK-46069][SQL][FOLLOWUP] Simplify the algorithm and add comments

2023-12-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f555e9983f6d [SPARK-46069][SQL][FOLLOWUP

(spark) branch master updated: [SPARK-46446][SQL][FOLLOW-UP] Fix sql tests for subqueries with correlated OFFSET

2023-12-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1591f7461e68 [SPARK-46446][SQL][FOLLOW-UP] Fix

[jira] [Resolved] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

2023-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46446. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44401 [https

[jira] [Assigned] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

2023-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46446: --- Assignee: Jack Chen > Correctness bug in correlated subquery with OFF

(spark) branch master updated: [SPARK-46446][SQL] Disable subqueries with correlated OFFSET to fix correctness bug

2023-12-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0b8e0998c673 [SPARK-46446][SQL] Disable

(spark) branch master updated (bfafad4d47b4 -> 5c80e6aec29e)

2023-12-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bfafad4d47b4 [SPARK-46440][SQL] Set the rebase configs to the `CORRECTED` mode by default add 5c80e6aec29e

[jira] [Created] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-18 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46444: --- Summary: V2SessionCatalog#createTable should not load the table Key: SPARK-46444 URL: https://issues.apache.org/jira/browse/SPARK-46444 Project: Spark Issue

[jira] [Resolved] (SPARK-45807) DataSourceV2: Improve ViewCatalog API

2023-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45807. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44330 [https

(spark) branch master updated (3d447c21b426 -> 69de04f6aaac)

2023-12-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3d447c21b426 [SPARK-46419][PS][TESTS] Reorganize `DatetimeIndexTests`: Factor out 3 slow tests add 69de04f6aaac

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46417: Issue Type: Bug (was: Improvement) > do not fail when calling getTable and throwExcept

[jira] [Created] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46417: --- Summary: do not fail when calling getTable and throwException is false Key: SPARK-46417 URL: https://issues.apache.org/jira/browse/SPARK-46417 Project: Spark

(spark) branch master updated: [SPARK-46294][SQL] Clean up semantics of init vs zero value

2023-12-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 50e668c780da [SPARK-46294][SQL] Clean up

[jira] [Resolved] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46294. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44222 [https

[jira] [Assigned] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46294: --- Assignee: Davin Tjong > Clean up initValue vs zeroValue semantics in SQLMetr

(spark) branch master updated: [SPARK-46043][SQL][FOLLOWUP] Remove the catalog and identifier check in DataSourceV2Relation

2023-12-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c045a425bf0c [SPARK-46043][SQL][FOLLOWUP

[jira] [Resolved] (SPARK-46394) spark.catalog.listDatabases() fails if containing schemas with special characters when spark.sql.legacy.keepCommandOutputSchema set to true

2023-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46394. - Fix Version/s: 4.0.0 Assignee: Xinyi Yu Resolution: Fixed

(spark) branch master updated: [SPARK-46394][SQL] Fix spark.catalog.listDatabases() issues on schemas with special characters when `spark.sql.legacy.keepCommandOutputSchema` set to true

2023-12-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new deb1d1b86162 [SPARK-46394][SQL] Fix

[jira] [Resolved] (SPARK-46370) Fix bug when querying from table after changing defaults

2023-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46370. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44302 [https

(spark) branch master updated: [SPARK-46370][SQL] Fix bug when querying from table after changing column defaults

2023-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b035bb177c08 [SPARK-46370][SQL] Fix bug when

[jira] [Resolved] (SPARK-46378) still remove Sort after converting Aggregate to Project

2023-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46378. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44310 [https

(spark) branch master updated: [SPARK-46378][SQL] Still remove Sort after converting Aggregate to Project

2023-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c1ba963e64a2 [SPARK-46378][SQL] Still remove

[jira] [Created] (SPARK-46378) still remove Sort after converting Aggregate to Project

2023-12-11 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46378: --- Summary: still remove Sort after converting Aggregate to Project Key: SPARK-46378 URL: https://issues.apache.org/jira/browse/SPARK-46378 Project: Spark Issue

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Kelvin Jiang > Range operator computeStats() proper long conversi

[jira] [Resolved] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46274. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-46274][SQL] Fix Range operator computeStats() to check long validity before converting

2023-12-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new a697725d99a [SPARK-46274][SQL] Fix

(spark) branch master updated: [SPARK-46274][SQL] Fix Range operator computeStats() to check long validity before converting

2023-12-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9fd575ae46f [SPARK-46274][SQL] Fix Range

[jira] [Assigned] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46173: --- Assignee: Aleksandar Tomic > Skipping trimAll call in stringToDate functions to av

[jira] [Resolved] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46173. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44110 [https

(spark) branch master updated: [SPARK-46173][SQL] Skipping trimAll call during date parsing

2023-12-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 348d88161a9 [SPARK-46173][SQL] Skipping trimAll

[jira] [Assigned] (SPARK-46043) Support create table using DSv2 sources

2023-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46043: --- Assignee: Allison Wang > Support create table using DSv2 sour

[jira] [Resolved] (SPARK-46043) Support create table using DSv2 sources

2023-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46043. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43949 [https

(spark) branch master updated: [SPARK-46043][SQL] Support create table using DSv2 sources

2023-12-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5fec76dc8db2 [SPARK-46043][SQL] Support create

[jira] [Created] (SPARK-46244) INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME

2023-12-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46244: --- Summary: INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME Key: SPARK-46244 URL: https://issues.apache.org/jira/browse/SPARK-46244 Project

(spark) branch master updated: [SPARK-46145][SQL] spark.catalog.listTables does not throw exception when the table or view is not found

2023-11-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 67f628e3bf87 [SPARK-46145][SQL

[jira] [Resolved] (SPARK-46141) Change default of spark.sql.legacy.ctePrecedencePolicy from EXCEPTION to CORRECTED

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46141. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44058 [https

(spark) branch master updated: [SPARK-46141][SQL] Change default for spark.sql.legacy.ctePrecedencePolicy to CORRECTED

2023-11-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3509174f7e5 [SPARK-46141][SQL] Change default

[jira] [Assigned] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46036: --- Assignee: Aleksandar Tomic > raise_error should only take the error class parame

[jira] [Resolved] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46036. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44004 [https

(spark) branch master updated: [SPARK-46036][SQL] Removing error-class from raise_error function

2023-11-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fa4096eb6ab [SPARK-46036][SQL] Removing error

[jira] [Resolved] (SPARK-46029) Escape the single quote, _ and % for DS V2 pushdown

2023-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46029. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-46029][SQL] Escape the single quote, `_` and `%` for DS V2 pushdown

2023-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 35ecb32e479 [SPARK-46029][SQL] Escape

(spark) branch master updated: [SPARK-46029][SQL] Escape the single quote, `_` and `%` for DS V2 pushdown

2023-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d2cd98bdd32 [SPARK-46029][SQL] Escape

[jira] [Resolved] (SPARK-46055) Refactor Catalog Database APIs implementation

2023-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46055. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43959 [https

(spark) branch master updated: [SPARK-46055][SQL] Rewrite Catalog Database APIs implementation

2023-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 126b74a792c [SPARK-46055][SQL] Rewrite Catalog

(spark) branch master updated: [SPARK-45827][SQL] Variant fixes with codegen and vectorized reader disabled

2023-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1ee3d2ae3b63 [SPARK-45827][SQL] Variant fixes

(spark) branch master updated: [SPARK-45760][SQL][FOLLOWUP] Inline With inside conditional branches

2023-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a6cda2302c29 [SPARK-45760][SQL][FOLLOWUP

[jira] [Resolved] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45974. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45974: --- Assignee: Zhen Wang > Add scan.filterAttributes non-empty judgm

(spark) branch branch-3.5 updated: [SPARK-45974][SQL] Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e4731e9d3b44 [SPARK-45974][SQL] Add

(spark) branch master updated: [SPARK-45974][SQL] Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

2023-11-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ade861d19910 [SPARK-45974][SQL] Add

[jira] [Assigned] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43980: --- Assignee: Yash Kothari > Add support for EXCEPT in select clause, similar to w

[jira] [Resolved] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43980. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43843 [https

(spark) branch master updated: [SPARK-43980][SQL] introducing `select * except` syntax

2023-11-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e4d75a349f [SPARK-43980][SQL] introducing

[jira] [Created] (SPARK-46073) Remove the special resolution of UnresolvedNamespace for certain commands

2023-11-23 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46073: --- Summary: Remove the special resolution of UnresolvedNamespace for certain commands Key: SPARK-46073 URL: https://issues.apache.org/jira/browse/SPARK-46073 Project

[jira] [Resolved] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46021. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43926 [https

[jira] [Assigned] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

2023-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46021: --- Assignee: Xinyi Yu > Support canceling future jobs belonging to a certain job gr

(spark) branch master updated: [SPARK-46021][CORE] Support cancel future jobs belonging to a job group

2023-11-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9c21238ce0e [SPARK-46021][CORE] Support cancel

Re: [DISCUSS] SPIP: Testing Framework for Spark UI Javascript files

2023-11-21 Thread Wenchen Fan
+1, very useful! On Wed, Nov 22, 2023 at 10:29 AM Dongjoon Hyun wrote: > Thank you for proposing a new UI test framework for Apache Spark 4.0. > > It looks very useful. > > Thanks, > Dongjoon. > > > On Tue, Nov 21, 2023 at 1:51 AM Kent Yao wrote: > >> Hi Spark Dev, >> >> This is a call to

[jira] [Created] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46036: --- Summary: raise_error should only take the error class parameter for internal usage Key: SPARK-46036 URL: https://issues.apache.org/jira/browse/SPARK-46036 Project

(spark) branch master updated: Revert "[SPARK-45649][SQL] Unify the prepare framework for `OffsetWindowFunctionFrame`"

2023-11-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c476641812c Revert "[SPARK-45649][SQL]

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788306#comment-17788306 ] Wenchen Fan commented on SPARK-45649: - This has a bug. I've uploaded the test data. You can

[jira] [Updated] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-45649: Attachment: test_table.parquet.zip > Unify the prepare framework for `OffsetWindowFunctionFr

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788307#comment-17788307 ] Wenchen Fan commented on SPARK-45649: - I'm reverting the commit. > Unify the prepare framew

[jira] [Reopened] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-45649: - > Unify the prepare framework for `OffsetWindowFunctionFr

(spark) branch master updated: [SPARK-45827][SQL] Use StructNullableTypeConverter for Variant

2023-11-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2235fa9590f [SPARK-45827][SQL] Use

[jira] [Resolved] (SPARK-33393) Support SHOW TABLE EXTENDED in DSv2

2023-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33393. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 37588 [https

(spark) branch master updated: [SPARK-33393][SQL] Support SHOW TABLE EXTENDED in v2

2023-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c91dbde2f94 [SPARK-33393][SQL] Support SHOW

(spark) branch master updated: [SPARK-45827][SQL] Fix variant parquet reader

2023-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f7d56e2827c [SPARK-45827][SQL] Fix variant

[jira] [Resolved] (SPARK-45905) least common type between decimal types should retain integral digits first

2023-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43781 [https

(spark) branch master updated: [SPARK-45905][SQL] Least common type between decimal types should retain integral digits first

2023-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7120e6b88f23 [SPARK-45905][SQL] Least common

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43393: --- Assignee: Deepayan Patra > Sequence expression can overf

[jira] [Resolved] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43393. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-43393][SQL] Address sequence expression overflow bug

2023-11-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 41a7a4a32337 [SPARK-43393][SQL] Address

(spark) branch master updated: [SPARK-43393][SQL] Address sequence expression overflow bug

2023-11-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new afc4c49927cb [SPARK-43393][SQL] Address

<    2   3   4   5   6   7   8   9   10   11   >