(spark) branch master updated: [SPARK-43393][SQL] Address sequence expression overflow bug

2023-11-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new afc4c49927cb [SPARK-43393][SQL] Address

[jira] [Created] (SPARK-45932) GROUP BY ordinal should not replicate the grouping expression

2023-11-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45932: --- Summary: GROUP BY ordinal should not replicate the grouping expression Key: SPARK-45932 URL: https://issues.apache.org/jira/browse/SPARK-45932 Project: Spark

[jira] [Resolved] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45898. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43771 [https

[jira] [Assigned] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45898: --- Assignee: Yihong He > Rewrite catalog table APIs to use unresolved logical p

[jira] [Created] (SPARK-45920) group by ordinal should be idempotent

2023-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45920: --- Summary: group by ordinal should be idempotent Key: SPARK-45920 URL: https://issues.apache.org/jira/browse/SPARK-45920 Project: Spark Issue Type: Bug

(spark) branch master updated: [SPARK-45882][SQL] BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning

2023-11-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 961dcdfb9845 [SPARK-45882][SQL

[jira] [Resolved] (SPARK-45892) Refactor the optimizer plan validation to decouple validateSchemaOutput and validateExprIdUniqueness

2023-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45892. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43761 [https

[jira] [Assigned] (SPARK-45892) Refactor the optimizer plan validation to decouple validateSchemaOutput and validateExprIdUniqueness

2023-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45892: --- Assignee: Xi Liang > Refactor the optimizer plan validation to decou

(spark) branch master updated: [SPARK-45892][SQL] Refactor optimizer plan validation to decouple `validateSchemaOutput` and `validateExprIdUniqueness`

2023-11-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7cea52c96f5b [SPARK-45892][SQL] Refactor

[jira] [Created] (SPARK-45905) least common type between decimal types should retain integral digits first

2023-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45905: --- Summary: least common type between decimal types should retain integral digits first Key: SPARK-45905 URL: https://issues.apache.org/jira/browse/SPARK-45905 Project

[jira] [Assigned] (SPARK-45815) Provide an interface for Streaming sources to add _metadata columns

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45815: --- Assignee: Yaohua Zhao > Provide an interface for Streaming sources to add _metad

[jira] [Resolved] (SPARK-45815) Provide an interface for Streaming sources to add _metadata columns

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45815. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43692 [https

(spark) branch master updated: [SPARK-45815][SQL][STREAMING] Provide an interface for other Streaming sources to add `_metadata` columns

2023-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1e93c408e19f [SPARK-45815][SQL][STREAMING

[jira] [Resolved] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44886. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42577 [https

[jira] [Assigned] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44886: --- Assignee: Terry Kim > Introduce CLUSTER BY SQL clause to CREATE/REPLACE TA

(spark) branch master updated: [SPARK-44886][SQL] Introduce CLUSTER BY clause for CREATE/REPLACE TABLE

2023-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5ac88b12f86b [SPARK-44886][SQL] Introduce

[jira] [Resolved] (SPARK-45752) Unreferenced CTE should all be checked by CheckAnalysis0

2023-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45752. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43614 [https

(spark) branch master updated: [SPARK-45752][SQL] Unreferenced CTE should all be checked by CheckAnalysis0

2023-11-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 24edc0ef5bee [SPARK-45752][SQL] Unreferenced

[jira] [Resolved] (SPARK-45760) Add With expression to avoid duplicating expressions

2023-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45760. - Fix Version/s: 4.0.0 Resolution: Fixed > Add With expression to avoid duplicat

(spark) branch master updated: [SPARK-45760][SQL] Add With expression to avoid duplicating expressions

2023-11-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 01c294b05f3a [SPARK-45760][SQL] Add

(spark) branch master updated: [SPARK-45509][SQL] Fix df column reference behavior for Spark Connect

2023-11-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c416290335 [SPARK-45509][SQL] Fix df column

[jira] [Created] (SPARK-45760) Add With expression to avoid duplicating expressions

2023-11-01 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45760: --- Summary: Add With expression to avoid duplicating expressions Key: SPARK-45760 URL: https://issues.apache.org/jira/browse/SPARK-45760 Project: Spark Issue

[jira] [Resolved] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45713. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43566 [https

[jira] [Assigned] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45713: --- Assignee: Allison Wang > Support registering Python data sour

(spark) branch master updated: [SPARK-45713][PYTHON] Support registering Python data sources

2023-10-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6cb0cd5bcb5 [SPARK-45713][PYTHON] Support

[jira] [Resolved] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45592. - Fix Version/s: 4.0.0 3.5.1 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-45592][SQL] Correctness issue in AQE with InMemoryTableScanExec

2023-10-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 212f00462f2 [SPARK-45592][SQL

(spark) branch master updated: [SPARK-45592][SQL] Correctness issue in AQE with InMemoryTableScanExec

2023-10-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2be03d81cea3 [SPARK-45592][SQL] Correctness

[jira] [Created] (SPARK-45725) remove the non-default IN subquery runtime filter

2023-10-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45725: --- Summary: remove the non-default IN subquery runtime filter Key: SPARK-45725 URL: https://issues.apache.org/jira/browse/SPARK-45725 Project: Spark Issue Type

[jira] [Resolved] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43507 [https

(spark) branch master updated (f1d1dc1f87a -> 3d6e31a13a4)

2023-10-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f1d1dc1f87a [SPARK-45706][PYTHON][DOCS] Makes entire Binder build fails fast during setting up add 3d6e31a13a4

[spark] branch branch-3.5 updated: [SPARK-43380][SQL] Fix slowdown in Avro read

2023-10-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new d393b50e6d5 [SPARK-43380][SQL] Fix

[spark] branch master updated: [SPARK-43380][SQL] Fix slowdown in Avro read

2023-10-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7d94c5769a8 [SPARK-43380][SQL] Fix slowdown

[jira] [Resolved] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows

2023-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45430. - Fix Version/s: 3.3.4 3.5.1 4.0.0 3.4.2

[jira] [Assigned] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows

2023-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45430: --- Assignee: Vitalii Li > FramelessOffsetWindowFunctionFrame fails when ignore nu

[spark] branch branch-3.3 updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount

2023-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 1bb41437320c [SPARK-45430] Fix

[spark] branch branch-3.4 updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount

2023-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 521c2e0ad64d [SPARK-45430] Fix

[spark] branch branch-3.5 updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount

2023-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new da08382faf10 [SPARK-45430] Fix

[spark] branch master updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount

2023-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 32e1e5841191 [SPARK-45430] Fix

[spark] branch master updated: [SPARK-45638][SQL][AVRO] Improve test coverage of decimal conversion

2023-10-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2daa66ec7856 [SPARK-45638][SQL][AVRO] Improve

Re: [VOTE] SPIP: State Data Source - Reader

2023-10-23 Thread Wenchen Fan
+1 On Mon, Oct 23, 2023 at 4:03 PM Jungtaek Lim wrote: > Starting with my +1 (non-binding). Thanks! > > On Mon, Oct 23, 2023 at 1:23 PM Jungtaek Lim > wrote: > >> Hi all, >> >> I'd like to start the vote for SPIP: State Data Source - Reader. >> >> The high level summary of the SPIP is that we

[jira] [Resolved] (SPARK-45616) Usages of ParVector are unsafe because it does not propagate ThreadLocals or SparkSession

2023-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45616. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[spark] branch branch-3.5 updated: [SPARK-45616][CORE] Avoid ParVector, which does not propagate ThreadLocals or SparkSession

2023-10-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 75a38b9024a [SPARK-45616][CORE] Avoid

[spark] branch master updated: [SPARK-45616][CORE] Avoid ParVector, which does not propagate ThreadLocals or SparkSession

2023-10-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 376de8a502f [SPARK-45616][CORE] Avoid ParVector

[spark] branch master updated: [SPARK-45595] Expose SQLSTATE in error message

2023-10-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4abab8b8308 [SPARK-45595] Expose SQLSTATE

[jira] [Resolved] (SPARK-45595) Expose SQLSTATE in error message

2023-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45595. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43438 [https

[jira] [Assigned] (SPARK-45595) Expose SQLSTATE in error message

2023-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45595: --- Assignee: Serge Rielau > Expose SQLSTATE in error mess

[jira] [Assigned] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45584: --- Assignee: Allison Wang > Execution fails when there are subquer

[jira] [Resolved] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45584. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[spark] branch branch-3.5 updated: [SPARK-45584][SQL] Fix subquery execution failure with TakeOrderedAndProjectExec

2023-10-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new f47b63c6a62 [SPARK-45584][SQL] Fix

[spark] branch master updated: [SPARK-45584][SQL] Fix subquery execution failure with TakeOrderedAndProjectExec

2023-10-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8fd915ffaba [SPARK-45584][SQL] Fix subquery

[jira] [Assigned] (SPARK-45507) Correctness bug in correlated scalar subqueries with COUNT aggregates

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45507: --- Assignee: Andy Lam > Correctness bug in correlated scalar subqueries with COUNT aggrega

[spark] branch master updated: [SPARK-45507][SQL] Correctness fix for nested correlated scalar subqueries with COUNT aggregates

2023-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8a972c2fe87 [SPARK-45507][SQL] Correctness fix

[jira] [Resolved] (SPARK-45507) Correctness bug in correlated scalar subqueries with COUNT aggregates

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45507. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43341 [https

[jira] [Assigned] (SPARK-45586) Reduce compilation time for large expression trees

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45586: --- Assignee: Kelvin Jiang > Reduce compilation time for large expression tr

[jira] [Resolved] (SPARK-45586) Reduce compilation time for large expression trees

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45586. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43420 [https

[spark] branch master updated: [SPARK-45586][SQL] Reduce compiler latency for plans with large expression trees

2023-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1e94415739c [SPARK-45586][SQL] Reduce compiler

[jira] [Assigned] (SPARK-44649) Runtime Filter supports passing equivalent creation side expressions

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44649: --- Assignee: Jiaan Geng > Runtime Filter supports passing equivalent creation s

[jira] [Resolved] (SPARK-44649) Runtime Filter supports passing equivalent creation side expressions

2023-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42317 [https

[spark] branch master updated: [SPARK-44649][SQL] Runtime Filter supports passing equivalent creation side expressions

2023-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 103de914a5f [SPARK-44649][SQL] Runtime Filter

[spark] branch master updated (4901548d4c3 -> f4bd99da12f)

2023-10-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4901548d4c3 [SPARK-45576][CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite add f4bd99da12f

[jira] [Created] (SPARK-45575) support time travel options for df read API

2023-10-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45575: --- Summary: support time travel options for df read API Key: SPARK-45575 URL: https://issues.apache.org/jira/browse/SPARK-45575 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-45531) Add more comments and rename some variable name for InjectRuntimeFilter

2023-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45531. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43359 [https

[spark] branch master updated: [SPARK-45531][SQL][DOCS] Add more comments and rename some variable name for InjectRuntimeFilter

2023-10-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7796d8a6331 [SPARK-45531][SQL][DOCS] Add more

[jira] [Resolved] (SPARK-45491) Replace: _LEGACY_ERROR_TEMP_2196 with a better error class

2023-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45491. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43376 [https

[spark] branch master updated: [SPARK-45491] Add missing SQLSTATES 2/2

2023-10-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c69117742b7 [SPARK-45491] Add missing SQLSTATES

[jira] [Assigned] (SPARK-45009) Correlated EXISTS subqueries in join ON condition unsupported and fail with internal error

2023-10-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45009: --- Assignee: Jack Chen > Correlated EXISTS subqueries in join ON condition unsuppor

[jira] [Resolved] (SPARK-45009) Correlated EXISTS subqueries in join ON condition unsupported and fail with internal error

2023-10-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42725 [https

[spark] branch master updated: [SPARK-45009][SQL] Decorrelate predicate subqueries in join condition

2023-10-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4fd2d6807bf [SPARK-45009][SQL] Decorrelate

[jira] [Resolved] (SPARK-45498) Followup: Ignore task completion from old stage after retrying indeterminate stages

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45498. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45498) Followup: Ignore task completion from old stage after retrying indeterminate stages

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45498: --- Assignee: Mayur Bhosale > Followup: Ignore task completion from old stage after retry

[spark] branch branch-3.5 updated: [SPARK-45498][CORE] Followup: Ignore task completion from old stage a…

2023-10-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new b5f3dc9e760 [SPARK-45498][CORE

[spark] branch master updated: [SPARK-45498][CORE] Followup: Ignore task completion from old stage a…

2023-10-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fb3b707bc1c [SPARK-45498][CORE] Followup

[jira] [Resolved] (SPARK-45418) Change CURRENT_SCHEMA() column alias to match function name

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45418. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43235 [https

[jira] [Assigned] (SPARK-45418) Change CURRENT_SCHEMA() column alias to match function name

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45418: --- Assignee: Michael Zhang > Change CURRENT_SCHEMA() column alias to match function n

[spark] branch master updated: [SPARK-45418][SQL][PYTHON][CONNECT] Change current_database() column alias to current_schema()

2023-10-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 12638b851f3 [SPARK-45418][SQL][PYTHON][CONNECT

[jira] [Assigned] (SPARK-45132) Fix IDENTIFIER clause for functions

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45132: --- Assignee: Serge Rielau > Fix IDENTIFIER clause for functi

[jira] [Resolved] (SPARK-45132) Fix IDENTIFIER clause for functions

2023-10-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45132. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[spark] branch master updated: [SPARK-45132][SQL] Fix IDENTIFIER for function invocation

2023-10-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f0b2e6da5211 [SPARK-45132][SQL] Fix IDENTIFIER

[spark] branch branch-3.5 updated: [SPARK-45132][SQL] Fix IDENTIFIER for function invocation

2023-10-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 249533bcc8c7 [SPARK-45132][SQL] Fix

[jira] [Resolved] (SPARK-45451) Make the default storage level of dataset cache configurable

2023-10-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45451. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43259 [https

[jira] [Assigned] (SPARK-45451) Make the default storage level of dataset cache configurable

2023-10-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45451: --- Assignee: XiDuo You > Make the default storage level of dataset cache configura

[spark] branch master updated: [SPARK-45451][SQL] Make the default storage level of dataset cache configurable

2023-10-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 11af786b35c [SPARK-45451][SQL] Make the default

[jira] [Assigned] (SPARK-45449) Cache Invalidation Issue with JDBC Table

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45449: --- Assignee: liangyongyuan > Cache Invalidation Issue with JDBC Ta

[jira] [Resolved] (SPARK-45449) Cache Invalidation Issue with JDBC Table

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45449. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[spark] branch branch-3.5 updated: [SPARK-45449][SQL] Cache Invalidation Issue with JDBC Table

2023-10-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 81a7f8f184c [SPARK-45449][SQL] Cache

[spark] branch master updated (c9c99222e82 -> d073f2d3e2f)

2023-10-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c9c99222e82 [SPARK-45205][SQL] CommandResultExec to override iterator methods to avoid triggering multiple jobs

[jira] [Assigned] (SPARK-45205) Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45205: --- Assignee: Qiang Yang > Since version 3.2.0, Spark SQL has taken longer to execute &q

[jira] [Resolved] (SPARK-45205) Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278

2023-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45205. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[spark] branch branch-3.5 updated: [SPARK-45205][SQL] CommandResultExec to override iterator methods to avoid triggering multiple jobs

2023-10-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 24f88b319c8 [SPARK-45205][SQL

[spark] branch master updated: [SPARK-45205][SQL] CommandResultExec to override iterator methods to avoid triggering multiple jobs

2023-10-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c9c99222e82 [SPARK-45205][SQL

[jira] [Commented] (SPARK-38341) Spark sql: 3.2.1 - Function of add_ Months returns an incorrect date

2023-10-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773146#comment-17773146 ] Wenchen Fan commented on SPARK-38341: - It seems like a common behavior to preserve the end-of-month

[jira] [Reopened] (SPARK-38341) Spark sql: 3.2.1 - Function of add_ Months returns an incorrect date

2023-10-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-38341: - > Spark sql: 3.2.1 - Function of add_ Months returns an incorrect d

[spark] branch master updated: [SPARK-44913][SQL][FOLLOWUP] DS V2 supports push down V2 UDF that has magic method

2023-10-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ffc6994f465 [SPARK-44913][SQL][FOLLOWUP] DS V2

[jira] [Assigned] (SPARK-44219) Add extra per-rule validation for optimization rewrites.

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44219: --- Assignee: Yannis Sismanis > Add extra per-rule validation for optimization rewri

[jira] [Resolved] (SPARK-44219) Add extra per-rule validation for optimization rewrites.

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44219. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41763 [https

[spark] branch master updated: [SPARK-44219][SQL] Adds extra per-rule validations for optimization rewrites

2023-10-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ce1a8769846 [SPARK-44219][SQL] Adds extra per

[jira] [Resolved] (SPARK-45421) Catch AnalysisException over InlineCTE

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45421. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43227 [https

[spark] branch master updated: [SPARK-45421][SQL] Catch AnalysisException over InlineCTE

2023-10-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 94666e9cd63a [SPARK-45421][SQL] Catch

[jira] [Assigned] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

2023-10-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36112: --- Assignee: Andrey Gubichev > Enable DecorrelateInnerQuery for IN/EXISTS subquer

<    3   4   5   6   7   8   9   10   11   12   >