[jira] [Resolved] (SPARK-46835) Join support for strings with collation

2024-03-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46835. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45389 [https

[jira] [Assigned] (SPARK-46835) Join support for strings with collation

2024-03-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46835: --- Assignee: Aleksandar Tomic > Join support for strings with collat

(spark) branch master updated (d7cc708e1e0d -> d5f35ec97fc4)

2024-03-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d7cc708e1e0d [SPARK-47280][SQL] Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE add d5f35ec97fc4

[jira] [Resolved] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

2024-03-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47247. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45357 [https

[jira] [Assigned] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

2024-03-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47247: --- Assignee: Wenchen Fan > use smaller target size when coalescing partitions with explod

(spark) branch master updated (36299f1b2bff -> e310e76e63fe)

2024-03-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 36299f1b2bff [SPARK-47285][SQL] AdaptiveSparkPlanExec should always use the context.session add e310e76e63fe

[jira] [Resolved] (SPARK-47033) EXECUTE IMMEDIATE USING does not recognize session variable names

2024-03-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47033. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45293 [https

(spark) branch master updated (502fa8070c65 -> c417c757907e)

2024-03-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 502fa8070c65 [SPARK-47168][SQL] Disable parquet filter pushdown when working with non default collated strings

[jira] [Resolved] (SPARK-47168) Disable parquet filter pushdown for non default collated strings

2024-03-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47168. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45262 [https

(spark) branch master updated (6534a3398ae9 -> 502fa8070c65)

2024-03-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6534a3398ae9 [SPARK-47102][SQL] Add the `COLLATION_ENABLED` config flag add 502fa8070c65 [SPARK-47168][SQL

(spark) branch master updated (dfb35bed522c -> c9435b8b4864)

2024-03-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dfb35bed522c [SPARK-47146][CORE] Possible thread leak when doing sort merge join add c9435b8b4864 [SPARK-47176

[jira] [Assigned] (SPARK-47268) Repartition by column should respect collation

2024-03-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47268: --- Assignee: Aleksandar Tomic > Repartition by column should respect collat

[jira] [Resolved] (SPARK-47268) Repartition by column should respect collation

2024-03-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47268. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45370 [https

(spark) branch master updated (7e7f3ff9e281 -> ca7c60b49988)

2024-03-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7e7f3ff9e281 [SPARK-47070] Fix invalid aggregation after subquery rewrite add ca7c60b49988 [SPARK-47268][SQL

[jira] [Resolved] (SPARK-47070) Subquery rewrite inside an aggregation makes an aggregation invalid

2024-03-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47070. - Fix Version/s: 4.0.0 Resolution: Fixed > Subquery rewrite inside an aggregation makes

(spark) branch master updated (479954cf73a5 -> 7e7f3ff9e281)

2024-03-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 479954cf73a5 [SPARK-47131][SQL][COLLATION] String function support: contains, startswith, endswith add

[jira] [Resolved] (SPARK-47131) contains, startswith, endswith

2024-03-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47131. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45216 [https

[jira] [Assigned] (SPARK-47131) contains, startswith, endswith

2024-03-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47131: --- Assignee: Uroš Bojanić > contains, startswith, endsw

(spark) branch master updated (b711efd6671a -> 479954cf73a5)

2024-03-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b711efd6671a [SPARK-43258][SQL] Assign names to error _LEGACY_ERROR_TEMP_202[3,5] add 479954cf73a5 [SPARK-47131

[jira] [Resolved] (SPARK-46973) Skip V2 table lookup when a table is in V1 table cache

2024-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46973. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45176 [https

[jira] [Assigned] (SPARK-46973) Skip V2 table lookup when a table is in V1 table cache

2024-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46973: --- Assignee: Allison Wang > Skip V2 table lookup when a table is in V1 table ca

(spark) branch master updated (71767cfe3765 -> 5a71f2184207)

2024-03-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 71767cfe3765 [SPARK-46834][SQL][COLLATIONS] Support for aggregates add 5a71f2184207 [SPARK-46973][SQL] Skip V2

[jira] [Resolved] (SPARK-46834) Aggregate support for strings with collation

2024-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46834. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45290 [https

[jira] [Assigned] (SPARK-46834) Aggregate support for strings with collation

2024-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46834: --- Assignee: Aleksandar Tomic > Aggregate support for strings with collat

(spark) branch master updated (433c9b064a3f -> 71767cfe3765)

2024-03-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 433c9b064a3f [SPARK-47246][SQL] Replace `InternalRow.fromSeq` with `new GenericInternalRow` to save a collection

[jira] [Resolved] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

2024-03-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47167. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45259 [https

(spark) branch master updated (a5a282234295 -> 2981618d5aad)

2024-03-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a5a282234295 [SPARK-43255][SQL] Replace the error class _LEGACY_ERROR_TEMP_2020 by an internal error add

[jira] [Created] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

2024-03-01 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47247: --- Summary: use smaller target size when coalescing partitions with exploding joins Key: SPARK-47247 URL: https://issues.apache.org/jira/browse/SPARK-47247 Project: Spark

[jira] [Created] (SPARK-47241) fix rule order issues for ExtractGenerator

2024-02-29 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47241: --- Summary: fix rule order issues for ExtractGenerator Key: SPARK-47241 URL: https://issues.apache.org/jira/browse/SPARK-47241 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

2024-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47145: --- Assignee: Uros Stankovic > Provide table identifier to scan node when DS v2 strategy

[jira] [Resolved] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

2024-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47145. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45200 [https

(spark) branch master updated (4cf90e3d468c -> 5c4b0d1c0483)

2024-02-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4cf90e3d468c [SPARK-47205][BUILD][TESTS] Upgrade docker-java to 3.3.5 add 5c4b0d1c0483 [SPARK-47145][SQL] Pass

[jira] [Resolved] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

2024-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47191. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45289 [https

[jira] [Assigned] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

2024-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47191: --- Assignee: Wenchen Fan > avoid unnecessary relation lookup when uncaching table/v

(spark) branch master updated: [SPARK-47191][SQL] Avoid unnecessary relation lookup when uncaching table/view

2024-02-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6d41866e6314 [SPARK-47191][SQL] Avoid

[jira] [Resolved] (SPARK-47144) Fix Spark Connect collation issue

2024-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47144. - Resolution: Fixed Issue resolved by pull request 45233 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-47144) Fix Spark Connect collation issue

2024-02-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47144: --- Assignee: Nikola Mandic > Fix Spark Connect collation is

(spark) branch master updated: [SPARK-47144][CONNECT][SQL][PYTHON] Fix Spark Connect collation error by adding collateId protobuf field

2024-02-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6385cf1bf155 [SPARK-47144][CONNECT][SQL][PYTHON

[jira] [Created] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

2024-02-27 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47191: --- Summary: avoid unnecessary relation lookup when uncaching table/view Key: SPARK-47191 URL: https://issues.apache.org/jira/browse/SPARK-47191 Project: Spark

[jira] [Resolved] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47176. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45270 [https

(spark) branch master updated: [SPARK-47176][SQL] Have a ResolveAllExpressionsUpWithPruning helper function

2024-02-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7234e35130c2 [SPARK-47176][SQL] Have a

[jira] [Resolved] (SPARK-47009) Create table with collation

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45105 [https

[jira] [Assigned] (SPARK-47009) Create table with collation

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47009: --- Assignee: Stefan Kandic > Create table with collat

(spark) branch master updated: [SPARK-47009][SQL] Enable create table support for collation

2024-02-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 298134fd5e98 [SPARK-47009][SQL] Enable create

[jira] [Assigned] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45599: --- Assignee: Nicholas Chammas > Percentile can produce a wrong answer if -0.0 and 0.0

[jira] [Resolved] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45599. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-45599][CORE] Use object equality in OpenHashSet

2024-02-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 588a55d010fe [SPARK-45599][CORE] Use

(spark) branch master updated: [SPARK-45599][CORE] Use object equality in OpenHashSet

2024-02-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fcc5dbc9b6c8 [SPARK-45599][CORE] Use object

[jira] [Assigned] (SPARK-47044) Add JDBC query to explain formatted command

2024-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47044: --- Assignee: Uros Stankovic > Add JDBC query to explain formatted comm

[jira] [Resolved] (SPARK-47044) Add JDBC query to explain formatted command

2024-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47044. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45102 [https

(spark) branch master updated: [SPARK-47044][SQL] Add executed query for JDBC external datasources to explain output

2024-02-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e6a3385e27fa [SPARK-47044][SQL] Add executed

[jira] [Resolved] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

2024-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45789. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45077 [https

[jira] [Assigned] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

2024-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45789: --- Assignee: Terry Kim > Support DESCRIBE TABLE for clustering colu

(spark) branch master updated: [SPARK-45789][SQL] Support DESCRIBE TABLE for clustering columns

2024-02-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f0f35c8b1c8f [SPARK-45789][SQL] Support

Re: [VOTE] Release Apache Spark 3.5.1 (RC2)

2024-02-19 Thread Wenchen Fan
+1, thanks for making the release! On Sat, Feb 17, 2024 at 3:54 AM Sean Owen wrote: > Yeah let's get that fix in, but it seems to be a minor test only issue so > should not block release. > > On Fri, Feb 16, 2024, 9:30 AM yangjie01 wrote: > >> Very sorry. When I was fixing `SPARK-45242 ( >> htt

[jira] [Updated] (SPARK-47071) inline With expression if it contains special expression

2024-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47071: Summary: inline With expression if it contains special expression (was: inline With expression

[jira] [Created] (SPARK-47071) inline With expression if it contains aggregate/window expression

2024-02-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47071: --- Summary: inline With expression if it contains aggregate/window expression Key: SPARK-47071 URL: https://issues.apache.org/jira/browse/SPARK-47071 Project: Spark

[jira] [Created] (SPARK-47059) attach error context for ALTER COLUMN v1 command

2024-02-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47059: --- Summary: attach error context for ALTER COLUMN v1 command Key: SPARK-47059 URL: https://issues.apache.org/jira/browse/SPARK-47059 Project: Spark Issue Type

[jira] [Assigned] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

2024-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39910: --- Assignee: Christophe Préaud > DataFrameReader API cannot read files from hadoop archi

[jira] [Resolved] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

2024-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39910. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-39910][SQL] Delegate path qualification to filesystem during DataSource file path globbing

2024-02-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 7658f77a613c [SPARK-39910][SQL

(spark) branch master updated: [SPARK-39910][SQL] Delegate path qualification to filesystem during DataSource file path globbing

2024-02-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b7edc5fac0f4 [SPARK-39910][SQL] Delegate path

[jira] [Resolved] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

2024-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46999. - Fix Version/s: 4.0.0 Assignee: Wenchen Fan Resolution: Fixed

(spark) branch master updated: [SPARK-46999][SQL] ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

2024-02-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b345b23b76c4 [SPARK-46999][SQL

[jira] [Resolved] (SPARK-46993) Allow session variables in more places such as from_json for schema

2024-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46993. - Fix Version/s: 4.0.0 Assignee: Serge Rielau Resolution: Fixed > Allow sess

(spark) branch master updated: [SPARK-46993][SQL] Fix constant folding for session variables

2024-02-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d25525d876b [SPARK-46993][SQL] Fix constant

[jira] [Assigned] (SPARK-46922) Do not wrap runtime user-facing errors

2024-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46922: --- Assignee: Wenchen Fan > Do not wrap runtime user-facing err

[jira] [Resolved] (SPARK-46922) Do not wrap runtime user-facing errors

2024-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46922. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44953 [https

[jira] [Created] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

2024-02-07 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46999: --- Summary: ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree Key: SPARK-46999 URL: https://issues.apache.org/jira/browse/SPARK-46999

(spark) branch master updated (dc73a8d7e96e -> becc04a9b6e2)

2024-02-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dc73a8d7e96e [SPARK-46526][SQL] Support LIMIT over correlated subqueries where predicates only reference outer table

[jira] [Resolved] (SPARK-46526) Limit over certain correlated subqueries results in Nosuchelement exception

2024-02-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46526. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44514 [https

(spark) branch master updated: [SPARK-46526][SQL] Support LIMIT over correlated subqueries where predicates only reference outer table

2024-02-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dc73a8d7e96e [SPARK-46526][SQL] Support LIMIT

(spark) branch master updated: [SPARK-46980][SQL][MINOR] Avoid using internal APIs in dataframe end-to-end tests

2024-02-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1a577b8f8881 [SPARK-46980][SQL][MINOR] Avoid

[jira] [Resolved] (SPARK-46980) Avoid using internal APIs in dataframe end-to-end tests

2024-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46980. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45034 [https

[jira] [Created] (SPARK-46980) Avoid using internal APIs in tests

2024-02-05 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46980: --- Summary: Avoid using internal APIs in tests Key: SPARK-46980 URL: https://issues.apache.org/jira/browse/SPARK-46980 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46980) Avoid using internal APIs in dataframe end-to-end tests

2024-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46980: Summary: Avoid using internal APIs in dataframe end-to-end tests (was: Avoid using internal APIs

[jira] [Assigned] (SPARK-46833) Using ICU library for collation tracking

2024-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46833: --- Assignee: Aleksandar Tomic > Using ICU library for collation track

(spark) branch master updated: [SPARK-46833][SQL] Collations - Introducing CollationFactory which provides comparison and hashing rules for supported collations

2024-02-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6ff5f396632d [SPARK-46833][SQL] Collations

[jira] [Resolved] (SPARK-46833) Using ICU library for collation tracking

2024-02-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46833. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44968 [https

[jira] [Resolved] (SPARK-46946) Supporting broadcast of multiple filtering keys in DynamicPruning

2024-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46946. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44988 [https

[jira] [Assigned] (SPARK-46946) Supporting broadcast of multiple filtering keys in DynamicPruning

2024-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46946: --- Assignee: Thang Long Vu > Supporting broadcast of multiple filtering keys

(spark) branch master updated: [SPARK-46946][SQL] Supporting broadcast of multiple filtering keys in DynamicPruning

2024-02-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 22e5938aefc7 [SPARK-46946][SQL] Supporting

[jira] [Updated] (SPARK-46922) Do not wrap runtime user-facing errors

2024-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46922: Summary: Do not wrap runtime user-facing errors (was: better handling for runtime user errors

[jira] [Created] (SPARK-46951) Define retry-able errors

2024-02-01 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46951: --- Summary: Define retry-able errors Key: SPARK-46951 URL: https://issues.apache.org/jira/browse/SPARK-46951 Project: Spark Issue Type: Improvement

(spark) branch master updated: [SPARK-45807][SQL] Return View after calling replaceView(..)

2024-02-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cedef63faf14 [SPARK-45807][SQL] Return View

[jira] [Assigned] (SPARK-46908) Extend SELECT * support outside of select list

2024-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46908: --- Assignee: Serge Rielau > Extend SELECT * support outside of select l

[jira] [Resolved] (SPARK-46908) Extend SELECT * support outside of select list

2024-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46908. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44938 [https

(spark) branch master updated (53cbaeb20293 -> 49e3f5e3bad4)

2024-02-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 53cbaeb20293 [SPARK-46936][PS] Implement `Frame.to_feather` add 49e3f5e3bad4 [SPARK-46908][SQL] Support star

[jira] [Resolved] (SPARK-46933) Add execution time metric for jdbc query

2024-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46933. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44969 [https

(spark) branch master updated: [SPARK-46933][SQL] Add query execution time metric to connectors which use JDBCRDD

2024-02-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 22586efb3cd4 [SPARK-46933][SQL] Add query

[jira] [Created] (SPARK-46922) better handling for runtime user errors

2024-01-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46922: --- Summary: better handling for runtime user errors Key: SPARK-46922 URL: https://issues.apache.org/jira/browse/SPARK-46922 Project: Spark Issue Type

[jira] [Resolved] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44935 [https

[jira] [Assigned] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46905: --- Assignee: Wenchen Fan > Add dedicated class to keep column definition instead

(spark) branch master updated: [SPARK-46905][SQL] Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4da7c3d316e3 [SPARK-46905][SQL] Add dedicated

[jira] [Created] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46905: --- Summary: Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command Key: SPARK-46905 URL: https://issues.apache.org/jira/browse/SPARK-46905

(spark) branch branch-3.5 updated: [SPARK-46590][SQL][FOLLOWUP] Update CoalesceShufflePartitions comments

2024-01-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 0956db6901bf [SPARK-46590][SQL

(spark) branch master updated: [SPARK-46590][SQL][FOLLOWUP] Update CoalesceShufflePartitions comments

2024-01-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fe4f8eac3efe [SPARK-46590][SQL][FOLLOWUP

[jira] [Resolved] (SPARK-46683) Write a subquery generator that generates subqueries of different variations to increase testing coverage in this area

2024-01-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46683. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44599 [https

(spark) branch master updated (2aed25b15dba -> bc889c8c2adb)

2024-01-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2aed25b15dba Revert "[SPARK-46417][SQL] Do not fail when calling hive.getTable and throwException is false"

[jira] [Resolved] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes

2024-01-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46763. - Fix Version/s: 3.4.3 3.5.1 4.0.0 Resolution: Fixed

<    7   8   9   10   11   12   13   14   15   16   >