[jira] [Assigned] (SPARK-47366) Implement parse_json

[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47366: --- Assignee: Chenhao Li > Implement parse_json > > >

(spark) branch master updated (fe0aa1edff04 -> 7eea705d3015)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fe0aa1edff04 [SPARK-47402][BUILD] Upgrade `ZooKeeper` to 3.9.2 add 7eea705d3015 [SPARK-47366][SQL] Implement

[jira] [Resolved] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47385. - Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed

[jira] [Assigned] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47385: --- Assignee: Chenhao Li > Tuple encoder produces wrong results with Option inp

(spark) branch branch-3.3 updated: [SPARK-47385] Fix tuple encoders with Option inputs

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 45ba9224602e [SPARK-47385] Fix tuple

(spark) branch branch-3.4 updated: [SPARK-47385] Fix tuple encoders with Option inputs

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 645a769e4c28 [SPARK-47385] Fix tuple

(spark) branch branch-3.5 updated: [SPARK-47385] Fix tuple encoders with Option inputs

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e3317a7cc66c [SPARK-47385] Fix tuple

(spark) branch master updated (e9802116b047 -> 9986462811f1)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e9802116b047 [SPARK-47374][CONNECT][DOCS] Fix connect-repl `usage prompt` & `docs link` add 9986462811f1 [S

[jira] [Created] (SPARK-47376) AssertNotNull should throw USER_RAISED_EXCEPTION error

Wenchen Fan created SPARK-47376: --- Summary: AssertNotNull should throw USER_RAISED_EXCEPTION error Key: SPARK-47376 URL: https://issues.apache.org/jira/browse/SPARK-47376 Project: Spark Issue

[jira] [Assigned] (SPARK-47270) Dataset.isEmpty should not trigger job execution on CommandResults

[ https://issues.apache.org/jira/browse/SPARK-47270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47270: --- Assignee: Zhen Wang > Dataset.isEmpty should not trigger job execution on CommandResu

[jira] [Resolved] (SPARK-47270) Dataset.isEmpty should not trigger job execution on CommandResults

[ https://issues.apache.org/jira/browse/SPARK-47270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47270. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45373 [https

(spark) branch master updated: [SPARK-47270][SQL] Dataset.isEmpty projects CommandResults locally

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f350b760ea11 [SPARK-47270][SQL] Dataset.isEmpty

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1 On Mon, Mar 11, 2024 at 5:26 PM Hyukjin Kwon wrote: > +1 > > On Mon, 11 Mar 2024 at 18:11, yangjie01 > wrote: > >> +1 >> >> >> >> Jie Yang >> >> >> >> *发件人**: *Haejoon Lee >> *日期**: *2024年3月11日 星期一 17:09 >> *收件人**: *Gengliang Wang >> *抄送**: *dev >> *主题**: *Re: [VOTE] SPIP: Structured

[jira] [Assigned] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47265: --- Assignee: BingKun Pan > Use `createTable(..., schema: StructType, ...)` inst

[jira] [Resolved] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47265. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45368 [https

(spark) branch master updated (c0a8cf9cca08 -> 50131054b818)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c0a8cf9cca08 [SPARK-47079][PYTHON][DOCS][FOLLOWUP] Add `VariantType` to API references add 50131054b818 [SPARK

(spark) branch master updated (456d246badb8 -> 0f9164201ff0)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 456d246badb8 [SPARK-47248][SQL][COLLATION] Improved string function support: contains add 0f9164201ff0 [SPARK

[jira] [Assigned] (SPARK-47248) contains (non-binary collations)

[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47248: --- Assignee: Uroš Bojanić > contains (non-binary collati

[jira] [Resolved] (SPARK-47248) contains (non-binary collations)

[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47248. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45382 [https

(spark) branch master updated (7a429aa84a5e -> 456d246badb8)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7a429aa84a5e [MINOR][DOCS][PYTHON] Fix documentation typo in takeSample method add 456d246badb8 [SPARK-47248

[jira] [Resolved] (SPARK-47241) fix rule order issues for ExtractGenerator

[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47241. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47241) fix rule order issues for ExtractGenerator

[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47241: --- Assignee: Wenchen Fan > fix rule order issues for ExtractGenera

(spark) branch branch-3.5 updated: [SPARK-47241][SQL] Fix rule order issues for ExtractGenerator

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 37307fb0d14e [SPARK-47241][SQL] Fix

(spark) branch master updated (9f28c43a127d -> 51f4cfa7560b)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9f28c43a127d [SPARK-47315][SQL][TEST] Clean up tempView for `createTempView` UT add 51f4cfa7560b [SPARK-47241

[jira] [Resolved] (SPARK-47238) Reduce executor memory usage by making generated code in WSCG a broadcast variable

[ https://issues.apache.org/jira/browse/SPARK-47238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47238. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45348 [https

(spark) branch master updated (e341e26330ba -> 3ec79a9df06f)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e341e26330ba [SPARK-47311][SQL][PYTHON] Suppress Python exceptions where PySpark is not in the Python path add

[jira] [Created] (SPARK-47313) scala.MatchError should be treated as internal error

Wenchen Fan created SPARK-47313: --- Summary: scala.MatchError should be treated as internal error Key: SPARK-47313 URL: https://issues.apache.org/jira/browse/SPARK-47313 Project: Spark Issue

[jira] [Created] (SPARK-47300) quoteIfNeeded should quote identifier starts with digits

Wenchen Fan created SPARK-47300: --- Summary: quoteIfNeeded should quote identifier starts with digits Key: SPARK-47300 URL: https://issues.apache.org/jira/browse/SPARK-47300 Project: Spark Issue

[jira] [Resolved] (SPARK-46835) Join support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46835. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45389 [https

[jira] [Assigned] (SPARK-46835) Join support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46835: --- Assignee: Aleksandar Tomic > Join support for strings with collat

(spark) branch master updated (d7cc708e1e0d -> d5f35ec97fc4)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d7cc708e1e0d [SPARK-47280][SQL] Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE add d5f35ec97fc4

[jira] [Resolved] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47247. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45357 [https

[jira] [Assigned] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47247: --- Assignee: Wenchen Fan > use smaller target size when coalescing partitions with explod

(spark) branch master updated (36299f1b2bff -> e310e76e63fe)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 36299f1b2bff [SPARK-47285][SQL] AdaptiveSparkPlanExec should always use the context.session add e310e76e63fe

[jira] [Resolved] (SPARK-47033) EXECUTE IMMEDIATE USING does not recognize session variable names

[ https://issues.apache.org/jira/browse/SPARK-47033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47033. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45293 [https

(spark) branch master updated (502fa8070c65 -> c417c757907e)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 502fa8070c65 [SPARK-47168][SQL] Disable parquet filter pushdown when working with non default collated strings

[jira] [Resolved] (SPARK-47168) Disable parquet filter pushdown for non default collated strings

[ https://issues.apache.org/jira/browse/SPARK-47168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47168. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45262 [https

(spark) branch master updated (6534a3398ae9 -> 502fa8070c65)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6534a3398ae9 [SPARK-47102][SQL] Add the `COLLATION_ENABLED` config flag add 502fa8070c65 [SPARK-47168][SQL

(spark) branch master updated (dfb35bed522c -> c9435b8b4864)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dfb35bed522c [SPARK-47146][CORE] Possible thread leak when doing sort merge join add c9435b8b4864 [SPARK-47176

[jira] [Assigned] (SPARK-47268) Repartition by column should respect collation

[ https://issues.apache.org/jira/browse/SPARK-47268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47268: --- Assignee: Aleksandar Tomic > Repartition by column should respect collat

[jira] [Resolved] (SPARK-47268) Repartition by column should respect collation

[ https://issues.apache.org/jira/browse/SPARK-47268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47268. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45370 [https

(spark) branch master updated (7e7f3ff9e281 -> ca7c60b49988)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7e7f3ff9e281 [SPARK-47070] Fix invalid aggregation after subquery rewrite add ca7c60b49988 [SPARK-47268][SQL

[jira] [Resolved] (SPARK-47070) Subquery rewrite inside an aggregation makes an aggregation invalid

[ https://issues.apache.org/jira/browse/SPARK-47070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47070. - Fix Version/s: 4.0.0 Resolution: Fixed > Subquery rewrite inside an aggregation ma

(spark) branch master updated (479954cf73a5 -> 7e7f3ff9e281)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 479954cf73a5 [SPARK-47131][SQL][COLLATION] String function support: contains, startswith, endswith add

[jira] [Resolved] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47131. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45216 [https

[jira] [Assigned] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47131: --- Assignee: Uroš Bojanić > contains, startswith, endsw

(spark) branch master updated (b711efd6671a -> 479954cf73a5)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b711efd6671a [SPARK-43258][SQL] Assign names to error _LEGACY_ERROR_TEMP_202[3,5] add 479954cf73a5 [SPARK-47131

[jira] [Resolved] (SPARK-46973) Skip V2 table lookup when a table is in V1 table cache

[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46973. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45176 [https

[jira] [Assigned] (SPARK-46973) Skip V2 table lookup when a table is in V1 table cache

[ https://issues.apache.org/jira/browse/SPARK-46973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46973: --- Assignee: Allison Wang > Skip V2 table lookup when a table is in V1 table ca

(spark) branch master updated (71767cfe3765 -> 5a71f2184207)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 71767cfe3765 [SPARK-46834][SQL][COLLATIONS] Support for aggregates add 5a71f2184207 [SPARK-46973][SQL] Skip V2

[jira] [Resolved] (SPARK-46834) Aggregate support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46834. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45290 [https

[jira] [Assigned] (SPARK-46834) Aggregate support for strings with collation

[ https://issues.apache.org/jira/browse/SPARK-46834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46834: --- Assignee: Aleksandar Tomic > Aggregate support for strings with collat

(spark) branch master updated (433c9b064a3f -> 71767cfe3765)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 433c9b064a3f [SPARK-47246][SQL] Replace `InternalRow.fromSeq` with `new GenericInternalRow` to save a collection

[jira] [Resolved] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47167. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45259 [https

(spark) branch master updated (a5a282234295 -> 2981618d5aad)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a5a282234295 [SPARK-43255][SQL] Replace the error class _LEGACY_ERROR_TEMP_2020 by an internal error add

[jira] [Created] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

Wenchen Fan created SPARK-47247: --- Summary: use smaller target size when coalescing partitions with exploding joins Key: SPARK-47247 URL: https://issues.apache.org/jira/browse/SPARK-47247 Project: Spark

[jira] [Created] (SPARK-47241) fix rule order issues for ExtractGenerator

Wenchen Fan created SPARK-47241: --- Summary: fix rule order issues for ExtractGenerator Key: SPARK-47241 URL: https://issues.apache.org/jira/browse/SPARK-47241 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47145: --- Assignee: Uros Stankovic > Provide table identifier to scan node when DS v2 strat

[jira] [Resolved] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47145. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45200 [https

(spark) branch master updated (4cf90e3d468c -> 5c4b0d1c0483)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4cf90e3d468c [SPARK-47205][BUILD][TESTS] Upgrade docker-java to 3.3.5 add 5c4b0d1c0483 [SPARK-47145][SQL] Pass

[jira] [Resolved] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47191. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45289 [https

[jira] [Assigned] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

[ https://issues.apache.org/jira/browse/SPARK-47191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47191: --- Assignee: Wenchen Fan > avoid unnecessary relation lookup when uncaching table/v

(spark) branch master updated: [SPARK-47191][SQL] Avoid unnecessary relation lookup when uncaching table/view

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6d41866e6314 [SPARK-47191][SQL] Avoid

[jira] [Resolved] (SPARK-47144) Fix Spark Connect collation issue

[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47144. - Resolution: Fixed Issue resolved by pull request 45233 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-47144) Fix Spark Connect collation issue

[ https://issues.apache.org/jira/browse/SPARK-47144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47144: --- Assignee: Nikola Mandic > Fix Spark Connect collation is

(spark) branch master updated: [SPARK-47144][CONNECT][SQL][PYTHON] Fix Spark Connect collation error by adding collateId protobuf field

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6385cf1bf155 [SPARK-47144][CONNECT][SQL][PYTHON

[jira] [Created] (SPARK-47191) avoid unnecessary relation lookup when uncaching table/view

Wenchen Fan created SPARK-47191: --- Summary: avoid unnecessary relation lookup when uncaching table/view Key: SPARK-47191 URL: https://issues.apache.org/jira/browse/SPARK-47191 Project: Spark

[jira] [Resolved] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

[ https://issues.apache.org/jira/browse/SPARK-47176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47176. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45270 [https

(spark) branch master updated: [SPARK-47176][SQL] Have a ResolveAllExpressionsUpWithPruning helper function

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7234e35130c2 [SPARK-47176][SQL] Have

[jira] [Resolved] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45105 [https

[jira] [Assigned] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47009: --- Assignee: Stefan Kandic > Create table with collat

(spark) branch master updated: [SPARK-47009][SQL] Enable create table support for collation

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 298134fd5e98 [SPARK-47009][SQL] Enable create

[jira] [Assigned] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45599: --- Assignee: Nicholas Chammas > Percentile can produce a wrong answer if -0.0 and

[jira] [Resolved] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45599. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-45599][CORE] Use object equality in OpenHashSet

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 588a55d010fe [SPARK-45599][CORE] Use

(spark) branch master updated: [SPARK-45599][CORE] Use object equality in OpenHashSet

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fcc5dbc9b6c8 [SPARK-45599][CORE] Use object

[jira] [Assigned] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47044: --- Assignee: Uros Stankovic > Add JDBC query to explain formatted comm

[jira] [Resolved] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47044. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45102 [https

(spark) branch master updated: [SPARK-47044][SQL] Add executed query for JDBC external datasources to explain output

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e6a3385e27fa [SPARK-47044][SQL] Add executed

[jira] [Resolved] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45789. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45077 [https

[jira] [Assigned] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

[ https://issues.apache.org/jira/browse/SPARK-45789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45789: --- Assignee: Terry Kim > Support DESCRIBE TABLE for clustering colu

(spark) branch master updated: [SPARK-45789][SQL] Support DESCRIBE TABLE for clustering columns

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f0f35c8b1c8f [SPARK-45789][SQL] Support

Re: [VOTE] Release Apache Spark 3.5.1 (RC2)

+1, thanks for making the release! On Sat, Feb 17, 2024 at 3:54 AM Sean Owen wrote: > Yeah let's get that fix in, but it seems to be a minor test only issue so > should not block release. > > On Fri, Feb 16, 2024, 9:30 AM yangjie01 wrote: > >> Very sorry. When I was fixing `SPARK-45242 ( >>

[jira] [Updated] (SPARK-47071) inline With expression if it contains special expression

[ https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47071: Summary: inline With expression if it contains special expression (was: inline With expression

[jira] [Created] (SPARK-47071) inline With expression if it contains aggregate/window expression

Wenchen Fan created SPARK-47071: --- Summary: inline With expression if it contains aggregate/window expression Key: SPARK-47071 URL: https://issues.apache.org/jira/browse/SPARK-47071 Project: Spark

[jira] [Created] (SPARK-47059) attach error context for ALTER COLUMN v1 command

Wenchen Fan created SPARK-47059: --- Summary: attach error context for ALTER COLUMN v1 command Key: SPARK-47059 URL: https://issues.apache.org/jira/browse/SPARK-47059 Project: Spark Issue Type

[jira] [Assigned] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39910: --- Assignee: Christophe Préaud > DataFrameReader API cannot read files from hadoop archi

[jira] [Resolved] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39910. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

(spark) branch branch-3.5 updated: [SPARK-39910][SQL] Delegate path qualification to filesystem during DataSource file path globbing

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 7658f77a613c [SPARK-39910][SQL

(spark) branch master updated: [SPARK-39910][SQL] Delegate path qualification to filesystem during DataSource file path globbing

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b7edc5fac0f4 [SPARK-39910][SQL] Delegate path

[jira] [Resolved] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

[ https://issues.apache.org/jira/browse/SPARK-46999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46999. - Fix Version/s: 4.0.0 Assignee: Wenchen Fan Resolution: Fixed

(spark) branch master updated: [SPARK-46999][SQL] ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b345b23b76c4 [SPARK-46999][SQL

[jira] [Resolved] (SPARK-46993) Allow session variables in more places such as from_json for schema

[ https://issues.apache.org/jira/browse/SPARK-46993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46993. - Fix Version/s: 4.0.0 Assignee: Serge Rielau Resolution: Fixed > Allow sess

(spark) branch master updated: [SPARK-46993][SQL] Fix constant folding for session variables

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d25525d876b [SPARK-46993][SQL] Fix constant

[jira] [Assigned] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46922: --- Assignee: Wenchen Fan > Do not wrap runtime user-facing err

[jira] [Resolved] (SPARK-46922) Do not wrap runtime user-facing errors

[ https://issues.apache.org/jira/browse/SPARK-46922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46922. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44953 [https

[jira] [Created] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

Wenchen Fan created SPARK-46999: --- Summary: ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree Key: SPARK-46999 URL: https://issues.apache.org/jira/browse/SPARK-46999

(spark) branch master updated (dc73a8d7e96e -> becc04a9b6e2)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dc73a8d7e96e [SPARK-46526][SQL] Support LIMIT over correlated subqueries where predicates only reference outer table

[jira] [Resolved] (SPARK-46526) Limit over certain correlated subqueries results in Nosuchelement exception

[ https://issues.apache.org/jira/browse/SPARK-46526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46526. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44514 [https

(spark) branch master updated: [SPARK-46526][SQL] Support LIMIT over correlated subqueries where predicates only reference outer table

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dc73a8d7e96e [SPARK-46526][SQL] Support LIMIT

<    1   2   3   4   5   6   7   8   9   10   >