(spark) branch master updated (ad2367c55aeb -> f576b8542f2e)

2024-04-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ad2367c55aeb [MINOR][PYTHON][SS][TESTS] Drop the tables after being used at `test_streaming_foreach_batch` add

[jira] [Resolved] (SPARK-47289) Allow extensions to log extended information in explain plan

2024-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47289. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45488 [https

[jira] [Assigned] (SPARK-47289) Allow extensions to log extended information in explain plan

2024-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47289: --- Assignee: Parth Chandra > Allow extensions to log extended information in explain p

(spark) branch master updated (0107435cb39d -> d5620cbe9a2e)

2024-04-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0107435cb39d [SPARK-47734][PYTHON][TESTS] Fix flaky DataFrame.writeStream doctest by stopping streaming query

(spark) branch master updated: [SPARK-47689][SQL][FOLLOWUP] More accurate file path in TASK_WRITE_FAILED error

2024-04-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5f9f5db9f363 [SPARK-47689][SQL][FOLLOWUP] More

(spark) branch master updated: Revert "[SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark

2024-04-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3b8aea39953c Revert "[SPARK-47708][CONNEC

[jira] [Resolved] (SPARK-47081) Support Query Execution Progress Messages

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47081. - Resolution: Fixed Issue resolved by pull request 45150 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-47081) Support Query Execution Progress Messages

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47081: --- Assignee: Martin Grund > Support Query Execution Progress Messa

(spark) branch master updated: [SPARK-47081][CONNECT] Support Query Execution Progress

2024-04-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6999df0c7f0 [SPARK-47081][CONNECT] Support

(spark) branch master updated: [SPARK-47210][SQL] Addition of implicit casting without indeterminate support

2024-04-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e3aab8c19492 [SPARK-47210][SQL] Addition of

[jira] [Assigned] (SPARK-47210) Addition of implicit casting without indeterminate support

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47210: --- Assignee: Mihailo Milosevic > Addition of implicit casting without indeterminate supp

[jira] [Resolved] (SPARK-47210) Addition of implicit casting without indeterminate support

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47210. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45383 [https

[jira] [Created] (SPARK-47714) set spark.sql.legacy.timeParserPolicy to CORRECTED by default

2024-04-03 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47714: --- Summary: set spark.sql.legacy.timeParserPolicy to CORRECTED by default Key: SPARK-47714 URL: https://issues.apache.org/jira/browse/SPARK-47714 Project: Spark

(spark) branch master updated: [SPARK-47689][SQL] Do not wrap query execution error during data writing

2024-04-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ba98b7ae53f8 [SPARK-47689][SQL] Do not wrap

[jira] [Resolved] (SPARK-47634) Legacy support for map normalization

2024-04-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47634. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45760 [https

(spark) branch master updated: [SPARK-47634][SQL] Add legacy support for disabling map key normalization

2024-04-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2e6e09a24db [SPARK-47634][SQL] Add legacy

[jira] [Created] (SPARK-47689) Do not wrap query execution error during data writing

2024-04-02 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47689: --- Summary: Do not wrap query execution error during data writing Key: SPARK-47689 URL: https://issues.apache.org/jira/browse/SPARK-47689 Project: Spark Issue

[jira] [Resolved] (SPARK-47551) Add variant_get expression.

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47551. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45708 [https

(spark) branch master updated (43cedc0b3dea -> 1fd308951668)

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 43cedc0b3dea [SPARK-46812][CONNECT][PYTHON] Make mapInPandas / mapInArrow support ResourceProfile add

[jira] [Resolved] (SPARK-46840) Collation benchmarking

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46840. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45453 [https

[jira] [Assigned] (SPARK-46840) Collation benchmarking

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46840: --- Assignee: Gideon P > Collation benchmark

(spark) branch master updated: [SPARK-46840][SQL][TESTS] Add `CollationBenchmark`

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e9f204ae9306 [SPARK-46840][SQL][TESTS] Add

[jira] [Resolved] (SPARK-47569) Disallow comparing variant.

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47569. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45726 [https

(spark) branch master updated: [SPARK-47569][SQL] Disallow comparing variant

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cf02b1a60d9d [SPARK-47569][SQL] Disallow

(spark) branch master updated (a5ca5867298f -> 535734e3901f)

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a5ca5867298f [SPARK-47654][INFRA] Structured logging framework: support log concatenation add 535734e3901f

[jira] [Resolved] (SPARK-47572) Enforce Window partitionSpec is orderable.

2024-03-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47572. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45730 [https

[jira] [Assigned] (SPARK-47572) Enforce Window partitionSpec is orderable.

2024-03-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47572: --- Assignee: Chenhao Li > Enforce Window partitionSpec is ordera

(spark) branch master updated: [SPARK-47572][SQL] Enforce Window partitionSpec is orderable

2024-03-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 609bd4839e5d [SPARK-47572][SQL] Enforce Window

(spark) branch master updated (a57f94b03e30 -> b3146721552f)

2024-03-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a57f94b03e30 [SPARK-47638][PS][CONNECT] Skip column name validation in PS add b3146721552f [SPARK-47511][SQL

[jira] [Resolved] (SPARK-47511) Canonicalize With expressions by re-assigning IDs

2024-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47511. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45649 [https

(spark) branch master updated (fde7a7f3d06b -> 41cbd56ba725)

2024-03-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fde7a7f3d06b [SPARK-47546][SQL][FOLLOWUP] Improve validation when reading Variant from Parquet using non-vectorized

[jira] [Resolved] (SPARK-47525) Support subquery correlation joining on map attributes

2024-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47525. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45673 [https

[jira] [Assigned] (SPARK-47525) Support subquery correlation joining on map attributes

2024-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47525: --- Assignee: Jack Chen > Support subquery correlation joining on map attribu

[jira] [Resolved] (SPARK-47559) Codegen Support for variant `parse_json`

2024-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47559. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45714 [https

[jira] [Assigned] (SPARK-47559) Codegen Support for variant `parse_json`

2024-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47559: --- Assignee: BingKun Pan > Codegen Support for variant `parse_j

(spark) branch master updated: [SPARK-47559][SQL] Codegen Support for variant `parse_json`

2024-03-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c4d6764674f [SPARK-47559][SQL] Codegen Support

(spark) branch master updated: [SPARK-47546][SQL] Improve validation when reading Variant from Parquet

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f2492ddbfe9d [SPARK-47546][SQL] Improve

[jira] [Resolved] (SPARK-47563) Map normalization upon creation

2024-03-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47563. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45721 [https

[jira] [Assigned] (SPARK-47563) Map normalization upon creation

2024-03-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47563: --- Assignee: Stevo Mitric > Map normalization upon creat

(spark) branch master updated: [SPARK-47563][SQL] Add map normalization on creation

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 87449c3f1d65 [SPARK-47563][SQL] Add map

(spark) branch master updated (b540cc538614 -> d57164a5cab9)

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b540cc538614 [SPARK-47611][SQL] Cleanup dead code in MySQLDialect.getCatalystType add d57164a5cab9 [SPARK-47430

(spark) branch master updated: [SPARK-46575][SQL][FOLLOWUP] Add back `HiveThriftServer2.startWithContext(SQLContext)` method for compatibility

2024-03-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f9eb3f3c13bf [SPARK-46575][SQL][FOLLOWUP] Add

[jira] [Updated] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47561: Fix Version/s: 3.5.2 > fix analyzer rule order issues about Al

(spark) branch branch-3.5 updated: [SPARK-47561][SQL] Fix analyzer rule order issues about Alias

2024-03-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 8bcbf7701388 [SPARK-47561][SQL] Fix

[jira] [Resolved] (SPARK-47431) Add session level default Collation

2024-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47431. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45592 [https

(spark) branch master updated: [SPARK-47431][SQL] Add session level default Collation

2024-03-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6ee662c28ffb [SPARK-47431][SQL] Add session

[jira] [Created] (SPARK-47564) always throw FAILED_READ_FILE error when fail to read files

2024-03-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47564: --- Summary: always throw FAILED_READ_FILE error when fail to read files Key: SPARK-47564 URL: https://issues.apache.org/jira/browse/SPARK-47564 Project: Spark

[jira] [Created] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47561: --- Summary: fix analyzer rule order issues about Alias Key: SPARK-47561 URL: https://issues.apache.org/jira/browse/SPARK-47561 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47509) Incorrect results for LambdaFunctions or HigherOrderFunctions in subquery expression plans

2024-03-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47509: --- Assignee: Daniel > Incorrect results for LambdaFunctions or HigherOrderFunctions

[jira] [Resolved] (SPARK-47509) Incorrect results for LambdaFunctions or HigherOrderFunctions in subquery expression plans

2024-03-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47509. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45652 [https

(spark) branch master updated (0054a12a013f -> acf13d6515f7)

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0054a12a013f Revert "[SPARK-47450][INFRA][R] Use R 4.3.3 in `windows` R GitHub Action job" add ac

(spark) branch master updated: [SPARK-47497][SQL][FOLLOWUP] Add a UT for `nested structure` for the function `to_csv`

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0340f805fdd2 [SPARK-47497][SQL][FOLLOWUP] Add a

[jira] [Assigned] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-03-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46743: --- Assignee: Andy Lam > Count bug introduced for scalar subquery when using TEMPORARY V

[jira] [Resolved] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-03-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46743. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45125 [https

(spark) branch master updated (1b55fd3ee107 -> b2f6474848fc)

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1b55fd3ee107 [SPARK-47539][SQL][FOLLOWUP] Fix UT about `variant` add b2f6474848fc [SPARK-46743][SQL] Count bug

[jira] [Assigned] (SPARK-47451) Support to_json(variant)

2024-03-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47451: --- Assignee: Chenhao Li > Support to_json(vari

[jira] [Resolved] (SPARK-47451) Support to_json(variant)

2024-03-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47451. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45575 [https

(spark) branch master updated: [SPARK-47451][SQL] Support to_json(variant).

2024-03-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4a1f2419e243 [SPARK-47451][SQL] Support to_json

(spark) branch master updated (057acf986d78 -> 7b575d137a1a)

2024-03-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 057acf986d78 [SPARK-47512][SS] Tag operation type used with RocksDB state store instance lock acquisition/release

(spark) branch master updated: Revert "[SPARK-47007][SQL][PYTHON][R][CONNECT] Add the `map_sort` function"

2024-03-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bb3e27581887 Revert "[SPARK-47007][SQL][P

[jira] [Assigned] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46990: --- Assignee: Ivan Sadikov > Regression: Unable to load empty avro files emitted by event-h

[jira] [Resolved] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46990. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45578 [https

(spark) branch master updated: [SPARK-46990][SQL] Fix loading empty Avro files emitted by event-hubs

2024-03-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 76260807eef2 [SPARK-46990][SQL] Fix loading

[jira] [Resolved] (SPARK-47296) fail all unsupported functions

2024-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47296. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45422 [https

(spark) branch master updated (a3c04ec11456 -> 8762e256d164)

2024-03-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a3c04ec11456 [SPARK-47478][SQL][TESTS] Improve test coverage for mysql bool synonyms add 8762e256d164 [SPARK

[jira] [Created] (SPARK-47487) simplify code in AnsiTypeCoercion

2024-03-20 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47487: --- Summary: simplify code in AnsiTypeCoercion Key: SPARK-47487 URL: https://issues.apache.org/jira/browse/SPARK-47487 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47422) Support collated strings in array operations

2024-03-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47422. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45563 [https

[jira] [Assigned] (SPARK-47422) Support collated strings in array operations

2024-03-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47422: --- Assignee: Nikola Mandic > Support collated strings in array operati

(spark) branch master updated (e01ed0da22f2 -> 681b41f0808e)

2024-03-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e01ed0da22f2 [SPARK-47345][SQL][TESTS][FOLLOW-UP] Rename JSON to XML within XmlFunctionsSuite add 681b41f0808e

[jira] [Resolved] (SPARK-45891) Support Variant data type

2024-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45891. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45539 [https

(spark) branch master updated: [SPARK-45891][DOCS] Update README with more details

2024-03-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 310dd5294267 [SPARK-45891][DOCS] Update README

[jira] [Resolved] (SPARK-47366) Implement parse_json

2024-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47366. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45479 [https

[jira] [Assigned] (SPARK-47366) Implement parse_json

2024-03-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47366: --- Assignee: Chenhao Li > Implement parse_json > > >

(spark) branch master updated (fe0aa1edff04 -> 7eea705d3015)

2024-03-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fe0aa1edff04 [SPARK-47402][BUILD] Upgrade `ZooKeeper` to 3.9.2 add 7eea705d3015 [SPARK-47366][SQL] Implement

[jira] [Resolved] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

2024-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47385. - Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed

[jira] [Assigned] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

2024-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47385: --- Assignee: Chenhao Li > Tuple encoder produces wrong results with Option inp

(spark) branch branch-3.3 updated: [SPARK-47385] Fix tuple encoders with Option inputs

2024-03-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 45ba9224602e [SPARK-47385] Fix tuple

(spark) branch branch-3.4 updated: [SPARK-47385] Fix tuple encoders with Option inputs

2024-03-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 645a769e4c28 [SPARK-47385] Fix tuple

(spark) branch branch-3.5 updated: [SPARK-47385] Fix tuple encoders with Option inputs

2024-03-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e3317a7cc66c [SPARK-47385] Fix tuple

(spark) branch master updated (e9802116b047 -> 9986462811f1)

2024-03-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e9802116b047 [SPARK-47374][CONNECT][DOCS] Fix connect-repl `usage prompt` & `docs link` add 9986462811f1 [S

[jira] [Created] (SPARK-47376) AssertNotNull should throw USER_RAISED_EXCEPTION error

2024-03-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47376: --- Summary: AssertNotNull should throw USER_RAISED_EXCEPTION error Key: SPARK-47376 URL: https://issues.apache.org/jira/browse/SPARK-47376 Project: Spark Issue

[jira] [Assigned] (SPARK-47270) Dataset.isEmpty should not trigger job execution on CommandResults

2024-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47270: --- Assignee: Zhen Wang > Dataset.isEmpty should not trigger job execution on CommandResu

[jira] [Resolved] (SPARK-47270) Dataset.isEmpty should not trigger job execution on CommandResults

2024-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47270. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45373 [https

(spark) branch master updated: [SPARK-47270][SQL] Dataset.isEmpty projects CommandResults locally

2024-03-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f350b760ea11 [SPARK-47270][SQL] Dataset.isEmpty

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Wenchen Fan
+1 On Mon, Mar 11, 2024 at 5:26 PM Hyukjin Kwon wrote: > +1 > > On Mon, 11 Mar 2024 at 18:11, yangjie01 > wrote: > >> +1 >> >> >> >> Jie Yang >> >> >> >> *发件人**: *Haejoon Lee >> *日期**: *2024年3月11日 星期一 17:09 >> *收件人**: *Gengliang Wang >> *抄送**: *dev >> *主题**: *Re: [VOTE] SPIP: Structured Logg

[jira] [Assigned] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

2024-03-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47265: --- Assignee: BingKun Pan > Use `createTable(..., schema: StructType, ...)` instead

[jira] [Resolved] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

2024-03-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47265. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45368 [https

(spark) branch master updated (c0a8cf9cca08 -> 50131054b818)

2024-03-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c0a8cf9cca08 [SPARK-47079][PYTHON][DOCS][FOLLOWUP] Add `VariantType` to API references add 50131054b818 [SPARK

(spark) branch master updated (456d246badb8 -> 0f9164201ff0)

2024-03-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 456d246badb8 [SPARK-47248][SQL][COLLATION] Improved string function support: contains add 0f9164201ff0 [SPARK

[jira] [Assigned] (SPARK-47248) contains (non-binary collations)

2024-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47248: --- Assignee: Uroš Bojanić > contains (non-binary collati

[jira] [Resolved] (SPARK-47248) contains (non-binary collations)

2024-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47248. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45382 [https

(spark) branch master updated (7a429aa84a5e -> 456d246badb8)

2024-03-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7a429aa84a5e [MINOR][DOCS][PYTHON] Fix documentation typo in takeSample method add 456d246badb8 [SPARK-47248

[jira] [Resolved] (SPARK-47241) fix rule order issues for ExtractGenerator

2024-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47241. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47241) fix rule order issues for ExtractGenerator

2024-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47241: --- Assignee: Wenchen Fan > fix rule order issues for ExtractGenera

(spark) branch branch-3.5 updated: [SPARK-47241][SQL] Fix rule order issues for ExtractGenerator

2024-03-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 37307fb0d14e [SPARK-47241][SQL] Fix

(spark) branch master updated (9f28c43a127d -> 51f4cfa7560b)

2024-03-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9f28c43a127d [SPARK-47315][SQL][TEST] Clean up tempView for `createTempView` UT add 51f4cfa7560b [SPARK-47241

[jira] [Resolved] (SPARK-47238) Reduce executor memory usage by making generated code in WSCG a broadcast variable

2024-03-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47238. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45348 [https

(spark) branch master updated (e341e26330ba -> 3ec79a9df06f)

2024-03-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e341e26330ba [SPARK-47311][SQL][PYTHON] Suppress Python exceptions where PySpark is not in the Python path add

[jira] [Created] (SPARK-47313) scala.MatchError should be treated as internal error

2024-03-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47313: --- Summary: scala.MatchError should be treated as internal error Key: SPARK-47313 URL: https://issues.apache.org/jira/browse/SPARK-47313 Project: Spark Issue

[jira] [Created] (SPARK-47300) quoteIfNeeded should quote identifier starts with digits

2024-03-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47300: --- Summary: quoteIfNeeded should quote identifier starts with digits Key: SPARK-47300 URL: https://issues.apache.org/jira/browse/SPARK-47300 Project: Spark Issue

<    6   7   8   9   10   11   12   13   14   15   >