[jira] [Resolved] (SPARK-47081) Support Query Execution Progress Messages

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47081. - Resolution: Fixed Issue resolved by pull request 45150

[jira] [Assigned] (SPARK-47081) Support Query Execution Progress Messages

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47081: --- Assignee: Martin Grund > Support Query Execution Progress Messages >

[jira] [Resolved] (SPARK-47577) Spark core: Migrate logError with variables to structured logging framework

2024-04-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47577. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45834

[jira] [Updated] (SPARK-47725) Set up the CI for pyspark-connect package

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47725: --- Labels: pull-request-available (was: ) > Set up the CI for pyspark-connect package >

[jira] [Created] (SPARK-47725) Set up the CI for pyspark-connect package

2024-04-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47725: Summary: Set up the CI for pyspark-connect package Key: SPARK-47725 URL: https://issues.apache.org/jira/browse/SPARK-47725 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47724) Add an environment variable for testing remote pure Python library

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47724. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45868

[jira] [Assigned] (SPARK-47724) Add an environment variable for testing remote pure Python library

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47724: Assignee: Hyukjin Kwon > Add an environment variable for testing remote pure Python

[jira] [Updated] (SPARK-47724) Add an environment variable for testing remote pure Python library

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47724: --- Labels: pull-request-available (was: ) > Add an environment variable for testing remote

[jira] [Created] (SPARK-47724) Add an environment variable for testing remote pure Python library

2024-04-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47724: Summary: Add an environment variable for testing remote pure Python library Key: SPARK-47724 URL: https://issues.apache.org/jira/browse/SPARK-47724 Project: Spark

[jira] [Resolved] (SPARK-47683) Separate pure Python packaging

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47683. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45053

[jira] [Assigned] (SPARK-47683) Separate pure Python packaging

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47683: Assignee: Hyukjin Kwon > Separate pure Python packaging > --

[jira] [Assigned] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47720: - Assignee: Dongjoon Hyun > Update `spark.speculation.multiplier` to 3 and

[jira] [Resolved] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47720. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45858

[jira] [Resolved] (SPARK-47708) Do not log the gRPC exception to stderr in PySpark

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47708. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45840

[jira] [Updated] (SPARK-47716) SQLQueryTestSuite flaky case due to view name conflict

2024-04-03 Thread Jack Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Chen updated SPARK-47716: -- Description: In SQLQueryTestSuite, the test case "Test logic for determining whether a query is

[jira] [Assigned] (SPARK-47210) Addition of implicit casting without indeterminate support

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47210: --- Assignee: Mihailo Milosevic > Addition of implicit casting without indeterminate support >

[jira] [Resolved] (SPARK-47210) Addition of implicit casting without indeterminate support

2024-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47210. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45383

[jira] [Resolved] (SPARK-47721) Guidelines for the Structured Logging Framework

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47721. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45862

[jira] [Assigned] (SPARK-47722) Wait until RocksDB background work finish before closing

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47722: Assignee: Wei Liu > Wait until RocksDB background work finish before closing >

[jira] [Resolved] (SPARK-47722) Wait until RocksDB background work finish before closing

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47722. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45863

[jira] [Assigned] (SPARK-47700) Fix formatting of error messages with treeNode

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47700: Assignee: Jack Chen > Fix formatting of error messages with treeNode >

[jira] [Resolved] (SPARK-47700) Fix formatting of error messages with treeNode

2024-04-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47700. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45825

[jira] [Resolved] (SPARK-47705) Sort LogKey alphabetically

2024-04-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47705. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45857

[jira] [Assigned] (SPARK-47705) Sort LogKey alphabetically

2024-04-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47705: -- Assignee: Daniel > Sort LogKey alphabetically > -- > >

[jira] [Updated] (SPARK-47722) Wait until RocksDB background work finish before closing

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47722: --- Labels: pull-request-available (was: ) > Wait until RocksDB background work finish before

[jira] [Created] (SPARK-47722) Wait until RocksDB background work finish before closing

2024-04-03 Thread Wei Liu (Jira)
Wei Liu created SPARK-47722: --- Summary: Wait until RocksDB background work finish before closing Key: SPARK-47722 URL: https://issues.apache.org/jira/browse/SPARK-47722 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47721) Guidelines for the Structured Logging Framework

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47721: --- Labels: pull-request-available (was: ) > Guidelines for the Structured Logging Framework >

[jira] [Created] (SPARK-47721) Guidelines for the Structured Logging Framework

2024-04-03 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47721: -- Summary: Guidelines for the Structured Logging Framework Key: SPARK-47721 URL: https://issues.apache.org/jira/browse/SPARK-47721 Project: Spark Issue

[jira] [Updated] (SPARK-47719) Change default of spark.sql.legacy.timeParserPolicy from EXCEPTION to CORRECTED

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47719: --- Labels: pull-request-available (was: ) > Change default of

[jira] [Updated] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47720: --- Labels: pull-request-available (was: ) > Update `spark.speculation.multiplier` to 3 and

[jira] [Updated] (SPARK-47705) Sort LogKey alphabetically

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47705: --- Labels: pull-request-available (was: ) > Sort LogKey alphabetically >

[jira] [Created] (SPARK-47719) Change default of spark.sql.legacy.timeParserPolicy from EXCEPTION to CORRECTED

2024-04-03 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-47719: Summary: Change default of spark.sql.legacy.timeParserPolicy from EXCEPTION to CORRECTED Key: SPARK-47719 URL: https://issues.apache.org/jira/browse/SPARK-47719

[jira] [Assigned] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47710: - Assignee: Kent Yao > Postgres: Document Mapping Spark SQL Data Types from PostgreSQL >

[jira] [Resolved] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47710. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45845

[jira] [Updated] (SPARK-47714) Set spark.sql.legacy.timeParserPolicy to CORRECTED by default

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47714: -- Summary: Set spark.sql.legacy.timeParserPolicy to CORRECTED by default (was: set

[jira] [Created] (SPARK-47718) .sql() does not recognize watermark defined upstream

2024-04-03 Thread Chloe He (Jira)
Chloe He created SPARK-47718: Summary: .sql() does not recognize watermark defined upstream Key: SPARK-47718 URL: https://issues.apache.org/jira/browse/SPARK-47718 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-47711) Parameterize JDBC Drivers for docker integration tests

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47711. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45847

[jira] [Commented] (SPARK-32821) cannot group by with window in sql statement for structured streaming with watermark

2024-04-03 Thread Chloe He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833662#comment-17833662 ] Chloe He commented on SPARK-32821: -- Hi All - I'm trying to do something similar here. I tried creating

[jira] [Created] (SPARK-47717) Support Hive tables as a streaming source and sink

2024-04-03 Thread Adi Suresh (Jira)
Adi Suresh created SPARK-47717: -- Summary: Support Hive tables as a streaming source and sink Key: SPARK-47717 URL: https://issues.apache.org/jira/browse/SPARK-47717 Project: Spark Issue Type:

[jira] [Created] (SPARK-47716) SQLQueryTestSuite flaky case due to view name conflict

2024-04-03 Thread Jack Chen (Jira)
Jack Chen created SPARK-47716: - Summary: SQLQueryTestSuite flaky case due to view name conflict Key: SPARK-47716 URL: https://issues.apache.org/jira/browse/SPARK-47716 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47716) SQLQueryTestSuite flaky case due to view name conflict

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47716: --- Labels: pull-request-available (was: ) > SQLQueryTestSuite flaky case due to view name

[jira] [Updated] (SPARK-47714) set spark.sql.legacy.timeParserPolicy to CORRECTED by default

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47714: --- Labels: pull-request-available (was: ) > set spark.sql.legacy.timeParserPolicy to

[jira] [Created] (SPARK-47714) set spark.sql.legacy.timeParserPolicy to CORRECTED by default

2024-04-03 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47714: --- Summary: set spark.sql.legacy.timeParserPolicy to CORRECTED by default Key: SPARK-47714 URL: https://issues.apache.org/jira/browse/SPARK-47714 Project: Spark

[jira] [Resolved] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47707. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45835

[jira] [Assigned] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47707: Assignee: 王俊博 > Special handling of JSON type for MySQL Connector/J 5.x >

[jira] [Updated] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44050: --- Labels: pull-request-available (was: ) > Unable to Mount ConfigMap in Driver Pod -

[jira] [Updated] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47710: --- Labels: pull-request-available (was: ) > Postgres: Document Mapping Spark SQL Data Types

[jira] [Created] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

2024-04-03 Thread Kent Yao (Jira)
Kent Yao created SPARK-47710: Summary: Postgres: Document Mapping Spark SQL Data Types from PostgreSQL Key: SPARK-47710 URL: https://issues.apache.org/jira/browse/SPARK-47710 Project: Spark

[jira] [Updated] (SPARK-47709) Upgrade tink to 1.13.0

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47709: --- Labels: pull-request-available (was: ) > Upgrade tink to 1.13.0 > -- >

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: Apache Spark > StringLocate > > > Key:

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: (was: Apache Spark) > StringLocate > > >

[jira] [Updated] (SPARK-47694) Make max message size configurable on client side

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47694: --- Labels: pull-request-available (was: ) > Make max message size configurable on client side

[jira] [Created] (SPARK-47709) Upgrade tink to 1.13.0

2024-04-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-47709: Summary: Upgrade tink to 1.13.0 Key: SPARK-47709 URL: https://issues.apache.org/jira/browse/SPARK-47709 Project: Spark Issue Type: Improvement Components:

[jira] [Updated] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47707: --- Labels: pull-request-available (was: ) > Special handling of JSON type for MySQL

[jira] [Updated] (SPARK-47708) Do not log the exception to stderr in PySpark

2024-04-03 Thread Nemanja Boric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemanja Boric updated SPARK-47708: -- Description: Currently if there's any exc (was: Currently SparkConnect only validates that

[jira] [Updated] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47707: Summary: Special handling of JSON type for MySQL Connector/J 5.x (was: Special handling of JSON type for MySQL

[jira] [Resolved] (SPARK-47380) Validate the spark connect session on server side

2024-04-03 Thread Nemanja Boric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemanja Boric resolved SPARK-47380. --- Resolution: Fixed > Validate the spark connect session on server side >

[jira] [Created] (SPARK-47708) Do not log the exception to stderr in PySpark

2024-04-03 Thread Nemanja Boric (Jira)
Nemanja Boric created SPARK-47708: - Summary: Do not log the exception to stderr in PySpark Key: SPARK-47708 URL: https://issues.apache.org/jira/browse/SPARK-47708 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47707) Special handling of JSON type for MySQL connector

2024-04-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47707: Description: MySQL JDBC driver `mysql-connector-java-5.1.49.jar` converts JSON type into Types.CHAR with a

[jira] [Commented] (SPARK-47707) Special handling of JSON type for MySQL connector

2024-04-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833445#comment-17833445 ] 王俊博 commented on SPARK-47707: - https://github.com/apache/spark/pull/45835 > Special handling of JSON type

[jira] [Updated] (SPARK-47707) Special handling of JSON type for MySQL connector

2024-04-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47707: Description: MySQL JDBC drivers `mysql-connector-java-5.1.49.jar` converts JSON type into Types.CHAR with a

[jira] [Updated] (SPARK-47707) Special handling of JSON type for MySQL connector

2024-04-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47707: Description: MySQL JDBC drivers `mysql-connector-java-5.1.49.jar` converts JSON type into Types.CHAR with a

[jira] [Updated] (SPARK-47707) Special handling of JSON type for MySQL connector

2024-04-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47707: Description: MySQL JDBC drivers `mysql-connector-java-5.1.49.jar` converts JSON type into Types.CHAR with a

[jira] [Created] (SPARK-47707) Special handling of JSON type for MySQL connector

2024-04-03 Thread Jira
王俊博 created SPARK-47707: --- Summary: Special handling of JSON type for MySQL connector Key: SPARK-47707 URL: https://issues.apache.org/jira/browse/SPARK-47707 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47653) Add support for negative numbers with range scan encoder

2024-04-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47653. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45778

[jira] [Updated] (SPARK-47230) The column pruning is not working as expected for nested struct in an array

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47230: --- Labels: pull-request-available (was: ) > The column pruning is not working as expected for

[jira] [Updated] (SPARK-47706) Bump json4s 4.0.7

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47706: --- Labels: pull-request-available (was: ) > Bump json4s 4.0.7 > - > >

[jira] [Updated] (SPARK-47598) MLLib: Migrate logError with variables to structured logging framework

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47598: --- Labels: pull-request-available (was: ) > MLLib: Migrate logError with variables to

[jira] [Updated] (SPARK-47702) Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node.

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47702: --- Labels: pull-request-available (was: ) > Shuffle service endpoint is not removed from the

[jira] [Created] (SPARK-47705) Sort LogKey alphabetically

2024-04-03 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47705: -- Summary: Sort LogKey alphabetically Key: SPARK-47705 URL: https://issues.apache.org/jira/browse/SPARK-47705 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-43362) Special handling of JSON type for MySQL connector

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43362: --- Labels: pull-request-available (was: ) > Special handling of JSON type for MySQL connector

[jira] [Updated] (SPARK-47577) Spark core: Migrate logError with variables to structured logging framework

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47577: --- Labels: pull-request-available (was: ) > Spark core: Migrate logError with variables to

[jira] [Updated] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDat

2024-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47704: --- Labels: pull-request-available (was: ) > JSON parsing fails with

[jira] [Updated] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDat

2024-04-03 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-47704: - Description: When reading the following JSON \{"a":[{"key":{"b":0}}]}:  {code:java} val df =