[jira] [Resolved] (SPARK-47611) Cleanup dead code in MySQLDialect.getCatalystType

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47611. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45734 [https

[jira] [Resolved] (SPARK-47491) Re-enable `driver log links` test in YarnClusterSuite

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47491. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45618 [https

[jira] [Resolved] (ORC-1665) Enable the `importOrder` function in `spotless-maven-plugin`

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1665. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1860 [https

[jira] [Assigned] (ORC-1665) Enable the `importOrder` function in `spotless-maven-plugin`

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1665: -- Assignee: dzcxzl > Enable the `importOrder` function in `spotless-maven-plu

[jira] [Resolved] (ORC-1666) Remove extra newlines at the end of Java files

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1666. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1861 [https

[jira] [Assigned] (ORC-1666) Remove extra newlines at the end of Java files

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1666: -- Assignee: dzcxzl > Remove extra newlines at the end of Java fi

[jira] [Assigned] (ORC-1664) Enable the removeUnusedImports function in spotless-maven-plugin

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1664: -- Assignee: dzcxzl > Enable the removeUnusedImports function in spotless-maven-plu

[jira] [Resolved] (ORC-1664) Enable the removeUnusedImports function in spotless-maven-plugin

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1664. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1859 [https

[jira] [Updated] (SPARK-47555) Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Summary: Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

[jira] [Assigned] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47555: - Assignee: xleoken > Record necessary raw exception log when loadTa

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Record necessary

[jira] [Resolved] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47555. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45711 [https

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Record necessary

[jira] [Assigned] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47561: - Assignee: Wenchen Fan > fix analyzer rule order issues about Al

[jira] [Resolved] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47561. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45718 [https

[jira] [Resolved] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47544. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45700 [https

[jira] [Assigned] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47544: - Assignee: Niranjan Jayakar > [Pyspark] SparkSession builder method is incompati

[jira] [Assigned] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47557: - Assignee: Kent Yao > Audit MySQL ENUM/SET Ty

[jira] [Resolved] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47557. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45713 [https

[jira] [Updated] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47549: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove Spark 3.0~

[jira] [Assigned] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47552: - Assignee: Dongjoon Hyun > Set spark.hadoop.fs.s3a.connection.establish.timeout to

[jira] [Resolved] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47552. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45710 [https

[jira] [Created] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

2024-03-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47552: - Summary: Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s Key: SPARK-47552 URL: https://issues.apache.org/jira/browse/SPARK-47552 Project: Spark

[jira] [Updated] (SPARK-47550) Update kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47550: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Upd

[jira] [Updated] (SPARK-47550) Upgrade kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47550: -- Summary: Upgrade kubernetes-client to 6.11.0 (was: Update kubernetes-client to 6.11.0

[jira] [Resolved] (SPARK-47550) Update kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47550. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45707 [https

[jira] [Assigned] (SPARK-47550) Update kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47550: - Assignee: Bjørn Jørgensen > Update kubernetes-client to 6.1

[jira] [Assigned] (SPARK-47548) Remove unused `commons-beanutils` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47548: - Assignee: Dongjoon Hyun > Remove unused `commons-beanutils` depende

[jira] [Resolved] (SPARK-47548) Remove unused `commons-beanutils` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47548. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45705 [https

[jira] [Created] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

2024-03-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47549: - Summary: Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts Key: SPARK-47549 URL: https://issues.apache.org/jira/browse/SPARK-47549 Project

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46743: -- Labels: correctness pull-request-available (was: pull-request-available) > Count

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46743: -- Component/s: SQL (was: Optimizer) > Count bug introduced for sca

[jira] [Created] (SPARK-47548) Remove unused `commons-beanutils` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47548: - Summary: Remove unused `commons-beanutils` dependency Key: SPARK-47548 URL: https://issues.apache.org/jira/browse/SPARK-47548 Project: Spark Issue Type

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830566#comment-17830566 ] Dongjoon Hyun commented on SPARK-42452: --- This was resolved via https://github.com/apache/spark

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47503: -- Fix Version/s: 3.4.3 > Spark history sever fails to display query for cached JDBC relat

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Fix Version/s: 3.4.3 > Use MySQL Connector/J for MySQL DB instead of MariaDB Connecto

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Affects Version/s: 3.5.1 (was: 3.5.2) > Use MySQL Connecto

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Fix Version/s: 3.5.2 > Use MySQL Connector/J for MySQL DB instead of MariaDB Connecto

Re: [DISCUSS] MySQL version support policy

2024-03-25 Thread Dongjoon Hyun
Hi, Cheng. Thank you for the suggestion. Your suggestion seems to have at least two themes. A. Adding a new Apache Spark community policy (contract) to guarantee MySQL LTS Versions Support. B. Dropping the support of non-LTS version support (MySQL 8.3/8.2/8.1) And, it brings me three questions.

Re: [DISCUSS] MySQL version support policy

2024-03-25 Thread Dongjoon Hyun
Hi, Cheng. Thank you for the suggestion. Your suggestion seems to have at least two themes. A. Adding a new Apache Spark community policy (contract) to guarantee MySQL LTS Versions Support. B. Dropping the support of non-LTS version support (MySQL 8.3/8.2/8.1) And, it brings me three questions.

[jira] [Resolved] (SPARK-47538) Remove `commons-logging` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47538. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45687 [https

[jira] [Resolved] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47537. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45689 [https

[jira] [Assigned] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47537: - Assignee: Kent Yao > Use MySQL Connector/J for MySQL DB instead of MariaDB Connecto

[jira] [Created] (SPARK-47538) Remove `commons-logging` dependency

2024-03-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47538: - Summary: Remove `commons-logging` dependency Key: SPARK-47538 URL: https://issues.apache.org/jira/browse/SPARK-47538 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47536: - Assignee: Yang Jie > Upgrade jmock-junit5 to 2.1

[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47536: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jmock-jun

[jira] [Resolved] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47536. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45669 [https

[jira] [Resolved] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47535. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45686 [https

[jira] [Assigned] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47535: - Assignee: Dongjoon Hyun > Update `publish_snapshot.yml` to publish twice per

[jira] [Created] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

2024-03-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47535: - Summary: Update `publish_snapshot.yml` to publish twice per day Key: SPARK-47535 URL: https://issues.apache.org/jira/browse/SPARK-47535 Project: Spark

[jira] [Resolved] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47534. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45685 [https

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47534: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Move `o.a.s.vari

[jira] [Assigned] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47534: - Assignee: Dongjoon Hyun > Move `o.a.s.variant` to `o.a.s.types.vari

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47534: -- Description: {code} -package org.apache.spark.variant; +package

[jira] [Resolved] (SPARK-47533) Migrate scalafmt dialect to scala213

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47533. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45683 [https

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47503: -- Fix Version/s: 3.5.2 > Spark history sever fails to display query for cached JDBC relat

[jira] [Resolved] (SPARK-47528) Add UserDefinedType support to DataTypeUtils.canWrite

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47528. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45678 [https

[jira] [Assigned] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47526: - Assignee: BingKun Pan > Upgrade `netty` to 4.1.108.Final and `netty-tcnat

[jira] [Resolved] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47526. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45676 [https

[jira] [Resolved] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47503. --- Fix Version/s: 4.0.0 Assignee: alexey Resolution: Fixed This is resolved

[jira] [Resolved] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47497. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45657 [https

[jira] [Assigned] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47497: - Assignee: BingKun Pan > Make `to_csv` support the output of `array/struct/

[jira] [Resolved] (SPARK-47531) Upgrade Arrow to 15.0.2

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47531. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45682 [https

[jira] [Resolved] (SPARK-47530) Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47530. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45681 [https

[jira] [Updated] (SPARK-47531) Upgrade Arrow to 15.0.2

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47531: -- Summary: Upgrade Arrow to 15.0.2 (was: Upgrade `Arrow` to 15.0.2) > Upgrade Arrow to 15.

[jira] [Updated] (SPARK-47531) Upgrade `Arrow` to 15.0.2

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47531: -- Parent Issue: SPARK-44111 (was: SPARK-47046) > Upgrade `Arrow` to 15.

[jira] [Updated] (SPARK-47531) Upgrade `Arrow` to 15.0.2

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47531: -- Summary: Upgrade `Arrow` to 15.0.2 (was: Upgrade `arrow-memory-netty` to 15.0.2) > Upgr

[jira] [Updated] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46411: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Change to use bcp

[jira] [Assigned] (SPARK-47530) Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47530: - Assignee: Dongjoon Hyun > Add `bcpkix-jdk18on` test dependencies to `hive` mod

[jira] [Updated] (SPARK-47530) Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47530: -- Summary: Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0 (was: Add

[jira] [Updated] (SPARK-47530) Add `org.bouncycastle` test dependencies to `hive` module for Hadoop 3.4.0

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47530: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Add `org.bouncycastle` t

[jira] [Created] (SPARK-47530) Add `org.bouncycastle` test dependencies to `hive` module for Hadoop 3.4.0

2024-03-23 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47530: - Summary: Add `org.bouncycastle` test dependencies to `hive` module for Hadoop 3.4.0 Key: SPARK-47530 URL: https://issues.apache.org/jira/browse/SPARK-47530 Project

[jira] [Updated] (SPARK-45781) Upgrade Arrow to 14.0.0

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45781: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade Ar

[jira] [Updated] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46718: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade Ar

[jira] [Updated] (SPARK-47529) Use hadoop 3.4.0 in some docs

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47529: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use hadoop 3.

[jira] [Assigned] (SPARK-47529) Use hadoop 3.4.0 in some docs

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47529: - Assignee: BingKun Pan > Use hadoop 3.4.0 in some d

[jira] [Resolved] (SPARK-47529) Use hadoop 3.4.0 in some docs

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47529. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45679 [https

[jira] [Assigned] (SPARK-47495) Primary resource jar added to spark.jars twice under k8s cluster mode

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47495: - Assignee: Jiale Tan > Primary resource jar added to spark.jars twice under k8s clus

[jira] [Resolved] (SPARK-47495) Primary resource jar added to spark.jars twice under k8s cluster mode

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47495. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45607 [https

[jira] [Assigned] (SPARK-47510) Fix `DSTREAM` label pattern in `labeler.yml`

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47510: - Assignee: Dongjoon Hyun > Fix `DSTREAM` label pattern in `labeler.

[jira] [Resolved] (SPARK-47510) Fix `DSTREAM` label pattern in `labeler.yml`

2024-03-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47510. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45648 [https

[jira] [Resolved] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47522. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45666 [https

[jira] [Assigned] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47522: - Assignee: Kent Yao > Read MySQL FLOAT as FloatType to keep consistent with the wr

[jira] [Commented] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829949#comment-17829949 ] Dongjoon Hyun commented on SPARK-47521: --- FYI, [~maheshk114], `Target Version` field is reserved

[jira] [Updated] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47521: -- Target Version/s: (was: 4.0.0) > Use `Utils.tryWithResource` during reading shuffle d

[jira] [Updated] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47521: -- Summary: Use `Utils.tryWithResource` during reading shuffle data from external storage

[jira] [Updated] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47521: -- Issue Type: Bug (was: Improvement) > Fix file handle leakage during shuffle data read f

[jira] [Resolved] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47521. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution

[jira] [Assigned] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47521: - Assignee: mahesh kumar behera > Fix file handle leakage during shuffle data read f

[jira] [Resolved] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47523. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45668 [https

[jira] [Assigned] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47523: - Assignee: Yang Jie > Replace Deprecated `JsonParser#getCurrentName` with `JsonPar

[jira] [Resolved] (ORC-1663) [C++] Enable TestTimezone.testMissingTZDB on Windows

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1663. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1856 [https

[jira] [Assigned] (SPARK-47499) Reuse `test_help_command` in Connect

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47499: - Assignee: Ruifeng Zheng > Reuse `test_help_command` in Conn

[jira] [Resolved] (SPARK-47499) Reuse `test_help_command` in Connect

2024-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47499. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45634 [https

[jira] [Updated] (SPARK-47513) Regenerate benchmark results

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47513: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Regenerate benchmark resu

[jira] [Resolved] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47514. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45637 [https

[jira] [Assigned] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47514: - Assignee: BingKun Pan > Add a test coverage for createTable method (partitioned-ta

[jira] [Resolved] (SPARK-47513) Regenerate benchmark results

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47513. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45654 [https

[jira] [Assigned] (SPARK-47513) Regenerate benchmark results

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47513: - Assignee: Dongjoon Hyun > Regenerate benchmark resu

[jira] [Created] (SPARK-47513) Regenerate benchmark results

2024-03-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47513: - Summary: Regenerate benchmark results Key: SPARK-47513 URL: https://issues.apache.org/jira/browse/SPARK-47513 Project: Spark Issue Type: Task

<    3   4   5   6   7   8   9   10   11   12   >