[jira] [Resolved] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres

[ https://issues.apache.org/jira/browse/SPARK-47647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47647. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45773 [https

[jira] [Resolved] (SPARK-47642) Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5`

[ https://issues.apache.org/jira/browse/SPARK-47642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47642. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45767 [https

[jira] [Resolved] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47636. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45762 [https

[jira] [Resolved] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47635. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45761 [https

[jira] [Created] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile

Dongjoon Hyun created SPARK-47636: - Summary: Use Java 17 instead of 17-jre image in K8s Dockerfile Key: SPARK-47636 URL: https://issues.apache.org/jira/browse/SPARK-47636 Project: Spark

[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47635: -- Affects Version/s: (was: 3.5.0) (was: 3.5.1) > Use Java

[jira] [Assigned] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47635: - Assignee: Dongjoon Hyun > Use Java 21 instead of 21-jre in K8s Dockerf

[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47635: -- Affects Version/s: 3.5.1 3.5.0 > Use Java 21 instead of 21-jre in

[jira] [Created] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

Dongjoon Hyun created SPARK-47635: - Summary: Use Java 21 instead of 21-jre in K8s Dockerfile Key: SPARK-47635 URL: https://issues.apache.org/jira/browse/SPARK-47635 Project: Spark Issue Type

[jira] [Resolved] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

[ https://issues.apache.org/jira/browse/SPARK-47632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47632. --- Fix Version/s: 4.0.0 Resolution: Fixed This is resolved via https://github.com

[jira] [Assigned] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

[ https://issues.apache.org/jira/browse/SPARK-47632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47632: - Assignee: Dongjoon Hyun > Ban `com.amazonaws:aws-java-sdk-bundle` depende

[jira] [Created] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

Dongjoon Hyun created SPARK-47632: - Summary: Ban `com.amazonaws:aws-java-sdk-bundle` dependency Key: SPARK-47632 URL: https://issues.apache.org/jira/browse/SPARK-47632 Project: Spark Issue

[jira] [Created] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method

Dongjoon Hyun created SPARK-47631: - Summary: Remove unused `SQLConf.parquetOutputCommitterClass` method Key: SPARK-47631 URL: https://issues.apache.org/jira/browse/SPARK-47631 Project: Spark

[jira] [Resolved] (SPARK-47630) Upgrade `zstd-jni` to 1.5.6-1

[ https://issues.apache.org/jira/browse/SPARK-47630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47630. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45756 [https

[jira] [Resolved] (ORC-1670) Upgrade `zstd-jni` to 1.5.6-1

[ https://issues.apache.org/jira/browse/ORC-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1670. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (ORC-1670) Upgrade `zstd-jni` to 1.5.6-1

[ https://issues.apache.org/jira/browse/ORC-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1670: -- Assignee: Dongjoon Hyun > Upgrade `zstd-jni` to 1.5.

[jira] [Created] (ORC-1670) Upgrade `zstd-jni` to 1.5.6-1

Dongjoon Hyun created ORC-1670: -- Summary: Upgrade `zstd-jni` to 1.5.6-1 Key: ORC-1670 URL: https://issues.apache.org/jira/browse/ORC-1670 Project: ORC Issue Type: Bug Components: Java

[jira] [Updated] (SPARK-47475) Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-47475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47475: -- Summary: Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode

Re: The dedicated repository for Kubernetes Operator for Apache Spark

Thank you, Liang-Chi! Dongjoon. On Wed, Mar 27, 2024 at 10:56 PM L. C. Hsieh wrote: > Hi all, > > For the passed SPIP: An Official Kubernetes Operator for Apache Spark, > the developers have been working on code cleaning and refactoring for > open source in the last few months. They are ready

[jira] [Assigned] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47628: - Assignee: Kent Yao > Fix Postgres bit array issue 'Cannot cast to bool

[jira] [Resolved] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47628. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45751 [https

[jira] [Updated] (SPARK-47618) Use Magic Committer for all S3 buckets by default

[ https://issues.apache.org/jira/browse/SPARK-47618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47618: -- Description: This issue aims to use Apache Hadoop `Magic Committer` for all S3 buckets

[jira] [Assigned] (SPARK-47618) Use Magic Committer for all S3 buckets by default

[ https://issues.apache.org/jira/browse/SPARK-47618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47618: - Assignee: Dongjoon Hyun > Use Magic Committer for all S3 buckets by defa

[jira] [Created] (SPARK-47618) Use Magic Committer for all S3 buckets by default

Dongjoon Hyun created SPARK-47618: - Summary: Use Magic Committer for all S3 buckets by default Key: SPARK-47618 URL: https://issues.apache.org/jira/browse/SPARK-47618 Project: Spark Issue

[jira] [Resolved] (ORC-1668) Add merge command to Java tools documentation

[ https://issues.apache.org/jira/browse/ORC-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1668. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (ORC-1668) Add merge command to Java tools documentation

[ https://issues.apache.org/jira/browse/ORC-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1668: -- Assignee: dzcxzl > Add merge command to Java tools documentat

[jira] [Resolved] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

[ https://issues.apache.org/jira/browse/SPARK-47616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47616. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45736 [https

[jira] [Assigned] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

[ https://issues.apache.org/jira/browse/SPARK-47616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47616: - Assignee: Kent Yao > Document Mapping Spark SQL Data Types from My

[jira] [Resolved] (SPARK-47611) Cleanup dead code in MySQLDialect.getCatalystType

[ https://issues.apache.org/jira/browse/SPARK-47611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47611. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45734 [https

[jira] [Resolved] (SPARK-47491) Re-enable `driver log links` test in YarnClusterSuite

[ https://issues.apache.org/jira/browse/SPARK-47491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47491. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45618 [https

[jira] [Resolved] (ORC-1665) Enable the `importOrder` function in `spotless-maven-plugin`

[ https://issues.apache.org/jira/browse/ORC-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1665. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1860 [https

[jira] [Assigned] (ORC-1665) Enable the `importOrder` function in `spotless-maven-plugin`

[ https://issues.apache.org/jira/browse/ORC-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1665: -- Assignee: dzcxzl > Enable the `importOrder` function in `spotless-maven-plu

[jira] [Resolved] (ORC-1666) Remove extra newlines at the end of Java files

[ https://issues.apache.org/jira/browse/ORC-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1666. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1861 [https

[jira] [Assigned] (ORC-1666) Remove extra newlines at the end of Java files

[ https://issues.apache.org/jira/browse/ORC-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1666: -- Assignee: dzcxzl > Remove extra newlines at the end of Java fi

[jira] [Assigned] (ORC-1664) Enable the removeUnusedImports function in spotless-maven-plugin

[ https://issues.apache.org/jira/browse/ORC-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1664: -- Assignee: dzcxzl > Enable the removeUnusedImports function in spotless-maven-plu

[jira] [Resolved] (ORC-1664) Enable the removeUnusedImports function in spotless-maven-plugin

[ https://issues.apache.org/jira/browse/ORC-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1664. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1859 [https

[jira] [Updated] (SPARK-47555) Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Summary: Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

[jira] [Assigned] (SPARK-47555) Record necessary raw exception log when loadTable

[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47555: - Assignee: xleoken > Record necessary raw exception log when loadTa

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Record necessary

[jira] [Resolved] (SPARK-47555) Record necessary raw exception log when loadTable

[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47555. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45711 [https

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Record necessary

[jira] [Assigned] (SPARK-47561) fix analyzer rule order issues about Alias

[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47561: - Assignee: Wenchen Fan > fix analyzer rule order issues about Al

[jira] [Resolved] (SPARK-47561) fix analyzer rule order issues about Alias

[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47561. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45718 [https

[jira] [Resolved] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47544. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45700 [https

[jira] [Assigned] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47544: - Assignee: Niranjan Jayakar > [Pyspark] SparkSession builder method is incompati

[jira] [Assigned] (SPARK-47557) Audit MySQL ENUM/SET Types

[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47557: - Assignee: Kent Yao > Audit MySQL ENUM/SET Ty

[jira] [Resolved] (SPARK-47557) Audit MySQL ENUM/SET Types

[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47557. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45713 [https

[jira] [Updated] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

[ https://issues.apache.org/jira/browse/SPARK-47549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47549: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove Spark 3.0~

[jira] [Assigned] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

[ https://issues.apache.org/jira/browse/SPARK-47552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47552: - Assignee: Dongjoon Hyun > Set spark.hadoop.fs.s3a.connection.establish.timeout to

[jira] [Resolved] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

[ https://issues.apache.org/jira/browse/SPARK-47552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47552. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45710 [https

[jira] [Created] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

Dongjoon Hyun created SPARK-47552: - Summary: Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s Key: SPARK-47552 URL: https://issues.apache.org/jira/browse/SPARK-47552 Project: Spark

[jira] [Updated] (SPARK-47550) Update kubernetes-client to 6.11.0

[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47550: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Upd

[jira] [Updated] (SPARK-47550) Upgrade kubernetes-client to 6.11.0

[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47550: -- Summary: Upgrade kubernetes-client to 6.11.0 (was: Update kubernetes-client to 6.11.0

[jira] [Resolved] (SPARK-47550) Update kubernetes-client to 6.11.0

[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47550. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45707 [https

[jira] [Assigned] (SPARK-47550) Update kubernetes-client to 6.11.0

[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47550: - Assignee: Bjørn Jørgensen > Update kubernetes-client to 6.1

[jira] [Assigned] (SPARK-47548) Remove unused `commons-beanutils` dependency

[ https://issues.apache.org/jira/browse/SPARK-47548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47548: - Assignee: Dongjoon Hyun > Remove unused `commons-beanutils` depende

[jira] [Resolved] (SPARK-47548) Remove unused `commons-beanutils` dependency

[ https://issues.apache.org/jira/browse/SPARK-47548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47548. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45705 [https

[jira] [Created] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

Dongjoon Hyun created SPARK-47549: - Summary: Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts Key: SPARK-47549 URL: https://issues.apache.org/jira/browse/SPARK-47549 Project

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46743: -- Labels: correctness pull-request-available (was: pull-request-available) > Count

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46743: -- Component/s: SQL (was: Optimizer) > Count bug introduced for sca

[jira] [Created] (SPARK-47548) Remove unused `commons-beanutils` dependency

Dongjoon Hyun created SPARK-47548: - Summary: Remove unused `commons-beanutils` dependency Key: SPARK-47548 URL: https://issues.apache.org/jira/browse/SPARK-47548 Project: Spark Issue Type

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830566#comment-17830566 ] Dongjoon Hyun commented on SPARK-42452: --- This was resolved via https://github.com/apache/spark

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47503: -- Fix Version/s: 3.4.3 > Spark history sever fails to display query for cached JDBC relat

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Fix Version/s: 3.4.3 > Use MySQL Connector/J for MySQL DB instead of MariaDB Connecto

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Affects Version/s: 3.5.1 (was: 3.5.2) > Use MySQL Connecto

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Fix Version/s: 3.5.2 > Use MySQL Connector/J for MySQL DB instead of MariaDB Connecto

Re: [DISCUSS] MySQL version support policy

Hi, Cheng. Thank you for the suggestion. Your suggestion seems to have at least two themes. A. Adding a new Apache Spark community policy (contract) to guarantee MySQL LTS Versions Support. B. Dropping the support of non-LTS version support (MySQL 8.3/8.2/8.1) And, it brings me three questions.

Re: [DISCUSS] MySQL version support policy

Hi, Cheng. Thank you for the suggestion. Your suggestion seems to have at least two themes. A. Adding a new Apache Spark community policy (contract) to guarantee MySQL LTS Versions Support. B. Dropping the support of non-LTS version support (MySQL 8.3/8.2/8.1) And, it brings me three questions.

[jira] [Resolved] (SPARK-47538) Remove `commons-logging` dependency

[ https://issues.apache.org/jira/browse/SPARK-47538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47538. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45687 [https

[jira] [Resolved] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47537. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45689 [https

[jira] [Assigned] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47537: - Assignee: Kent Yao > Use MySQL Connector/J for MySQL DB instead of MariaDB Connecto

[jira] [Created] (SPARK-47538) Remove `commons-logging` dependency

Dongjoon Hyun created SPARK-47538: - Summary: Remove `commons-logging` dependency Key: SPARK-47538 URL: https://issues.apache.org/jira/browse/SPARK-47538 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47536: - Assignee: Yang Jie > Upgrade jmock-junit5 to 2.1

[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47536: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jmock-jun

[jira] [Resolved] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47536. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45669 [https

[jira] [Resolved] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47535. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45686 [https

[jira] [Assigned] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47535: - Assignee: Dongjoon Hyun > Update `publish_snapshot.yml` to publish twice per

[jira] [Created] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

Dongjoon Hyun created SPARK-47535: - Summary: Update `publish_snapshot.yml` to publish twice per day Key: SPARK-47535 URL: https://issues.apache.org/jira/browse/SPARK-47535 Project: Spark

[jira] [Resolved] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47534. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45685 [https

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47534: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Move `o.a.s.vari

[jira] [Assigned] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47534: - Assignee: Dongjoon Hyun > Move `o.a.s.variant` to `o.a.s.types.vari

[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`

[ https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47534: -- Description: {code} -package org.apache.spark.variant; +package

[jira] [Resolved] (SPARK-47533) Migrate scalafmt dialect to scala213

[ https://issues.apache.org/jira/browse/SPARK-47533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47533. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45683 [https

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47503: -- Fix Version/s: 3.5.2 > Spark history sever fails to display query for cached JDBC relat

[jira] [Resolved] (SPARK-47528) Add UserDefinedType support to DataTypeUtils.canWrite

[ https://issues.apache.org/jira/browse/SPARK-47528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47528. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45678 [https

[jira] [Assigned] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47526: - Assignee: BingKun Pan > Upgrade `netty` to 4.1.108.Final and `netty-tcnat

[jira] [Resolved] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47526. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45676 [https

[jira] [Resolved] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47503. --- Fix Version/s: 4.0.0 Assignee: alexey Resolution: Fixed This is resolved

[jira] [Resolved] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47497. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45657 [https

[jira] [Assigned] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47497: - Assignee: BingKun Pan > Make `to_csv` support the output of `array/struct/

[jira] [Resolved] (SPARK-47531) Upgrade Arrow to 15.0.2

[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47531. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45682 [https

[jira] [Resolved] (SPARK-47530) Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47530. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45681 [https

[jira] [Updated] (SPARK-47531) Upgrade Arrow to 15.0.2

[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47531: -- Summary: Upgrade Arrow to 15.0.2 (was: Upgrade `Arrow` to 15.0.2) > Upgrade Arrow to 15.

[jira] [Updated] (SPARK-47531) Upgrade `Arrow` to 15.0.2

[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47531: -- Parent Issue: SPARK-44111 (was: SPARK-47046) > Upgrade `Arrow` to 15.

[jira] [Updated] (SPARK-47531) Upgrade `Arrow` to 15.0.2

[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47531: -- Summary: Upgrade `Arrow` to 15.0.2 (was: Upgrade `arrow-memory-netty` to 15.0.2) > Upgr

[jira] [Updated] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46411: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Change to use bcp

[jira] [Assigned] (SPARK-47530) Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47530: - Assignee: Dongjoon Hyun > Add `bcpkix-jdk18on` test dependencies to `hive` mod

[jira] [Updated] (SPARK-47530) Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47530: -- Summary: Add `bcpkix-jdk18on` test dependencies to `hive` module for Hadoop 3.4.0 (was: Add

[jira] [Updated] (SPARK-47530) Add `org.bouncycastle` test dependencies to `hive` module for Hadoop 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47530: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Add `org.bouncycastle` t

[jira] [Created] (SPARK-47530) Add `org.bouncycastle` test dependencies to `hive` module for Hadoop 3.4.0

Dongjoon Hyun created SPARK-47530: - Summary: Add `org.bouncycastle` test dependencies to `hive` module for Hadoop 3.4.0 Key: SPARK-47530 URL: https://issues.apache.org/jira/browse/SPARK-47530 Project

<    3   4   5   6   7   8   9   10   11   12   >