[jira] [Updated] (SPARK-47714) Set spark.sql.legacy.timeParserPolicy to CORRECTED by default

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47714: -- Summary: Set spark.sql.legacy.timeParserPolicy to CORRECTED by default (was: set

[jira] [Resolved] (SPARK-47711) Parameterize JDBC Drivers for docker integration tests

2024-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47711. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45847

[jira] [Resolved] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47691. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45815

[jira] [Assigned] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47691: - Assignee: Kent Yao > Postgres: Support multi dimensional array on the write side >

[jira] [Resolved] (SPARK-47697) Add scala style check for invalid MDC usage

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47697. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45823

[jira] [Updated] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46793: -- Parent: (was: SPARK-44124) Issue Type: Bug (was: Sub-task) > Revert S3A endpoint

[jira] [Created] (SPARK-47695) Update AWS SDK v2 to 2.24.6

2024-04-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47695: - Summary: Update AWS SDK v2 to 2.24.6 Key: SPARK-47695 URL: https://issues.apache.org/jira/browse/SPARK-47695 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47686: - Assignee: Yang Jie > Use `=!=` instead of `!==` in `JoinHintSuite` >

[jira] [Resolved] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47686. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45812

[jira] [Resolved] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47679. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45804

[jira] [Updated] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47679: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use

[jira] [Created] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47679: - Summary: Use `HiveConf.getConfVars` or Hive conf names directly Key: SPARK-47679 URL: https://issues.apache.org/jira/browse/SPARK-47679 Project: Spark

[jira] [Resolved] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47676. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47676: - Assignee: Dongjoon Hyun > Clean up the removed `VersionsSuite` references >

[jira] [Created] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47676: - Summary: Clean up the removed `VersionsSuite` references Key: SPARK-47676 URL: https://issues.apache.org/jira/browse/SPARK-47676 Project: Spark Issue

[jira] [Resolved] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47675. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45799

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: SPARK-36014) > [K8] Spark App ID collision resulting in deleting

[jira] [Closed] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47556. - > [K8] Spark App ID collision resulting in deleting wrong resources >

[jira] [Resolved] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47556. --- Fix Version/s: SPARK-36014 Resolution: Duplicate > [K8] Spark App ID collision

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: 3.3.0) > [K8] Spark App ID collision resulting in deleting wrong

[jira] [Reopened] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-47556: --- > [K8] Spark App ID collision resulting in deleting wrong resources >

[jira] [Updated] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47675: -- Summary: Use AWS SDK v2 2.23.19 in K8s IT (was: Remove `aws.java.sdk.v2.version` property in

[jira] [Updated] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47675: -- Component/s: Kubernetes Tests > Remove `aws.java.sdk.v2.version` property in

[jira] [Assigned] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47675: - Assignee: Dongjoon Hyun > Remove `aws.java.sdk.v2.version` property in pom.xml >

[jira] [Created] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47675: - Summary: Remove `aws.java.sdk.v2.version` property in pom.xml Key: SPARK-47675 URL: https://issues.apache.org/jira/browse/SPARK-47675 Project: Spark Issue

[jira] [Resolved] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47674. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45798

[jira] [Assigned] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47674: - Assignee: Dongjoon Hyun > Enable `spark.metrics.appStatusSource.enabled` by default >

[jira] [Created] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47674: - Summary: Enable `spark.metrics.appStatusSource.enabled` by default Key: SPARK-47674 URL: https://issues.apache.org/jira/browse/SPARK-47674 Project: Spark

[jira] [Updated] (SPARK-47645) Make Spark build with -release instead of -target

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47645: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Make Spark build with

[jira] [Assigned] (SPARK-47645) Make Spark build with -release instead of -target

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47645: - Assignee: Yang Jie > Make Spark build with -release instead of -target >

[jira] [Resolved] (SPARK-47645) Make Spark build with -release instead of -target

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47645. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45716

[jira] [Resolved] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47662. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45787

[jira] [Assigned] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47662: - Assignee: Kent Yao > Document Mapping Spark SQL Data Types to MySQL >

[jira] [Resolved] (SPARK-47658) Upgrade `tink` to 1.12.0

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47658. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45783

[jira] [Resolved] (SPARK-47656) Upgrade commons-io to 2.16.0

2024-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47656. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45781

[jira] [Resolved] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`

2024-03-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47648. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45774

[jira] [Assigned] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`

2024-03-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47648: - Assignee: BingKun Pan > Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite`

[jira] [Assigned] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres

2024-03-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47647: - Assignee: Kent Yao > Make MySQL data source be able to read bit(n>1) as BinaryType

[jira] [Resolved] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres

2024-03-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47647. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45773

[jira] [Resolved] (SPARK-47642) Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5`

2024-03-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47642. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45767

[jira] [Resolved] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47636. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45762

[jira] [Resolved] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47635. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45761

[jira] [Created] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47636: - Summary: Use Java 17 instead of 17-jre image in K8s Dockerfile Key: SPARK-47636 URL: https://issues.apache.org/jira/browse/SPARK-47636 Project: Spark

[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47635: -- Affects Version/s: (was: 3.5.0) (was: 3.5.1) > Use Java 21

[jira] [Assigned] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47635: - Assignee: Dongjoon Hyun > Use Java 21 instead of 21-jre in K8s Dockerfile >

[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47635: -- Affects Version/s: 3.5.1 3.5.0 > Use Java 21 instead of 21-jre in K8s

[jira] [Created] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

2024-03-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47635: - Summary: Use Java 21 instead of 21-jre in K8s Dockerfile Key: SPARK-47635 URL: https://issues.apache.org/jira/browse/SPARK-47635 Project: Spark Issue

[jira] [Resolved] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47632. --- Fix Version/s: 4.0.0 Resolution: Fixed This is resolved via

[jira] [Assigned] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47632: - Assignee: Dongjoon Hyun > Ban `com.amazonaws:aws-java-sdk-bundle` dependency >

[jira] [Created] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

2024-03-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47632: - Summary: Ban `com.amazonaws:aws-java-sdk-bundle` dependency Key: SPARK-47632 URL: https://issues.apache.org/jira/browse/SPARK-47632 Project: Spark Issue

[jira] [Created] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method

2024-03-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47631: - Summary: Remove unused `SQLConf.parquetOutputCommitterClass` method Key: SPARK-47631 URL: https://issues.apache.org/jira/browse/SPARK-47631 Project: Spark

[jira] [Resolved] (SPARK-47630) Upgrade `zstd-jni` to 1.5.6-1

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47630. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45756

[jira] [Updated] (SPARK-47475) Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47475: -- Summary: Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode (was:

[jira] [Assigned] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47628: - Assignee: Kent Yao > Fix Postgres bit array issue 'Cannot cast to boolean' >

[jira] [Resolved] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

2024-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47628. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45751

[jira] [Updated] (SPARK-47618) Use Magic Committer for all S3 buckets by default

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47618: -- Description: This issue aims to use Apache Hadoop `Magic Committer` for all S3 buckets by

[jira] [Assigned] (SPARK-47618) Use Magic Committer for all S3 buckets by default

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47618: - Assignee: Dongjoon Hyun > Use Magic Committer for all S3 buckets by default >

[jira] [Created] (SPARK-47618) Use Magic Committer for all S3 buckets by default

2024-03-27 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47618: - Summary: Use Magic Committer for all S3 buckets by default Key: SPARK-47618 URL: https://issues.apache.org/jira/browse/SPARK-47618 Project: Spark Issue

[jira] [Resolved] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47616. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45736

[jira] [Assigned] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47616: - Assignee: Kent Yao > Document Mapping Spark SQL Data Types from MySQL >

[jira] [Resolved] (SPARK-47611) Cleanup dead code in MySQLDialect.getCatalystType

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47611. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45734

[jira] [Resolved] (SPARK-47491) Re-enable `driver log links` test in YarnClusterSuite

2024-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47491. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45618

[jira] [Updated] (SPARK-47555) Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Summary: Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

[jira] [Assigned] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47555: - Assignee: xleoken > Record necessary raw exception log when loadTable >

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Record necessary raw

[jira] [Resolved] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47555. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45711

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Record necessary raw

[jira] [Assigned] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47561: - Assignee: Wenchen Fan > fix analyzer rule order issues about Alias >

[jira] [Resolved] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47561. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45718

[jira] [Resolved] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47544. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45700

[jira] [Assigned] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47544: - Assignee: Niranjan Jayakar > [Pyspark] SparkSession builder method is incompatible

[jira] [Assigned] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47557: - Assignee: Kent Yao > Audit MySQL ENUM/SET Types > -- > >

[jira] [Resolved] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47557. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45713

[jira] [Updated] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47549: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove Spark 3.0~3.2

[jira] [Assigned] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47552: - Assignee: Dongjoon Hyun > Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

[jira] [Resolved] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47552. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45710

[jira] [Created] (SPARK-47552) Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

2024-03-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47552: - Summary: Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s Key: SPARK-47552 URL: https://issues.apache.org/jira/browse/SPARK-47552 Project: Spark

[jira] [Updated] (SPARK-47550) Update kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47550: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Update

[jira] [Updated] (SPARK-47550) Upgrade kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47550: -- Summary: Upgrade kubernetes-client to 6.11.0 (was: Update kubernetes-client to 6.11.0) >

[jira] [Resolved] (SPARK-47550) Update kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47550. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45707

[jira] [Assigned] (SPARK-47550) Update kubernetes-client to 6.11.0

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47550: - Assignee: Bjørn Jørgensen > Update kubernetes-client to 6.11.0 >

[jira] [Assigned] (SPARK-47548) Remove unused `commons-beanutils` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47548: - Assignee: Dongjoon Hyun > Remove unused `commons-beanutils` dependency >

[jira] [Resolved] (SPARK-47548) Remove unused `commons-beanutils` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47548. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45705

[jira] [Created] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

2024-03-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47549: - Summary: Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts Key: SPARK-47549 URL: https://issues.apache.org/jira/browse/SPARK-47549 Project:

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46743: -- Labels: correctness pull-request-available (was: pull-request-available) > Count bug

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46743: -- Component/s: SQL (was: Optimizer) > Count bug introduced for scalar

[jira] [Created] (SPARK-47548) Remove unused `commons-beanutils` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47548: - Summary: Remove unused `commons-beanutils` dependency Key: SPARK-47548 URL: https://issues.apache.org/jira/browse/SPARK-47548 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830566#comment-17830566 ] Dongjoon Hyun commented on SPARK-42452: --- This was resolved via

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47503: -- Fix Version/s: 3.4.3 > Spark history sever fails to display query for cached JDBC relation

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Fix Version/s: 3.4.3 > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J >

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Affects Version/s: 3.5.1 (was: 3.5.2) > Use MySQL Connector/J for

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47537: -- Fix Version/s: 3.5.2 > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J >

[jira] [Resolved] (SPARK-47538) Remove `commons-logging` dependency

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47538. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45687

[jira] [Resolved] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47537. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45689

[jira] [Assigned] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47537: - Assignee: Kent Yao > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

[jira] [Created] (SPARK-47538) Remove `commons-logging` dependency

2024-03-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47538: - Summary: Remove `commons-logging` dependency Key: SPARK-47538 URL: https://issues.apache.org/jira/browse/SPARK-47538 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47536: - Assignee: Yang Jie > Upgrade jmock-junit5 to 2.13.1 > -- >

[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47536: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jmock-junit5

[jira] [Resolved] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47536. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45669

[jira] [Resolved] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

2024-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47535. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45686

<    2   3   4   5   6   7   8   9   10   11   >