[jira] [Resolved] (SPARK-47507) Upgrade ORC to 1.9.3

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47507. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45646

[jira] [Created] (SPARK-47510) Fix `DSTREAM` label pattern in `labeler.yml`

2024-03-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47510: - Summary: Fix `DSTREAM` label pattern in `labeler.yml` Key: SPARK-47510 URL: https://issues.apache.org/jira/browse/SPARK-47510 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47505: - Assignee: BingKun Pan > Fix `pyspark-errors` test jobs for branch-3.4 >

[jira] [Resolved] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47505. --- Fix Version/s: 3.4.3 Resolution: Fixed Issue resolved by pull request 45624

[jira] [Commented] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829639#comment-17829639 ] Dongjoon Hyun commented on SPARK-47046: --- All known issues except SPARK-47018 are resolved as of

[jira] [Resolved] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47046. --- Fix Version/s: 4.0.0 Resolution: Fixed > Apache Spark 4.0.0 Dependency Audit and

[jira] [Assigned] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47046: - Assignee: Dongjoon Hyun > Apache Spark 4.0.0 Dependency Audit and Cleanup >

[jira] [Assigned] (SPARK-47487) simplify code in AnsiTypeCoercion

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47487: - Assignee: Wenchen Fan > simplify code in AnsiTypeCoercion >

[jira] [Resolved] (SPARK-47487) simplify code in AnsiTypeCoercion

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47487. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45612

[jira] [Resolved] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47501. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45638

[jira] [Assigned] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47501: - Assignee: Kent Yao > Add convertDateToDate like the existing

[jira] [Resolved] (SPARK-41888) Support StreamingQueryListener for DataFrame.observe

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41888. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45627

[jira] [Assigned] (SPARK-41888) Support StreamingQueryListener for DataFrame.observe

2024-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41888: - Assignee: Jiaan Geng > Support StreamingQueryListener for DataFrame.observe >

[jira] [Updated] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47008: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Spark to support S3

[jira] [Updated] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47008: -- Parent Issue: SPARK-44111 (was: SPARK-44124) > Spark to support S3 Express One Zone Storage

[jira] [Closed] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-46793. - > Revert S3A endpoint fixup logic of SPARK-35878 > -- >

[jira] [Resolved] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46793. --- Resolution: Duplicate > Revert S3A endpoint fixup logic of SPARK-35878 >

[jira] [Resolved] (SPARK-45721) Upgrade AWS SDK to v2 for Hadoop dependency

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45721. --- Resolution: Duplicate > Upgrade AWS SDK to v2 for Hadoop dependency >

[jira] [Closed] (SPARK-45721) Upgrade AWS SDK to v2 for Hadoop dependency

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-45721. - > Upgrade AWS SDK to v2 for Hadoop dependency > --- > >

[jira] [Assigned] (SPARK-47491) Re-enable `driver log links` test in YarnClusterSuite

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47491: - Assignee: Dongjoon Hyun > Re-enable `driver log links` test in YarnClusterSuite >

[jira] [Updated] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47054: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Remove pinned version of torch

[jira] [Resolved] (SPARK-47494) Add migration doc for the behavior change of Parquet timestamp inference since Spark 3.3

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47494. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Resolved] (SPARK-47490) Fix RocksDB Logger deprecation warning

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47490. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45616

[jira] [Assigned] (SPARK-47490) Fix RocksDB Logger deprecation warning

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47490: - Assignee: Anish Shrigondekar > Fix RocksDB Logger deprecation warning >

[jira] [Updated] (SPARK-47486) Remove unused private `ArrowDeserializers.getString` method

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47486: -- Summary: Remove unused private `ArrowDeserializers.getString` method (was: Remove unused

[jira] [Resolved] (SPARK-47486) Remove unused private method `getString` from `ArrowDeserializers`

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47486. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45610

[jira] [Updated] (SPARK-47490) Fix RocksDB Logger deprecation warning

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47490: -- Issue Type: Improvement (was: Task) > Fix RocksDB Logger deprecation warning >

[jira] [Resolved] (SPARK-45393) Upgrade Hadoop to 3.4.0

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45393. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45583

[jira] [Created] (SPARK-47491) Re-enable `driver log links` test in YarnClusterSuite

2024-03-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47491: - Summary: Re-enable `driver log links` test in YarnClusterSuite Key: SPARK-47491 URL: https://issues.apache.org/jira/browse/SPARK-47491 Project: Spark

[jira] [Resolved] (SPARK-47462) Align the mapping ways of other unsigned numeric types with TINYINT UNSGINED in MySQLDialect

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47462. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45588

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Affects Version/s: 4.0.0 (was: 3.2.0) > [k8s]Driver stuck when

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Component/s: Kubernetes (was: k8s) > [k8s]Driver stuck when thread pool

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Priority: Major (was: Critical) > [k8s]Driver stuck when thread pool is not shut down >

[jira] [Updated] (SPARK-47488) Driver stuck when thread pool is not shut down

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Summary: Driver stuck when thread pool is not shut down (was: [k8s]Driver stuck when thread

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Issue Type: Improvement (was: Bug) > [k8s]Driver stuck when thread pool is not shut down >

[jira] [Updated] (SPARK-47481) Fix Python linter

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47481: -- Issue Type: Task (was: Improvement) > Fix Python linter > - > >

[jira] [Updated] (SPARK-47481) Fix Python linter

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47481: -- Fix Version/s: 3.5.2 > Fix Python linter > - > > Key:

[jira] [Resolved] (SPARK-47481) Fix Python linter

2024-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47481. --- Fix Version/s: 3.4.3 Resolution: Fixed Issue resolved by pull request 45608

[jira] [Assigned] (SPARK-47472) Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47472: - Assignee: Dongjoon Hyun > Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile` >

[jira] [Resolved] (SPARK-47472) Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47472. --- Fix Version/s: 3.4.3 Resolution: Fixed Issue resolved by pull request 45595

[jira] [Created] (SPARK-47472) Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile`

2024-03-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47472: - Summary: Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile` Key: SPARK-47472 URL: https://issues.apache.org/jira/browse/SPARK-47472 Project: Spark Issue

[jira] [Resolved] (SPARK-47470) Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47470. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45597

[jira] [Assigned] (SPARK-47470) Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47470: - Assignee: Dongjoon Hyun > Ignore `IntentionallyFaultyConnectionProvider` error in

[jira] [Updated] (SPARK-47470) Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47470: -- Summary: Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite` (was: Make

[jira] [Created] (SPARK-47470) Make `CliSuite` ignores `IntentionallyFaultyConnectionProvider` error

2024-03-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47470: - Summary: Make `CliSuite` ignores `IntentionallyFaultyConnectionProvider` error Key: SPARK-47470 URL: https://issues.apache.org/jira/browse/SPARK-47470 Project:

[jira] [Comment Edited] (SPARK-44101) Support pandas 2

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828556#comment-17828556 ] Dongjoon Hyun edited comment on SPARK-44101 at 3/20/24 1:00 AM: I added

[jira] [Assigned] (SPARK-44101) Support pandas 2

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44101: - Assignee: Haejoon Lee > Support pandas 2 > > > Key:

[jira] [Updated] (SPARK-44101) Support pandas 2

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44101: -- Labels: releasenotes (was: ) > Support pandas 2 > > > Key:

[jira] [Commented] (SPARK-44101) Support pandas 2

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828556#comment-17828556 ] Dongjoon Hyun commented on SPARK-44101: --- I added `releasenotes` label to this JIRA. > Support

[jira] [Closed] (SPARK-44149) Support DataFrame Merge API

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-44149. - > Support DataFrame Merge API > --- > > Key: SPARK-44149 >

[jira] [Updated] (SPARK-46207) Support MergeInto in DataFrameWriterV2

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46207: -- Parent: SPARK-44111 Issue Type: Sub-task (was: New Feature) > Support MergeInto in

[jira] [Resolved] (SPARK-47468) Exclude `logback` dependency from SBT like Maven

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47468. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45594

[jira] [Updated] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47432: -- Fix Version/s: 3.4.3 > Add `pyarrow` upper bound requirement, `<13.0.0` >

[jira] [Resolved] (SPARK-47290) Extend CustomTaskMetric to allow metric values from multiple sources

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47290. --- Resolution: Invalid > Extend CustomTaskMetric to allow metric values from multiple sources

[jira] [Closed] (SPARK-47290) Extend CustomTaskMetric to allow metric values from multiple sources

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47290. - Sure. I closed this. > Extend CustomTaskMetric to allow metric values from multiple sources >

[jira] [Resolved] (SPARK-47464) Update labeler.yml

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47464. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45590

[jira] [Updated] (SPARK-47464) Update labeler.yml for module common/sketch and common/variant

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47464: -- Summary: Update labeler.yml for module common/sketch and common/variant (was: Update

[jira] [Updated] (SPARK-47468) Exclude `logback` dependency from SBT like Maven

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47468: -- Summary: Exclude `logback` dependency from SBT like Maven (was: Exclude `logback` from SBT

[jira] [Assigned] (SPARK-47468) Exclude `logback` from SBT dependency like Maven

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47468: - Assignee: Dongjoon Hyun > Exclude `logback` from SBT dependency like Maven >

[jira] [Created] (SPARK-47468) Exclude `logback` from SBT dependency like Maven

2024-03-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47468: - Summary: Exclude `logback` from SBT dependency like Maven Key: SPARK-47468 URL: https://issues.apache.org/jira/browse/SPARK-47468 Project: Spark Issue

[jira] [Resolved] (SPARK-47461) Remove unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47461. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45587

[jira] [Assigned] (SPARK-47461) Remove unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47461: - Assignee: Yang Jie > Remove unused private function

[jira] [Resolved] (ORC-1608) Upgrade Hadoop to 3.4.0

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1608. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1783

[jira] [Assigned] (ORC-1608) Upgrade Hadoop to 3.4.0

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1608: -- Assignee: Dongjoon Hyun > Upgrade Hadoop to 3.4.0 > --- > >

[jira] [Resolved] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4+

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47457. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45585

[jira] [Updated] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4+

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47457: -- Summary: Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4+ (was:

[jira] [Assigned] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47457: - Assignee: Dongjoon Hyun > Fix `IsolatedClientLoader.supportsHadoopShadedClient` to

[jira] [Updated] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47457: -- Component/s: SQL (was: Spark Core) > Fix

[jira] [Created] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

2024-03-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47457: - Summary: Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4 Key: SPARK-47457 URL: https://issues.apache.org/jira/browse/SPARK-47457

[jira] [Resolved] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47452. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45576

[jira] [Updated] (SPARK-47456) Support ORC Brotli codec

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47456: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support ORC Brotli

[jira] [Assigned] (SPARK-47456) Support ORC Brotli codec

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47456: - Assignee: dzcxzl > Support ORC Brotli codec > > >

[jira] [Resolved] (SPARK-47456) Support ORC Brotli codec

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47456. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45584

[jira] [Resolved] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47453. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45581

[jira] [Assigned] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47453: - Assignee: Kent Yao > Upgrade MySQL docker image version to 8.3.0 >

[jira] [Updated] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47452: -- Summary: Use `Ubuntu 22.04` in `dev/infra/Dockerfile` (was: Use Ubuntu 22.04 in

[jira] [Created] (SPARK-47452) Use Ubuntu 22.04 in `dev/infra/Dockerfile`

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47452: - Summary: Use Ubuntu 22.04 in `dev/infra/Dockerfile` Key: SPARK-47452 URL: https://issues.apache.org/jira/browse/SPARK-47452 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47450. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45574

[jira] [Resolved] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47448. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45572

[jira] [Updated] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45921: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use Hadoop 3.3.5

[jira] [Updated] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45995: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade R version from

[jira] [Assigned] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47448: - Assignee: Dongjoon Hyun > Enable spark.shuffle.service.removeShuffle by default >

[jira] [Created] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47448: - Summary: Enable spark.shuffle.service.removeShuffle by default Key: SPARK-47448 URL: https://issues.apache.org/jira/browse/SPARK-47448 Project: Spark

[jira] [Resolved] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47446. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45570

[jira] [Assigned] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47446: - Assignee: Dongjoon Hyun > Make `BlockManager` warn before `removeBlockInternal` >

[jira] [Created] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47446: - Summary: Make `BlockManager` warn before `removeBlockInternal` Key: SPARK-47446 URL: https://issues.apache.org/jira/browse/SPARK-47446 Project: Spark

[jira] [Updated] (SPARK-47383) Support `spark.shutdown.timeout` config

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47383: -- Summary: Support `spark.shutdown.timeout` config (was: Make the shutdown hook timeout

[jira] [Resolved] (SPARK-47383) Make the shutdown hook timeout configurable

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47383. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45504

[jira] [Assigned] (SPARK-47383) Make the shutdown hook timeout configurable

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47383: - Assignee: Rob Reeves > Make the shutdown hook timeout configurable >

[jira] [Assigned] (ORC-1660) Bump `checkstyle` to 10.14.2

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1660: -- Assignee: Dongjoon Hyun > Bump `checkstyle` to 10.14.2 > > >

[jira] [Resolved] (ORC-1660) Bump `checkstyle` to 10.14.2

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1660. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1854

[jira] [Created] (ORC-1660) Bump `checkstyle` to 10.14.2

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1660: -- Summary: Bump `checkstyle` to 10.14.2 Key: ORC-1660 URL: https://issues.apache.org/jira/browse/ORC-1660 Project: ORC Issue Type: Test Components: Java

[jira] [Assigned] (ORC-1659) Bump `guava` to 33.1.0-jre

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1659: -- Assignee: Dongjoon Hyun > Bump `guava` to 33.1.0-jre > -- > >

[jira] [Resolved] (ORC-1659) Bump `guava` to 33.1.0-jre

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1659. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1852

[jira] [Created] (ORC-1659) Bump `guava` to 33.1.0-jre

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1659: -- Summary: Bump `guava` to 33.1.0-jre Key: ORC-1659 URL: https://issues.apache.org/jira/browse/ORC-1659 Project: ORC Issue Type: Test Components: Java

[jira] [Resolved] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47442. --- Fix Version/s: 4.0.0 Assignee: wuyi Resolution: Fixed > Use port 0 to start

[jira] [Resolved] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47435. --- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > SPARK-45561

[jira] [Resolved] (SPARK-47438) Upgrade jackson to 2.17.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47438. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45562

[jira] [Updated] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47442: -- Reporter: wuyi (was: Dongjoon Hyun) > Use port 0 to start worker server in MasterSuite >

[jira] [Assigned] (SPARK-47434) Streaming Statistics link redirect causing 302 error

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47434: - Assignee: Huw > Streaming Statistics link redirect causing 302 error >

<    4   5   6   7   8   9   10   11   12   13   >