[jira] [Updated] (SPARK-47486) Remove unused private `ArrowDeserializers.getString` method

[ https://issues.apache.org/jira/browse/SPARK-47486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47486: -- Summary: Remove unused private `ArrowDeserializers.getString` method (was: Remove unused

[jira] [Resolved] (SPARK-47486) Remove unused private method `getString` from `ArrowDeserializers`

[ https://issues.apache.org/jira/browse/SPARK-47486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47486. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45610 [https

[jira] [Updated] (SPARK-47490) Fix RocksDB Logger deprecation warning

[ https://issues.apache.org/jira/browse/SPARK-47490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47490: -- Issue Type: Improvement (was: Task) > Fix RocksDB Logger deprecation warn

Re: [ANNOUNCE] Apache Hadoop 3.4.0 release

Thank you all! Apache ORC and Spark starts to use Apache Hadoop 3.4.0 successfully. https://github.com/apache/orc/commit/d2f9d8d97a99bffb9e9adfa5a53c8419e5540f44 https://github.com/apache/spark/commit/49b4c3bc9c09325de941dfaf41e4fd3a4a4c345f Thanks, Dongjoon. On 2024/03/19 13:07:37 slfan1989

[jira] [Resolved] (SPARK-45393) Upgrade Hadoop to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45393. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45583 [https

[jira] [Created] (SPARK-47491) Re-enable `driver log links` test in YarnClusterSuite

Dongjoon Hyun created SPARK-47491: - Summary: Re-enable `driver log links` test in YarnClusterSuite Key: SPARK-47491 URL: https://issues.apache.org/jira/browse/SPARK-47491 Project: Spark

[jira] [Resolved] (SPARK-47462) Align the mapping ways of other unsigned numeric types with TINYINT UNSGINED in MySQLDialect

[ https://issues.apache.org/jira/browse/SPARK-47462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47462. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45588 [https

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Affects Version/s: 4.0.0 (was: 3.2.0) > [k8s]Driver stuck w

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Component/s: Kubernetes (was: k8s) > [k8s]Driver stuck when thread p

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Priority: Major (was: Critical) > [k8s]Driver stuck when thread pool is not shut d

[jira] [Updated] (SPARK-47488) Driver stuck when thread pool is not shut down

[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Summary: Driver stuck when thread pool is not shut down (was: [k8s]Driver stuck when thread

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47488: -- Issue Type: Improvement (was: Bug) > [k8s]Driver stuck when thread pool is not shut d

[jira] [Updated] (SPARK-47481) Fix Python linter

[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47481: -- Issue Type: Task (was: Improvement) > Fix Python lin

[jira] [Updated] (SPARK-47481) Fix Python linter

[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47481: -- Fix Version/s: 3.5.2 > Fix Python linter > - > >

[jira] [Resolved] (SPARK-47481) Fix Python linter

[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47481. --- Fix Version/s: 3.4.3 Resolution: Fixed Issue resolved by pull request 45608 [https

[jira] [Assigned] (SPARK-47472) Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile`

[ https://issues.apache.org/jira/browse/SPARK-47472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47472: - Assignee: Dongjoon Hyun > Pin `numpy` to 1.23.5 in `dev/infra/Dockerf

[jira] [Resolved] (SPARK-47472) Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile`

[ https://issues.apache.org/jira/browse/SPARK-47472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47472. --- Fix Version/s: 3.4.3 Resolution: Fixed Issue resolved by pull request 45595 [https

[jira] [Created] (SPARK-47472) Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile`

Dongjoon Hyun created SPARK-47472: - Summary: Pin `numpy` to 1.23.5 in `dev/infra/Dockerfile` Key: SPARK-47472 URL: https://issues.apache.org/jira/browse/SPARK-47472 Project: Spark Issue Type

[jira] [Resolved] (SPARK-47470) Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite`

[ https://issues.apache.org/jira/browse/SPARK-47470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47470. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45597 [https

[jira] [Assigned] (SPARK-47470) Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite`

[ https://issues.apache.org/jira/browse/SPARK-47470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47470: - Assignee: Dongjoon Hyun > Ignore `IntentionallyFaultyConnectionProvider` er

[jira] [Updated] (SPARK-47470) Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite`

[ https://issues.apache.org/jira/browse/SPARK-47470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47470: -- Summary: Ignore `IntentionallyFaultyConnectionProvider` error in `CliSuite` (was: Make

[jira] [Created] (SPARK-47470) Make `CliSuite` ignores `IntentionallyFaultyConnectionProvider` error

Dongjoon Hyun created SPARK-47470: - Summary: Make `CliSuite` ignores `IntentionallyFaultyConnectionProvider` error Key: SPARK-47470 URL: https://issues.apache.org/jira/browse/SPARK-47470 Project

[jira] [Comment Edited] (SPARK-44101) Support pandas 2

[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828556#comment-17828556 ] Dongjoon Hyun edited comment on SPARK-44101 at 3/20/24 1:00 AM: I added

[jira] [Assigned] (SPARK-44101) Support pandas 2

[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44101: - Assignee: Haejoon Lee > Support pandas 2 > > >

[jira] [Updated] (SPARK-44101) Support pandas 2

[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44101: -- Labels: releasenotes (was: ) > Support pandas 2 > > >

[jira] [Commented] (SPARK-44101) Support pandas 2

[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828556#comment-17828556 ] Dongjoon Hyun commented on SPARK-44101: --- I added `releasenotes` label to this JIRA. > Supp

[jira] [Closed] (SPARK-44149) Support DataFrame Merge API

[ https://issues.apache.org/jira/browse/SPARK-44149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-44149. - > Support DataFrame Merge API > --- > > Key:

[jira] [Updated] (SPARK-46207) Support MergeInto in DataFrameWriterV2

[ https://issues.apache.org/jira/browse/SPARK-46207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46207: -- Parent: SPARK-44111 Issue Type: Sub-task (was: New Feature) > Support MergeI

[jira] [Resolved] (SPARK-47468) Exclude `logback` dependency from SBT like Maven

[ https://issues.apache.org/jira/browse/SPARK-47468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47468. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45594 [https

[jira] [Updated] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47432: -- Fix Version/s: 3.4.3 > Add `pyarrow` upper bound requirement, `<

[jira] [Resolved] (SPARK-47290) Extend CustomTaskMetric to allow metric values from multiple sources

[ https://issues.apache.org/jira/browse/SPARK-47290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47290. --- Resolution: Invalid > Extend CustomTaskMetric to allow metric values from multiple sour

[jira] [Closed] (SPARK-47290) Extend CustomTaskMetric to allow metric values from multiple sources

[ https://issues.apache.org/jira/browse/SPARK-47290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47290. - Sure. I closed this. > Extend CustomTaskMetric to allow metric values from multiple sour

[jira] [Resolved] (SPARK-47464) Update labeler.yml

[ https://issues.apache.org/jira/browse/SPARK-47464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47464. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45590 [https

[jira] [Updated] (SPARK-47464) Update labeler.yml for module common/sketch and common/variant

[ https://issues.apache.org/jira/browse/SPARK-47464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47464: -- Summary: Update labeler.yml for module common/sketch and common/variant (was: Update

[jira] [Updated] (SPARK-47468) Exclude `logback` dependency from SBT like Maven

[ https://issues.apache.org/jira/browse/SPARK-47468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47468: -- Summary: Exclude `logback` dependency from SBT like Maven (was: Exclude `logback` from SBT

[jira] [Assigned] (SPARK-47468) Exclude `logback` from SBT dependency like Maven

[ https://issues.apache.org/jira/browse/SPARK-47468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47468: - Assignee: Dongjoon Hyun > Exclude `logback` from SBT dependency like Ma

[jira] [Created] (SPARK-47468) Exclude `logback` from SBT dependency like Maven

Dongjoon Hyun created SPARK-47468: - Summary: Exclude `logback` from SBT dependency like Maven Key: SPARK-47468 URL: https://issues.apache.org/jira/browse/SPARK-47468 Project: Spark Issue

[jira] [Resolved] (SPARK-47461) Remove unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager`

[ https://issues.apache.org/jira/browse/SPARK-47461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47461. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45587 [https

[jira] [Assigned] (SPARK-47461) Remove unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager`

[ https://issues.apache.org/jira/browse/SPARK-47461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47461: - Assignee: Yang Jie > Remove unused private funct

[jira] [Resolved] (ORC-1608) Upgrade Hadoop to 3.4.0

[ https://issues.apache.org/jira/browse/ORC-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1608. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1783 [https

[jira] [Assigned] (ORC-1608) Upgrade Hadoop to 3.4.0

[ https://issues.apache.org/jira/browse/ORC-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1608: -- Assignee: Dongjoon Hyun > Upgrade Hadoop to 3.

[jira] [Resolved] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4+

[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47457. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45585 [https

[jira] [Updated] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4+

[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47457: -- Summary: Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

[jira] [Assigned] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47457: - Assignee: Dongjoon Hyun > Fix `IsolatedClientLoader.supportsHadoopShadedCli

[jira] [Updated] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47457: -- Component/s: SQL (was: Spark Core) >

[jira] [Created] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

Dongjoon Hyun created SPARK-47457: - Summary: Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4 Key: SPARK-47457 URL: https://issues.apache.org/jira/browse/SPARK-47457 Project

[jira] [Resolved] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47452. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45576 [https

[jira] [Updated] (SPARK-47456) Support ORC Brotli codec

[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47456: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support ORC Bro

[jira] [Assigned] (SPARK-47456) Support ORC Brotli codec

[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47456: - Assignee: dzcxzl > Support ORC Brotli co

[jira] [Resolved] (SPARK-47456) Support ORC Brotli codec

[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47456. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45584 [https

[jira] [Resolved] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47453. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45581 [https

[jira] [Assigned] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47453: - Assignee: Kent Yao > Upgrade MySQL docker image version to 8.

[jira] [Updated] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47452: -- Summary: Use `Ubuntu 22.04` in `dev/infra/Dockerfile` (was: Use Ubuntu 22.04 in `dev/infra

[jira] [Created] (SPARK-47452) Use Ubuntu 22.04 in `dev/infra/Dockerfile`

Dongjoon Hyun created SPARK-47452: - Summary: Use Ubuntu 22.04 in `dev/infra/Dockerfile` Key: SPARK-47452 URL: https://issues.apache.org/jira/browse/SPARK-47452 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47450. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45574 [https

[jira] [Resolved] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47448. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45572 [https

[jira] [Updated] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45921: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use Hadoop 3.

[jira] [Updated] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45995: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade R version f

[jira] [Assigned] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47448: - Assignee: Dongjoon Hyun > Enable spark.shuffle.service.removeShuffle by defa

[jira] [Created] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

Dongjoon Hyun created SPARK-47448: - Summary: Enable spark.shuffle.service.removeShuffle by default Key: SPARK-47448 URL: https://issues.apache.org/jira/browse/SPARK-47448 Project: Spark

[jira] [Resolved] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47446. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45570 [https

[jira] [Assigned] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47446: - Assignee: Dongjoon Hyun > Make `BlockManager` warn before `removeBlockInter

[jira] [Created] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

Dongjoon Hyun created SPARK-47446: - Summary: Make `BlockManager` warn before `removeBlockInternal` Key: SPARK-47446 URL: https://issues.apache.org/jira/browse/SPARK-47446 Project: Spark

[jira] [Updated] (SPARK-47383) Support `spark.shutdown.timeout` config

[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47383: -- Summary: Support `spark.shutdown.timeout` config (was: Make the shutdown hook timeout

[jira] [Resolved] (SPARK-47383) Make the shutdown hook timeout configurable

[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47383. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45504 [https

[jira] [Assigned] (SPARK-47383) Make the shutdown hook timeout configurable

[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47383: - Assignee: Rob Reeves > Make the shutdown hook timeout configura

Re: [VOTE] Release Apache ORC 1.9.3 (RC0)

+1 - Verified the checksum and sigs - Verified the source tarball - Built and tested from source with Java 17.0.10 on MacOS 14.4/AppleSilicon. - Verified the published Maven Artifacts are built with Java 8. $ javap -verbose Reader.class Classfile

[jira] [Assigned] (ORC-1660) Bump `checkstyle` to 10.14.2

[ https://issues.apache.org/jira/browse/ORC-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1660: -- Assignee: Dongjoon Hyun > Bump `checkstyle` to 10.1

[jira] [Resolved] (ORC-1660) Bump `checkstyle` to 10.14.2

[ https://issues.apache.org/jira/browse/ORC-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1660. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1854 [https

[jira] [Created] (ORC-1660) Bump `checkstyle` to 10.14.2

Dongjoon Hyun created ORC-1660: -- Summary: Bump `checkstyle` to 10.14.2 Key: ORC-1660 URL: https://issues.apache.org/jira/browse/ORC-1660 Project: ORC Issue Type: Test Components: Java

[jira] [Assigned] (ORC-1659) Bump `guava` to 33.1.0-jre

[ https://issues.apache.org/jira/browse/ORC-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1659: -- Assignee: Dongjoon Hyun > Bump `guava` to 33.1.0-

[jira] [Resolved] (ORC-1659) Bump `guava` to 33.1.0-jre

[ https://issues.apache.org/jira/browse/ORC-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1659. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1852 [https

[jira] [Created] (ORC-1659) Bump `guava` to 33.1.0-jre

Dongjoon Hyun created ORC-1659: -- Summary: Bump `guava` to 33.1.0-jre Key: ORC-1659 URL: https://issues.apache.org/jira/browse/ORC-1659 Project: ORC Issue Type: Test Components: Java

[jira] [Resolved] (SPARK-47442) Use port 0 to start worker server in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47442. --- Fix Version/s: 4.0.0 Assignee: wuyi Resolution: Fixed > Use port 0 to st

[jira] [Resolved] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

[ https://issues.apache.org/jira/browse/SPARK-47435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47435. --- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > SPARK-45

[jira] [Resolved] (SPARK-47438) Upgrade jackson to 2.17.0

[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47438. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45562 [https

[jira] [Updated] (SPARK-47442) Use port 0 to start worker server in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47442: -- Reporter: wuyi (was: Dongjoon Hyun) > Use port 0 to start worker server in MasterSu

[jira] [Assigned] (SPARK-47434) Streaming Statistics link redirect causing 302 error

[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47434: - Assignee: Huw > Streaming Statistics link redirect causing 302 er

[jira] [Resolved] (SPARK-47434) Streaming Statistics link redirect causing 302 error

[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47434. --- Fix Version/s: 3.4.3 4.0.0 Resolution: Fixed Issue resolved

[jira] [Created] (SPARK-47442) Use port 0 to start worker server in MasterSuite

Dongjoon Hyun created SPARK-47442: - Summary: Use port 0 to start worker server in MasterSuite Key: SPARK-47442 URL: https://issues.apache.org/jira/browse/SPARK-47442 Project: Spark Issue

[jira] [Commented] (ORC-1657) Fix building apache orc with clang-cl on Windows

[ https://issues.apache.org/jira/browse/ORC-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828001#comment-17828001 ] Dongjoon Hyun commented on ORC-1657: Thank you for reporting, [~georgthegreat]. > Fix building apa

[jira] [Updated] (SPARK-47438) Upgrade jackson to 2.17.0

[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47438: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jack

[jira] [Resolved] (SPARK-47433) Update PySpark package dependency version ranges

[ https://issues.apache.org/jira/browse/SPARK-47433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47433. --- Fix Version/s: 3.4.3 Assignee: Dongjoon Hyun Resolution: Fixed > Upd

[jira] [Resolved] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47432. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45553 [https

[jira] [Created] (SPARK-47433) Update PySpark package dependency version ranges

Dongjoon Hyun created SPARK-47433: - Summary: Update PySpark package dependency version ranges Key: SPARK-47433 URL: https://issues.apache.org/jira/browse/SPARK-47433 Project: Spark Issue

[jira] [Updated] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47432: -- Affects Version/s: (was: 3.4.3) > Add `pyarrow` upper bound requirement, `<

[jira] [Updated] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47432: -- Component/s: Connect > Add `pyarrow` upper bound requirement, `<

[jira] [Created] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

Dongjoon Hyun created SPARK-47432: - Summary: Add `pyarrow` upper bound requirement, `<13.0.0` Key: SPARK-47432 URL: https://issues.apache.org/jira/browse/SPARK-47432 Project: Spark Is

[jira] [Updated] (SPARK-45141) Pin `pyarrow==12.0.1` in CI

[ https://issues.apache.org/jira/browse/SPARK-45141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45141: -- Description: PyArrow 13.0.0 is supported since Apache Spark 4.0.0. > Pin `pyarrow==12.

[jira] [Updated] (SPARK-45141) Pin `pyarrow==12.0.1` in CI

[ https://issues.apache.org/jira/browse/SPARK-45141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45141: -- Fix Version/s: 3.5.2 3.4.3 > Pin `pyarrow==12.0.1` in

[jira] [Assigned] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47426: - Assignee: BingKun Pan > Upgrade Guava used by the connect module to 33.1.0-

[jira] [Resolved] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47426. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45540 [https

Re: ORC 1.9.3 Release

Thank you so much, Gang! Dongjoon. On Sat, Mar 16, 2024 at 8:03 PM Gang Wu wrote: > Hi, > > I'd like to volunteer. Thanks! > > Best. > Gang > > On Sun, Mar 17, 2024 at 7:20 AM Dongjoon Hyun > wrote: > > > Thank you for the reminder. > > > >

Re: ORC 1.9.3 Release

Thank you for the reminder. Of course, I can volunteer. If there is no other person, I'll start next week. Bests, Dongjoon. On Sat, Mar 16, 2024 at 12:24 AM William H. wrote: > Hey All, > > ORC 1.9.3 is scheduled to release this month. > > https://github.com/apache/orc/milestone/25 > > Would

[jira] [Updated] (SPARK-47405) Remove `JLine 2` dependency

[ https://issues.apache.org/jira/browse/SPARK-47405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47405: -- Parent: (was: SPARK-47046) Issue Type: Improvement (was: Sub-task) > Rem

[jira] [Updated] (SPARK-45587) Skip UNIDOC and MIMA in build GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-45587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45587: -- Fix Version/s: 3.5.2 3.4.3 > Skip UNIDOC and MIMA in build GitHub Act

[jira] [Resolved] (SPARK-47428) Upgrade Jetty to 9.4.54.v20240208

[ https://issues.apache.org/jira/browse/SPARK-47428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47428. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45543 [https

[jira] [Created] (SPARK-47428) Upgrade Jetty to 9.4.54.v20240208

Dongjoon Hyun created SPARK-47428: - Summary: Upgrade Jetty to 9.4.54.v20240208 Key: SPARK-47428 URL: https://issues.apache.org/jira/browse/SPARK-47428 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45540) Upgrade jetty to 9.4.53.v20231009

[ https://issues.apache.org/jira/browse/SPARK-45540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45540: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade je

[jira] [Updated] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47426: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Guava u

<    5   6   7   8   9   10   11   12   13   14   >