[jira] [Updated] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47457: -- Component/s: SQL (was: Spark Core) >

[jira] [Created] (SPARK-47457) Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4

2024-03-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47457: - Summary: Fix `IsolatedClientLoader.supportsHadoopShadedClient` to handle Hadoop 3.4 Key: SPARK-47457 URL: https://issues.apache.org/jira/browse/SPARK-47457 Project

[jira] [Resolved] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47452. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45576 [https

[jira] [Updated] (SPARK-47456) Support ORC Brotli codec

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47456: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support ORC Bro

[jira] [Assigned] (SPARK-47456) Support ORC Brotli codec

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47456: - Assignee: dzcxzl > Support ORC Brotli co

[jira] [Resolved] (SPARK-47456) Support ORC Brotli codec

2024-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47456. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45584 [https

[jira] [Resolved] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47453. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45581 [https

[jira] [Assigned] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47453: - Assignee: Kent Yao > Upgrade MySQL docker image version to 8.

[jira] [Updated] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47452: -- Summary: Use `Ubuntu 22.04` in `dev/infra/Dockerfile` (was: Use Ubuntu 22.04 in `dev/infra

[jira] [Created] (SPARK-47452) Use Ubuntu 22.04 in `dev/infra/Dockerfile`

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47452: - Summary: Use Ubuntu 22.04 in `dev/infra/Dockerfile` Key: SPARK-47452 URL: https://issues.apache.org/jira/browse/SPARK-47452 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47450. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45574 [https

[jira] [Resolved] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47448. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45572 [https

[jira] [Updated] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45921: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use Hadoop 3.

[jira] [Updated] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45995: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade R version f

[jira] [Assigned] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47448: - Assignee: Dongjoon Hyun > Enable spark.shuffle.service.removeShuffle by defa

[jira] [Created] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47448: - Summary: Enable spark.shuffle.service.removeShuffle by default Key: SPARK-47448 URL: https://issues.apache.org/jira/browse/SPARK-47448 Project: Spark

[jira] [Resolved] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47446. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45570 [https

[jira] [Assigned] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47446: - Assignee: Dongjoon Hyun > Make `BlockManager` warn before `removeBlockInter

[jira] [Created] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47446: - Summary: Make `BlockManager` warn before `removeBlockInternal` Key: SPARK-47446 URL: https://issues.apache.org/jira/browse/SPARK-47446 Project: Spark

[jira] [Updated] (SPARK-47383) Support `spark.shutdown.timeout` config

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47383: -- Summary: Support `spark.shutdown.timeout` config (was: Make the shutdown hook timeout

[jira] [Resolved] (SPARK-47383) Make the shutdown hook timeout configurable

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47383. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45504 [https

[jira] [Assigned] (SPARK-47383) Make the shutdown hook timeout configurable

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47383: - Assignee: Rob Reeves > Make the shutdown hook timeout configura

Re: [VOTE] Release Apache ORC 1.9.3 (RC0)

2024-03-18 Thread Dongjoon Hyun
+1 - Verified the checksum and sigs - Verified the source tarball - Built and tested from source with Java 17.0.10 on MacOS 14.4/AppleSilicon. - Verified the published Maven Artifacts are built with Java 8. $ javap -verbose Reader.class Classfile

[jira] [Assigned] (ORC-1660) Bump `checkstyle` to 10.14.2

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1660: -- Assignee: Dongjoon Hyun > Bump `checkstyle` to 10.1

[jira] [Resolved] (ORC-1660) Bump `checkstyle` to 10.14.2

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1660. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1854 [https

[jira] [Created] (ORC-1660) Bump `checkstyle` to 10.14.2

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1660: -- Summary: Bump `checkstyle` to 10.14.2 Key: ORC-1660 URL: https://issues.apache.org/jira/browse/ORC-1660 Project: ORC Issue Type: Test Components: Java

[jira] [Assigned] (ORC-1659) Bump `guava` to 33.1.0-jre

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1659: -- Assignee: Dongjoon Hyun > Bump `guava` to 33.1.0-

[jira] [Resolved] (ORC-1659) Bump `guava` to 33.1.0-jre

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1659. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1852 [https

[jira] [Created] (ORC-1659) Bump `guava` to 33.1.0-jre

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1659: -- Summary: Bump `guava` to 33.1.0-jre Key: ORC-1659 URL: https://issues.apache.org/jira/browse/ORC-1659 Project: ORC Issue Type: Test Components: Java

[jira] [Resolved] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47442. --- Fix Version/s: 4.0.0 Assignee: wuyi Resolution: Fixed > Use port 0 to st

[jira] [Resolved] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47435. --- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > SPARK-45

[jira] [Resolved] (SPARK-47438) Upgrade jackson to 2.17.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47438. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45562 [https

[jira] [Updated] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47442: -- Reporter: wuyi (was: Dongjoon Hyun) > Use port 0 to start worker server in MasterSu

[jira] [Assigned] (SPARK-47434) Streaming Statistics link redirect causing 302 error

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47434: - Assignee: Huw > Streaming Statistics link redirect causing 302 er

[jira] [Resolved] (SPARK-47434) Streaming Statistics link redirect causing 302 error

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47434. --- Fix Version/s: 3.4.3 4.0.0 Resolution: Fixed Issue resolved

[jira] [Created] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47442: - Summary: Use port 0 to start worker server in MasterSuite Key: SPARK-47442 URL: https://issues.apache.org/jira/browse/SPARK-47442 Project: Spark Issue

[jira] [Commented] (ORC-1657) Fix building apache orc with clang-cl on Windows

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828001#comment-17828001 ] Dongjoon Hyun commented on ORC-1657: Thank you for reporting, [~georgthegreat]. > Fix building apa

[jira] [Updated] (SPARK-47438) Upgrade jackson to 2.17.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47438: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jack

[jira] [Resolved] (SPARK-47433) Update PySpark package dependency version ranges

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47433. --- Fix Version/s: 3.4.3 Assignee: Dongjoon Hyun Resolution: Fixed > Upd

[jira] [Resolved] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47432. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45553 [https

[jira] [Created] (SPARK-47433) Update PySpark package dependency version ranges

2024-03-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47433: - Summary: Update PySpark package dependency version ranges Key: SPARK-47433 URL: https://issues.apache.org/jira/browse/SPARK-47433 Project: Spark Issue

[jira] [Updated] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47432: -- Affects Version/s: (was: 3.4.3) > Add `pyarrow` upper bound requirement, `<

[jira] [Updated] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47432: -- Component/s: Connect > Add `pyarrow` upper bound requirement, `<

[jira] [Created] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`

2024-03-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47432: - Summary: Add `pyarrow` upper bound requirement, `<13.0.0` Key: SPARK-47432 URL: https://issues.apache.org/jira/browse/SPARK-47432 Project: Spark Is

[jira] [Updated] (SPARK-45141) Pin `pyarrow==12.0.1` in CI

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45141: -- Description: PyArrow 13.0.0 is supported since Apache Spark 4.0.0. > Pin `pyarrow==12.

[jira] [Updated] (SPARK-45141) Pin `pyarrow==12.0.1` in CI

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45141: -- Fix Version/s: 3.5.2 3.4.3 > Pin `pyarrow==12.0.1` in

[jira] [Assigned] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47426: - Assignee: BingKun Pan > Upgrade Guava used by the connect module to 33.1.0-

[jira] [Resolved] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

2024-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47426. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45540 [https

Re: ORC 1.9.3 Release

2024-03-16 Thread Dongjoon Hyun
Thank you so much, Gang! Dongjoon. On Sat, Mar 16, 2024 at 8:03 PM Gang Wu wrote: > Hi, > > I'd like to volunteer. Thanks! > > Best. > Gang > > On Sun, Mar 17, 2024 at 7:20 AM Dongjoon Hyun > wrote: > > > Thank you for the reminder. > > > >

Re: ORC 1.9.3 Release

2024-03-16 Thread Dongjoon Hyun
Thank you for the reminder. Of course, I can volunteer. If there is no other person, I'll start next week. Bests, Dongjoon. On Sat, Mar 16, 2024 at 12:24 AM William H. wrote: > Hey All, > > ORC 1.9.3 is scheduled to release this month. > > https://github.com/apache/orc/milestone/25 > > Would

[jira] [Updated] (SPARK-47405) Remove `JLine 2` dependency

2024-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47405: -- Parent: (was: SPARK-47046) Issue Type: Improvement (was: Sub-task) > Rem

[jira] [Updated] (SPARK-45587) Skip UNIDOC and MIMA in build GitHub Action job

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45587: -- Fix Version/s: 3.5.2 3.4.3 > Skip UNIDOC and MIMA in build GitHub Act

[jira] [Resolved] (SPARK-47428) Upgrade Jetty to 9.4.54.v20240208

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47428. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45543 [https

[jira] [Created] (SPARK-47428) Upgrade Jetty to 9.4.54.v20240208

2024-03-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47428: - Summary: Upgrade Jetty to 9.4.54.v20240208 Key: SPARK-47428 URL: https://issues.apache.org/jira/browse/SPARK-47428 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45540) Upgrade jetty to 9.4.53.v20231009

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45540: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade je

[jira] [Updated] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47426: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Guava u

[jira] [Assigned] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47419: - Assignee: BingKun Pan > Move `log4j2-defaults.properties` to `common/ut

[jira] [Resolved] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47419. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45532 [https

[jira] [Commented] (SPARK-45877) ExecutorFailureTracker support for standalone mode

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827395#comment-17827395 ] Dongjoon Hyun commented on SPARK-45877: --- Hi, [~yao]. Shall we convert this from a subtask

[jira] [Updated] (SPARK-44893) ThreadInfo improvements for monitoring APIs

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44893: -- Labels: releasenotes (was: ) > ThreadInfo improvements for monitoring A

[jira] [Resolved] (SPARK-47234) Upgrade Scala to 2.13.13

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47234. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45342 [https

[jira] [Created] (SPARK-47405) Remove `JLine 2` dependency

2024-03-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47405: - Summary: Remove `JLine 2` dependency Key: SPARK-47405 URL: https://issues.apache.org/jira/browse/SPARK-47405 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45376) Add netty-tcnative-boringssl-static dependency

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45376: -- Summary: Add netty-tcnative-boringssl-static dependency (was: [CORE] Add netty-tcnative

[jira] [Closed] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47342. - > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME Z

[jira] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342 ] Dongjoon Hyun deleted comment on SPARK-47342: --- was (Author: dongjoon): Issue resolved by pull request 45471 [https://github.com/apache/spark/pull/45471] > Support TimestampNTZ for

[jira] [Commented] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827258#comment-17827258 ] Dongjoon Hyun commented on SPARK-47342: --- Thank you for providing the context. > Supp

[jira] [Resolved] (SPARK-47402) Upgrade `ZooKeeper` to 3.9.2

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47402. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45524 [https

[jira] [Updated] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46305: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove the spec

[jira] [Resolved] (SPARK-47396) Add a general mapping for TIME WITHOUT TIME ZONE to TimestampNTZType

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47396. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45519 [https

[jira] [Resolved] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47401. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45523 [https

[jira] [Assigned] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47401: - Assignee: Dongjoon Hyun > Update `YuniKorn` docs with v

[jira] [Updated] (SPARK-46210) Update `YuniKorn` docs with v1.4

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46210: -- Summary: Update `YuniKorn` docs with v1.4 (was: Update YuniKorn docs with v1.4) > Upd

[jira] [Created] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47401: - Summary: Update `YuniKorn` docs with v1.5 Key: SPARK-47401 URL: https://issues.apache.org/jira/browse/SPARK-47401 Project: Spark Issue Type: Sub-task

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-14 Thread Dongjoon Hyun
+1 I tested with Apache ORC repo. Thank you for the new release. Dongjoon. (PS. My previous vote went to yarn-dev@ for some reasons, too) On 2024/03/14 08:40:29 Takanobu Asanuma wrote: > +1 (binding). > > Thanks for the great work, Shilun Fan. > > * Verified signatures and checksums > *

[jira] [Resolved] (SPARK-47400) Upgrade `gcs-connector` to 2.2.20

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47400. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45521 [https

[jira] [Updated] (SPARK-44197) Upgrade Hadoop to 3.3.6

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44197: -- Fix Version/s: 4.0.0 (was: 3.5.0) > Upgrade Hadoop to 3.

[jira] [Updated] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47337: -- Parent Issue: SPARK-47361 (was: SPARK-47046) > Bump DB2 Docker version to 11.5.

[jira] [Commented] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827152#comment-17827152 ] Dongjoon Hyun commented on SPARK-47337: --- I changed this subtask from SPARK-47046 to SPARK-47361

[jira] [Updated] (SPARK-45850) Upgrade oracle jdbc driver to 23.3.0.23.09

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45850: -- Parent Issue: SPARK-47361 (was: SPARK-47046) > Upgrade oracle jdbc driver to 23.3.0.23

[jira] [Resolved] (SPARK-47384) Upgrade RoaringBitmap to 1.0.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47384. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45507 [https

[jira] [Resolved] (SPARK-47391) Remove the test case workaround for JDK 8

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47391. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45514 [https

[jira] [Assigned] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47394: - Assignee: Kent Yao > Support TIMESTAMP WITH TIME ZONE for H2Dial

[jira] [Resolved] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47394. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45516 [https

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826833#comment-17826833 ] Dongjoon Hyun commented on SPARK-46810: --- Yes, it sounds fine to me because it's Spark 4, Max

[jira] [Resolved] (SPARK-47378) Make the related Protobuf UT run well in IDE

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47378. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45498 [https

[jira] [Assigned] (SPARK-47378) Make the related Protobuf UT run well in IDE

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47378: - Assignee: BingKun Pan > Make the related Protobuf UT run well in

[jira] [Updated] (SPARK-47314) [DOC] Correct the ExternalSorter#writePartitionedMapOutput method comment

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47314: -- Issue Type: Documentation (was: Improvement) > [DOC] Correct the ExternalSor

[jira] [Updated] (SPARK-47314) Correct the ExternalSorter#writePartitionedMapOutput method comment

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47314: -- Summary: Correct the ExternalSorter#writePartitionedMapOutput method comment (was: [DOC

[jira] [Resolved] (SPARK-47373) [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47373. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45491 [https

[jira] [Assigned] (SPARK-47373) [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47373: - Assignee: Binjie Yang > [SQL] Match FileSourceScanLike to get metadata inst

[jira] [Assigned] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47349: - Assignee: Uroš Bojanić > new test suite for UTF8Str

[jira] [Resolved] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47349. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45477 [https

[jira] [Comment Edited] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825843#comment-17825843 ] Dongjoon Hyun edited comment on SPARK-47369 at 3/12/24 10:05 PM: - Thank

[jira] [Commented] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825843#comment-17825843 ] Dongjoon Hyun commented on SPARK-47369: --- Thank you for reporting, [~neilramaswamy]  Could you

[jira] [Commented] (HADOOP-19108) S3 Express: document use

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825788#comment-17825788 ] Dongjoon Hyun commented on HADOOP-19108: Is this targeting Apache Hadoop 3.4.1? > S3 Expr

[jira] [Resolved] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47364. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45478 [https

[jira] [Assigned] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47364: - Assignee: Dongjoon Hyun > Make `PluginEndpoint` warn when plugins reply for one-

[jira] [Created] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47364: - Summary: Make `PluginEndpoint` warn when plugins reply for one-way message Key: SPARK-47364 URL: https://issues.apache.org/jira/browse/SPARK-47364 Project: Spark

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-12 Thread Dongjoon Hyun
+1 I tested with Apache ORC repo. Thank you for the new release. Dongjoon. On 2024/03/11 20:28:22 Steve Loughran wrote: > +1 binding > > (sorry, this had ended in the yarn-dev folder, otherwise I'd have seen it > earlier. been testing it this afternoon: > > pulled the latest version of >

[jira] [Resolved] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46919. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44929 [https

<    5   6   7   8   9   10   11   12   13   14   >