[jira] [Updated] (SPARK-44393) Upgrade H2 from 2.1.214 to 2.2.220

[ https://issues.apache.org/jira/browse/SPARK-44393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44393: -- Fix Version/s: 3.4.3 > Upgrade H2 from 2.1.214 to 2.2.

[jira] [Updated] (SPARK-44279) Upgrade optionator to ^0.9.3

[ https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44279: -- Fix Version/s: 3.5.0 > Upgrade optionator to ^0.

[jira] [Resolved] (SPARK-47735) Make pyspark.testing.connectutils compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47735. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45887 [https

[jira] [Assigned] (SPARK-47735) Make pyspark.testing.connectutils compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47735: - Assignee: Hyukjin Kwon > Make pyspark.testing.connectutils compatible with pysp

[jira] [Resolved] (HADOOP-19141) Update VectorIO default values consistently

[ https://issues.apache.org/jira/browse/HADOOP-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved HADOOP-19141. Fix Version/s: 3.3.7 3.4.1 Resolution: Fixed > Update Vecto

[jira] [Assigned] (HADOOP-19141) Update VectorIO default values consistently

[ https://issues.apache.org/jira/browse/HADOOP-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned HADOOP-19141: -- Assignee: Dongjoon Hyun > Update VectorIO default values consisten

[jira] [Resolved] (HADOOP-19141) Update VectorIO default values consistently

[ https://issues.apache.org/jira/browse/HADOOP-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved HADOOP-19141. Fix Version/s: 3.3.7 3.4.1 Resolution: Fixed > Update Vecto

[jira] [Resolved] (SPARK-47728) Document G1 Concurrent GC metrics

[ https://issues.apache.org/jira/browse/SPARK-47728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47728. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45874 [https

[jira] [Assigned] (SPARK-47728) Document G1 Concurrent GC metrics

[ https://issues.apache.org/jira/browse/SPARK-47728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47728: - Assignee: Luca Canali > Document G1 Concurrent GC metr

[jira] [Resolved] (SPARK-47729) Get the proper default port for pyspark-connect testcases

[ https://issues.apache.org/jira/browse/SPARK-47729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47729. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45875 [https

[jira] [Assigned] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47720: - Assignee: Dongjoon Hyun > Update `spark.speculation.multiplier` t

[jira] [Resolved] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47720. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45858 [https

[jira] [Assigned] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47710: - Assignee: Kent Yao > Postgres: Document Mapping Spark SQL Data Types from Postgre

[jira] [Resolved] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47710. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45845 [https

[jira] [Updated] (SPARK-47714) Set spark.sql.legacy.timeParserPolicy to CORRECTED by default

[ https://issues.apache.org/jira/browse/SPARK-47714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47714: -- Summary: Set spark.sql.legacy.timeParserPolicy to CORRECTED by default (was: set

[jira] [Resolved] (SPARK-47711) Parameterize JDBC Drivers for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-47711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47711. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45847 [https

[jira] [Created] (HADOOP-19141) Update VectorIO default values consistently

Dongjoon Hyun created HADOOP-19141: -- Summary: Update VectorIO default values consistently Key: HADOOP-19141 URL: https://issues.apache.org/jira/browse/HADOOP-19141 Project: Hadoop Common

[jira] [Created] (HADOOP-19141) Update VectorIO default values consistently

Dongjoon Hyun created HADOOP-19141: -- Summary: Update VectorIO default values consistently Key: HADOOP-19141 URL: https://issues.apache.org/jira/browse/HADOOP-19141 Project: Hadoop Common

[jira] [Resolved] (SPARK-47691) Postgres: Support multi dimensional array on the write side

[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47691. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45815 [https

[jira] [Assigned] (SPARK-47691) Postgres: Support multi dimensional array on the write side

[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47691: - Assignee: Kent Yao > Postgres: Support multi dimensional array on the write s

[jira] [Resolved] (ORC-1676) Use Hive 4.0.0 in benchmark

[ https://issues.apache.org/jira/browse/ORC-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1676. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-47697) Add scala style check for invalid MDC usage

[ https://issues.apache.org/jira/browse/SPARK-47697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47697. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45823 [https

[jira] [Assigned] (ORC-1676) Use Hive 4.0.0 in benchmark

[ https://issues.apache.org/jira/browse/ORC-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1676: -- Assignee: Dongjoon Hyun > Use Hive 4.0.0 in benchm

[jira] [Created] (ORC-1676) Use Hive 4.0.0 in benchmark

Dongjoon Hyun created ORC-1676: -- Summary: Use Hive 4.0.0 in benchmark Key: ORC-1676 URL: https://issues.apache.org/jira/browse/ORC-1676 Project: ORC Issue Type: Test Components: Java

[jira] [Commented] (HADOOP-18830) S3A: Cut S3 Select

[ https://issues.apache.org/jira/browse/HADOOP-18830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833281#comment-17833281 ] Dongjoon Hyun commented on HADOOP-18830: Hi, can we remove `3.4.1` from the `Fixed Version

[jira] [Updated] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46793: -- Parent: (was: SPARK-44124) Issue Type: Bug (was: Sub-task) > Revert S3A endpo

[jira] [Created] (SPARK-47695) Update AWS SDK v2 to 2.24.6

Dongjoon Hyun created SPARK-47695: - Summary: Update AWS SDK v2 to 2.24.6 Key: SPARK-47695 URL: https://issues.apache.org/jira/browse/SPARK-47695 Project: Spark Issue Type: Sub-task

[jira] [Commented] (ORC-1674) Remove patch file from vcpkg

[ https://issues.apache.org/jira/browse/ORC-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833222#comment-17833222 ] Dongjoon Hyun commented on ORC-1674: Thank you! > Remove patch file from vc

[jira] [Assigned] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47686: - Assignee: Yang Jie > Use `=!=` instead of `!==` in `JoinHintSu

[jira] [Resolved] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47686. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45812 [https

[jira] [Resolved] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47679. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45804 [https

[jira] [Updated] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47679: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) >

[jira] [Created] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

Dongjoon Hyun created SPARK-47679: - Summary: Use `HiveConf.getConfVars` or Hive conf names directly Key: SPARK-47679 URL: https://issues.apache.org/jira/browse/SPARK-47679 Project: Spark

[jira] [Resolved] (SPARK-47676) Clean up the removed `VersionsSuite` references

[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47676. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution

[jira] [Assigned] (SPARK-47676) Clean up the removed `VersionsSuite` references

[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47676: - Assignee: Dongjoon Hyun > Clean up the removed `VersionsSuite` referen

[jira] [Created] (SPARK-47676) Clean up the removed `VersionsSuite` references

Dongjoon Hyun created SPARK-47676: - Summary: Clean up the removed `VersionsSuite` references Key: SPARK-47676 URL: https://issues.apache.org/jira/browse/SPARK-47676 Project: Spark Issue Type

[jira] [Resolved] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47675. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45799 [https

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: SPARK-36014) > [K8] Spark App ID collision resulting in delet

[jira] [Closed] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47556. - > [K8] Spark App ID collision resulting in deleting wrong resour

[jira] [Resolved] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47556. --- Fix Version/s: SPARK-36014 Resolution: Duplicate > [K8] Spark App ID collis

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: 3.3.0) > [K8] Spark App ID collision resulting in deleting wr

[jira] [Reopened] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-47556: --- > [K8] Spark App ID collision resulting in deleting wrong resour

[jira] [Updated] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47675: -- Summary: Use AWS SDK v2 2.23.19 in K8s IT (was: Remove `aws.java.sdk.v2.version` property

[jira] [Updated] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47675: -- Component/s: Kubernetes Tests > Remove `aws.java.sdk.v2.version` prope

[jira] [Assigned] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47675: - Assignee: Dongjoon Hyun > Remove `aws.java.sdk.v2.version` property in pom.

[jira] [Created] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

Dongjoon Hyun created SPARK-47675: - Summary: Remove `aws.java.sdk.v2.version` property in pom.xml Key: SPARK-47675 URL: https://issues.apache.org/jira/browse/SPARK-47675 Project: Spark Issue

[jira] [Resolved] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47674. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45798 [https

[jira] [Assigned] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47674: - Assignee: Dongjoon Hyun > Enable `spark.metrics.appStatusSource.enabled` by defa

[jira] [Created] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

Dongjoon Hyun created SPARK-47674: - Summary: Enable `spark.metrics.appStatusSource.enabled` by default Key: SPARK-47674 URL: https://issues.apache.org/jira/browse/SPARK-47674 Project: Spark

Re: [DRAFT] [REPORT] ORC - April 2024

Thank you always, William. Looks good to me. I have only two minor comments about typos 1. - According to our release cadence, we released three maintenance + According to our release cadence, we released two maintenance 2. - the traffic of both dev, issues, and user mailing lists + the traffic

[jira] [Assigned] (ORC-1672) Modify the package name of TestCheckTool

[ https://issues.apache.org/jira/browse/ORC-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1672: -- Assignee: dzcxzl > Modify the package name of TestCheckT

[jira] [Resolved] (ORC-1672) Modify the package name of TestCheckTool

[ https://issues.apache.org/jira/browse/ORC-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1672. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-47645) Make Spark build with -release instead of -target

[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47645: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Make Spark bu

[jira] [Assigned] (SPARK-47645) Make Spark build with -release instead of -target

[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47645: - Assignee: Yang Jie > Make Spark build with -release instead of -tar

[jira] [Resolved] (SPARK-47645) Make Spark build with -release instead of -target

[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47645. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45716 [https

[jira] [Resolved] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL

[ https://issues.apache.org/jira/browse/SPARK-47662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47662. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45787 [https

[jira] [Assigned] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL

[ https://issues.apache.org/jira/browse/SPARK-47662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47662: - Assignee: Kent Yao > Document Mapping Spark SQL Data Types to My

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1 Thank you, Hyukjin. Dongjoon On Sun, Mar 31, 2024 at 19:07 Haejoon Lee wrote: > +1 > > On Mon, Apr 1, 2024 at 10:15 AM Hyukjin Kwon wrote: > >> Hi all, >> >> I'd like to start the vote for SPIP: Pure Python Package in PyPI (Spark >> Connect) >> >> JIRA

[jira] [Resolved] (ORC-1673) Remove test packages `o.a.o.tools.[count|merge|sizes]`

[ https://issues.apache.org/jira/browse/ORC-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1673. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-47658) Upgrade `tink` to 1.12.0

[ https://issues.apache.org/jira/browse/SPARK-47658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47658. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45783 [https

[jira] [Resolved] (SPARK-47656) Upgrade commons-io to 2.16.0

[ https://issues.apache.org/jira/browse/SPARK-47656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47656. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45781 [https

[jira] [Assigned] (ORC-1673) Remove test packages `o.a.o.tools.[count|merge|sizes]`

[ https://issues.apache.org/jira/browse/ORC-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1673: -- Assignee: Dongjoon Hyun > Remove test packages `o.a.o.tools.[count|merge|si

[jira] [Created] (ORC-1673) Remove test packages `org/apache/orc/tools/[count|merge|sizes]`

Dongjoon Hyun created ORC-1673: -- Summary: Remove test packages `org/apache/orc/tools/[count|merge|sizes]` Key: ORC-1673 URL: https://issues.apache.org/jira/browse/ORC-1673 Project: ORC Issue

[jira] [Updated] (ORC-1673) Remove test packages `o.a.o.tools.[count|merge|sizes]`

[ https://issues.apache.org/jira/browse/ORC-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1673: --- Summary: Remove test packages `o.a.o.tools.[count|merge|sizes]` (was: Remove test packages `org

Re: Regarding the Apache Committee Report Helper Website

Ya, it seems to happen at multiple projects. Like Apache ORC community, Apache Spark community report page is also missing JIRA/Commit/GitHub PR activities like the following. - https://reporter.apache.org/wizard/statistics?spark JIRA activity: 0 issues opened in JIRA, past quarter (-100%

[jira] [Updated] (ORC-1667) Add `check` tool to check the index of the specified column

[ https://issues.apache.org/jira/browse/ORC-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1667: --- Summary: Add `check` tool to check the index of the specified column (was: Add check tool to check

[jira] [Assigned] (ORC-1667) Add `bloom-filter` tool to check the bloom filter of the specified column

[ https://issues.apache.org/jira/browse/ORC-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1667: -- Assignee: dzcxzl > Add `bloom-filter` tool to check the bloom filter of the specified col

[jira] [Updated] (ORC-1667) Add check tool to check the index of the specified column

[ https://issues.apache.org/jira/browse/ORC-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1667: --- Summary: Add check tool to check the index of the specified column (was: Add `bloom-filter` tool

[jira] [Resolved] (ORC-1667) Add `bloom-filter` tool to check the bloom filter of the specified column

[ https://issues.apache.org/jira/browse/ORC-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1667. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47648. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45774 [https

[jira] [Assigned] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47648: - Assignee: BingKun Pan > Use `checkError()` to check Exception in `[CSV|Json|Xml]Su

[jira] [Assigned] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres

[ https://issues.apache.org/jira/browse/SPARK-47647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47647: - Assignee: Kent Yao > Make MySQL data source be able to read bit(n>1) as Bina

[jira] [Resolved] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres

[ https://issues.apache.org/jira/browse/SPARK-47647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47647. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45773 [https

[jira] [Resolved] (SPARK-47642) Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5`

[ https://issues.apache.org/jira/browse/SPARK-47642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47642. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45767 [https

[jira] [Resolved] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47636. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45762 [https

[jira] [Resolved] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47635. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45761 [https

[jira] [Created] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile

Dongjoon Hyun created SPARK-47636: - Summary: Use Java 17 instead of 17-jre image in K8s Dockerfile Key: SPARK-47636 URL: https://issues.apache.org/jira/browse/SPARK-47636 Project: Spark

[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47635: -- Affects Version/s: (was: 3.5.0) (was: 3.5.1) > Use Java

[jira] [Assigned] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47635: - Assignee: Dongjoon Hyun > Use Java 21 instead of 21-jre in K8s Dockerf

[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-47635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47635: -- Affects Version/s: 3.5.1 3.5.0 > Use Java 21 instead of 21-jre in

[jira] [Created] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile

Dongjoon Hyun created SPARK-47635: - Summary: Use Java 21 instead of 21-jre in K8s Dockerfile Key: SPARK-47635 URL: https://issues.apache.org/jira/browse/SPARK-47635 Project: Spark Issue Type

[jira] [Resolved] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

[ https://issues.apache.org/jira/browse/SPARK-47632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47632. --- Fix Version/s: 4.0.0 Resolution: Fixed This is resolved via https://github.com

[jira] [Assigned] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

[ https://issues.apache.org/jira/browse/SPARK-47632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47632: - Assignee: Dongjoon Hyun > Ban `com.amazonaws:aws-java-sdk-bundle` depende

[jira] [Created] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency

Dongjoon Hyun created SPARK-47632: - Summary: Ban `com.amazonaws:aws-java-sdk-bundle` dependency Key: SPARK-47632 URL: https://issues.apache.org/jira/browse/SPARK-47632 Project: Spark Issue

[jira] [Created] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method

Dongjoon Hyun created SPARK-47631: - Summary: Remove unused `SQLConf.parquetOutputCommitterClass` method Key: SPARK-47631 URL: https://issues.apache.org/jira/browse/SPARK-47631 Project: Spark

[jira] [Resolved] (SPARK-47630) Upgrade `zstd-jni` to 1.5.6-1

[ https://issues.apache.org/jira/browse/SPARK-47630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47630. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45756 [https

[jira] [Resolved] (ORC-1670) Upgrade `zstd-jni` to 1.5.6-1

[ https://issues.apache.org/jira/browse/ORC-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1670. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (ORC-1670) Upgrade `zstd-jni` to 1.5.6-1

[ https://issues.apache.org/jira/browse/ORC-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1670: -- Assignee: Dongjoon Hyun > Upgrade `zstd-jni` to 1.5.

[jira] [Created] (ORC-1670) Upgrade `zstd-jni` to 1.5.6-1

Dongjoon Hyun created ORC-1670: -- Summary: Upgrade `zstd-jni` to 1.5.6-1 Key: ORC-1670 URL: https://issues.apache.org/jira/browse/ORC-1670 Project: ORC Issue Type: Bug Components: Java

[jira] [Updated] (SPARK-47475) Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-47475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47475: -- Summary: Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode

Re: The dedicated repository for Kubernetes Operator for Apache Spark

Thank you, Liang-Chi! Dongjoon. On Wed, Mar 27, 2024 at 10:56 PM L. C. Hsieh wrote: > Hi all, > > For the passed SPIP: An Official Kubernetes Operator for Apache Spark, > the developers have been working on code cleaning and refactoring for > open source in the last few months. They are ready

[jira] [Assigned] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47628: - Assignee: Kent Yao > Fix Postgres bit array issue 'Cannot cast to bool

[jira] [Resolved] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47628. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45751 [https

[jira] [Updated] (SPARK-47618) Use Magic Committer for all S3 buckets by default

[ https://issues.apache.org/jira/browse/SPARK-47618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47618: -- Description: This issue aims to use Apache Hadoop `Magic Committer` for all S3 buckets

[jira] [Assigned] (SPARK-47618) Use Magic Committer for all S3 buckets by default

[ https://issues.apache.org/jira/browse/SPARK-47618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47618: - Assignee: Dongjoon Hyun > Use Magic Committer for all S3 buckets by defa

[jira] [Created] (SPARK-47618) Use Magic Committer for all S3 buckets by default

Dongjoon Hyun created SPARK-47618: - Summary: Use Magic Committer for all S3 buckets by default Key: SPARK-47618 URL: https://issues.apache.org/jira/browse/SPARK-47618 Project: Spark Issue

[jira] [Resolved] (ORC-1668) Add merge command to Java tools documentation

[ https://issues.apache.org/jira/browse/ORC-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1668. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (ORC-1668) Add merge command to Java tools documentation

[ https://issues.apache.org/jira/browse/ORC-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1668: -- Assignee: dzcxzl > Add merge command to Java tools documentat

[jira] [Resolved] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

[ https://issues.apache.org/jira/browse/SPARK-47616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47616. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45736 [https

[jira] [Assigned] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

[ https://issues.apache.org/jira/browse/SPARK-47616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47616: - Assignee: Kent Yao > Document Mapping Spark SQL Data Types from My

<    2   3   4   5   6   7   8   9   10   11   >