[jira] [Assigned] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47419: - Assignee: BingKun Pan > Move `log4j2-defaults.properties` to `common/ut

[jira] [Resolved] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47419. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45532 [https

[jira] [Commented] (SPARK-45877) ExecutorFailureTracker support for standalone mode

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827395#comment-17827395 ] Dongjoon Hyun commented on SPARK-45877: --- Hi, [~yao]. Shall we convert this from a subtask

[jira] [Updated] (SPARK-44893) ThreadInfo improvements for monitoring APIs

2024-03-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44893: -- Labels: releasenotes (was: ) > ThreadInfo improvements for monitoring A

[jira] [Resolved] (SPARK-47234) Upgrade Scala to 2.13.13

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47234. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45342 [https

[jira] [Created] (SPARK-47405) Remove `JLine 2` dependency

2024-03-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47405: - Summary: Remove `JLine 2` dependency Key: SPARK-47405 URL: https://issues.apache.org/jira/browse/SPARK-47405 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45376) Add netty-tcnative-boringssl-static dependency

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45376: -- Summary: Add netty-tcnative-boringssl-static dependency (was: [CORE] Add netty-tcnative

[jira] [Closed] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47342. - > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME Z

[jira] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342 ] Dongjoon Hyun deleted comment on SPARK-47342: --- was (Author: dongjoon): Issue resolved by pull request 45471 [https://github.com/apache/spark/pull/45471] > Support TimestampNTZ for

[jira] [Commented] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827258#comment-17827258 ] Dongjoon Hyun commented on SPARK-47342: --- Thank you for providing the context. > Supp

[jira] [Resolved] (SPARK-47402) Upgrade `ZooKeeper` to 3.9.2

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47402. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45524 [https

[jira] [Updated] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46305: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove the spec

[jira] [Resolved] (SPARK-47396) Add a general mapping for TIME WITHOUT TIME ZONE to TimestampNTZType

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47396. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45519 [https

[jira] [Resolved] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47401. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45523 [https

[jira] [Assigned] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47401: - Assignee: Dongjoon Hyun > Update `YuniKorn` docs with v

[jira] [Updated] (SPARK-46210) Update `YuniKorn` docs with v1.4

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46210: -- Summary: Update `YuniKorn` docs with v1.4 (was: Update YuniKorn docs with v1.4) > Upd

[jira] [Created] (SPARK-47401) Update `YuniKorn` docs with v1.5

2024-03-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47401: - Summary: Update `YuniKorn` docs with v1.5 Key: SPARK-47401 URL: https://issues.apache.org/jira/browse/SPARK-47401 Project: Spark Issue Type: Sub-task

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-14 Thread Dongjoon Hyun
+1 I tested with Apache ORC repo. Thank you for the new release. Dongjoon. (PS. My previous vote went to yarn-dev@ for some reasons, too) On 2024/03/14 08:40:29 Takanobu Asanuma wrote: > +1 (binding). > > Thanks for the great work, Shilun Fan. > > * Verified signatures and checksums > *

[jira] [Resolved] (SPARK-47400) Upgrade `gcs-connector` to 2.2.20

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47400. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45521 [https

[jira] [Updated] (SPARK-44197) Upgrade Hadoop to 3.3.6

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44197: -- Fix Version/s: 4.0.0 (was: 3.5.0) > Upgrade Hadoop to 3.

[jira] [Updated] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47337: -- Parent Issue: SPARK-47361 (was: SPARK-47046) > Bump DB2 Docker version to 11.5.

[jira] [Commented] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827152#comment-17827152 ] Dongjoon Hyun commented on SPARK-47337: --- I changed this subtask from SPARK-47046 to SPARK-47361

[jira] [Updated] (SPARK-45850) Upgrade oracle jdbc driver to 23.3.0.23.09

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45850: -- Parent Issue: SPARK-47361 (was: SPARK-47046) > Upgrade oracle jdbc driver to 23.3.0.23

[jira] [Resolved] (SPARK-47384) Upgrade RoaringBitmap to 1.0.5

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47384. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45507 [https

[jira] [Resolved] (SPARK-47391) Remove the test case workaround for JDK 8

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47391. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45514 [https

[jira] [Assigned] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47394: - Assignee: Kent Yao > Support TIMESTAMP WITH TIME ZONE for H2Dial

[jira] [Resolved] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47394. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45516 [https

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826833#comment-17826833 ] Dongjoon Hyun commented on SPARK-46810: --- Yes, it sounds fine to me because it's Spark 4, Max

[jira] [Resolved] (SPARK-47378) Make the related Protobuf UT run well in IDE

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47378. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45498 [https

[jira] [Assigned] (SPARK-47378) Make the related Protobuf UT run well in IDE

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47378: - Assignee: BingKun Pan > Make the related Protobuf UT run well in

[jira] [Updated] (SPARK-47314) [DOC] Correct the ExternalSorter#writePartitionedMapOutput method comment

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47314: -- Issue Type: Documentation (was: Improvement) > [DOC] Correct the ExternalSor

[jira] [Updated] (SPARK-47314) Correct the ExternalSorter#writePartitionedMapOutput method comment

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47314: -- Summary: Correct the ExternalSorter#writePartitionedMapOutput method comment (was: [DOC

[jira] [Resolved] (SPARK-47373) [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47373. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45491 [https

[jira] [Assigned] (SPARK-47373) [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec

2024-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47373: - Assignee: Binjie Yang > [SQL] Match FileSourceScanLike to get metadata inst

[jira] [Assigned] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47349: - Assignee: Uroš Bojanić > new test suite for UTF8Str

[jira] [Resolved] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47349. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45477 [https

[jira] [Comment Edited] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825843#comment-17825843 ] Dongjoon Hyun edited comment on SPARK-47369 at 3/12/24 10:05 PM: - Thank

[jira] [Commented] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825843#comment-17825843 ] Dongjoon Hyun commented on SPARK-47369: --- Thank you for reporting, [~neilramaswamy]  Could you

[jira] [Commented] (HADOOP-19108) S3 Express: document use

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825788#comment-17825788 ] Dongjoon Hyun commented on HADOOP-19108: Is this targeting Apache Hadoop 3.4.1? > S3 Expr

[jira] [Resolved] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47364. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45478 [https

[jira] [Assigned] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47364: - Assignee: Dongjoon Hyun > Make `PluginEndpoint` warn when plugins reply for one-

[jira] [Created] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47364: - Summary: Make `PluginEndpoint` warn when plugins reply for one-way message Key: SPARK-47364 URL: https://issues.apache.org/jira/browse/SPARK-47364 Project: Spark

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-12 Thread Dongjoon Hyun
+1 I tested with Apache ORC repo. Thank you for the new release. Dongjoon. On 2024/03/11 20:28:22 Steve Loughran wrote: > +1 binding > > (sorry, this had ended in the yarn-dev folder, otherwise I'd have seen it > earlier. been testing it this afternoon: > > pulled the latest version of >

[jira] [Resolved] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46919. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44929 [https

[jira] [Updated] (SPARK-45425) Mapped TINYINT to ShortType for MsSqlServerDialect

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45425: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Task) > Mapped TINYINT to ShortT

[jira] [Updated] (SPARK-44866) Spark wrongly map the BOOLEAN Type to BIT(1) in Snowflake

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44866: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Spark wrongly map the BOOL

[jira] [Updated] (SPARK-44262) JdbcUtils hardcodes some SQL statements

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44262: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > JdbcUtils hardco

[jira] [Updated] (SPARK-45116) Add some comment for param of JdbcDialect createTable

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45116: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Add some comm

[jira] [Updated] (SPARK-45561) Convert TINYINT catalyst properly in MySQL Dialect

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45561: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Convert TINYINT catal

[jira] [Updated] (SPARK-46410) Assign error classes/subclasses to JdbcUtils.classifyException

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46410: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Assign error clas

[jira] [Updated] (SPARK-46608) Restore backward compatibility of JdbcDialect.classifyException

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46608: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Restore backw

[jira] [Updated] (SPARK-46727) Port classifyException() in JDBC dialects on error classes

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46727: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Port classifyExcept

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46747: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Too Many Shared Locks

[jira] [Updated] (SPARK-46077) Error in postgresql when pushing down filter by timestamp_ntz field

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46077: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Error in postgresql w

[jira] [Updated] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26494: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Support Ora

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42627: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Spark: Gett

[jira] [Updated] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47316: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Fix Timestamp

[jira] [Updated] (SPARK-47280) Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47280: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Remove timez

[jira] [Updated] (SPARK-46579) Redact JDBC url in errors and logs

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46579: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Redact JDBC

[jira] [Updated] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47342: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Support Timestamp

[jira] [Created] (SPARK-47361) Improve JDBC data sources

2024-03-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47361: - Summary: Improve JDBC data sources Key: SPARK-47361 URL: https://issues.apache.org/jira/browse/SPARK-47361 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47342: - Assignee: Kent Yao > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME Z

[jira] [Resolved] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47342. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45471 [https

[jira] [Resolved] (SPARK-47335) Upgrade mvn-scalafmt to 1.1.1684076452.9f83818

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47335. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45452 [https

Re: [ANNOUNCE] Announcing ORC availability in Conan

2024-03-11 Thread Dongjoon Hyun
It’s a great news! Thank you so much. Dongjoon On Mon, Mar 11, 2024 at 19:05 Gang Wu wrote: > Hi All. > > We are happy to announce the availability of Apache ORC C++ library > in the conan center, which is the home of the popular C++ package > manager: > > https://conan.io/center/recipes/orc >

Re: [ANNOUNCE] Announcing ORC availability in Conan

2024-03-11 Thread Dongjoon Hyun
It’s a great news! Thank you so much. Dongjoon On Mon, Mar 11, 2024 at 19:05 Gang Wu wrote: > Hi All. > > We are happy to announce the availability of Apache ORC C++ library > in the conan center, which is the home of the popular C++ package > manager: > > https://conan.io/center/recipes/orc >

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Dongjoon Hyun
Ya, I also have a similar opinion with Mridul. +1 Thank you, Gengliang. Dongjoon. On Mon, Mar 11, 2024 at 1:34 PM Mridul Muralidharan wrote: > > I am supportive of the proposal - this is a step in the right direction ! > Additional metadata (explicit and inferred) for log records, and

[jira] [Assigned] (ORC-1646) Close the reader when reading the schema with the `convert` command

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1646: -- Assignee: dzcxzl > Close the reader when reading the schema with the `convert` comm

[jira] [Updated] (ORC-1646) Close the reader when reading the schema with the `convert` command

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1646: --- Fix Version/s: 2.0.1 (was: 2.1.0) > Close the reader when reading the sch

[jira] [Resolved] (ORC-1646) Close the reader when reading the schema with the `convert` command

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1646. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1837 [https

[jira] [Resolved] (ORC-1634) Fix some outdated descriptions in Building ORC documentation

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1634. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1819 [https

[jira] [Assigned] (ORC-1634) Fix some outdated descriptions in Building ORC documentation

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1634: -- Assignee: dzcxzl > Fix some outdated descriptions in Building ORC documentat

[jira] [Assigned] (ORC-1653) Bump `maven-assembly-plugin` to 3.7.0

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1653: -- Assignee: Dongjoon Hyun > Bump `maven-assembly-plugin` to 3.

[jira] [Resolved] (ORC-1653) Bump `maven-assembly-plugin` to 3.7.0

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1653. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1843 [https

[jira] [Created] (ORC-1653) Bump `maven-assembly-plugin` to 3.7.0

2024-03-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1653: -- Summary: Bump `maven-assembly-plugin` to 3.7.0 Key: ORC-1653 URL: https://issues.apache.org/jira/browse/ORC-1653 Project: ORC Issue Type: Test

[jira] [Created] (ORC-1652) Bump `extra-enforcer-rules` to 1.8.0

2024-03-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1652: -- Summary: Bump `extra-enforcer-rules` to 1.8.0 Key: ORC-1652 URL: https://issues.apache.org/jira/browse/ORC-1652 Project: ORC Issue Type: Test

[jira] [Assigned] (ORC-1652) Bump `extra-enforcer-rules` to 1.8.0

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1652: -- Assignee: Dongjoon Hyun > Bump `extra-enforcer-rules` to 1.

[jira] [Resolved] (ORC-1652) Bump `extra-enforcer-rules` to 1.8.0

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1652. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1842 [https

[jira] [Created] (ORC-1651) Bump `checkstyle` to 10.14.0

2024-03-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1651: -- Summary: Bump `checkstyle` to 10.14.0 Key: ORC-1651 URL: https://issues.apache.org/jira/browse/ORC-1651 Project: ORC Issue Type: Test Components: Java

[jira] [Resolved] (ORC-1651) Bump `checkstyle` to 10.14.0

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1651. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1836 [https

[jira] [Assigned] (ORC-1651) Bump `checkstyle` to 10.14.0

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1651: -- Assignee: Dongjoon Hyun > Bump `checkstyle` to 10.1

[jira] [Assigned] (ORC-1650) Bump `maven-shade-plugin` to 3.5.2

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1650: -- Assignee: Dongjoon Hyun > Bump `maven-shade-plugin` to 3.

[jira] [Resolved] (ORC-1650) Bump `maven-shade-plugin` to 3.5.2

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1650. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 1822 [https

[jira] [Created] (ORC-1650) Bump `maven-shade-plugin` to 3.5.2

2024-03-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1650: -- Summary: Bump `maven-shade-plugin` to 3.5.2 Key: ORC-1650 URL: https://issues.apache.org/jira/browse/ORC-1650 Project: ORC Issue Type: Task Components

[jira] [Resolved] (ORC-1649) [C++][Conan] Add 2.0.0 to conan recipe and update release guide

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1649. Fix Version/s: 2.0.1 2.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-47339) Upgrade checkStyle to `10.14.0`.

2024-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47339. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45451 [https

Re: [ANNOUNCE] Announcing Apache ORC 2.0.0

2024-03-11 Thread Dongjoon Hyun
Thank you! Dongjoon On Sun, Mar 10, 2024 at 2:53 PM William H. wrote: > Thank you Dongjoon for leading this major release! > > Bests, > William > > On Fri, Mar 8, 2024 at 2:34 PM Dongjoon Hyun > wrote: > > > > Hi All. > > > > We are happy to

Re: [ANNOUNCE] Announcing Apache ORC 2.0.0

2024-03-11 Thread Dongjoon Hyun
Thank you! Dongjoon On Sun, Mar 10, 2024 at 2:53 PM William H. wrote: > Thank you Dongjoon for leading this major release! > > Bests, > William > > On Fri, Mar 8, 2024 at 2:34 PM Dongjoon Hyun > wrote: > > > > Hi All. > > > > We are happy to

[ANNOUNCE] Announcing Apache ORC 2.0.0

2024-03-08 Thread Dongjoon Hyun
Hi All. We are happy to announce the availability of Apache ORC 2.0.0! https://orc.apache.org/news/2024/03/08/ORC-2.0.0/ 2.0.0 is a major release containing new features and improvements like the following: - ORC-1547: Spin-off ORC Format - ORC-1572: Use Apache ORC Format 1.0.0

[ANNOUNCE] Announcing Apache ORC 2.0.0

2024-03-08 Thread Dongjoon Hyun
Hi All. We are happy to announce the availability of Apache ORC 2.0.0! https://orc.apache.org/news/2024/03/08/ORC-2.0.0/ 2.0.0 is a major release containing new features and improvements like the following: - ORC-1547: Spin-off ORC Format - ORC-1572: Use Apache ORC Format 1.0.0

[jira] [Closed] (ORC-1100) Support vcpkg

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1100. -- > Support vcpkg > - > > Key: ORC-1100 >

[jira] [Updated] (ORC-1100) Support vcpkg

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1100: --- Labels: releasenotes (was: ) > Support vcpkg > - > > K

[jira] [Reopened] (ORC-1100) Support vcpkg

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened ORC-1100: > Support vcpkg > - > > Key: ORC-1100 >

[jira] [Resolved] (ORC-1100) Support vcpkg

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1100. Resolution: Fixed > Support vcpkg > - > > K

[jira] [Updated] (ORC-1585) [C++] Add orc-format_ep as a dependency of orc

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1585: --- Parent: ORC-1547 Issue Type: Sub-task (was: Bug) > [C++] Add orc-format_ep as a depende

[jira] [Closed] (ORC-1547) Spin-off ORC Format

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1547. -- > Spin-off ORC Format > --- > > Key: ORC-1547 >

[jira] [Resolved] (ORC-1547) Spin-off ORC Format

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1547. Resolution: Fixed > Spin-off ORC Format > --- > > K

[jira] [Resolved] (ORC-1585) [C++] Add orc-format_ep as a dependency of orc

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1585. Resolution: Fixed > [C++] Add orc-format_ep as a dependency of

[jira] [Closed] (ORC-1585) [C++] Add orc-format_ep as a dependency of orc

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1585. -- > [C++] Add orc-format_ep as a dependency of

[jira] [Reopened] (ORC-1547) Spin-off ORC Format

2024-03-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened ORC-1547: > Spin-off ORC Format > --- > > Key: ORC-1547 >

<    6   7   8   9   10   11   12   13   14   15   >