[jira] [Commented] (SPARK-45877) ExecutorFailureTracker support for standalone mode

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827434#comment-17827434 ] Kent Yao commented on SPARK-45877: -- Hi [~dongjoon] , LGTM. I have separated this from  SPARK-45869  >

[jira] [Updated] (SPARK-45877) ExecutorFailureTracker support for standalone mode

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-45877: - Parent: (was: SPARK-45869) Issue Type: New Feature (was: Sub-task) >

[jira] [Created] (SPARK-47407) Support java.sql.Types.NULL

2024-03-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-47407: Summary: Support java.sql.Types.NULL Key: SPARK-47407 URL: https://issues.apache.org/jira/browse/SPARK-47407 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47406) Handle TIMESTAMP and DATETIME in MYSQLDialect

2024-03-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-47406: Summary: Handle TIMESTAMP and DATETIME in MYSQLDialect Key: SPARK-47406 URL: https://issues.apache.org/jira/browse/SPARK-47406 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47390: Assignee: Kent Yao > PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ >

[jira] [Resolved] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47390. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45513

[jira] [Created] (SPARK-47394) Support TIMESTAMP WITH TIME ZONE for H2Dialect

2024-03-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-47394: Summary: Support TIMESTAMP WITH TIME ZONE for H2Dialect Key: SPARK-47394 URL: https://issues.apache.org/jira/browse/SPARK-47394 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47390) PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ

2024-03-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-47390: Summary: PostgresDialect distinguishes TIMESTAMP from TIMESTAMP_TZ Key: SPARK-47390 URL: https://issues.apache.org/jira/browse/SPARK-47390 Project: Spark Issue

[jira] [Assigned] (SPARK-47375) Add guidelines for timestamp mapping in JdbcDialect#getCatalystType

2024-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47375: Assignee: Kent Yao > Add guidelines for timestamp mapping in JdbcDialect#getCatalystType >

[jira] [Resolved] (SPARK-47375) Add guidelines for timestamp mapping in JdbcDialect#getCatalystType

2024-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47375. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45496

[jira] [Comment Edited] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825975#comment-17825975 ] Kent Yao edited comment on SPARK-47342 at 3/13/24 9:19 AM: --- The db2 tstz

[jira] [Resolved] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47342. -- Resolution: Invalid The tstz matches specifically to our ltz > Support TimestampNTZ for DB2

[jira] [Reopened] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-47342: -- Assignee: (was: Kent Yao) > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE >

[jira] [Updated] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47342: - Fix Version/s: (was: 4.0.0) > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE >

[jira] [Created] (SPARK-47375) Add guidelines for timestamp mapping in JdbcDialect#getCatalystType

2024-03-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-47375: Summary: Add guidelines for timestamp mapping in JdbcDialect#getCatalystType Key: SPARK-47375 URL: https://issues.apache.org/jira/browse/SPARK-47375 Project: Spark

[jira] [Updated] (SPARK-46478) Revert SPARK-43049

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46478: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Revert SPARK-43049 > --

[jira] [Updated] (SPARK-46612) Clickhouse's JDBC throws `java.lang.IllegalArgumentException: Unknown data type: string` when write array string with Apache Spark scala

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46612: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Clickhouse's JDBC throws

[jira] [Updated] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47324: - Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Call

[jira] [Updated] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47337: - Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Bump DB2 Docker version to

[jira] [Created] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-47342: Summary: Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE Key: SPARK-47342 URL: https://issues.apache.org/jira/browse/SPARK-47342 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47337. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed issue resolved by

[jira] [Created] (SPARK-47337) Bump DB2 Docker version to 11.5.8.0

2024-03-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-47337: Summary: Bump DB2 Docker version to 11.5.8.0 Key: SPARK-47337 URL: https://issues.apache.org/jira/browse/SPARK-47337 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47316: Assignee: Kent Yao > Fix TimestampNTZ in Postgres Array > --- >

[jira] [Resolved] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47316. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45418

[jira] [Updated] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47324: - Affects Version/s: 4.0.0 (was: 3.5.1) > Call convertJavaTimestampToTimeStamp

[jira] [Created] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-47324: Summary: Call convertJavaTimestampToTimeStamp in Array getter Key: SPARK-47324 URL: https://issues.apache.org/jira/browse/SPARK-47324 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47319) Fix missingInput calculation

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47319. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45424

[jira] [Assigned] (SPARK-47319) Fix missingInput calculation

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47319: Assignee: Peter Toth > Fix missingInput calculation > > >

[jira] [Assigned] (SPARK-47314) [DOC] Correct the ExternalSorter#writePartitionedMapOutput method comment

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47314: Assignee: Binjie Yang > [DOC] Correct the ExternalSorter#writePartitionedMapOutput method

[jira] [Resolved] (SPARK-47314) [DOC] Correct the ExternalSorter#writePartitionedMapOutput method comment

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47314. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45415

[jira] [Resolved] (SPARK-47278) Upgrade rocksdbjni to 8.11.3

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47278. -- Fix Version/s: 4.0.0 Assignee: Yang Jie Resolution: Fixed resolved by GitHub Pull

[jira] [Resolved] (SPARK-47298) Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to `2.7.12`

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47298. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45399

[jira] [Assigned] (SPARK-47298) Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to `2.7.12`

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47298: Assignee: BingKun Pan > Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to

[jira] [Resolved] (SPARK-47300) quoteIfNeeded should quote identifier starts with digits

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47300. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45401

[jira] [Assigned] (SPARK-47300) quoteIfNeeded should quote identifier starts with digits

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47300: Assignee: Wenchen Fan > quoteIfNeeded should quote identifier starts with digits >

[jira] [Resolved] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47301. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45403

[jira] [Assigned] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47301: Assignee: BingKun Pan > Fix flaky ParquetIOSuite > > >

[jira] [Resolved] (SPARK-47315) tempView created in createTempView UT is not cleaned up

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47315. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45417

[jira] [Assigned] (SPARK-47315) tempView created in createTempView UT is not cleaned up

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47315: Assignee: Zhen Wang > tempView created in createTempView UT is not cleaned up >

[jira] [Created] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-47316: Summary: Fix TimestampNTZ in Postgres Array Key: SPARK-47316 URL: https://issues.apache.org/jira/browse/SPARK-47316 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47293) Build batchSchema with total sparkSchema instead of append one by one

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47293. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45396

[jira] [Assigned] (SPARK-47293) Build batchSchema with total sparkSchema instead of append one by one

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47293: Assignee: Binjie Yang > Build batchSchema with total sparkSchema instead of append one by one >

[jira] [Resolved] (SPARK-47280) Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47280. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45384

[jira] [Resolved] (SPARK-47285) AdaptiveSparkPlanExec should always use the context.session

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47285. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45388

[jira] [Assigned] (SPARK-47285) AdaptiveSparkPlanExec should always use the context.session

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47285: Assignee: XiDuo You > AdaptiveSparkPlanExec should always use the context.session >

[jira] [Commented] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823616#comment-17823616 ] Kent Yao commented on SPARK-47198: -- Hi [~melin], it would be better to ask your questions via the

[jira] [Resolved] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47198. -- Resolution: Information Provided > Is it possible to dynamically add backend service to ingress with

[jira] [Created] (SPARK-47280) Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE

2024-03-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-47280: Summary: Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE Key: SPARK-47280 URL: https://issues.apache.org/jira/browse/SPARK-47280 Project: Spark Issue

[jira] [Resolved] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-26494. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45337

[jira] [Assigned] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42627: Assignee: Kent Yao > Spark: Getting SQLException: Unsupported type -102 reading from Oracle >

[jira] [Assigned] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-26494: Assignee: Kent Yao > Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type >

[jira] [Resolved] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42627. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45337

[jira] [Resolved] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47132. -- Fix Version/s: 4.0.0 Resolution: Fixed > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Assigned] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47132: Assignee: Albert Ziegler > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Resolved] (SPARK-47205) Upgrade docker-java to 3.3.5

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45307

[jira] [Resolved] (SPARK-45200) Spark 3.4.0 always using default log4j profile

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45200. -- Resolution: Not A Problem > Spark 3.4.0 always using default log4j profile >

[jira] [Resolved] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46766. -- Fix Version/s: 4.0.0 Resolution: Fixed resolved by https://github.com/apache/spark/pull/44792

[jira] [Assigned] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46766: Assignee: Kent Yao > ZSTD Buffer Pool Support For AVRO datasource >

[jira] [Created] (SPARK-47205) Upgrade docker-java to 3.3.5

2024-02-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-47205: Summary: Upgrade docker-java to 3.3.5 Key: SPARK-47205 URL: https://issues.apache.org/jira/browse/SPARK-47205 Project: Spark Issue Type: Dependency upgrade

[jira] [Resolved] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47063. -- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47063: Assignee: Pablo Langa Blanco > CAST long to timestamp has different behavior for codegen vs

[jira] [Resolved] (SPARK-47186) Improve the debuggability for docker integration test

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47186. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45284

[jira] [Created] (SPARK-47186) Improve the debuggability for docker integration test

2024-02-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-47186: Summary: Improve the debuggability for docker integration test Key: SPARK-47186 URL: https://issues.apache.org/jira/browse/SPARK-47186 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47166) Improve merge_spark_pr.py by emphasising input and error

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47166. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45256

[jira] [Resolved] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47175. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45265

[jira] [Assigned] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47175: Assignee: Dongjoon Hyun > Remove ZOOKEEPER-1844 comment from KafkaTestUtils >

[jira] [Assigned] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47165: Assignee: Kent Yao > Pull docker image only when its' absent >

[jira] [Resolved] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47165. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45255

[jira] [Updated] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47165: - Issue Type: Test (was: Improvement) > Pull docker image only when its' absent >

[jira] [Created] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-47165: Summary: Pull docker image only when its' absent Key: SPARK-47165 URL: https://issues.apache.org/jira/browse/SPARK-47165 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47130: Assignee: Kent Yao > Use listStatus to bypass block location info when cleaning driver logs >

[jira] [Resolved] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47130. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45215

[jira] [Created] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47130: Summary: Use listStatus to bypass block location info when cleaning driver logs Key: SPARK-47130 URL: https://issues.apache.org/jira/browse/SPARK-47130 Project: Spark

[jira] [Updated] (SPARK-47117) Format the whole code base

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47117: - Priority: Trivial (was: Major) > Format the whole code base > -- > >

[jira] [Updated] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34631: - Description: emphasized textcreate a table, set location as parquet, do msck repair table to get the

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819232#comment-17819232 ] Kent Yao commented on SPARK-46934: -- Hi [~dongjoon], this is not a regression. As I commented above, I

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Issue Type: Improvement (was: Test) > HiveExternalCatalog.verifyDataSchema does not fully comply with

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Summary: HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules (was:

[jira] [Created] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules

2024-02-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-47101: Summary: HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules Key: SPARK-47101 URL: https://issues.apache.org/jira/browse/SPARK-47101 Project:

[jira] [Resolved] (SPARK-47085) Preformance issue on thrift API

2024-02-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47085. -- Fix Version/s: 4.0.0 Resolution: Fixed resolved by https://github.com/apache/spark/pull/45155

[jira] [Assigned] (SPARK-47085) Preformance issue on thrift API

2024-02-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47085: Assignee: Izek Greenfield > Preformance issue on thrift API > --- >

[jira] [Updated] (SPARK-46170) Support inject adaptive query post planner strategy rules in SparkSessionExtensions

2024-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46170: - Fix Version/s: 3.5.1 > Support inject adaptive query post planner strategy rules in >

[jira] [Created] (SPARK-46982) Remove _LEGACY_ERROR_TEMP_2187 in favor of CANNOT_RECOGNIZE_HIVE_TYPE

2024-02-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-46982: Summary: Remove _LEGACY_ERROR_TEMP_2187 in favor of CANNOT_RECOGNIZE_HIVE_TYPE Key: SPARK-46982 URL: https://issues.apache.org/jira/browse/SPARK-46982 Project: Spark

[jira] [Resolved] (SPARK-46958) missing timezone to coerce default values

2024-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46958. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45000

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814588#comment-17814588 ] Kent Yao commented on SPARK-46934: -- Hi [~yutinglin], How can I create an element named

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814166#comment-17814166 ] Kent Yao commented on SPARK-46934: -- I will fix this > Unable to create Hive View from certain Spark

[jira] [Created] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

2024-02-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-46974: Summary: Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values Key: SPARK-46974 URL: https://issues.apache.org/jira/browse/SPARK-46974 Project:

[jira] [Created] (SPARK-46972) Asymmetrical replacement for char/varchar in V2SessionCatalog.createTable

2024-02-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-46972: Summary: Asymmetrical replacement for char/varchar in V2SessionCatalog.createTable Key: SPARK-46972 URL: https://issues.apache.org/jira/browse/SPARK-46972 Project: Spark

[jira] [Updated] (SPARK-46958) FIx coerceDefaultValue when canUpCast

2024-02-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46958: - Affects Version/s: 3.5.0 > FIx coerceDefaultValue when canUpCast >

[jira] [Created] (SPARK-46958) FIx coerceDefaultValue when canUpCast

2024-02-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-46958: Summary: FIx coerceDefaultValue when canUpCast Key: SPARK-46958 URL: https://issues.apache.org/jira/browse/SPARK-46958 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

2024-02-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46949: Assignee: Kent Yao > Support CHAR/VARCHAR through ResolveDefaultColumns >

[jira] [Resolved] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

2024-02-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46949. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44991

[jira] [Resolved] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46953. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46953: Assignee: Kent Yao > Wrap withTable for a test in ResolveDefaultColumnsSuite >

[jira] [Created] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

2024-02-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-46953: Summary: Wrap withTable for a test in ResolveDefaultColumnsSuite Key: SPARK-46953 URL: https://issues.apache.org/jira/browse/SPARK-46953 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46945: - Fix Version/s: 3.5.1 3.4.3 > Add

[jira] [Resolved] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46945. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44985

[jira] [Created] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

2024-02-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-46949: Summary: Support CHAR/VARCHAR through ResolveDefaultColumns Key: SPARK-46949 URL: https://issues.apache.org/jira/browse/SPARK-46949 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Fix Version/s: 3.5.1 3.4.3 > Too Many Shared Locks due to

[jira] [Resolved] (SPARK-46924) Fix `Load New` button in `Master/HistoryServer` Log UI

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46924. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44957

<    1   2   3   4   5   6   7   8   9   10   >