[jira] [Created] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server

2024-04-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-47953: Summary: MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server Key: SPARK-47953 URL: https://issues.apache.org/jira/browse/SPARK-47953 Project: Spark

[jira] [Resolved] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47945. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46173

[jira] [Assigned] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47945: Assignee: Kent Yao > MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL

[jira] [Created] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

2024-04-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-47949: Summary: MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04 Key: SPARK-47949 URL: https://issues.apache.org/jira/browse/SPARK-47949 Project: Spark

[jira] [Created] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47945: Summary: MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests Key: SPARK-47945 URL: https://issues.apache.org/jira/browse/SPARK-47945

[jira] [Created] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error

2024-04-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47938: Summary: MsSQLServer: Cannot find data type BYTE error Key: SPARK-47938 URL: https://issues.apache.org/jira/browse/SPARK-47938 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47916) Unused and leaked session hive instance in HiveSessionImplwithUGI

2024-04-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-47916: Summary: Unused and leaked session hive instance in HiveSessionImplwithUGI Key: SPARK-47916 URL: https://issues.apache.org/jira/browse/SPARK-47916 Project: Spark

[jira] [Assigned] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

2024-04-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47833: Assignee: Cheng Pan > Supply caller stackstrace for checkAndGlobPathIfNecessary

[jira] [Resolved] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

2024-04-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47833. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46028

[jira] [Created] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

2024-04-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-47911: Summary: Introduces a universal BinaryFormatter to make binary output consistent Key: SPARK-47911 URL: https://issues.apache.org/jira/browse/SPARK-47911 Project: Spark

[jira] [Created] (SPARK-47905) ANSI Mode: Trim binary values shall result binary type instead of string type

2024-04-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-47905: Summary: ANSI Mode: Trim binary values shall result binary type instead of string type Key: SPARK-47905 URL: https://issues.apache.org/jira/browse/SPARK-47905 Project:

[jira] [Resolved] (SPARK-47897) ExpressionSet performance regression in scala 2.12

2024-04-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47897. -- Fix Version/s: 3.4.4 3.5.2 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-47898) Port HIVE-12270: Add DBTokenStore support to HS2 delegation token

2024-04-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-47898: Summary: Port HIVE-12270: Add DBTokenStore support to HS2 delegation token Key: SPARK-47898 URL: https://issues.apache.org/jira/browse/SPARK-47898 Project: Spark

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: 3.5.1 3.4.2 > Improve JDBC data sources >

[jira] [Updated] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47882: - Affects Version/s: 3.5.1 3.4.2 > createTableColumnTypes need to be mapped to

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: (was: 3.4.2) (was: 3.5.1) > Improve JDBC data sources

[jira] [Created] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47882: Summary: createTableColumnTypes need to be mapped to database types instead of using directly Key: SPARK-47882 URL: https://issues.apache.org/jira/browse/SPARK-47882

[jira] [Resolved] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47880. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46092

[jira] [Assigned] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47880: Assignee: Kent Yao > Oracle: Document Mapping Spark SQL Data Types to Oracle >

[jira] [Resolved] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47879. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46091

[jira] [Created] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47880: Summary: Oracle: Document Mapping Spark SQL Data Types to Oracle Key: SPARK-47880 URL: https://issues.apache.org/jira/browse/SPARK-47880 Project: Spark Issue Type:

[jira] [Created] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47879: Summary: Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping Key: SPARK-47879 URL: https://issues.apache.org/jira/browse/SPARK-47879 Project: Spark

[jira] [Commented] (SPARK-45859) Make UDF objects in ml.functions lazy

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837644#comment-17837644 ] Kent Yao commented on SPARK-45859: -- I removed 3.0 and 3.1 from *Affects Version/s:* here because I

[jira] [Updated] (SPARK-45859) Make UDF objects in ml.functions lazy

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-45859: - Affects Version/s: (was: 3.0) (was: 3.1) > Make UDF objects in

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47556: - Affects Version/s: 3.1.0 (was: 3.1) > [K8] Spark App ID collision resulting

[jira] [Created] (SPARK-47871) Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47871: Summary: Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE Key: SPARK-47871 URL: https://issues.apache.org/jira/browse/SPARK-47871 Project: Spark Issue

[jira] [Created] (SPARK-47856) Oracle: Document Mapping Spark SQL Data Types from Oracle

2024-04-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-47856: Summary: Oracle: Document Mapping Spark SQL Data Types from Oracle Key: SPARK-47856 URL: https://issues.apache.org/jira/browse/SPARK-47856 Project: Spark Issue

[jira] [Resolved] (SPARK-47795) Supplement the doc of job schedule for K8S

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47795. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45982

[jira] [Resolved] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47813. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46006

[jira] [Resolved] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47809. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45997

[jira] [Assigned] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47809: Assignee: Wenchen Fan > checkExceptionInExpression should check error for each codegen mode >

[jira] [Created] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-47813: Summary: Replace getArrayDimension with updateExtraColumnMeta Key: SPARK-47813 URL: https://issues.apache.org/jira/browse/SPARK-47813 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47798) Enrich the error message for the reading failures of decimal values

2024-04-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47798. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45981

[jira] [Created] (SPARK-47798) Enrich the error message for the reading failures of decimal values

2024-04-10 Thread Kent Yao (Jira)
Kent Yao created SPARK-47798: Summary: Enrich the error message for the reading failures of decimal values Key: SPARK-47798 URL: https://issues.apache.org/jira/browse/SPARK-47798 Project: Spark

[jira] [Resolved] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

2024-04-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47791. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45976

[jira] [Created] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

2024-04-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-47791: Summary: Truncate exceed decimals with scale first instead of precision from JDBC datasource Key: SPARK-47791 URL: https://issues.apache.org/jira/browse/SPARK-47791 Project:

[jira] [Updated] (SPARK-47781) Handle negative scale for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47781: - Summary: Handle negative scale for JDBC data sources (was: Handle negative scale and truncate exceed

[jira] [Resolved] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47781. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45956

[jira] [Resolved] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47761. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45925

[jira] [Assigned] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47761: Assignee: Kent Yao > Oracle: Support reading AnsiIntervalTypes >

[jira] [Created] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-47781: Summary: Handle negative scale and truncate exceed scale first for JDBC data sources Key: SPARK-47781 URL: https://issues.apache.org/jira/browse/SPARK-47781 Project: Spark

[jira] [Created] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-47761: Summary: Oracle: Support reading AnsiIntervalTypes Key: SPARK-47761 URL: https://issues.apache.org/jira/browse/SPARK-47761 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

2024-04-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47750. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45912

[jira] [Assigned] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

2024-04-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47750: Assignee: Kent Yao > Postgres: Document Mapping Spark SQL Data Types to PostgreSQL >

[jira] [Created] (SPARK-47754) Postgres: Support reading multidimensional arrays

2024-04-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-47754: Summary: Postgres: Support reading multidimensional arrays Key: SPARK-47754 URL: https://issues.apache.org/jira/browse/SPARK-47754 Project: Spark Issue Type:

[jira] [Created] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

2024-04-06 Thread Kent Yao (Jira)
Kent Yao created SPARK-47750: Summary: Postgres: Document Mapping Spark SQL Data Types to PostgreSQL Key: SPARK-47750 URL: https://issues.apache.org/jira/browse/SPARK-47750 Project: Spark Issue

[jira] [Resolved] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47707. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45835

[jira] [Assigned] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47707: Assignee: 王俊博 > Special handling of JSON type for MySQL Connector/J 5.x >

[jira] [Created] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

2024-04-03 Thread Kent Yao (Jira)
Kent Yao created SPARK-47710: Summary: Postgres: Document Mapping Spark SQL Data Types from PostgreSQL Key: SPARK-47710 URL: https://issues.apache.org/jira/browse/SPARK-47710 Project: Spark

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Fix Version/s: 3.4.3 > Fix NPE when reading mysql bit array as LongType >

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Fix Version/s: 3.5.2 > Fix NPE when reading mysql bit array as LongType >

[jira] [Created] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-47691: Summary: Postgres: Support multi dimensional array on the write side Key: SPARK-47691 URL: https://issues.apache.org/jira/browse/SPARK-47691 Project: Spark Issue

[jira] [Assigned] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47665: Assignee: Kent Yao > Using SMALLINT to Write ShortType to MYSQL >

[jira] [Resolved] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47665. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45789

[jira] [Commented] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832809#comment-17832809 ] Kent Yao commented on SPARK-47666: -- resolved by https://github.com/apache/spark/pull/45790 > Fix NPE

[jira] [Resolved] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47666. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > Fix NPE when reading

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Affects Version/s: 3.5.1 3.4.1 > Fix NPE when reading mysql bit array as

[jira] [Created] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-47666: Summary: Fix NPE when reading mysql bit array as LongType Key: SPARK-47666 URL: https://issues.apache.org/jira/browse/SPARK-47666 Project: Spark Issue Type:

[jira] [Created] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-47665: Summary: Using SMALLINT to Write ShortType to MYSQL Key: SPARK-47665 URL: https://issues.apache.org/jira/browse/SPARK-47665 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL

2024-03-31 Thread Kent Yao (Jira)
Kent Yao created SPARK-47662: Summary: Document Mapping Spark SQL Data Types to MySQL Key: SPARK-47662 URL: https://issues.apache.org/jira/browse/SPARK-47662 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres

2024-03-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-47647: Summary: Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres Key: SPARK-47647 URL: https://issues.apache.org/jira/browse/SPARK-47647 Project: Spark

[jira] [Resolved] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`

2024-03-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47614. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45735

[jira] [Assigned] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`

2024-03-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47614: Assignee: BingKun Pan > Rename `JavaModuleOptions` to `JVMRuntimeOptions` >

[jira] [Created] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

2024-03-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-47628: Summary: Fix Postgres bit array issue 'Cannot cast to boolean' Key: SPARK-47628 URL: https://issues.apache.org/jira/browse/SPARK-47628 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'

2024-03-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47628: - Description: {code:java} [info]   Cause: org.postgresql.util.PSQLException: Cannot cast to boolean:

[jira] [Created] (SPARK-47616) Document Mapping Spark SQL Data Types from MySQL

2024-03-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-47616: Summary: Document Mapping Spark SQL Data Types from MySQL Key: SPARK-47616 URL: https://issues.apache.org/jira/browse/SPARK-47616 Project: Spark Issue Type:

[jira] [Created] (SPARK-47611) Cleanup dead code in MySQLDialect.getCatalystType

2024-03-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-47611: Summary: Cleanup dead code in MySQLDialect.getCatalystType Key: SPARK-47611 URL: https://issues.apache.org/jira/browse/SPARK-47611 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47557: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Audit MySQL ENUM/SET Types >

[jira] [Created] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-47557: Summary: Audit MySQL ENUM/SET Types Key: SPARK-47557 URL: https://issues.apache.org/jira/browse/SPARK-47557 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-46822) Respect spark.sql.legacy.charVarcharAsString when casting jdbc type to catalyst type in jdbc

2024-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46822: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Respect

[jira] [Created] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-47537: Summary: Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J Key: SPARK-47537 URL: https://issues.apache.org/jira/browse/SPARK-47537 Project: Spark

[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J

2024-03-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47537: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Use MySQL Connector/J for MySQL DB

[jira] [Resolved] (SPARK-47517) Prefer Utils.bytesToString for size display

2024-03-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47517. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45660

[jira] [Assigned] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

2024-03-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47440: Assignee: Stefan Bukorovic > SQLServer does not support LIKE operator in binary comparison >

[jira] [Resolved] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

2024-03-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47440. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

2024-03-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47522: Summary: Read MySQL FLOAT as FloatType to keep consistent with the write side Key: SPARK-47522 URL: https://issues.apache.org/jira/browse/SPARK-47522 Project: Spark

[jira] [Resolved] (SPARK-47515) Save TimestampNTZType as DATETIME in MySQL

2024-03-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47515. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45655

[jira] [Created] (SPARK-47515) Save TimestampNTZType as DATETIME in MySQL

2024-03-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-47515: Summary: Save TimestampNTZType as DATETIME in MySQL Key: SPARK-47515 URL: https://issues.apache.org/jira/browse/SPARK-47515 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47496) Java SPI Support for JDBC dialect registering

2024-03-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47496. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45626

[jira] [Assigned] (SPARK-47496) Java SPI Support for JDBC dialect registering

2024-03-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47496: Assignee: Kent Yao > Java SPI Support for JDBC dialect registering >

[jira] [Created] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

2024-03-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-47501: Summary: Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects Key: SPARK-47501 URL: https://issues.apache.org/jira/browse/SPARK-47501

[jira] [Created] (SPARK-47496) Java SPI Support for JDBC dialect registering

2024-03-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-47496: Summary: Java SPI Support for JDBC dialect registering Key: SPARK-47496 URL: https://issues.apache.org/jira/browse/SPARK-47496 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-47467) Error message regressed when creating hive table with illegal column name

2024-03-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828915#comment-17828915 ] Kent Yao commented on SPARK-47467: -- {code:java} spark-sql (default)> select version(); 4.0.0

[jira] [Updated] (SPARK-47467) Error message regressed when creating hive table with illegal column name

2024-03-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47467: - Priority: Minor (was: Major) > Error message regressed when creating hive table with illegal column

[jira] [Resolved] (SPARK-47473) Correctness issue of converting postgres INFINITIES timestamps

2024-03-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47473. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-47473) Correctness issue of converting postgres INFINITIES timestamps

2024-03-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47473: Assignee: Kent Yao > Correctness issue of converting postgres INFINITIES timestamps >

[jira] [Created] (SPARK-47478) Improve test coverage for mysql bool synonyms

2024-03-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-47478: Summary: Improve test coverage for mysql bool synonyms Key: SPARK-47478 URL: https://issues.apache.org/jira/browse/SPARK-47478 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47473) Correctness issue of converting postgres INFINITIES timestamps

2024-03-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47473: - Labels: correctness (was: ) > Correctness issue of converting postgres INFINITIES timestamps >

[jira] [Created] (SPARK-47473) Correctness issue of converting postgres INFINITIES timestamps

2024-03-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-47473: Summary: Correctness issue of converting postgres INFINITIES timestamps Key: SPARK-47473 URL: https://issues.apache.org/jira/browse/SPARK-47473 Project: Spark

[jira] [Created] (SPARK-47462) Align the mapping ways of other unsigned numeric types with TINYINT UNSGINED in MySQLDialect

2024-03-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-47462: Summary: Align the mapping ways of other unsigned numeric types with TINYINT UNSGINED in MySQLDialect Key: SPARK-47462 URL: https://issues.apache.org/jira/browse/SPARK-47462

[jira] [Updated] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

2024-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47435: - Fix Version/s: 3.5.2 > SPARK-45561 causes mysql unsigned tinyint overflow >

[jira] [Updated] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47453: - Priority: Minor (was: Major) > Upgrade MySQL docker image version to 8.3.0 >

[jira] [Created] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-47453: Summary: Upgrade MySQL docker image version to 8.3.0 Key: SPARK-47453 URL: https://issues.apache.org/jira/browse/SPARK-47453 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

2024-03-17 Thread Kent Yao (Jira)
Kent Yao created SPARK-47435: Summary: SPARK-45561 causes mysql unsigned tinyint overflow Key: SPARK-47435 URL: https://issues.apache.org/jira/browse/SPARK-47435 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47406) Handle TIMESTAMP and DATETIME in MYSQLDialect

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47406: Assignee: Kent Yao > Handle TIMESTAMP and DATETIME in MYSQLDialect >

[jira] [Commented] (SPARK-47406) Handle TIMESTAMP and DATETIME in MYSQLDialect

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827447#comment-17827447 ] Kent Yao commented on SPARK-47406: -- resolved by https://github.com/apache/spark/pull/45530 > Handle

[jira] [Resolved] (SPARK-47406) Handle TIMESTAMP and DATETIME in MYSQLDialect

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47406. -- Fix Version/s: 4.0.0 Resolution: Fixed > Handle TIMESTAMP and DATETIME in MYSQLDialect >

[jira] [Commented] (SPARK-44893) ThreadInfo improvements for monitoring APIs

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827435#comment-17827435 ] Kent Yao commented on SPARK-44893: -- Updated. Thank you  [~dongjoon]  > ThreadInfo improvements for

[jira] [Resolved] (SPARK-44893) ThreadInfo improvements for monitoring APIs

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44893. -- Fix Version/s: 4.0.0 Resolution: Fixed > ThreadInfo improvements for monitoring APIs >

[jira] [Updated] (SPARK-44896) Consider adding information os_prio, cpu, elapsed, tid, nid, etc., from the jstack tool

2024-03-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-44896: - Parent: (was: SPARK-44893) Issue Type: Improvement (was: Sub-task) > Consider adding

<    1   2   3   4   5   6   7   8   9   10   >