[jira] [Updated] (SPARK-48026) Promote trunc from a datetime only function to a datetime function

2024-05-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48026: - Issue Type: Improvement (was: Bug) > Promote trunc from a datetime only function to a datetime >

[jira] [Created] (SPARK-48269) DB2: Document Mapping Spark SQL Data Types from DB2 and add tests

2024-05-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-48269: Summary: DB2: Document Mapping Spark SQL Data Types from DB2 and add tests Key: SPARK-48269 URL: https://issues.apache.org/jira/browse/SPARK-48269 Project: Spark

[jira] [Created] (SPARK-48216) Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable

2024-05-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-48216: Summary: Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable Key: SPARK-48216 URL: https://issues.apache.org/jira/browse/SPARK-48216

[jira] [Resolved] (SPARK-48211) DB2: Read SMALLINT as ShortType

2024-05-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48211. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46497

[jira] [Assigned] (SPARK-48211) DB2: Read SMALLINT as ShortType

2024-05-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48211: Assignee: Kent Yao > DB2: Read SMALLINT as ShortType > --- > >

[jira] [Created] (SPARK-48211) DB2: Read SMALLINT as ShortType

2024-05-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-48211: Summary: DB2: Read SMALLINT as ShortType Key: SPARK-48211 URL: https://issues.apache.org/jira/browse/SPARK-48211 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-48188) Consistently use normalized plan for cache

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48188: Assignee: Wenchen Fan > Consistently use normalized plan for cache >

[jira] [Resolved] (SPARK-48188) Consistently use normalized plan for cache

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48188. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46465

[jira] [Resolved] (SPARK-48191) Support UTF-32 for string encode and decode

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48191. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46469

[jira] [Assigned] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48185: Assignee: Kent Yao > Fix 'symbolic reference class is not accessible: class >

[jira] [Resolved] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48185. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46457

[jira] [Resolved] (SPARK-47914) Do not display the splits parameter in Rang

2024-05-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47914. -- Resolution: Fixed Issue resolved by pull request 46136 [https://github.com/apache/spark/pull/46136]

[jira] [Assigned] (SPARK-47914) Do not display the splits parameter in Rang

2024-05-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47914: Assignee: guihuawen > Do not display the splits parameter in Rang >

[jira] [Created] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'

2024-05-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-48185: Summary: Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo' Key: SPARK-48185 URL: https://issues.apache.org/jira/browse/SPARK-48185 Project:

[jira] [Created] (SPARK-48168) Add bitwise shifting operators support

2024-05-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-48168: Summary: Add bitwise shifting operators support Key: SPARK-48168 URL: https://issues.apache.org/jira/browse/SPARK-48168 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48066) TPCDSBenchmark fails with divide by zero in q90 for ANSI

2024-04-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-48066: Summary: TPCDSBenchmark fails with divide by zero in q90 for ANSI Key: SPARK-48066 URL: https://issues.apache.org/jira/browse/SPARK-48066 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47994) SQLServer does not support 1 and 0 as boolean values

2024-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47994. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46231

[jira] [Updated] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48042: - Issue Type: Improvement (was: Test) > Don't use a copy of timestamp formatter with a new override zone

[jira] [Created] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-48042: Summary: Don't use a copy of timestamp formatter with a new override zone for each value Key: SPARK-48042 URL: https://issues.apache.org/jira/browse/SPARK-48042 Project:

[jira] [Resolved] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48034. -- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48034: Assignee: Kent Yao > NullPointerException in MapStatusesSerDeserBenchmark >

[jira] [Created] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark

2024-04-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-48034: Summary: NullPointerException in MapStatusesSerDeserBenchmark Key: SPARK-48034 URL: https://issues.apache.org/jira/browse/SPARK-48034 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44442) Drop mesos support

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-2: - Labels: pull-request-available releasenotes (was: pull-request-available) > Drop mesos support >

[jira] [Updated] (SPARK-48028) Regenerate benchmark results after turning ANSI on

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48028: - External issue ID: SPARK-4 > Regenerate benchmark results after turning ANSI on >

[jira] [Assigned] (SPARK-48028) Regenerate benchmark results after turning ANSI on

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48028: Assignee: Kent Yao > Regenerate benchmark results after turning ANSI on >

[jira] [Created] (SPARK-48028) Regenerate benchmark results after turning ANSI on

2024-04-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-48028: Summary: Regenerate benchmark results after turning ANSI on Key: SPARK-48028 URL: https://issues.apache.org/jira/browse/SPARK-48028 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48025. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46261

[jira] [Assigned] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark

2024-04-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48025: Assignee: Kent Yao > Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark >

[jira] [Created] (SPARK-48026) Promote trunc from a datetime only function to a datetime function

2024-04-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-48026: Summary: Promote trunc from a datetime only function to a datetime function Key: SPARK-48026 URL: https://issues.apache.org/jira/browse/SPARK-48026 Project: Spark

[jira] [Created] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark

2024-04-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-48025: Summary: Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark Key: SPARK-48025 URL: https://issues.apache.org/jira/browse/SPARK-48025 Project: Spark

[jira] [Assigned] (SPARK-48020) Pin 'pandas==2.2.2'

2024-04-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48020: Assignee: Ruifeng Zheng > Pin 'pandas==2.2.2' > --- > > Key:

[jira] [Resolved] (SPARK-48020) Pin 'pandas==2.2.2'

2024-04-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48020. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46256

[jira] [Resolved] (SPARK-47968) MsSQLServer: Map datatimeoffset to TimestampType

2024-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47968. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46239

[jira] [Assigned] (SPARK-48004) Add WriteFilesExecBase trait for v1 write

2024-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48004: Assignee: XiDuo You > Add WriteFilesExecBase trait for v1 write >

[jira] [Resolved] (SPARK-48004) Add WriteFilesExecBase trait for v1 write

2024-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48004. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46240

[jira] [Created] (SPARK-48007) MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11

2024-04-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-48007: Summary: MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11 Key: SPARK-48007 URL: https://issues.apache.org/jira/browse/SPARK-48007 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`

2024-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48001. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46238

[jira] [Assigned] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`

2024-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48001: Assignee: Yang Jie > Remove unused `private implicit def arrayToArrayWritable` from

[jira] [Updated] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

2024-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47440: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > SQLServer does not support LIKE operator

[jira] [Resolved] (SPARK-47982) Update code style' plugins to latest version

2024-04-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47982. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46216

[jira] [Resolved] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.

2024-04-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47984. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46218

[jira] [Assigned] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.

2024-04-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47984: Assignee: Yang Jie > Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call >

[jira] [Resolved] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal

2024-04-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47983. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46217

[jira] [Created] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal

2024-04-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-47983: Summary: Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal Key: SPARK-47983 URL: https://issues.apache.org/jira/browse/SPARK-47983 Project:

[jira] [Created] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server

2024-04-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-47953: Summary: MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server Key: SPARK-47953 URL: https://issues.apache.org/jira/browse/SPARK-47953 Project: Spark

[jira] [Resolved] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47945. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46173

[jira] [Assigned] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47945: Assignee: Kent Yao > MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL

[jira] [Created] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

2024-04-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-47949: Summary: MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04 Key: SPARK-47949 URL: https://issues.apache.org/jira/browse/SPARK-47949 Project: Spark

[jira] [Created] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47945: Summary: MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests Key: SPARK-47945 URL: https://issues.apache.org/jira/browse/SPARK-47945

[jira] [Created] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error

2024-04-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47938: Summary: MsSQLServer: Cannot find data type BYTE error Key: SPARK-47938 URL: https://issues.apache.org/jira/browse/SPARK-47938 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47916) Unused and leaked session hive instance in HiveSessionImplwithUGI

2024-04-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-47916: Summary: Unused and leaked session hive instance in HiveSessionImplwithUGI Key: SPARK-47916 URL: https://issues.apache.org/jira/browse/SPARK-47916 Project: Spark

[jira] [Assigned] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

2024-04-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47833: Assignee: Cheng Pan > Supply caller stackstrace for checkAndGlobPathIfNecessary

[jira] [Resolved] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

2024-04-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47833. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46028

[jira] [Created] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

2024-04-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-47911: Summary: Introduces a universal BinaryFormatter to make binary output consistent Key: SPARK-47911 URL: https://issues.apache.org/jira/browse/SPARK-47911 Project: Spark

[jira] [Created] (SPARK-47905) ANSI Mode: Trim binary values shall result binary type instead of string type

2024-04-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-47905: Summary: ANSI Mode: Trim binary values shall result binary type instead of string type Key: SPARK-47905 URL: https://issues.apache.org/jira/browse/SPARK-47905 Project:

[jira] [Resolved] (SPARK-47897) ExpressionSet performance regression in scala 2.12

2024-04-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47897. -- Fix Version/s: 3.4.4 3.5.2 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-47898) Port HIVE-12270: Add DBTokenStore support to HS2 delegation token

2024-04-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-47898: Summary: Port HIVE-12270: Add DBTokenStore support to HS2 delegation token Key: SPARK-47898 URL: https://issues.apache.org/jira/browse/SPARK-47898 Project: Spark

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: 3.5.1 3.4.2 > Improve JDBC data sources >

[jira] [Updated] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47882: - Affects Version/s: 3.5.1 3.4.2 > createTableColumnTypes need to be mapped to

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: (was: 3.4.2) (was: 3.5.1) > Improve JDBC data sources

[jira] [Created] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47882: Summary: createTableColumnTypes need to be mapped to database types instead of using directly Key: SPARK-47882 URL: https://issues.apache.org/jira/browse/SPARK-47882

[jira] [Resolved] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47880. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46092

[jira] [Assigned] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47880: Assignee: Kent Yao > Oracle: Document Mapping Spark SQL Data Types to Oracle >

[jira] [Resolved] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47879. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46091

[jira] [Created] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47880: Summary: Oracle: Document Mapping Spark SQL Data Types to Oracle Key: SPARK-47880 URL: https://issues.apache.org/jira/browse/SPARK-47880 Project: Spark Issue Type:

[jira] [Created] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47879: Summary: Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping Key: SPARK-47879 URL: https://issues.apache.org/jira/browse/SPARK-47879 Project: Spark

[jira] [Commented] (SPARK-45859) Make UDF objects in ml.functions lazy

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837644#comment-17837644 ] Kent Yao commented on SPARK-45859: -- I removed 3.0 and 3.1 from *Affects Version/s:* here because I

[jira] [Updated] (SPARK-45859) Make UDF objects in ml.functions lazy

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-45859: - Affects Version/s: (was: 3.0) (was: 3.1) > Make UDF objects in

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47556: - Affects Version/s: 3.1.0 (was: 3.1) > [K8] Spark App ID collision resulting

[jira] [Created] (SPARK-47871) Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47871: Summary: Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE Key: SPARK-47871 URL: https://issues.apache.org/jira/browse/SPARK-47871 Project: Spark Issue

[jira] [Created] (SPARK-47856) Oracle: Document Mapping Spark SQL Data Types from Oracle

2024-04-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-47856: Summary: Oracle: Document Mapping Spark SQL Data Types from Oracle Key: SPARK-47856 URL: https://issues.apache.org/jira/browse/SPARK-47856 Project: Spark Issue

[jira] [Resolved] (SPARK-47795) Supplement the doc of job schedule for K8S

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47795. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45982

[jira] [Resolved] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47813. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46006

[jira] [Resolved] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47809. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45997

[jira] [Assigned] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47809: Assignee: Wenchen Fan > checkExceptionInExpression should check error for each codegen mode >

[jira] [Created] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-47813: Summary: Replace getArrayDimension with updateExtraColumnMeta Key: SPARK-47813 URL: https://issues.apache.org/jira/browse/SPARK-47813 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47798) Enrich the error message for the reading failures of decimal values

2024-04-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47798. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45981

[jira] [Created] (SPARK-47798) Enrich the error message for the reading failures of decimal values

2024-04-10 Thread Kent Yao (Jira)
Kent Yao created SPARK-47798: Summary: Enrich the error message for the reading failures of decimal values Key: SPARK-47798 URL: https://issues.apache.org/jira/browse/SPARK-47798 Project: Spark

[jira] [Resolved] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

2024-04-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47791. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45976

[jira] [Created] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

2024-04-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-47791: Summary: Truncate exceed decimals with scale first instead of precision from JDBC datasource Key: SPARK-47791 URL: https://issues.apache.org/jira/browse/SPARK-47791 Project:

[jira] [Updated] (SPARK-47781) Handle negative scale for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47781: - Summary: Handle negative scale for JDBC data sources (was: Handle negative scale and truncate exceed

[jira] [Resolved] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47781. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45956

[jira] [Resolved] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47761. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45925

[jira] [Assigned] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47761: Assignee: Kent Yao > Oracle: Support reading AnsiIntervalTypes >

[jira] [Created] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-47781: Summary: Handle negative scale and truncate exceed scale first for JDBC data sources Key: SPARK-47781 URL: https://issues.apache.org/jira/browse/SPARK-47781 Project: Spark

[jira] [Created] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-47761: Summary: Oracle: Support reading AnsiIntervalTypes Key: SPARK-47761 URL: https://issues.apache.org/jira/browse/SPARK-47761 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

2024-04-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47750. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45912

[jira] [Assigned] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

2024-04-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47750: Assignee: Kent Yao > Postgres: Document Mapping Spark SQL Data Types to PostgreSQL >

[jira] [Created] (SPARK-47754) Postgres: Support reading multidimensional arrays

2024-04-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-47754: Summary: Postgres: Support reading multidimensional arrays Key: SPARK-47754 URL: https://issues.apache.org/jira/browse/SPARK-47754 Project: Spark Issue Type:

[jira] [Created] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

2024-04-06 Thread Kent Yao (Jira)
Kent Yao created SPARK-47750: Summary: Postgres: Document Mapping Spark SQL Data Types to PostgreSQL Key: SPARK-47750 URL: https://issues.apache.org/jira/browse/SPARK-47750 Project: Spark Issue

[jira] [Resolved] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47707. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45835

[jira] [Assigned] (SPARK-47707) Special handling of JSON type for MySQL Connector/J 5.x

2024-04-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47707: Assignee: 王俊博 > Special handling of JSON type for MySQL Connector/J 5.x >

[jira] [Created] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

2024-04-03 Thread Kent Yao (Jira)
Kent Yao created SPARK-47710: Summary: Postgres: Document Mapping Spark SQL Data Types from PostgreSQL Key: SPARK-47710 URL: https://issues.apache.org/jira/browse/SPARK-47710 Project: Spark

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Fix Version/s: 3.4.3 > Fix NPE when reading mysql bit array as LongType >

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Fix Version/s: 3.5.2 > Fix NPE when reading mysql bit array as LongType >

[jira] [Created] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-47691: Summary: Postgres: Support multi dimensional array on the write side Key: SPARK-47691 URL: https://issues.apache.org/jira/browse/SPARK-47691 Project: Spark Issue

[jira] [Assigned] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47665: Assignee: Kent Yao > Using SMALLINT to Write ShortType to MYSQL >

[jira] [Resolved] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47665. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45789

[jira] [Commented] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832809#comment-17832809 ] Kent Yao commented on SPARK-47666: -- resolved by https://github.com/apache/spark/pull/45790 > Fix NPE

[jira] [Resolved] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47666. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > Fix NPE when reading

  1   2   3   4   5   6   7   8   9   10   >