[jira] [Updated] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter

2024-03-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47368: --- Affects Version/s: 3.5.0 3.4.0 (was:

[jira] [Resolved] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter

2024-03-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47368. Fix Version/s: 3.4.3 3.5.2 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter

2024-03-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47368: --- Fix Version/s: 4.0.0 > Remove inferTimestampNTZ config check in ParquetRowConverter >

[jira] [Resolved] (SPARK-47333) Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47333. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45167

[jira] [Assigned] (SPARK-47333) Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47333: Assignee: BingKun Pan > Use checkInputDataTypes to check the parameter types of the function

[jira] [Resolved] (SPARK-47340) Change "collate" in StringType typename to lowercase

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47340. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45475

[jira] [Updated] (SPARK-47344) Enhance error message for invalid identifiers that need backticks

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47344: --- Labels: pull-request-available (was: ) > Enhance error message for invalid identifiers

[jira] [Updated] (SPARK-47373) [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47373: --- Labels: pull-request-available (was: ) > [SQL] Match FileSourceScanLike to get metadata

[jira] [Created] (SPARK-47373) [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec

2024-03-12 Thread Binjie Yang (Jira)
Binjie Yang created SPARK-47373: --- Summary: [SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec Key: SPARK-47373 URL: https://issues.apache.org/jira/browse/SPARK-47373 Project:

[jira] [Resolved] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47348. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45416

[jira] [Assigned] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47348: Assignee: BingKun Pan > Align the version of the ubuntu host machine where the GitHub

[jira] [Updated] (SPARK-47289) Allow extensions to log extended information in explain plan

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47289: --- Labels: pull-request-available (was: ) > Allow extensions to log extended information in

[jira] [Updated] (SPARK-47371) XML: Ignore row tags in CDATA Tokenizer

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47371: --- Labels: pull-request-available (was: ) > XML: Ignore row tags in CDATA Tokenizer >

[jira] [Created] (SPARK-47371) XML: Ignore row tags in CDATA

2024-03-12 Thread Yousof Hosny (Jira)
Yousof Hosny created SPARK-47371: Summary: XML: Ignore row tags in CDATA Key: SPARK-47371 URL: https://issues.apache.org/jira/browse/SPARK-47371 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47371) XML: Ignore row tags in CDATA Tokenizer

2024-03-12 Thread Yousof Hosny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yousof Hosny updated SPARK-47371: - Summary: XML: Ignore row tags in CDATA Tokenizer (was: XML: Ignore row tags in CDATA) > XML:

[jira] [Updated] (SPARK-47367) Support Python data source API with Spark Connect

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47367: --- Labels: pull-request-available (was: ) > Support Python data source API with Spark Connect

[jira] [Assigned] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47349: - Assignee: Uroš Bojanić > new test suite for UTF8String > -

[jira] [Resolved] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47349. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45477

[jira] [Updated] (SPARK-47107) Implement partition reader for python streaming data source

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47107: --- Labels: pull-request-available (was: ) > Implement partition reader for python streaming

[jira] [Resolved] (SPARK-47272) MapState Implementation for State V2

2024-03-12 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47272. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45341

[jira] [Resolved] (SPARK-47370) Add migration doc: TimestampNTZ type inference on Parquet files

2024-03-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47370. Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Comment Edited] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825843#comment-17825843 ] Dongjoon Hyun edited comment on SPARK-47369 at 3/12/24 10:05 PM: - Thank

[jira] [Commented] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825843#comment-17825843 ] Dongjoon Hyun commented on SPARK-47369: --- Thank you for reporting, [~neilramaswamy]  Could you

[jira] [Updated] (SPARK-47370) Add migration doc: TimestampNTZ type inference on Parquet files

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47370: --- Labels: pull-request-available (was: ) > Add migration doc: TimestampNTZ type inference on

[jira] [Updated] (SPARK-47365) Add toArrow() DataFrame method to PySpark

2024-03-12 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Component/s: SQL > Add toArrow() DataFrame method to PySpark >

[jira] [Updated] (SPARK-47365) Add toArrow() DataFrame method to PySpark

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47365: --- Labels: pull-request-available (was: ) > Add toArrow() DataFrame method to PySpark >

[jira] [Updated] (SPARK-47365) Add toArrow() DataFrame method to PySpark

2024-03-12 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Description: Over in the Apache Arrow community, we hear from a lot of users who want to return the

[jira] [Updated] (SPARK-47365) Add toArrow() DataFrame method to PySpark

2024-03-12 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47365: - Summary: Add toArrow() DataFrame method to PySpark (was: Add toArrow() DataFrame method) > Add

[jira] [Commented] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Neil Ramaswamy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825828#comment-17825828 ] Neil Ramaswamy commented on SPARK-47369: cc: [~dongjoon] and [~LuciferYang], who were involved

[jira] [Created] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-12 Thread Neil Ramaswamy (Jira)
Neil Ramaswamy created SPARK-47369: -- Summary: Fix performance regression in JDK 17 caused from RocksDB logging Key: SPARK-47369 URL: https://issues.apache.org/jira/browse/SPARK-47369 Project: Spark

[jira] [Updated] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47368: --- Labels: pull-request-available (was: ) > Remove inferTimestampNTZ config check in

[jira] [Created] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter

2024-03-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47368: -- Summary: Remove inferTimestampNTZ config check in ParquetRowConverter Key: SPARK-47368 URL: https://issues.apache.org/jira/browse/SPARK-47368 Project: Spark

[jira] [Updated] (SPARK-47367) Support Python data source API with Spark Connect

2024-03-12 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-47367: - Summary: Support Python data source API with Spark Connect (was: Support Python data source

[jira] [Updated] (SPARK-47367) Support Python data source API in Spark Connect

2024-03-12 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-47367: - Summary: Support Python data source API in Spark Connect (was: Support Python data source API

[jira] [Created] (SPARK-47367) Support Python data source API with Spark Connect

2024-03-12 Thread Allison Wang (Jira)
Allison Wang created SPARK-47367: Summary: Support Python data source API with Spark Connect Key: SPARK-47367 URL: https://issues.apache.org/jira/browse/SPARK-47367 Project: Spark Issue

[jira] [Updated] (SPARK-47366) Implement parse_json

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47366: --- Labels: pull-request-available (was: ) > Implement parse_json > > >

[jira] [Created] (SPARK-47366) Implement parse_json

2024-03-12 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47366: -- Summary: Implement parse_json Key: SPARK-47366 URL: https://issues.apache.org/jira/browse/SPARK-47366 Project: Spark Issue Type: Sub-task Components:

[jira] [Comment Edited] (SPARK-47365) Add toArrow() DataFrame method

2024-03-12 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825769#comment-17825769 ] Ian Cook edited comment on SPARK-47365 at 3/12/24 8:04 PM: --- It looks like all

[jira] [Resolved] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47364. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45478

[jira] [Assigned] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47364: - Assignee: Dongjoon Hyun > Make `PluginEndpoint` warn when plugins reply for one-way

[jira] [Commented] (SPARK-47365) Add toArrow() DataFrame method

2024-03-12 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825769#comment-17825769 ] Ian Cook commented on SPARK-47365: -- It looks like all the pieces required to enable this already exist:

[jira] [Created] (SPARK-47365) Add toArrow() DataFrame method

2024-03-12 Thread Ian Cook (Jira)
Ian Cook created SPARK-47365: Summary: Add toArrow() DataFrame method Key: SPARK-47365 URL: https://issues.apache.org/jira/browse/SPARK-47365 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-47344) Enhance error message for invalid identifiers that need backticks

2024-03-12 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825757#comment-17825757 ] Ignite TC Bot commented on SPARK-47344: --- User 'srielau' has created a pull request for this issue:

[jira] [Updated] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47364: --- Labels: pull-request-available (was: ) > Make `PluginEndpoint` warn when plugins reply for

[jira] [Created] (SPARK-47364) Make `PluginEndpoint` warn when plugins reply for one-way message

2024-03-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47364: - Summary: Make `PluginEndpoint` warn when plugins reply for one-way message Key: SPARK-47364 URL: https://issues.apache.org/jira/browse/SPARK-47364 Project: Spark

[jira] [Created] (SPARK-47363) Initial State without state reader implementation for State API v2.

2024-03-12 Thread Jing Zhan (Jira)
Jing Zhan created SPARK-47363: - Summary: Initial State without state reader implementation for State API v2. Key: SPARK-47363 URL: https://issues.apache.org/jira/browse/SPARK-47363 Project: Spark

[jira] [Created] (SPARK-47362) Enhance the console sink to provide watermark and state information

2024-03-12 Thread Neil Ramaswamy (Jira)
Neil Ramaswamy created SPARK-47362: -- Summary: Enhance the console sink to provide watermark and state information Key: SPARK-47362 URL: https://issues.apache.org/jira/browse/SPARK-47362 Project:

[jira] [Updated] (SPARK-46478) Revert SPARK-43049

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46478: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Revert SPARK-43049 > --

[jira] [Updated] (SPARK-46612) Clickhouse's JDBC throws `java.lang.IllegalArgumentException: Unknown data type: string` when write array string with Apache Spark scala

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46612: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Clickhouse's JDBC throws

[jira] [Updated] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47324: - Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Call

[jira] [Resolved] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46919. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44929

[jira] [Updated] (SPARK-45425) Mapped TINYINT to ShortType for MsSqlServerDialect

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45425: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Task) > Mapped TINYINT to ShortType

[jira] [Updated] (SPARK-44866) Spark wrongly map the BOOLEAN Type to BIT(1) in Snowflake

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44866: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Spark wrongly map the BOOLEAN

[jira] [Updated] (SPARK-44262) JdbcUtils hardcodes some SQL statements

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44262: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > JdbcUtils hardcodes

[jira] [Updated] (SPARK-45116) Add some comment for param of JdbcDialect createTable

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45116: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Add some comment for

[jira] [Updated] (SPARK-45561) Convert TINYINT catalyst properly in MySQL Dialect

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45561: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Convert TINYINT catalyst

[jira] [Updated] (SPARK-46410) Assign error classes/subclasses to JdbcUtils.classifyException

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46410: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Assign error

[jira] [Updated] (SPARK-46608) Restore backward compatibility of JdbcDialect.classifyException

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46608: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Restore backward

[jira] [Updated] (SPARK-46727) Port classifyException() in JDBC dialects on error classes

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46727: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Port

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46747: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Too Many Shared Locks due to

[jira] [Updated] (SPARK-46077) Error in postgresql when pushing down filter by timestamp_ntz field

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46077: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Error in postgresql when

[jira] [Updated] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26494: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Support Oracle

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42627: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Spark: Getting

[jira] [Updated] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47316: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Fix TimestampNTZ in

[jira] [Updated] (SPARK-47280) Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47280: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Remove timezone

[jira] [Updated] (SPARK-46579) Redact JDBC url in errors and logs

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46579: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Redact JDBC url in

[jira] [Updated] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47342: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Support TimestampNTZ

[jira] [Created] (SPARK-47361) Improve JDBC data sources

2024-03-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47361: - Summary: Improve JDBC data sources Key: SPARK-47361 URL: https://issues.apache.org/jira/browse/SPARK-47361 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47342: - Assignee: Kent Yao > Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE >

[jira] [Resolved] (SPARK-47342) Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47342. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45471

[jira] [Resolved] (SPARK-47335) Upgrade mvn-scalafmt to 1.1.1684076452.9f83818

2024-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47335. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45452

[jira] [Commented] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-03-12 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825686#comment-17825686 ] Martin Rueckl commented on SPARK-46876: --- ping. The PR is open, the issue could be closed since 2

[jira] [Updated] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Stevo Mitric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Mitric updated SPARK-47349: - Description: {{CollationSuite}} is a bit over cluttered and it should be used for for E2E

[jira] [Updated] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Stevo Mitric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Mitric updated SPARK-47349: - Description: {{CollationSuite}} is a bit over cluttered and it should be used for for E2E

[jira] [Updated] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47349: --- Labels: pull-request-available (was: ) > new test suite for UTF8String >

[jira] [Created] (SPARK-47360) Overlay (all collations)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47360: Summary: Overlay (all collations) Key: SPARK-47360 URL: https://issues.apache.org/jira/browse/SPARK-47360 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47359) StringTranslate (all collations)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47359: Summary: StringTranslate (all collations) Key: SPARK-47359 URL: https://issues.apache.org/jira/browse/SPARK-47359 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47358) StringReplace (all collations)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47358: Summary: StringReplace (all collations) Key: SPARK-47358 URL: https://issues.apache.org/jira/browse/SPARK-47358 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47357) Upper & Lower (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47357: Summary: Upper & Lower (lowercase collation) Key: SPARK-47357 URL: https://issues.apache.org/jira/browse/SPARK-47357 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47356) ConcatWs & Elt (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47356: Summary: ConcatWs & Elt (lowercase collation) Key: SPARK-47356 URL: https://issues.apache.org/jira/browse/SPARK-47356 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47351) ilike & rlike (lowercase collation)

2024-03-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: ilike & rlike (lowercase collation) (was: rlike (lowercase collation)) > ilike &

[jira] [Created] (SPARK-47355) regexp_replace & regexp_instr (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47355: Summary: regexp_replace & regexp_instr (lowercase collation) Key: SPARK-47355 URL: https://issues.apache.org/jira/browse/SPARK-47355 Project: Spark Issue

[jira] [Created] (SPARK-47354) regexp_extract & regexp_extract_all (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47354: Summary: regexp_extract & regexp_extract_all (lowercase collation) Key: SPARK-47354 URL: https://issues.apache.org/jira/browse/SPARK-47354 Project: Spark

[jira] [Created] (SPARK-47353) regexp_count & regexp_substr (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47353: Summary: regexp_count & regexp_substr (lowercase collation) Key: SPARK-47353 URL: https://issues.apache.org/jira/browse/SPARK-47353 Project: Spark Issue

[jira] [Created] (SPARK-47352) split (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47352: Summary: split (lowercase collation) Key: SPARK-47352 URL: https://issues.apache.org/jira/browse/SPARK-47352 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47351) rlike (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47351: Summary: rlike (lowercase collation) Key: SPARK-47351 URL: https://issues.apache.org/jira/browse/SPARK-47351 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47350) like (lowercase collation)

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47350: Summary: like (lowercase collation) Key: SPARK-47350 URL: https://issues.apache.org/jira/browse/SPARK-47350 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Stevo Mitric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Mitric updated SPARK-47349: - Description: {{CollationSuite}} is a bit over cluttered and it should be used for for E2E

[jira] [Created] (SPARK-47349) new test suite for UTF8String

2024-03-12 Thread Jira
Uroš Bojanić created SPARK-47349: Summary: new test suite for UTF8String Key: SPARK-47349 URL: https://issues.apache.org/jira/browse/SPARK-47349 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47343) Execute immediate throws NPE when `sqlString` variable value is null

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47343. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45462

[jira] [Assigned] (SPARK-47295) startswith, endswith (non-binary collations)

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47295: Assignee: Stevo Mitric > startswith, endswith (non-binary collations) >

[jira] [Resolved] (SPARK-47295) startswith, endswith (non-binary collations)

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47295. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45421

[jira] [Resolved] (SPARK-47169) Disable bucketing on collated collumns

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47169. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45260

[jira] [Assigned] (SPARK-47169) Disable bucketing on collated collumns

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47169: Assignee: Mihailo Milosevic > Disable bucketing on collated collumns >

[jira] [Assigned] (SPARK-47254) Assign names to the error classes _LEGACY_ERROR_TEMP_325[1-9]

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47254: Assignee: Stefan Bukorovic > Assign names to the error classes _LEGACY_ERROR_TEMP_325[1-9] >

[jira] [Resolved] (SPARK-47254) Assign names to the error classes _LEGACY_ERROR_TEMP_325[1-9]

2024-03-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47254. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45407

[jira] [Assigned] (SPARK-47343) Execute immediate throws NPE when `sqlString` variable value is null

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47343: -- Assignee: (was: Apache Spark) > Execute immediate throws NPE when `sqlString`

[jira] [Assigned] (SPARK-47343) Execute immediate throws NPE when `sqlString` variable value is null

2024-03-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47343: -- Assignee: Apache Spark > Execute immediate throws NPE when `sqlString` variable

[jira] [Resolved] (SPARK-47347) Factor session-related tests out of test_connect_basic

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47347. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45472

[jira] [Assigned] (SPARK-47347) Factor session-related tests out of test_connect_basic

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47347: Assignee: Ruifeng Zheng > Factor session-related tests out of test_connect_basic >

  1   2   >