[jira] [Resolved] (SPARK-47479) Optimize cannot write data to relations with multiple paths error log

[ https://issues.apache.org/jira/browse/SPARK-47479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47479. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45605

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47516: --- Labels: pull-request-available (was: ) > Move `remove unused installation package logic`

[jira] [Updated] (SPARK-47513) Regenerate benchmark results

[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47513: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Regenerate benchmark results

[jira] [Resolved] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

[ https://issues.apache.org/jira/browse/SPARK-47514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47514. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45637

[jira] [Assigned] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

[ https://issues.apache.org/jira/browse/SPARK-47514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47514: - Assignee: BingKun Pan > Add a test coverage for createTable method (partitioned-table)

[jira] [Resolved] (SPARK-47513) Regenerate benchmark results

[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47513. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45654

[jira] [Assigned] (SPARK-47513) Regenerate benchmark results

[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47513: - Assignee: Dongjoon Hyun > Regenerate benchmark results >

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Description: When creating the docker image, remove unused installation packages. > Move `remove

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Summary: Move `remove unused installation package logic` from `each test job` to `create the

[jira] [Created] (SPARK-47516) When creating the docker image, remove unused installation packages

BingKun Pan created SPARK-47516: --- Summary: When creating the docker image, remove unused installation packages Key: SPARK-47516 URL: https://issues.apache.org/jira/browse/SPARK-47516 Project: Spark

[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47497: --- Labels: pull-request-available (was: ) > Make `to_csv` support the output of

[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support the output of `array/struct/map` as pretty strings (was: Make

[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map ` as pretty strings

[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support the output of `array/struct/map ` as pretty strings (was: Make

[jira] [Created] (SPARK-47515) Save TimestampNTZType as DATETIME in MySQL

Kent Yao created SPARK-47515: Summary: Save TimestampNTZType as DATETIME in MySQL Key: SPARK-47515 URL: https://issues.apache.org/jira/browse/SPARK-47515 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47512) Tag operation type for RocksDB instance lock acquisition

[ https://issues.apache.org/jira/browse/SPARK-47512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47512. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45651

[jira] [Created] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

BingKun Pan created SPARK-47514: --- Summary: Add a test coverage for createTable method (partitioned-table) in CatalogSuite Key: SPARK-47514 URL: https://issues.apache.org/jira/browse/SPARK-47514

[jira] [Updated] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

[ https://issues.apache.org/jira/browse/SPARK-47514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47514: --- Labels: pull-request-available (was: ) > Add a test coverage for createTable method

[jira] [Updated] (SPARK-47513) Regenerate benchmark results

[ https://issues.apache.org/jira/browse/SPARK-47513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47513: --- Labels: pull-request-available (was: ) > Regenerate benchmark results >

[jira] [Created] (SPARK-47513) Regenerate benchmark results

Dongjoon Hyun created SPARK-47513: - Summary: Regenerate benchmark results Key: SPARK-47513 URL: https://issues.apache.org/jira/browse/SPARK-47513 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-47502) Make the `size` of the installed packages output in `descending` order, and add a `header`

[ https://issues.apache.org/jira/browse/SPARK-47502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47502. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45630

[jira] [Assigned] (SPARK-47502) Make the `size` of the installed packages output in `descending` order, and add a `header`

[ https://issues.apache.org/jira/browse/SPARK-47502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47502: - Assignee: BingKun Pan > Make the `size` of the installed packages output in

[jira] [Updated] (SPARK-47509) Incorrect results for LambdaFunctions or HigherOrderFunctions in subquery expression plans

[ https://issues.apache.org/jira/browse/SPARK-47509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47509: --- Labels: pull-request-available (was: ) > Incorrect results for LambdaFunctions or

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829681#comment-17829681 ] Gideon P commented on SPARK-47413: -- [~uros-db] I think this one could be a good one for me to tackle. I

[jira] [Resolved] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-47398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-47398. --- Fix Version/s: 4.0.0 3.5.2 Assignee: Raza Jafri

[jira] [Updated] (SPARK-47512) Tag operation type for RocksDB instance lock acquisition

[ https://issues.apache.org/jira/browse/SPARK-47512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47512: --- Labels: pull-request-available (was: ) > Tag operation type for RocksDB instance lock

[jira] [Created] (SPARK-47512) Tag operation type for RocksDB instance lock acquisition

Anish Shrigondekar created SPARK-47512: -- Summary: Tag operation type for RocksDB instance lock acquisition Key: SPARK-47512 URL: https://issues.apache.org/jira/browse/SPARK-47512 Project: Spark

[jira] [Resolved] (SPARK-47507) Upgrade ORC to 1.9.3

[ https://issues.apache.org/jira/browse/SPARK-47507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47507. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 45646

[jira] [Resolved] (SPARK-47508) Update black from 23.9.1 to 24.3.0

[ https://issues.apache.org/jira/browse/SPARK-47508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen resolved SPARK-47508. - Resolution: Won't Fix > Update black from 23.9.1 to 24.3.0 >

[jira] [Updated] (SPARK-47511) Canonicalize With expressions by re-assigning IDs

[ https://issues.apache.org/jira/browse/SPARK-47511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47511: --- Labels: pull-request-available (was: ) > Canonicalize With expressions by re-assigning IDs

[jira] [Created] (SPARK-47511) Canonicalize With expressions by re-assigning IDs

Kelvin Jiang created SPARK-47511: Summary: Canonicalize With expressions by re-assigning IDs Key: SPARK-47511 URL: https://issues.apache.org/jira/browse/SPARK-47511 Project: Spark Issue

[jira] [Updated] (SPARK-47510) Fix `DSTREAM` label pattern in `labeler.yml`

[ https://issues.apache.org/jira/browse/SPARK-47510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47510: --- Labels: pull-request-available (was: ) > Fix `DSTREAM` label pattern in `labeler.yml` >

[jira] [Created] (SPARK-47510) Fix `DSTREAM` label pattern in `labeler.yml`

Dongjoon Hyun created SPARK-47510: - Summary: Fix `DSTREAM` label pattern in `labeler.yml` Key: SPARK-47510 URL: https://issues.apache.org/jira/browse/SPARK-47510 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47505: --- Labels: pull-request-available (was: ) > Fix `pyspark-errors` test jobs for branch-3.4 >

[jira] [Assigned] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47505: - Assignee: BingKun Pan > Fix `pyspark-errors` test jobs for branch-3.4 >

[jira] [Resolved] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47505. --- Fix Version/s: 3.4.3 Resolution: Fixed Issue resolved by pull request 45624

[jira] [Updated] (SPARK-47509) Incorrect results for LambdaFunctions or HigherOrderFunctions in subquery expression plans

[ https://issues.apache.org/jira/browse/SPARK-47509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-47509: --- Summary: Incorrect results for LambdaFunctions or HigherOrderFunctions in subquery expression plans (was:

[jira] [Updated] (SPARK-47509) Incorrect results for LambdaFunction or HigherOrderFunction within subquery expressions

[ https://issues.apache.org/jira/browse/SPARK-47509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-47509: --- Summary: Incorrect results for LambdaFunction or HigherOrderFunction within subquery expressions (was:

[jira] [Created] (SPARK-47509) Incorrect results for LambdaFunction or HigherOrderFunction with subquery expressions

Daniel created SPARK-47509: -- Summary: Incorrect results for LambdaFunction or HigherOrderFunction with subquery expressions Key: SPARK-47509 URL: https://issues.apache.org/jira/browse/SPARK-47509 Project:

[jira] [Commented] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829639#comment-17829639 ] Dongjoon Hyun commented on SPARK-47046: --- All known issues except SPARK-47018 are resolved as of

[jira] [Resolved] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47046. --- Fix Version/s: 4.0.0 Resolution: Fixed > Apache Spark 4.0.0 Dependency Audit and

[jira] [Assigned] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47046: - Assignee: Dongjoon Hyun > Apache Spark 4.0.0 Dependency Audit and Cleanup >

[jira] [Updated] (SPARK-47508) Update black from 23.9.1 to 24.3.0

[ https://issues.apache.org/jira/browse/SPARK-47508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47508: --- Labels: pull-request-available (was: ) > Update black from 23.9.1 to 24.3.0 >

[jira] [Created] (SPARK-47508) Update black from 23.9.1 to 24.3.0

Bjørn Jørgensen created SPARK-47508: --- Summary: Update black from 23.9.1 to 24.3.0 Key: SPARK-47508 URL: https://issues.apache.org/jira/browse/SPARK-47508 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47487) simplify code in AnsiTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-47487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47487: - Assignee: Wenchen Fan > simplify code in AnsiTypeCoercion >

[jira] [Resolved] (SPARK-47487) simplify code in AnsiTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-47487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47487. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45612

[jira] [Resolved] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-47501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47501. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45638

[jira] [Assigned] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-47501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47501: - Assignee: Kent Yao > Add convertDateToDate like the existing

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47477: --- Labels: pull-request-available (was: ) > SubstringIndex, StringLocate (all collations) >

Re: Spark 3.5.1 known CVE ID's - Open source library security issues.

Hello Manohara, Thank you for your question. When an advisory is published for a dependency, more often than not, the project does not use the dependency in a way that is affected by the problem described in the advisory. For this reason we don't accept the simple fact that an advisory exists for

[jira] [Updated] (SPARK-47506) Support all file source formats for collated data types

[ https://issues.apache.org/jira/browse/SPARK-47506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47506: --- Labels: pull-request-available (was: ) > Support all file source formats for collated data

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47503: --- Labels: pull-request-available (was: ) > Spark history sever fails to display query for

[jira] [Created] (SPARK-47506) Support all file source formats for collated data types

Stefan Kandic created SPARK-47506: - Summary: Support all file source formats for collated data types Key: SPARK-47506 URL: https://issues.apache.org/jira/browse/SPARK-47506 Project: Spark

[jira] [Updated] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47505: Summary: Fix `pyspark-errors` test jobs for branch-3.4 (was: Fix `Pyspark-errors` for

[jira] [Created] (SPARK-47505) Fix `Pyspark-errors` for branch-3.4

BingKun Pan created SPARK-47505: --- Summary: Fix `Pyspark-errors` for branch-3.4 Key: SPARK-47505 URL: https://issues.apache.org/jira/browse/SPARK-47505 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47504) Resolve AbstractDataType simpleStrings for StringTypeCollated

Mihailo Milosevic created SPARK-47504: - Summary: Resolve AbstractDataType simpleStrings for StringTypeCollated Key: SPARK-47504 URL: https://issues.apache.org/jira/browse/SPARK-47504 Project:

[jira] [Commented] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829531#comment-17829531 ] alexey commented on SPARK-47503: If no one minds i'd like to fix this myself > Spark history sever

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexey updated SPARK-47503: --- Description: Spark history sever fails to display query for cached JDBC relation (or calculation derived

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexey updated SPARK-47503: --- Description: Spark history sever fails to display query for cached JDBC relation (or calculation derived

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexey updated SPARK-47503: --- Description: Spark history sever fails to display query for cached JDBC relation (or calculation derived

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexey updated SPARK-47503: --- Attachment: eventlog_v2_local-1711020585149.rar > Spark history sever fails to display query for cached

[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

[ https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexey updated SPARK-47503: --- Attachment: Screenshot_11.png > Spark history sever fails to display query for cached JDBC relation named

[jira] [Created] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes

alexey created SPARK-47503: -- Summary: Spark history sever fails to display query for cached JDBC relation named in quotes Key: SPARK-47503 URL: https://issues.apache.org/jira/browse/SPARK-47503 Project:

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829521#comment-17829521 ] Steve Loughran commented on SPARK-38330: [~jpanda] a bit late but your problem is the WONTFIX

[jira] [Updated] (SPARK-47502) Make the `size` of the installed packages output in `descending` order, and add a `header`

[ https://issues.apache.org/jira/browse/SPARK-47502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47502: Summary: Make the `size` of the installed packages output in `descending` order, and add a

[jira] [Updated] (SPARK-47502) Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order`

[ https://issues.apache.org/jira/browse/SPARK-47502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47502: --- Labels: pull-request-available (was: ) > Make the size of the installed packages output in

[jira] [Created] (SPARK-47502) Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order`

BingKun Pan created SPARK-47502: --- Summary: Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order` Key: SPARK-47502 URL:

[jira] [Resolved] (SPARK-47496) Java SPI Support for JDBC dialect registering

[ https://issues.apache.org/jira/browse/SPARK-47496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47496. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45626

[jira] [Assigned] (SPARK-47496) Java SPI Support for JDBC dialect registering

[ https://issues.apache.org/jira/browse/SPARK-47496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47496: Assignee: Kent Yao > Java SPI Support for JDBC dialect registering >

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829463#comment-17829463 ] Uroš Bojanić commented on SPARK-47413: -- Hey [~gpgp]! Thanks for your patience while we figured out

[jira] [Updated] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47413: - Description: Enable collation support for the *Substring* built-in string function in Spark

[jira] [Updated] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-47501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47501: --- Labels: pull-request-available (was: ) > Add convertDateToDate like the existing

[jira] [Created] (SPARK-47501) Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects

Kent Yao created SPARK-47501: Summary: Add convertDateToDate like the existing convertTimestampToTimestamp for JdbcDialects Key: SPARK-47501 URL: https://issues.apache.org/jira/browse/SPARK-47501

[jira] [Assigned] (SPARK-47496) Java SPI Support for JDBC dialect registering

[ https://issues.apache.org/jira/browse/SPARK-47496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47496: -- Assignee: Apache Spark > Java SPI Support for JDBC dialect registering >

[jira] [Assigned] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47500: -- Assignee: Apache Spark > Factor column name handling out of `plan.py` >

[jira] [Assigned] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47500: -- Assignee: (was: Apache Spark) > Factor column name handling out of `plan.py` >

[jira] [Assigned] (SPARK-47496) Java SPI Support for JDBC dialect registering

[ https://issues.apache.org/jira/browse/SPARK-47496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47496: -- Assignee: (was: Apache Spark) > Java SPI Support for JDBC dialect registering >

[jira] [Updated] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47500: --- Labels: pull-request-available (was: ) > Factor column name handling out of `plan.py` >

[jira] [Assigned] (SPARK-47358) StringRepeat (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47358: -- Assignee: (was: Apache Spark) > StringRepeat (all collations) >

[jira] [Assigned] (SPARK-47483) Add support for aggregation and join operations on arrays of collated strings

[ https://issues.apache.org/jira/browse/SPARK-47483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47483: -- Assignee: (was: Apache Spark) > Add support for aggregation and join operations

[jira] [Assigned] (SPARK-47358) StringRepeat (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47358: -- Assignee: Apache Spark > StringRepeat (all collations) >

[jira] [Assigned] (SPARK-47483) Add support for aggregation and join operations on arrays of collated strings

[ https://issues.apache.org/jira/browse/SPARK-47483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47483: -- Assignee: Apache Spark > Add support for aggregation and join operations on arrays

[jira] [Created] (SPARK-47500) Factor column name handling out of `plan.py`

Ruifeng Zheng created SPARK-47500: - Summary: Factor column name handling out of `plan.py` Key: SPARK-47500 URL: https://issues.apache.org/jira/browse/SPARK-47500 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47499) Reuse `test_help_command` in Connect

[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47499: --- Labels: pull-request-available (was: ) > Reuse `test_help_command` in Connect >

[jira] [Created] (SPARK-47499) Reuse `test_help_command` in Connect

Ruifeng Zheng created SPARK-47499: - Summary: Reuse `test_help_command` in Connect Key: SPARK-47499 URL: https://issues.apache.org/jira/browse/SPARK-47499 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-47498) Refine some fractional GPU resource calculation tests.

[ https://issues.apache.org/jira/browse/SPARK-47498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47498: --- Labels: pull-request-available (was: ) > Refine some fractional GPU resource calculation

[jira] [Commented] (SPARK-47477) SubstringIndex, StringLocate (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829408#comment-17829408 ] Milan Dankovic commented on SPARK-47477: I am working on this > SubstringIndex, StringLocate

[jira] [Created] (SPARK-47498) Refine some fractional GPU resource calculation tests.

Bobby Wang created SPARK-47498: -- Summary: Refine some fractional GPU resource calculation tests. Key: SPARK-47498 URL: https://issues.apache.org/jira/browse/SPARK-47498 Project: Spark Issue

[jira] [Updated] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44708: --- Labels: pull-request-available (was: ) > Migrate test_reset_index assert_eq to use

[jira] [Resolved] (SPARK-41888) Support StreamingQueryListener for DataFrame.observe

[ https://issues.apache.org/jira/browse/SPARK-41888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41888. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45627

[jira] [Assigned] (SPARK-41888) Support StreamingQueryListener for DataFrame.observe

[ https://issues.apache.org/jira/browse/SPARK-41888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41888: - Assignee: Jiaan Geng > Support StreamingQueryListener for DataFrame.observe >