[jira] [Updated] (SPARK-47525) Support subquery correlation joining on map attributes

[ https://issues.apache.org/jira/browse/SPARK-47525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47525: --- Labels: pull-request-available (was: ) > Support subquery correlation joining on map

[jira] [Created] (SPARK-47525) Support subquery correlation joining on map attributes

Jack Chen created SPARK-47525: - Summary: Support subquery correlation joining on map attributes Key: SPARK-47525 URL: https://issues.apache.org/jira/browse/SPARK-47525 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47525) Support subquery correlation joining on map attributes

[ https://issues.apache.org/jira/browse/SPARK-47525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Chen updated SPARK-47525: -- Description: Currently, when a subquery is correlated on a condition like `outer_map[1] =

[jira] [Created] (SPARK-47524) Add support for range scan encoder and state data source reader

Anish Shrigondekar created SPARK-47524: -- Summary: Add support for range scan encoder and state data source reader Key: SPARK-47524 URL: https://issues.apache.org/jira/browse/SPARK-47524 Project:

[jira] [Resolved] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

[ https://issues.apache.org/jira/browse/SPARK-47522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47522. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45666

[jira] [Assigned] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

[ https://issues.apache.org/jira/browse/SPARK-47522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47522: - Assignee: Kent Yao > Read MySQL FLOAT as FloatType to keep consistent with the write

[jira] [Commented] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829949#comment-17829949 ] Dongjoon Hyun commented on SPARK-47521: --- FYI, [~maheshk114], `Target Version` field is reserved

[jira] [Updated] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47521: -- Target Version/s: (was: 4.0.0) > Use `Utils.tryWithResource` during reading shuffle data

[jira] [Updated] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47521: -- Summary: Use `Utils.tryWithResource` during reading shuffle data from external storage (was:

[jira] [Updated] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47521: -- Issue Type: Bug (was: Improvement) > Fix file handle leakage during shuffle data read from

[jira] [Resolved] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47521. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47521: - Assignee: mahesh kumar behera > Fix file handle leakage during shuffle data read from

[jira] [Resolved] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

[ https://issues.apache.org/jira/browse/SPARK-47523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47523. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45668

[jira] [Assigned] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

[ https://issues.apache.org/jira/browse/SPARK-47523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47523: - Assignee: Yang Jie > Replace Deprecated `JsonParser#getCurrentName` with

[jira] [Resolved] (SPARK-47517) Prefer Utils.bytesToString for size display

[ https://issues.apache.org/jira/browse/SPARK-47517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47517. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45660

[jira] [Created] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

Yang Jie created SPARK-47523: Summary: Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName` Key: SPARK-47523 URL: https://issues.apache.org/jira/browse/SPARK-47523 Project: Spark

[jira] [Updated] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

[ https://issues.apache.org/jira/browse/SPARK-47523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47523: --- Labels: pull-request-available (was: ) > Replace Deprecated `JsonParser#getCurrentName`

[jira] [Updated] (SPARK-47488) Driver stuck when thread pool is not shut down

[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-47488: -- Description: The app example：   {code:java} object SparkTest { def main(args: Array[String]): Unit

[jira] [Updated] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

[ https://issues.apache.org/jira/browse/SPARK-47522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47522: --- Labels: pull-request-available (was: ) > Read MySQL FLOAT as FloatType to keep consistent

[jira] [Assigned] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

[ https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47440: Assignee: Stefan Bukorovic > SQLServer does not support LIKE operator in binary comparison >

[jira] [Resolved] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

[ https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47440. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-47522) Read MySQL FLOAT as FloatType to keep consistent with the write side

Kent Yao created SPARK-47522: Summary: Read MySQL FLOAT as FloatType to keep consistent with the write side Key: SPARK-47522 URL: https://issues.apache.org/jira/browse/SPARK-47522 Project: Spark

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition

[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024

[jira] [Updated] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

[ https://issues.apache.org/jira/browse/SPARK-47521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47521: --- Labels: pull-request-available (was: ) > Fix file handle leakage during shuffle data read

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition

[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024

[jira] [Updated] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition

[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Summary: Precision issues with sum of floats/doubles leads to incorrect data after

[jira] [Created] (SPARK-47521) Fix file handle leakage during shuffle data read from external storage.

mahesh kumar behera created SPARK-47521: --- Summary: Fix file handle leakage during shuffle data read from external storage. Key: SPARK-47521 URL: https://issues.apache.org/jira/browse/SPARK-47521

[jira] [Updated] (SPARK-47141) Support enabling migration of shuffle data directly to external storage using config parameter

[ https://issues.apache.org/jira/browse/SPARK-47141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated SPARK-47141: Summary: Support enabling migration of shuffle data directly to external storage

[jira] [Resolved] (SPARK-47515) Save TimestampNTZType as DATETIME in MySQL

[ https://issues.apache.org/jira/browse/SPARK-47515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47515. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45655

[jira] [Commented] (SPARK-47519) Support json_length function

[ https://issues.apache.org/jira/browse/SPARK-47519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829779#comment-17829779 ] Qian Sun commented on SPARK-47519: -- [~cloud_fan] [~smilegator]  Excuse me, I look forward to your

[jira] [Updated] (SPARK-47519) Support json_length function

[ https://issues.apache.org/jira/browse/SPARK-47519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-47519: - Description: At the moment, we don't support json_length built-in function in apache spark. This

[jira] [Updated] (SPARK-47520) Rounding issues with sum of floats/doubles leads to incorrect data after repartition

[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024

[jira] [Updated] (SPARK-47520) Rounding issues with sum of floats/doubles leads to incorrect data after repartition

[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Montaz updated SPARK-47520: --- Description: We discovered an important correctness issue directly linked to SPARK-47024

[jira] [Created] (SPARK-47520) Rounding issues with sum of floats/doubles leads to incorrect data after repartition

William Montaz created SPARK-47520: -- Summary: Rounding issues with sum of floats/doubles leads to incorrect data after repartition Key: SPARK-47520 URL: https://issues.apache.org/jira/browse/SPARK-47520

[jira] [Commented] (SPARK-47429) Rename errorClass to errorCondition

[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829776#comment-17829776 ] Max Gekk commented on SPARK-47429: -- [~nchammas] I am going to rename `class` to `condition`. Just want

[jira] [Created] (SPARK-47519) Support json_length function

Qian Sun created SPARK-47519: Summary: Support json_length function Key: SPARK-47519 URL: https://issues.apache.org/jira/browse/SPARK-47519 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-47518) Skip transfer the last spilled shuffle data

[ https://issues.apache.org/jira/browse/SPARK-47518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47518: --- Labels: pull-request-available (was: ) > Skip transfer the last spilled shuffle data >

[jira] [Created] (SPARK-47518) Skip transfer the last spilled shuffle data

Wan Kun created SPARK-47518: --- Summary: Skip transfer the last spilled shuffle data Key: SPARK-47518 URL: https://issues.apache.org/jira/browse/SPARK-47518 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47483) Add support for aggregation and join operations on arrays of collated strings

[ https://issues.apache.org/jira/browse/SPARK-47483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47483: Assignee: Nikola Mandic > Add support for aggregation and join operations on arrays of collated

[jira] [Resolved] (SPARK-47483) Add support for aggregation and join operations on arrays of collated strings

[ https://issues.apache.org/jira/browse/SPARK-47483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47483. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45611

[jira] [Updated] (SPARK-47517) Prefer Utils.bytesToString for size display

[ https://issues.apache.org/jira/browse/SPARK-47517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47517: --- Labels: pull-request-available (was: ) > Prefer Utils.bytesToString for size display >

[jira] [Assigned] (SPARK-47499) Reuse `test_help_command` in Connect

[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47499: - Assignee: Ruifeng Zheng > Reuse `test_help_command` in Connect >

[jira] [Resolved] (SPARK-47499) Reuse `test_help_command` in Connect

[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47499. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45634

[jira] [Assigned] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47500: Assignee: Ruifeng Zheng > Factor column name handling out of `plan.py` >

[jira] [Resolved] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47500. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45636