[jira] [Resolved] (SPARK-42724) Upgrade buf to v1.15.1

[ https://issues.apache.org/jira/browse/SPARK-42724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42724. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40348

[jira] [Assigned] (SPARK-42724) Upgrade buf to v1.15.1

[ https://issues.apache.org/jira/browse/SPARK-42724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42724: - Assignee: BingKun Pan > Upgrade buf to v1.15.1 > -- > >

[jira] [Commented] (SPARK-42626) Add Destructive Iterator for SparkResult

[ https://issues.apache.org/jira/browse/SPARK-42626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698220#comment-17698220 ] Tengfei Huang commented on SPARK-42626: --- I will take a look! Thanks > Add Destructive Iterator

[jira] [Commented] (SPARK-42554) Spark Connect Scala Client

[ https://issues.apache.org/jira/browse/SPARK-42554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698216#comment-17698216 ] Yang Jie commented on SPARK-42554: -- Friendly ping [~ivoson] , [~hvanhovell] has created some tickets

[jira] [Assigned] (SPARK-42689) Allow ShuffleDriverComponent to declare if shuffle data is reliably stored

[ https://issues.apache.org/jira/browse/SPARK-42689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42689: --- Assignee: Mridul Muralidharan > Allow ShuffleDriverComponent to declare if

[jira] [Resolved] (SPARK-42689) Allow ShuffleDriverComponent to declare if shuffle data is reliably stored

[ https://issues.apache.org/jira/browse/SPARK-42689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42689. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-42690) Implement CSV/JSON parsing funcions

[ https://issues.apache.org/jira/browse/SPARK-42690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42690: - Assignee: Yang Jie > Implement CSV/JSON parsing funcions >

[jira] [Resolved] (SPARK-42690) Implement CSV/JSON parsing funcions

[ https://issues.apache.org/jira/browse/SPARK-42690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42690. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40332

[jira] [Commented] (SPARK-42725) Make LiteralExpression support array

[ https://issues.apache.org/jira/browse/SPARK-42725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698207#comment-17698207 ] Apache Spark commented on SPARK-42725: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42725) Make LiteralExpression support array

[ https://issues.apache.org/jira/browse/SPARK-42725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42725: Assignee: (was: Apache Spark) > Make LiteralExpression support array >

[jira] [Assigned] (SPARK-42725) Make LiteralExpression support array

[ https://issues.apache.org/jira/browse/SPARK-42725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42725: Assignee: Apache Spark > Make LiteralExpression support array >

[jira] [Commented] (SPARK-42725) Make LiteralExpression support array

[ https://issues.apache.org/jira/browse/SPARK-42725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698206#comment-17698206 ] Apache Spark commented on SPARK-42725: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42725) Make LiteralExpression support array

Ruifeng Zheng created SPARK-42725: - Summary: Make LiteralExpression support array Key: SPARK-42725 URL: https://issues.apache.org/jira/browse/SPARK-42725 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-42701) Add the try_aes_decrypt() function

[ https://issues.apache.org/jira/browse/SPARK-42701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42701. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40340

[jira] [Assigned] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

[ https://issues.apache.org/jira/browse/SPARK-42717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42717: Assignee: BingKun Pan > Upgrade mysql-connector-java from 8.0.31 to 8.0.32 >

[jira] [Resolved] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

[ https://issues.apache.org/jira/browse/SPARK-42717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42717. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40335

[jira] [Resolved] (SPARK-42697) /api/v1/applications return 0 for duration

[ https://issues.apache.org/jira/browse/SPARK-42697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42697. -- Fix Version/s: 3.3.3 3.2.4 3.4.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-42697) /api/v1/applications return 0 for duration

[ https://issues.apache.org/jira/browse/SPARK-42697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42697: Assignee: Kent Yao > /api/v1/applications return 0 for duration >

[jira] [Commented] (SPARK-42703) How to use Fair Scheduler Pools

[ https://issues.apache.org/jira/browse/SPARK-42703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698163#comment-17698163 ] LiJie2023 commented on SPARK-42703: --- Sorry, this "SPARK-42703" is also submitted by me. I haven't got

[jira] [Resolved] (SPARK-42723) Support parser data type json "timestamp_ltz" as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-42723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42723. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40345

[jira] [Resolved] (SPARK-42703) How to use Fair Scheduler Pools

[ https://issues.apache.org/jira/browse/SPARK-42703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42703. -- Resolution: Invalid > How to use Fair Scheduler Pools > --- > >

[jira] [Updated] (SPARK-42497) Support of pandas API on Spark for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42497: - Summary: Support of pandas API on Spark for Spark Connect (was: Support of pandas API on Spark

[jira] [Commented] (SPARK-42711) build/sbt usage error messages about java-home

[ https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698155#comment-17698155 ] Apache Spark commented on SPARK-42711: -- User 'liang3zy22' has created a pull request for this

[jira] [Assigned] (SPARK-42711) build/sbt usage error messages about java-home

[ https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42711: Assignee: (was: Apache Spark) > build/sbt usage error messages about java-home >

[jira] [Assigned] (SPARK-42711) build/sbt usage error messages about java-home

[ https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42711: Assignee: Apache Spark > build/sbt usage error messages about java-home >

[jira] [Assigned] (SPARK-42724) Upgrade buf to v1.15.1

[ https://issues.apache.org/jira/browse/SPARK-42724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42724: Assignee: (was: Apache Spark) > Upgrade buf to v1.15.1 > -- > >

[jira] [Commented] (SPARK-42724) Upgrade buf to v1.15.1

[ https://issues.apache.org/jira/browse/SPARK-42724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698156#comment-17698156 ] Apache Spark commented on SPARK-42724: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42724) Upgrade buf to v1.15.1

[ https://issues.apache.org/jira/browse/SPARK-42724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42724: Assignee: Apache Spark > Upgrade buf to v1.15.1 > -- > >

[jira] [Created] (SPARK-42724) Upgrade buf to v1.15.1

BingKun Pan created SPARK-42724: --- Summary: Upgrade buf to v1.15.1 Key: SPARK-42724 URL: https://issues.apache.org/jira/browse/SPARK-42724 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-42643) Register Java (aggregate) user-defined functions

[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42643: - Parent: SPARK-41661 Issue Type: Sub-task (was: Improvement) > Register Java

[jira] [Resolved] (SPARK-42722) Python Connect def schema() should not cache the schema

[ https://issues.apache.org/jira/browse/SPARK-42722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42722. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40343

[jira] [Updated] (SPARK-42480) Improve the performance of drop partitions

[ https://issues.apache.org/jira/browse/SPARK-42480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-42480: - Fix Version/s: 3.4.0 > Improve the performance of drop partitions >

[jira] [Updated] (SPARK-42480) Improve the performance of drop partitions

[ https://issues.apache.org/jira/browse/SPARK-42480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-42480: - Fix Version/s: (was: 3.5.0) > Improve the performance of drop partitions >

[jira] [Assigned] (SPARK-42480) Improve the performance of drop partitions

[ https://issues.apache.org/jira/browse/SPARK-42480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-42480: Assignee: Wechar > Improve the performance of drop partitions >

[jira] [Resolved] (SPARK-42480) Improve the performance of drop partitions

[ https://issues.apache.org/jira/browse/SPARK-42480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-42480. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40069

[jira] [Commented] (SPARK-42667) Spark Connect: newSession API

[ https://issues.apache.org/jira/browse/SPARK-42667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698119#comment-17698119 ] Apache Spark commented on SPARK-42667: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-42723) Support parser data type json "timestamp_ltz" as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-42723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698096#comment-17698096 ] Apache Spark commented on SPARK-42723: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42723) Support parser data type json "timestamp_ltz" as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-42723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42723: Assignee: Apache Spark (was: Gengliang Wang) > Support parser data type json

[jira] [Assigned] (SPARK-42723) Support parser data type json "timestamp_ltz" as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-42723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42723: Assignee: Gengliang Wang (was: Apache Spark) > Support parser data type json

[jira] [Commented] (SPARK-42723) Support parser data type json "timestamp_ltz" as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-42723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698095#comment-17698095 ] Apache Spark commented on SPARK-42723: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-42723) Support parser data type json "timestamp_ltz" as TimestampType

Gengliang Wang created SPARK-42723: -- Summary: Support parser data type json "timestamp_ltz" as TimestampType Key: SPARK-42723 URL: https://issues.apache.org/jira/browse/SPARK-42723 Project: Spark

[jira] [Commented] (SPARK-42656) Spark Connect Scala Client Shell Script

[ https://issues.apache.org/jira/browse/SPARK-42656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698081#comment-17698081 ] Apache Spark commented on SPARK-42656: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Commented] (SPARK-42722) Python Connect def schema() should not cache the schema

[ https://issues.apache.org/jira/browse/SPARK-42722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698073#comment-17698073 ] Apache Spark commented on SPARK-42722: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42722) Python Connect def schema() should not cache the schema

[ https://issues.apache.org/jira/browse/SPARK-42722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42722: Assignee: Apache Spark (was: Rui Wang) > Python Connect def schema() should not cache

[jira] [Commented] (SPARK-42722) Python Connect def schema() should not cache the schema

[ https://issues.apache.org/jira/browse/SPARK-42722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698072#comment-17698072 ] Apache Spark commented on SPARK-42722: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42722) Python Connect def schema() should not cache the schema

[ https://issues.apache.org/jira/browse/SPARK-42722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42722: Assignee: Rui Wang (was: Apache Spark) > Python Connect def schema() should not cache

[jira] [Created] (SPARK-42722) Python Connect def schema() should not cache the schema

Rui Wang created SPARK-42722: Summary: Python Connect def schema() should not cache the schema Key: SPARK-42722 URL: https://issues.apache.org/jira/browse/SPARK-42722 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698057#comment-17698057 ] Apache Spark commented on SPARK-42721: -- User 'rangadi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42721: Assignee: (was: Apache Spark) > Add an Interceptor to log RPCs in connect-server >

[jira] [Assigned] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42721: Assignee: Apache Spark > Add an Interceptor to log RPCs in connect-server >

[jira] [Commented] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698055#comment-17698055 ] Apache Spark commented on SPARK-42721: -- User 'rangadi' has created a pull request for this issue:

[jira] [Created] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

Raghu Angadi created SPARK-42721: Summary: Add an Interceptor to log RPCs in connect-server Key: SPARK-42721 URL: https://issues.apache.org/jira/browse/SPARK-42721 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42689) Allow ShuffleDriverComponent to declare if shuffle data is reliably stored

[ https://issues.apache.org/jira/browse/SPARK-42689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42689: -- Affects Version/s: 3.5.0 (was: 3.1.0)

[jira] [Resolved] (SPARK-42709) Do not rely on __file__

[ https://issues.apache.org/jira/browse/SPARK-42709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42709. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40328

[jira] [Assigned] (SPARK-42709) Do not rely on __file__

[ https://issues.apache.org/jira/browse/SPARK-42709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42709: - Assignee: Hyukjin Kwon > Do not rely on __file__ > --- > >

[jira] [Commented] (SPARK-42715) NegativeArraySizeException by too many datas read from ORC file

[ https://issues.apache.org/jira/browse/SPARK-42715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697999#comment-17697999 ] Apache Spark commented on SPARK-42715: -- User 'chong0929' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42715) NegativeArraySizeException by too many datas read from ORC file

[ https://issues.apache.org/jira/browse/SPARK-42715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42715: Assignee: Apache Spark > NegativeArraySizeException by too many datas read from ORC file

[jira] [Assigned] (SPARK-42715) NegativeArraySizeException by too many datas read from ORC file

[ https://issues.apache.org/jira/browse/SPARK-42715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42715: Assignee: (was: Apache Spark) > NegativeArraySizeException by too many datas read

[jira] [Created] (SPARK-42720) Refactor the withSequenceColumn

Haejoon Lee created SPARK-42720: --- Summary: Refactor the withSequenceColumn Key: SPARK-42720 URL: https://issues.apache.org/jira/browse/SPARK-42720 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42701) Add the try_aes_decrypt() function

[ https://issues.apache.org/jira/browse/SPARK-42701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42701: Assignee: Max Gekk (was: Apache Spark) > Add the try_aes_decrypt() function >

[jira] [Assigned] (SPARK-42701) Add the try_aes_decrypt() function

[ https://issues.apache.org/jira/browse/SPARK-42701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42701: Assignee: Apache Spark (was: Max Gekk) > Add the try_aes_decrypt() function >

[jira] [Commented] (SPARK-42701) Add the try_aes_decrypt() function

[ https://issues.apache.org/jira/browse/SPARK-42701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697923#comment-17697923 ] Apache Spark commented on SPARK-42701: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42701) Add the try_aes_decrypt() function

[ https://issues.apache.org/jira/browse/SPARK-42701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42701: Assignee: Max Gekk > Add the try_aes_decrypt() function > -- > >

[jira] [Commented] (SPARK-42701) Add the try_aes_decrypt() function

[ https://issues.apache.org/jira/browse/SPARK-42701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697903#comment-17697903 ] Max Gekk commented on SPARK-42701: -- I am working on this. > Add the try_aes_decrypt() function >

[jira] [Assigned] (SPARK-42719) `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42719: Assignee: (was: Apache Spark) > `MapOutputTracker#getMapLocation` should respect >

[jira] [Commented] (SPARK-42719) `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697891#comment-17697891 ] Apache Spark commented on SPARK-42719: -- User 'jerqi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42719) `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42719: Assignee: Apache Spark > `MapOutputTracker#getMapLocation` should respect >

[jira] [Assigned] (SPARK-42684) v2 catalog should not allow column default value by default

[ https://issues.apache.org/jira/browse/SPARK-42684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42684: --- Assignee: Wenchen Fan > v2 catalog should not allow column default value by default >

[jira] [Resolved] (SPARK-42684) v2 catalog should not allow column default value by default

[ https://issues.apache.org/jira/browse/SPARK-42684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42684. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40299

[jira] [Updated] (SPARK-42719) `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Qi updated SPARK-42719: -- Summary: `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled` (was:

[jira] [Updated] (SPARK-42719) `Map#getPreferredLocations` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Qi updated SPARK-42719: -- Summary: `Map#getPreferredLocations` should respect `spark.shuffle.reduceLocality.enabled` (was:

[jira] [Updated] (SPARK-42719) `MapOutputTracker#getPreferredLocations` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Qi updated SPARK-42719: -- Summary: `MapOutputTracker#getPreferredLocations` should respect `spark.shuffle.reduceLocality.enabled`

[jira] [Assigned] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

[ https://issues.apache.org/jira/browse/SPARK-42718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42718: Assignee: Apache Spark > Upgrade rocksdbjni to 7.10.2 > > >

[jira] [Assigned] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

[ https://issues.apache.org/jira/browse/SPARK-42718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42718: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.10.2 >

[jira] [Commented] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

[ https://issues.apache.org/jira/browse/SPARK-42718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697875#comment-17697875 ] Apache Spark commented on SPARK-42718: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-42719) `ShuffledRowRdd#getPreferredLocations` should respect to `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Qi updated SPARK-42719: -- Description: Discuss as [https://github.com/apache/spark/pull/40307] {{getPreferredLocations}} in 

[jira] [Created] (SPARK-42719) `ShuffledRowRdd#getPreferredLocations` should respect to `spark.shuffle.reduceLocality.enabled`

He Qi created SPARK-42719: - Summary: `ShuffledRowRdd#getPreferredLocations` should respect to `spark.shuffle.reduceLocality.enabled` Key: SPARK-42719 URL: https://issues.apache.org/jira/browse/SPARK-42719

[jira] [Updated] (SPARK-42706) Document the Spark SQL error classes in user-facing documentation.

[ https://issues.apache.org/jira/browse/SPARK-42706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42706: Summary: Document the Spark SQL error classes in user-facing documentation. (was: List the error

[jira] [Assigned] (SPARK-42706) List the error class to user-facing documentation.

[ https://issues.apache.org/jira/browse/SPARK-42706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42706: Assignee: (was: Apache Spark) > List the error class to user-facing documentation. >

[jira] [Assigned] (SPARK-42706) List the error class to user-facing documentation.

[ https://issues.apache.org/jira/browse/SPARK-42706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42706: Assignee: Apache Spark > List the error class to user-facing documentation. >

[jira] [Commented] (SPARK-42706) List the error class to user-facing documentation.

[ https://issues.apache.org/jira/browse/SPARK-42706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697863#comment-17697863 ] Apache Spark commented on SPARK-42706: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

Yang Jie created SPARK-42718: Summary: Upgrade rocksdbjni to 7.10.2 Key: SPARK-42718 URL: https://issues.apache.org/jira/browse/SPARK-42718 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

[ https://issues.apache.org/jira/browse/SPARK-42717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697850#comment-17697850 ] Apache Spark commented on SPARK-42717: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

[ https://issues.apache.org/jira/browse/SPARK-42717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697851#comment-17697851 ] Apache Spark commented on SPARK-42717: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

[ https://issues.apache.org/jira/browse/SPARK-42717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42717: Assignee: Apache Spark > Upgrade mysql-connector-java from 8.0.31 to 8.0.32 >

[jira] [Assigned] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

[ https://issues.apache.org/jira/browse/SPARK-42717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42717: Assignee: (was: Apache Spark) > Upgrade mysql-connector-java from 8.0.31 to 8.0.32 >

[jira] [Created] (SPARK-42717) Upgrade mysql-connector-java from 8.0.31 to 8.0.32

BingKun Pan created SPARK-42717: --- Summary: Upgrade mysql-connector-java from 8.0.31 to 8.0.32 Key: SPARK-42717 URL: https://issues.apache.org/jira/browse/SPARK-42717 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42716) DataSourceV2 cannot report KeyGroupedPartitioning with multiple keys per partition

[ https://issues.apache.org/jira/browse/SPARK-42716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697847#comment-17697847 ] Apache Spark commented on SPARK-42716: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42716) DataSourceV2 cannot report KeyGroupedPartitioning with multiple keys per partition

[ https://issues.apache.org/jira/browse/SPARK-42716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42716: Assignee: (was: Apache Spark) > DataSourceV2 cannot report KeyGroupedPartitioning

[jira] [Assigned] (SPARK-42716) DataSourceV2 cannot report KeyGroupedPartitioning with multiple keys per partition

[ https://issues.apache.org/jira/browse/SPARK-42716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42716: Assignee: Apache Spark > DataSourceV2 cannot report KeyGroupedPartitioning with multiple

[jira] [Commented] (SPARK-42716) DataSourceV2 cannot report KeyGroupedPartitioning with multiple keys per partition

[ https://issues.apache.org/jira/browse/SPARK-42716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697845#comment-17697845 ] Apache Spark commented on SPARK-42716: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Created] (SPARK-42716) DataSourceV2 cannot report KeyGroupedPartitioning with multiple keys per partition

Enrico Minack created SPARK-42716: - Summary: DataSourceV2 cannot report KeyGroupedPartitioning with multiple keys per partition Key: SPARK-42716 URL: https://issues.apache.org/jira/browse/SPARK-42716

[jira] [Resolved] (SPARK-42713) Add '__getattr__' and '__getitem__' of DataFrame and Column to API reference

[ https://issues.apache.org/jira/browse/SPARK-42713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42713. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40331

[jira] [Assigned] (SPARK-42713) Add '__getattr__' and '__getitem__' of DataFrame and Column to API reference

[ https://issues.apache.org/jira/browse/SPARK-42713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42713: Assignee: Ruifeng Zheng > Add '__getattr__' and '__getitem__' of DataFrame and Column to

[jira] [Resolved] (SPARK-42266) Local mode should work with IPython

[ https://issues.apache.org/jira/browse/SPARK-42266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42266. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40327

[jira] [Assigned] (SPARK-42266) Local mode should work with IPython

[ https://issues.apache.org/jira/browse/SPARK-42266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42266: Assignee: Hyukjin Kwon > Local mode should work with IPython >

[jira] [Resolved] (SPARK-42712) Improve docstring of mapInPandas and mapInArrow

[ https://issues.apache.org/jira/browse/SPARK-42712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42712. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40330

[jira] [Assigned] (SPARK-42712) Improve docstring of mapInPandas and mapInArrow

[ https://issues.apache.org/jira/browse/SPARK-42712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42712: Assignee: Xinrong Meng > Improve docstring of mapInPandas and mapInArrow >

[jira] [Created] (SPARK-42715) NegativeArraySizeException by too many datas read from ORC file

XiaoLong Wu created SPARK-42715: --- Summary: NegativeArraySizeException by too many datas read from ORC file Key: SPARK-42715 URL: https://issues.apache.org/jira/browse/SPARK-42715 Project: Spark

[jira] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623 ] ming95 deleted comment on SPARK-42623: was (Author: zing): i can try to fix this issue > parameter markers not blocked in DDL > > >

  1   2   >