[jira] [Created] (SPARK-46940) Remove unused `updateSparkConfigFromProperties` and `isAbsoluteURI` in `o.a.s.u.Utils`

2024-01-31 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46940: --- Summary: Remove unused `updateSparkConfigFromProperties` and `isAbsoluteURI` in `o.a.s.u.Utils` Key: SPARK-46940 URL: https://issues.apache.org/jira/browse/SPARK-46940

[jira] [Updated] (SPARK-46679) Encoders with multiple inheritance - Key not found: T

2024-01-31 Thread Andoni Teso (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andoni Teso updated SPARK-46679: Priority: Blocker (was: Major) > Encoders with multiple inheritance - Key not found: T >

[jira] [Updated] (SPARK-46939) Simplify IndylambdaScalaClosures#getSerializationProxy

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46939: --- Labels: pull-request-available (was: ) > Simplify

[jira] [Created] (SPARK-46939) Simplify IndylambdaScalaClosures#getSerializationProxy

2024-01-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-46939: Summary: Simplify IndylambdaScalaClosures#getSerializationProxy Key: SPARK-46939 URL: https://issues.apache.org/jira/browse/SPARK-46939 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45522) Migrate jetty 9 to jetty 10

2024-01-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813043#comment-17813043 ] Yang Jie commented on SPARK-45522: -- [~HF] I have created SPARK-46938, we can use this ticket to

[jira] [Created] (SPARK-46938) Migrate jetty 10 to jetty 11

2024-01-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-46938: Summary: Migrate jetty 10 to jetty 11 Key: SPARK-46938 URL: https://issues.apache.org/jira/browse/SPARK-46938 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45522) Migrate jetty 9 to jetty 10

2024-01-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45522: - Summary: Migrate jetty 9 to jetty 10 (was: Migrate jetty 9 to jetty 12) > Migrate jetty 9 to jetty 10

[jira] [Resolved] (SPARK-46473) Reuse `getPartitionedFile` method

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-46473. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44437

[jira] [Assigned] (SPARK-46473) Reuse `getPartitionedFile` method

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-46473: Assignee: xiaoping.huang > Reuse `getPartitionedFile` method >

[jira] [Updated] (SPARK-46936) implement `Frame.to_feather`

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46936: --- Labels: pull-request-available (was: ) > implement `Frame.to_feather` >

[jira] [Created] (SPARK-46936) implement `Frame.to_feather`

2024-01-31 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46936: - Summary: implement `Frame.to_feather` Key: SPARK-46936 URL: https://issues.apache.org/jira/browse/SPARK-46936 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46923) Limit width of config tables in documentation and style them consistently

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46923: --- Labels: pull-request-available (was: ) > Limit width of config tables in documentation and

[jira] [Updated] (SPARK-46935) Consolidate error documentation

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46935: --- Labels: pull-request-available (was: ) > Consolidate error documentation >

[jira] [Updated] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46928: --- Labels: pull-request-available (was: ) > Support ListState in Arbitrary State API v2 >

[jira] [Created] (SPARK-46935) Consolidate error documentation

2024-01-31 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46935: Summary: Consolidate error documentation Key: SPARK-46935 URL: https://issues.apache.org/jira/browse/SPARK-46935 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-31 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Updated] (SPARK-46862) Incorrect count() of a dataframe loaded from CSV datasource

2024-01-31 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-46862: --- Labels: correctness pull-request-available (was: pull-request-available) > Incorrect count() of a

[jira] [Created] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-01-31 Thread Yu-Ting LIN (Jira)
Yu-Ting LIN created SPARK-46934: --- Summary: Unable to create Hive View from certain Spark Dataframe StructType Key: SPARK-46934 URL: https://issues.apache.org/jira/browse/SPARK-46934 Project: Spark

[jira] [Commented] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-01-31 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812820#comment-17812820 ] Bhuwan Sahni commented on SPARK-46928: -- PR submitted -

[jira] [Resolved] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46931. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44966

[jira] [Updated] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46931: --- Labels: pull-request-available (was: ) > Implement {Frame, Series}.to_hdf >

[jira] [Assigned] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46931: - Assignee: Ruifeng Zheng > Implement {Frame, Series}.to_hdf >

[jira] [Resolved] (SPARK-46930) Add support for a custom prefix for Union type fields in Avro when enableStableIdentifiersForUnionType is enabled

2024-01-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46930. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44964

[jira] [Resolved] (SPARK-46929) Use ThreadUtils.shutdown to close thread pools

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-46929. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44962

[jira] [Updated] (SPARK-46929) Use ThreadUtils.shutdown to close thread pools

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-46929: - Priority: Trivial (was: Major) > Use ThreadUtils.shutdown to close thread pools >

[jira] [Resolved] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-46400. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44343

[jira] [Assigned] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-46400: Assignee: BingKun Pan > When there are corrupted files in the local maven repo, retry to

[jira] [Assigned] (SPARK-45522) Migrate jetty 9 to jetty 12

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45522: Assignee: HiuFung > Migrate jetty 9 to jetty 12 > --- > >

[jira] [Resolved] (SPARK-45522) Migrate jetty 9 to jetty 12

2024-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45522. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43765

[jira] [Resolved] (SPARK-46072) Missing .jars when applying code to spark-connect

2024-01-31 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Kravchuk resolved SPARK-46072. - Resolution: Not A Problem > Missing .jars when applying code to spark-connect >

[jira] [Commented] (SPARK-46072) Missing .jars when applying code to spark-connect

2024-01-31 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812702#comment-17812702 ] Dmitry Kravchuk commented on SPARK-46072: - I just changed --packahges to --jars, placed local

[jira] [Updated] (SPARK-46929) Use ThreadUtils.shutdown to close thread pools

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46929: --- Labels: pull-request-available (was: ) > Use ThreadUtils.shutdown to close thread pools >

[jira] [Updated] (SPARK-46933) Add execution time metric for jdbc query

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46933: --- Labels: pull-request-available (was: ) > Add execution time metric for jdbc query >

[jira] [Created] (SPARK-46933) Add execution time metric for jdbc query

2024-01-31 Thread Milan Stefanovic (Jira)
Milan Stefanovic created SPARK-46933: Summary: Add execution time metric for jdbc query Key: SPARK-46933 URL: https://issues.apache.org/jira/browse/SPARK-46933 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46833) Using ICU library for collation tracking

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46833: --- Labels: pull-request-available (was: ) > Using ICU library for collation tracking >

[jira] [Assigned] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46931: -- Assignee: (was: Apache Spark) > Implement {Frame, Series}.to_hdf >

[jira] [Commented] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812590#comment-17812590 ] ASF GitHub Bot commented on SPARK-46931: User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812591#comment-17812591 ] ASF GitHub Bot commented on SPARK-46931: User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46931: -- Assignee: Apache Spark > Implement {Frame, Series}.to_hdf >

[jira] [Assigned] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46931: -- Assignee: Apache Spark > Implement {Frame, Series}.to_hdf >

[jira] [Assigned] (SPARK-46931) Implement {Frame, Series}.to_hdf

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46931: -- Assignee: (was: Apache Spark) > Implement {Frame, Series}.to_hdf >

[jira] [Resolved] (SPARK-46932) Clean up the imports in `pyspark.pandas.test_*`

2024-01-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46932. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44967