[jira] [Commented] (SPARK-41700) Remove `FunctionBuilder`

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651766#comment-17651766 ] Apache Spark commented on SPARK-41700: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41700) Remove `FunctionBuilder`

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41700: Assignee: Apache Spark > Remove `FunctionBuilder` > > >

[jira] [Assigned] (SPARK-41700) Remove `FunctionBuilder`

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41700: Assignee: (was: Apache Spark) > Remove `FunctionBuilder` > >

[jira] [Commented] (SPARK-41700) Remove `FunctionBuilder`

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651765#comment-17651765 ] Apache Spark commented on SPARK-41700: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-41700) Remove `FunctionBuilder`

2022-12-23 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41700: - Summary: Remove `FunctionBuilder` Key: SPARK-41700 URL: https://issues.apache.org/jira/browse/SPARK-41700 Project: Spark Issue Type: Sub-task Com

[jira] [Commented] (SPARK-41503) Implement Partition Transformation Functions

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651762#comment-17651762 ] Apache Spark commented on SPARK-41503: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41503) Implement Partition Transformation Functions

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41503: Assignee: Xinrong Meng (was: Apache Spark) > Implement Partition Transformation Function

[jira] [Commented] (SPARK-41503) Implement Partition Transformation Functions

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651763#comment-17651763 ] Apache Spark commented on SPARK-41503: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41503) Implement Partition Transformation Functions

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41503: Assignee: Apache Spark (was: Xinrong Meng) > Implement Partition Transformation Function

[jira] [Commented] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651752#comment-17651752 ] Apache Spark commented on SPARK-41685: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41685: Assignee: Apache Spark > Support optional using Protobuf serializer for KVStore in Histor

[jira] [Commented] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651753#comment-17651753 ] Apache Spark commented on SPARK-41685: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41685: Assignee: (was: Apache Spark) > Support optional using Protobuf serializer for KVStor

[jira] [Commented] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651749#comment-17651749 ] Gengliang Wang commented on SPARK-41685: I am working on this. > Support option

[jira] [Assigned] (SPARK-41699) Upgrade buf to v1.11.0

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41699: Assignee: (was: Apache Spark) > Upgrade buf to v1.11.0 > -- > >

[jira] [Assigned] (SPARK-41699) Upgrade buf to v1.11.0

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41699: Assignee: Apache Spark > Upgrade buf to v1.11.0 > -- > >

[jira] [Commented] (SPARK-41699) Upgrade buf to v1.11.0

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651748#comment-17651748 ] Apache Spark commented on SPARK-41699: -- User 'zhengruifeng' has created a pull requ

[jira] [Updated] (SPARK-41699) Upgrade buf to v1.11.0

2022-12-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41699: -- Component/s: Build (was: Project Infra) > Upgrade buf to v1.11.0 > --

[jira] [Created] (SPARK-41699) Upgrade buf to v1.11.0

2022-12-23 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41699: - Summary: Upgrade buf to v1.11.0 Key: SPARK-41699 URL: https://issues.apache.org/jira/browse/SPARK-41699 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651744#comment-17651744 ] Gengliang Wang commented on SPARK-41677: [~LuciferYang] We can skip this one, or

[jira] [Comment Edited] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651744#comment-17651744 ] Gengliang Wang edited comment on SPARK-41677 at 12/24/22 12:24 AM: ---

[jira] [Assigned] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41430: -- Assignee: Sandeep Singh > Protobuf serializer for ProcessSummaryWrapper > ---

[jira] [Resolved] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41430. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39109 [https:

[jira] [Resolved] (SPARK-41431) Protobuf serializer for SQLExecutionUIData

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41431. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39139 [https:

[jira] [Assigned] (SPARK-41431) Protobuf serializer for SQLExecutionUIData

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41431: -- Assignee: Yang Jie > Protobuf serializer for SQLExecutionUIData > ---

[jira] [Assigned] (SPARK-41696) Upgrade Hadoop to 3.3.4

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41696: Assignee: Apache Spark > Upgrade Hadoop to 3.3.4 > --- > >

[jira] [Commented] (SPARK-41696) Upgrade Hadoop to 3.3.4

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651722#comment-17651722 ] Apache Spark commented on SPARK-41696: -- User 'tobiasstadler' has created a pull req

[jira] [Assigned] (SPARK-41696) Upgrade Hadoop to 3.3.4

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41696: Assignee: (was: Apache Spark) > Upgrade Hadoop to 3.3.4 > --- > >

[jira] [Commented] (SPARK-41695) Upgrade netty to 4.1.86.Final

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651704#comment-17651704 ] Apache Spark commented on SPARK-41695: -- User 'tobiasstadler' has created a pull req

[jira] [Assigned] (SPARK-41695) Upgrade netty to 4.1.86.Final

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41695: Assignee: Apache Spark > Upgrade netty to 4.1.86.Final > - >

[jira] [Assigned] (SPARK-41695) Upgrade netty to 4.1.86.Final

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41695: Assignee: (was: Apache Spark) > Upgrade netty to 4.1.86.Final > -

[jira] [Commented] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

2022-12-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651672#comment-17651672 ] Steve Loughran commented on SPARK-41599: apps can call  FileSystem.closeAllForUG

[jira] [Assigned] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41697: Assignee: Hyukjin Kwon > Enable test_df_show, test_drop, test_dropna, test_toDF_with_sche

[jira] [Resolved] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41697. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39193 [https://gi

[jira] [Assigned] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41698: Assignee: Hyukjin Kwon > Enable 16 tests that pass > - > >

[jira] [Resolved] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41698. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39195 [https://gi

[jira] [Commented] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

2022-12-23 Thread Maciej Smolenski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651638#comment-17651638 ] Maciej Smolenski commented on SPARK-41599: -- [~ste...@apache.org]  Thanks for t

[jira] [Updated] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

2022-12-23 Thread Maciej Smolenski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Smolenski updated SPARK-41599: - Attachment: (was: adding_fs_to_cache_with_staging_dir_set_traces_142334.txt) > Memo

[jira] [Updated] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

2022-12-23 Thread Maciej Smolenski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Smolenski updated SPARK-41599: - Attachment: SPARK-41599-fixes-to-limit-FileSystem-CACHE-size-when-using-InProcessLaunche

[jira] [Updated] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

2022-12-23 Thread Maciej Smolenski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Smolenski updated SPARK-41599: - Attachment: (was: adding_fs_to_cache_traces_140722.txt) > Memory leak in FileSystem.

[jira] [Assigned] (SPARK-41498) Union does not propagate Metadata output

2022-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41498: --- Assignee: Fredrik Klauß > Union does not propagate Metadata output > --

[jira] [Resolved] (SPARK-41498) Union does not propagate Metadata output

2022-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41498. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38941 [https://gith

[jira] [Commented] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651624#comment-17651624 ] Apache Spark commented on SPARK-41698: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651623#comment-17651623 ] Apache Spark commented on SPARK-41698: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41698: Assignee: Apache Spark > Enable 16 tests that pass > - > >

[jira] [Assigned] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41698: Assignee: (was: Apache Spark) > Enable 16 tests that pass > -

[jira] [Commented] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651622#comment-17651622 ] Apache Spark commented on SPARK-41407: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651618#comment-17651618 ] Apache Spark commented on SPARK-41407: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher

2022-12-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651614#comment-17651614 ] Steve Loughran commented on SPARK-41599: 1. try explicitly disabling the cache f

[jira] [Created] (SPARK-41698) Enable 16 tests that pass

2022-12-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41698: Summary: Enable 16 tests that pass Key: SPARK-41698 URL: https://issues.apache.org/jira/browse/SPARK-41698 Project: Spark Issue Type: Sub-task Comp

[jira] [Assigned] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41697: Assignee: (was: Apache Spark) > Enable test_df_show, test_drop, test_dropna, test_toD

[jira] [Assigned] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41697: Assignee: Apache Spark > Enable test_df_show, test_drop, test_dropna, test_toDF_with_sche

[jira] [Commented] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651595#comment-17651595 ] Apache Spark commented on SPARK-41697: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41383) Implement `DataFrame.cube`

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41383: Assignee: Ruifeng Zheng > Implement `DataFrame.cube` > -- > >

[jira] [Resolved] (SPARK-41693) Implement `GroupedData.pivot`

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41693. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39191 [https://gi

[jira] [Assigned] (SPARK-41693) Implement `GroupedData.pivot`

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41693: Assignee: Ruifeng Zheng > Implement `GroupedData.pivot` > - >

[jira] [Resolved] (SPARK-41383) Implement `DataFrame.cube`

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41383. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39191 [https://gi

[jira] [Resolved] (SPARK-41692) implement `DataFrame.rollup`

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41692. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39191 [https://gi

[jira] [Assigned] (SPARK-41692) implement `DataFrame.rollup`

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41692: Assignee: Ruifeng Zheng > implement `DataFrame.rollup` > > >

[jira] [Created] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed

2022-12-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41697: Summary: Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed Key: SPARK-41697 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Created] (SPARK-41696) Upgrade Hadoop to 3.3.4

2022-12-23 Thread Tobias Stadler (Jira)
Tobias Stadler created SPARK-41696: -- Summary: Upgrade Hadoop to 3.3.4 Key: SPARK-41696 URL: https://issues.apache.org/jira/browse/SPARK-41696 Project: Spark Issue Type: Dependency upgrade

[jira] [Created] (SPARK-41695) Upgrade netty to 4.1.86.Final

2022-12-23 Thread Tobias Stadler (Jira)
Tobias Stadler created SPARK-41695: -- Summary: Upgrade netty to 4.1.86.Final Key: SPARK-41695 URL: https://issues.apache.org/jira/browse/SPARK-41695 Project: Spark Issue Type: Dependency upgr

[jira] [Assigned] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41407: --- Assignee: XiDuo You > Pull out v1 write to WriteFiles > --- > >

[jira] [Resolved] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41407. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38939 [https://gith

[jira] [Resolved] (SPARK-41666) Support parameterized SQL in PySpark

2022-12-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41666. -- Resolution: Fixed Issue resolved by pull request 39183 [https://github.com/apache/spark/pull/39183] >

[jira] [Commented] (SPARK-41423) Protobuf serializer for StageDataWrapper

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651560#comment-17651560 ] Apache Spark commented on SPARK-41423: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-41423) Protobuf serializer for StageDataWrapper

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41423: Assignee: Apache Spark > Protobuf serializer for StageDataWrapper > -

[jira] [Assigned] (SPARK-41423) Protobuf serializer for StageDataWrapper

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41423: Assignee: (was: Apache Spark) > Protobuf serializer for StageDataWrapper > --

[jira] [Commented] (SPARK-41423) Protobuf serializer for StageDataWrapper

2022-12-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651559#comment-17651559 ] Apache Spark commented on SPARK-41423: -- User 'panbingkun' has created a pull reques

[jira] [Created] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop()

2022-12-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-41694: Summary: Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop() Key: SPARK-41694 URL: https://issues.apache.org/jira/browse/SPARK-41694 Project:

[jira] [Assigned] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41422: -- Assignee: Sandeep Singh > Protobuf serializer for ExecutorSummaryWrapper > --

[jira] [Resolved] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper

2022-12-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41422. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39141 [https:

[jira] [Updated] (SPARK-41642) Deduplicate docstrings in Python Spark Connect

2022-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41642: - Fix Version/s: 3.4.0 > Deduplicate docstrings in Python Spark Connect >