[jira] [Comment Edited] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-12-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651121#comment-17651121 ] Yang Jie edited comment on SPARK-41053 at 12/22/22 7:51 AM:

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-12-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651121#comment-17651121 ] Yang Jie commented on SPARK-41053: -- [~Gengliang.Wang] I have created some more tickets. Please check

[jira] [Commented] (SPARK-41681) Factor GroupedData out to group.py

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651118#comment-17651118 ] Apache Spark commented on SPARK-41681: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41681) Factor GroupedData out to group.py

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651117#comment-17651117 ] Apache Spark commented on SPARK-41681: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41681) Factor GroupedData out to group.py

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41681: Assignee: (was: Apache Spark) > Factor GroupedData out to group.py >

[jira] [Assigned] (SPARK-41681) Factor GroupedData out to group.py

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41681: Assignee: Apache Spark > Factor GroupedData out to group.py >

[jira] [Created] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41682: Summary: Protobuf serializer for ApplicationStoreInfo Key: SPARK-41682 URL: https://issues.apache.org/jira/browse/SPARK-41682 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41679) Protobuf serializer for StreamBlockData

2022-12-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41679: - Summary: Protobuf serializer for StreamBlockData (was: Protobuf serializer for LogInfo) > Protobuf

[jira] [Created] (SPARK-41680) Protobuf serializer for CachedQuantile

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41680: Summary: Protobuf serializer for CachedQuantile Key: SPARK-41680 URL: https://issues.apache.org/jira/browse/SPARK-41680 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41681) Factor GroupedData out to group.py

2022-12-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41681: Summary: Factor GroupedData out to group.py Key: SPARK-41681 URL: https://issues.apache.org/jira/browse/SPARK-41681 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41679) Protobuf serializer for LogInfo

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41679: Summary: Protobuf serializer for LogInfo Key: SPARK-41679 URL: https://issues.apache.org/jira/browse/SPARK-41679 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41678) Protobuf serializer for LogInfo

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41678: Summary: Protobuf serializer for LogInfo Key: SPARK-41678 URL: https://issues.apache.org/jira/browse/SPARK-41678 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41677: Summary: Protobuf serializer for StreamingQueryProgressWrapper Key: SPARK-41677 URL: https://issues.apache.org/jira/browse/SPARK-41677 Project: Spark Issue Type:

[jira] [Created] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41676: Summary: Protobuf serializer for StreamingQueryData Key: SPARK-41676 URL: https://issues.apache.org/jira/browse/SPARK-41676 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41675) Make column op support `datetime`

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41675: Assignee: Ruifeng Zheng > Make column op support `datetime` >

[jira] [Resolved] (SPARK-41675) Make column op support `datetime`

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41675. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39171

[jira] [Resolved] (SPARK-41641) Implement `Column.over`

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41641. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39149

[jira] [Assigned] (SPARK-41640) implement `Window` functions

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41640: Assignee: Ruifeng Zheng > implement `Window` functions > >

[jira] [Assigned] (SPARK-41641) Implement `Column.over`

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41641: Assignee: Ruifeng Zheng > Implement `Column.over` > --- > >

[jira] [Assigned] (SPARK-41292) Window-function support

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41292: Assignee: Martin Grund > Window-function support > --- > >

[jira] [Assigned] (SPARK-41292) Window-function support

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41292: Assignee: Ruifeng Zheng (was: Martin Grund) > Window-function support >

[jira] [Resolved] (SPARK-41640) implement `Window` functions

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41640. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39149

[jira] [Assigned] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41282: Assignee: Ruifeng Zheng (was: Rui Wang) > Feature parity: Column API in Spark Connect >

[jira] [Resolved] (SPARK-41292) Window-function support

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41292. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39149

[jira] [Resolved] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41673. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39169

[jira] [Assigned] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41673: - Assignee: Ruifeng Zheng > Implement `Column.astype` > - > >

[jira] [Commented] (SPARK-41675) Make column op support `datetime`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651094#comment-17651094 ] Apache Spark commented on SPARK-41675: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41675) Make column op support `datetime`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41675: Assignee: Apache Spark > Make column op support `datetime` >

[jira] [Assigned] (SPARK-41675) Make column op support `datetime`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41675: Assignee: (was: Apache Spark) > Make column op support `datetime` >

[jira] [Updated] (SPARK-41675) Make column op support `datetime`

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41675: -- Summary: Make column op support `datetime` (was: Make column op support datetime) > Make

[jira] [Created] (SPARK-41675) Make column op support datetime

2022-12-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41675: - Summary: Make column op support datetime Key: SPARK-41675 URL: https://issues.apache.org/jira/browse/SPARK-41675 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41668: --- Fix Version/s: 3.3.2 3.4.0 > DECODE function returns wrong results when

[jira] [Assigned] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41668: -- Assignee: Gengliang Wang > DECODE function returns wrong results when passed NULL >

[jira] [Resolved] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41668. Fix Version/s: 3.2.3 (was: 3.4.0) (was:

[jira] [Resolved] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41672. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39167

[jira] [Assigned] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41672: - Assignee: Ruifeng Zheng > Enable the deprecated functions >

[jira] [Resolved] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41428. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39108

[jira] [Assigned] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41428: -- Assignee: Sandeep Singh > Protobuf serializer for SpeculationStageSummaryWrapper >

[jira] [Deleted] (SPARK-41671) Implement initial Catalog.* API

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-41671: - > Implement initial Catalog.* API > --- > > Key:

[jira] [Commented] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651076#comment-17651076 ] Apache Spark commented on SPARK-41674: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41674: Assignee: (was: Apache Spark) > Runtime filter should supports the any side of child

[jira] [Assigned] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41674: Assignee: Apache Spark > Runtime filter should supports the any side of child join as

[jira] [Commented] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651075#comment-17651075 ] Apache Spark commented on SPARK-41674: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side

2022-12-21 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-41674: -- Summary: Runtime filter should supports the any side of child join as filter creation side Key: SPARK-41674 URL: https://issues.apache.org/jira/browse/SPARK-41674

[jira] [Assigned] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41673: Assignee: (was: Apache Spark) > Implement `Column.astype` >

[jira] [Commented] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651071#comment-17651071 ] Apache Spark commented on SPARK-41673: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41673: Assignee: Apache Spark > Implement `Column.astype` > - > >

[jira] [Commented] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651070#comment-17651070 ] Apache Spark commented on SPARK-41673: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-41673) Implement `Column.astype`

2022-12-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41673: - Summary: Implement `Column.astype` Key: SPARK-41673 URL: https://issues.apache.org/jira/browse/SPARK-41673 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41639) Remove ScalaReflectionLock

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41639: --- Assignee: Sandish Kumar HN > Remove ScalaReflectionLock > --- > >

[jira] [Resolved] (SPARK-41639) Remove ScalaReflectionLock

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41639. - Resolution: Fixed Issue resolved by pull request 39147

[jira] [Commented] (SPARK-41528) Sharing namespace between PySpark and Spark Connect

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651063#comment-17651063 ] Apache Spark commented on SPARK-41528: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41528) Sharing namespace between PySpark and Spark Connect

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651062#comment-17651062 ] Apache Spark commented on SPARK-41528: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651058#comment-17651058 ] Apache Spark commented on SPARK-41672: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41672: Assignee: Apache Spark > Enable the deprecated functions >

[jira] [Assigned] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41672: Assignee: (was: Apache Spark) > Enable the deprecated functions >

[jira] [Commented] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651057#comment-17651057 ] Apache Spark commented on SPARK-41672: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-41672) Enable the deprecated functions

2022-12-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41672: - Summary: Enable the deprecated functions Key: SPARK-41672 URL: https://issues.apache.org/jira/browse/SPARK-41672 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651055#comment-17651055 ] Apache Spark commented on SPARK-41668: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41668: --- Fix Version/s: 3.3.2 3.4.0 > DECODE function returns wrong results when

[jira] [Updated] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41668: --- Affects Version/s: 3.3.1 3.2.2 3.3.0

[jira] [Commented] (SPARK-41671) Implement initial Catalog.* API

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651052#comment-17651052 ] Apache Spark commented on SPARK-41671: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41671) Implement initial Catalog.* API

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41671: Assignee: Apache Spark > Implement initial Catalog.* API >

[jira] [Assigned] (SPARK-41671) Implement initial Catalog.* API

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41671: Assignee: (was: Apache Spark) > Implement initial Catalog.* API >

[jira] [Resolved] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41669. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39161

[jira] [Assigned] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41669: --- Assignee: Allison Wang > Speed up CollapseProject for wide tables >

[jira] [Created] (SPARK-41671) Implement initial Catalog.* API

2022-12-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41671: Summary: Implement initial Catalog.* API Key: SPARK-41671 URL: https://issues.apache.org/jira/browse/SPARK-41671 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41432: Assignee: Apache Spark > Protobuf serializer for SparkPlanGraphWrapper >

[jira] [Assigned] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41432: Assignee: (was: Apache Spark) > Protobuf serializer for SparkPlanGraphWrapper >

[jira] [Commented] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651031#comment-17651031 ] Apache Spark commented on SPARK-41432: -- User 'techaddict' has created a pull request for this

[jira] [Resolved] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41646. -- Assignee: Hyukjin Kwon Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-41648) Deduplicate docstrings in pyspark.sql.connect.readwriter

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41648: Assignee: Hyukjin Kwon > Deduplicate docstrings in pyspark.sql.connect.readwriter >

[jira] [Resolved] (SPARK-41648) Deduplicate docstrings in pyspark.sql.connect.readwriter

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41648. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39153

[jira] [Assigned] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41663: Assignee: Ruifeng Zheng > Implement the rest of Lambda functions >

[jira] [Resolved] (SPARK-41663) Implement the rest of Lambda functions

2022-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41663. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39154

[jira] [Comment Edited] (SPARK-41557) Union of tables with and without metadata column fails when used in join

2022-12-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651026#comment-17651026 ] Maxime Thébault edited comment on SPARK-41557 at 12/22/22 12:31 AM:

[jira] [Commented] (SPARK-41557) Union of tables with and without metadata column fails when used in join

2022-12-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651026#comment-17651026 ] Maxime Thébault commented on SPARK-41557: - Might be related to (and fixed by) SPARK-41660? >

[jira] [Created] (SPARK-41670) Introduce builtin and session namespaces for builtin functions and temp views/functions

2022-12-21 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-41670: Summary: Introduce builtin and session namespaces for builtin functions and temp views/functions Key: SPARK-41670 URL: https://issues.apache.org/jira/browse/SPARK-41670

[jira] [Assigned] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41668: Assignee: Apache Spark > DECODE function returns wrong results when passed NULL >

[jira] [Commented] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651000#comment-17651000 ] Apache Spark commented on SPARK-41668: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41668: Assignee: (was: Apache Spark) > DECODE function returns wrong results when passed

[jira] [Commented] (SPARK-41615) Support Catalog.listDatabases

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650998#comment-17650998 ] Apache Spark commented on SPARK-41615: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41615) Support Catalog.listDatabases

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41615: Assignee: (was: Apache Spark) > Support Catalog.listDatabases >

[jira] [Commented] (SPARK-41615) Support Catalog.listDatabases

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650997#comment-17650997 ] Apache Spark commented on SPARK-41615: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41615) Support Catalog.listDatabases

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41615: Assignee: Apache Spark > Support Catalog.listDatabases > - >

[jira] [Assigned] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41669: Assignee: (was: Apache Spark) > Speed up CollapseProject for wide tables >

[jira] [Commented] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650994#comment-17650994 ] Apache Spark commented on SPARK-41669: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41669: Assignee: Apache Spark > Speed up CollapseProject for wide tables >

[jira] [Commented] (SPARK-41650) json expressions much slower in optimized mode

2022-12-21 Thread Yi Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650993#comment-17650993 ] Yi Zhang commented on SPARK-41650: -- just saw that SPARK-33078 added the config to turn it on/off 

[jira] [Created] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Allison Wang (Jira)
Allison Wang created SPARK-41669: Summary: Speed up CollapseProject for wide tables Key: SPARK-41669 URL: https://issues.apache.org/jira/browse/SPARK-41669 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41650) json expressions much slower in optimized mode

2022-12-21 Thread Yi Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhang updated SPARK-41650: - Affects Version/s: 3.1.3 > json expressions much slower in optimized mode >

[jira] [Updated] (SPARK-41650) json expressions much slower in optimized mode

2022-12-21 Thread Yi Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhang updated SPARK-41650: - Affects Version/s: 3.3.1 > json expressions much slower in optimized mode >

[jira] [Created] (SPARK-41668) DECODE function returns wrong results when passed NULL

2022-12-21 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-41668: Summary: DECODE function returns wrong results when passed NULL Key: SPARK-41668 URL: https://issues.apache.org/jira/browse/SPARK-41668 Project: Spark Issue

[jira] [Assigned] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41644: -- Assignee: Yang Jie > Introducing SPI mechanism to make it easy for other modules to

[jira] [Resolved] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer

2022-12-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41644. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39148

[jira] [Commented] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650936#comment-17650936 ] Apache Spark commented on SPARK-41667: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41667: Assignee: Apache Spark > Expose env var SPARK_DRIVER_POD_NAME in Driver Pod >

[jira] [Assigned] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41667: Assignee: (was: Apache Spark) > Expose env var SPARK_DRIVER_POD_NAME in Driver Pod >

[jira] [Commented] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod

2022-12-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650935#comment-17650935 ] Apache Spark commented on SPARK-41667: -- User 'pan3793' has created a pull request for this issue:

[jira] [Created] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod

2022-12-21 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-41667: - Summary: Expose env var SPARK_DRIVER_POD_NAME in Driver Pod Key: SPARK-41667 URL: https://issues.apache.org/jira/browse/SPARK-41667 Project: Spark Issue Type:

  1   2   >