[jira] [Commented] (SPARK-42878) Named Table should support options

[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703048#comment-17703048 ] Apache Spark commented on SPARK-42878: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42878) Named Table should support options

[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42878: Assignee: Rui Wang (was: Apache Spark) > Named Table should support options >

[jira] [Assigned] (SPARK-42878) Named Table should support options

[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42878: Assignee: Apache Spark (was: Rui Wang) > Named Table should support options >

[jira] [Assigned] (SPARK-40822) Use stable derived-column-alias algorithm, suitable for CREATE VIEW

[ https://issues.apache.org/jira/browse/SPARK-40822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40822: Assignee: Max Gekk > Use stable derived-column-alias algorithm, suitable for CREATE VIEW >

[jira] [Commented] (SPARK-42878) Named Table should support options

[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703050#comment-17703050 ] Apache Spark commented on SPARK-42878: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-42830) Link skipped stages on Spark UI

[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703046#comment-17703046 ] Apache Spark commented on SPARK-42830: -- User 'yliou' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42830) Link skipped stages on Spark UI

[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42830: Assignee: Apache Spark > Link skipped stages on Spark UI >

[jira] [Created] (SPARK-42878) Named Table should support options

Rui Wang created SPARK-42878: Summary: Named Table should support options Key: SPARK-42878 URL: https://issues.apache.org/jira/browse/SPARK-42878 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-42830) Link skipped stages on Spark UI

[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42830: Assignee: (was: Apache Spark) > Link skipped stages on Spark UI >

[jira] [Resolved] (SPARK-40822) Use stable derived-column-alias algorithm, suitable for CREATE VIEW

[ https://issues.apache.org/jira/browse/SPARK-40822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40822. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40126

[jira] [Commented] (SPARK-42884) Add Ammonite REPL support

[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703459#comment-17703459 ] Apache Spark commented on SPARK-42884: -- User 'hvanhovell' has created a pull request for this

[jira] [Resolved] (SPARK-42786) Impl typed select in Dataset

[ https://issues.apache.org/jira/browse/SPARK-42786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42786. --- Fix Version/s: 3.5.0 Assignee: Zhen Li Resolution: Fixed > Impl

[jira] [Created] (SPARK-42894) Implement cache, persist, unpersist

Yang Jie created SPARK-42894: Summary: Implement cache, persist, unpersist Key: SPARK-42894 URL: https://issues.apache.org/jira/browse/SPARK-42894 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42052) Codegen Support for HiveSimpleUDF

[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42052: --- Assignee: BingKun Pan > Codegen Support for HiveSimpleUDF >

[jira] [Resolved] (SPARK-42052) Codegen Support for HiveSimpleUDF

[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42052. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40397

[jira] [Commented] (SPARK-42884) Add Ammonite REPL support

[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703458#comment-17703458 ] Apache Spark commented on SPARK-42884: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42884) Add Ammonite REPL support

[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42884: Assignee: Herman van Hövell (was: Apache Spark) > Add Ammonite REPL support >

[jira] [Assigned] (SPARK-42884) Add Ammonite REPL support

[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42884: Assignee: Apache Spark (was: Herman van Hövell) > Add Ammonite REPL support >

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Summary: Implement cache, persist, unpersist, and storageLevel (was: Implement cache, persist,

[jira] [Commented] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703493#comment-17703493 ] Apache Spark commented on SPARK-42894: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703492#comment-17703492 ] Apache Spark commented on SPARK-42894: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42894: Assignee: (was: Apache Spark) > Implement cache, persist, unpersist, and

[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42894: Assignee: Apache Spark > Implement cache, persist, unpersist, and storageLevel >

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Affects Version/s: (was: 3.4.0) > Implement cache, persist, unpersist, and storageLevel >

[jira] [Updated] (SPARK-42880) Improve the yarn document for lo4j2 configuration

[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42880: - Priority: Trivial (was: Minor) > Improve the yarn document for lo4j2 configuration >

[jira] [Updated] (SPARK-42880) Improve the yarn document for lo4j2 configuration

[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42880: - Component/s: Documentation > Improve the yarn document for lo4j2 configuration >

[jira] [Resolved] (SPARK-42880) Improve the yarn document for lo4j2 configuration

[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42880. -- Fix Version/s: 3.5.0 Assignee: Zhifang Li Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42340: - Fix Version/s: 3.4.1 (was: 3.5.0) > Implement GroupedData.applyInPandas

[jira] [Resolved] (SPARK-42876) DataType's physicalDataType should be private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42876. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40499

[jira] [Created] (SPARK-42882) Implement missing Pandas API and incomplete parameters

Xinrong Meng created SPARK-42882: Summary: Implement missing Pandas API and incomplete parameters Key: SPARK-42882 URL: https://issues.apache.org/jira/browse/SPARK-42882 Project: Spark Issue

[jira] [Resolved] (SPARK-42883) Implement Pandas API Missing Parameters

[ https://issues.apache.org/jira/browse/SPARK-42883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42883. -- Resolution: Resolved > Implement Pandas API Missing Parameters >

[jira] [Resolved] (SPARK-42882) Pandas API Coverage Improvements

[ https://issues.apache.org/jira/browse/SPARK-42882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42882. -- Resolution: Resolved > Pandas API Coverage Improvements > >

[jira] [Updated] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

[ https://issues.apache.org/jira/browse/SPARK-38552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38552: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `keep` parameter of

[jira] [Commented] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703145#comment-17703145 ] Cedric van Eetvelde commented on SPARK-41006: - As mentionned above, I create a Pull Request

[jira] [Comment Edited] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703145#comment-17703145 ] Cedric van Eetvelde edited comment on SPARK-41006 at 3/21/23 11:03 AM:

[jira] [Created] (SPARK-42879) Spark SQL reads unnecessary nested fields

Jiri Humpolicek created SPARK-42879: --- Summary: Spark SQL reads unnecessary nested fields Key: SPARK-42879 URL: https://issues.apache.org/jira/browse/SPARK-42879 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42881) get_json_object Codegen Support

[ https://issues.apache.org/jira/browse/SPARK-42881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42881: Assignee: (was: Apache Spark) > get_json_object Codegen Support >

[jira] [Assigned] (SPARK-42881) get_json_object Codegen Support

[ https://issues.apache.org/jira/browse/SPARK-42881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42881: Assignee: Apache Spark > get_json_object Codegen Support >

[jira] [Commented] (SPARK-42881) get_json_object Codegen Support

[ https://issues.apache.org/jira/browse/SPARK-42881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703077#comment-17703077 ] Apache Spark commented on SPARK-42881: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-42881) get_json_object Codegen Support

[ https://issues.apache.org/jira/browse/SPARK-42881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703078#comment-17703078 ] Apache Spark commented on SPARK-42881: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-42662) Add `_distributed_sequence_id` for distributed-sequence index.

[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703112#comment-17703112 ] Apache Spark commented on SPARK-42662: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

[ https://issues.apache.org/jira/browse/SPARK-40386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40386: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `ddof` in `DataFrame.cov` >

[jira] [Updated] (SPARK-40510) Implement `ddof` in `Series.cov`

[ https://issues.apache.org/jira/browse/SPARK-40510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40510: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `ddof` in `Series.cov` >

[jira] [Updated] (SPARK-40341) Implement `Rolling.median`.

[ https://issues.apache.org/jira/browse/SPARK-40341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40341: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `Rolling.median`. >

[jira] [Updated] (SPARK-40744) Make `_reduce_for_stat_function` in `groupby` accept `min_count`

[ https://issues.apache.org/jira/browse/SPARK-40744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40744: - Parent: SPARK-42882 (was: SPARK-40327) > Make `_reduce_for_stat_function` in `groupby` accept

[jira] [Updated] (SPARK-40631) Implement `min_count` in `GroupBy.first`

[ https://issues.apache.org/jira/browse/SPARK-40631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40631: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `min_count` in `GroupBy.first` >

[jira] [Updated] (SPARK-40573) Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40573: - Parent: SPARK-42882 (was: SPARK-40327) > Make `ddof` in `GroupBy.std`, `GroupBy.var` and

[jira] [Updated] (SPARK-40340) Implement `Expanding.sem`.

[ https://issues.apache.org/jira/browse/SPARK-40340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40340: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `Expanding.sem`. >

[jira] [Updated] (SPARK-40421) Make `spearman` correlation in `DataFrame.corr` support missing values and `min_periods`

[ https://issues.apache.org/jira/browse/SPARK-40421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40421: - Parent: SPARK-42882 (was: SPARK-40327) > Make `spearman` correlation in `DataFrame.corr`

[jira] [Updated] (SPARK-40503) Add resampling to API references

[ https://issues.apache.org/jira/browse/SPARK-40503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40503: - Parent: SPARK-42882 (was: SPARK-40327) > Add resampling to API references >

[jira] [Updated] (SPARK-40399) Make `pearson` correlation in `DataFrame.corr` support missing values and `min_periods`

[ https://issues.apache.org/jira/browse/SPARK-40399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40399: - Parent: SPARK-42882 (was: SPARK-40327) > Make `pearson` correlation in `DataFrame.corr`

[jira] [Updated] (SPARK-40543) Make `ddof` in `DataFrame.var` and `Series.var` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40543: - Parent: SPARK-42882 (was: SPARK-40327) > Make `ddof` in `DataFrame.var` and `Series.var`

[jira] [Updated] (SPARK-40486) Implement `spearman` and `kendall` in `DataFrame.corrwith`

[ https://issues.apache.org/jira/browse/SPARK-40486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40486: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `spearman` and `kendall` in

[jira] [Updated] (SPARK-40345) Implement `ExpandingGroupby.quantile`.

[ https://issues.apache.org/jira/browse/SPARK-40345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40345: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `ExpandingGroupby.quantile`. >

[jira] [Updated] (SPARK-40498) Implement `kendall` and `min_periods` in `Series.corr`

[ https://issues.apache.org/jira/browse/SPARK-40498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40498: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `kendall` and `min_periods` in

[jira] [Updated] (SPARK-40579) `GroupBy.first` should skip nulls

[ https://issues.apache.org/jira/browse/SPARK-40579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40579: - Parent: SPARK-42882 (was: SPARK-40327) > `GroupBy.first` should skip nulls >

[jira] [Updated] (SPARK-40621) Implement `numeric_only` and `min_count` in `GroupBy.sum`

[ https://issues.apache.org/jira/browse/SPARK-40621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40621: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `numeric_only` and `min_count` in

[jira] [Updated] (SPARK-40305) Implement Groupby.sem

[ https://issues.apache.org/jira/browse/SPARK-40305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40305: - Parent: SPARK-42882 (was: SPARK-40327) > Implement Groupby.sem > - > >

[jira] [Updated] (SPARK-40445) Refactor Resampler

[ https://issues.apache.org/jira/browse/SPARK-40445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40445: - Parent: SPARK-42882 (was: SPARK-40327) > Refactor Resampler > -- > >

[jira] [Updated] (SPARK-40542) Make `ddof` in `DataFrame.std` and `Series.std` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40542: - Parent: SPARK-42882 (was: SPARK-40327) > Make `ddof` in `DataFrame.std` and `Series.std`

[jira] [Updated] (SPARK-40332) Implement `GroupBy.quantile`.

[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40332: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `GroupBy.quantile`. >

[jira] [Updated] (SPARK-40447) Implement `kendall` correlation in `DataFrame.corr`

[ https://issues.apache.org/jira/browse/SPARK-40447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40447: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `kendall` correlation in `DataFrame.corr` >

[jira] [Updated] (SPARK-40339) Implement `Expanding.quantile`.

[ https://issues.apache.org/jira/browse/SPARK-40339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40339: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `Expanding.quantile`. >

[jira] [Updated] (SPARK-40643) Implement `min_count` in `GroupBy.last`

[ https://issues.apache.org/jira/browse/SPARK-40643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40643: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `min_count` in `GroupBy.last` >

[jira] [Updated] (SPARK-40161) Make Series.mode apply PandasMode

[ https://issues.apache.org/jira/browse/SPARK-40161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40161: - Parent: SPARK-42882 (was: SPARK-40327) > Make Series.mode apply PandasMode >

[jira] [Updated] (SPARK-40592) Implement `min_count` in `GroupBy.max`

[ https://issues.apache.org/jira/browse/SPARK-40592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40592: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `min_count` in `GroupBy.max` >

[jira] [Updated] (SPARK-40698) Improve the precision of `product` for intergral inputs

[ https://issues.apache.org/jira/browse/SPARK-40698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40698: - Parent: SPARK-42882 (was: SPARK-40327) > Improve the precision of `product` for intergral

[jira] [Updated] (SPARK-40348) Implement `RollingGroupby.quantile`.

[ https://issues.apache.org/jira/browse/SPARK-40348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40348: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `RollingGroupby.quantile`. >

[jira] [Updated] (SPARK-40561) Implement `min_count` in GroupBy.min

[ https://issues.apache.org/jira/browse/SPARK-40561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40561: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `min_count` in GroupBy.min >

[jira] [Updated] (SPARK-40446) Rename `_MissingPandasXXX` as `MissingPandasXXX`

[ https://issues.apache.org/jira/browse/SPARK-40446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40446: - Parent: SPARK-42882 (was: SPARK-40327) > Rename `_MissingPandasXXX` as `MissingPandasXXX` >

[jira] [Updated] (SPARK-40529) Remove `pyspark.pandas.ml`

[ https://issues.apache.org/jira/browse/SPARK-40529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40529: - Parent: SPARK-42882 (was: SPARK-40327) > Remove `pyspark.pandas.ml` >

[jira] [Updated] (SPARK-40330) Implement `Series.searchsorted`.

[ https://issues.apache.org/jira/browse/SPARK-40330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40330: - Parent: SPARK-42882 (was: SPARK-40327) > Implement `Series.searchsorted`. >

[jira] [Created] (SPARK-42880) Improve the yarn document for lo4j2 configuration

Zhifang Li created SPARK-42880: -- Summary: Improve the yarn document for lo4j2 configuration Key: SPARK-42880 URL: https://issues.apache.org/jira/browse/SPARK-42880 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42880) Improve the yarn document for lo4j2 configuration

[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42880: Assignee: Apache Spark > Improve the yarn document for lo4j2 configuration >

[jira] [Assigned] (SPARK-42880) Improve the yarn document for lo4j2 configuration

[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42880: Assignee: (was: Apache Spark) > Improve the yarn document for lo4j2 configuration >

[jira] [Commented] (SPARK-42880) Improve the yarn document for lo4j2 configuration

[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703071#comment-17703071 ] Apache Spark commented on SPARK-42880: -- User 'frankliee' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33307) Refactor GROUPING ANALYTICS

[ https://issues.apache.org/jira/browse/SPARK-33307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33307. - Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed > Refactor GROUPING

[jira] [Updated] (SPARK-38576) Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only

[ https://issues.apache.org/jira/browse/SPARK-38576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38576: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `numeric_only` parameter for

[jira] [Updated] (SPARK-38387) Support `na_action` and Series input correspondence in `Series.map`

[ https://issues.apache.org/jira/browse/SPARK-38387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38387: - Parent: SPARK-42883 (was: SPARK-39199) > Support `na_action` and Series input correspondence

[jira] [Updated] (SPARK-39201) Implement `ignore_index` of `DataFrame.explode` and `DataFrame.drop_duplicates`

[ https://issues.apache.org/jira/browse/SPARK-39201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39201: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `ignore_index` of `DataFrame.explode` and

[jira] [Updated] (SPARK-38608) Implement `bool_only` parameter of `DataFrame.all` and`DataFrame.any`

[ https://issues.apache.org/jira/browse/SPARK-38608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38608: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `bool_only` parameter of `DataFrame.all`

[jira] [Updated] (SPARK-38793) Support `return_indexer` parameter of `Index/MultiIndex.sort_values`

[ https://issues.apache.org/jira/browse/SPARK-38793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38793: - Parent: SPARK-42883 (was: SPARK-39199) > Support `return_indexer` parameter of

[jira] [Updated] (SPARK-38441) Support string and bool `regex` in `Series.replace`

[ https://issues.apache.org/jira/browse/SPARK-38441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38441: - Parent: SPARK-42883 (was: SPARK-39199) > Support string and bool `regex` in `Series.replace` >

[jira] [Updated] (SPARK-38989) Implement `ignore_index` of `DataFrame/Series.sample`

[ https://issues.apache.org/jira/browse/SPARK-38989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38989: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `ignore_index` of `DataFrame/Series.sample`

[jira] [Updated] (SPARK-38726) Support `how` parameter of `MultiIndex.dropna`

[ https://issues.apache.org/jira/browse/SPARK-38726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38726: - Parent: SPARK-42883 (was: SPARK-39199) > Support `how` parameter of `MultiIndex.dropna` >

[jira] [Updated] (SPARK-38765) Implement `inplace` parameter of `Series.clip`

[ https://issues.apache.org/jira/browse/SPARK-38765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38765: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `inplace` parameter of `Series.clip` >

[jira] [Updated] (SPARK-38686) Implement `keep` parameter of `(Index/MultiIndex).drop_duplicates`

[ https://issues.apache.org/jira/browse/SPARK-38686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38686: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `keep` parameter of

[jira] [Updated] (SPARK-39907) Implement axis and skipna of Series.argmin

[ https://issues.apache.org/jira/browse/SPARK-39907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39907: - Parent: SPARK-42883 (was: SPARK-39199) > Implement axis and skipna of Series.argmin >

[jira] [Updated] (SPARK-38903) Implement `ignore_index` of `Series.sort_values` and `Series.sort_index`

[ https://issues.apache.org/jira/browse/SPARK-38903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38903: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `ignore_index` of `Series.sort_values` and

[jira] [Updated] (SPARK-38518) Implement `skipna` of `Series.all/Index.all` to exclude NA/null values

[ https://issues.apache.org/jira/browse/SPARK-38518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38518: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `skipna` of `Series.all/Index.all` to

[jira] [Updated] (SPARK-38479) Add `Series.duplicated` to indicate duplicate Series values.

[ https://issues.apache.org/jira/browse/SPARK-38479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38479: - Parent: SPARK-42883 (was: SPARK-39199) > Add `Series.duplicated` to indicate duplicate Series

[jira] [Updated] (SPARK-38938) Implement `inplace` and `columns` parameters of `Series.drop`

[ https://issues.apache.org/jira/browse/SPARK-38938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38938: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `inplace` and `columns` parameters of

[jira] [Updated] (SPARK-38937) interpolate support param `limit_direction`

[ https://issues.apache.org/jira/browse/SPARK-38937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38937: - Parent: SPARK-42883 (was: SPARK-39199) > interpolate support param `limit_direction` >

[jira] [Updated] (SPARK-38863) Implement `skipna` parameter of `DataFrame.all`

[ https://issues.apache.org/jira/browse/SPARK-38863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38863: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `skipna` parameter of `DataFrame.all` >

[jira] [Updated] (SPARK-38491) Support `ignore_index` of `Series.sort_values`

[ https://issues.apache.org/jira/browse/SPARK-38491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38491: - Parent: SPARK-42883 (was: SPARK-39199) > Support `ignore_index` of `Series.sort_values` >

[jira] [Updated] (SPARK-38943) EWM support ignore_na

[ https://issues.apache.org/jira/browse/SPARK-38943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38943: - Parent: SPARK-42883 (was: SPARK-39199) > EWM support ignore_na > - > >

[jira] [Updated] (SPARK-39189) interpolate supports limit_area

[ https://issues.apache.org/jira/browse/SPARK-39189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39189: - Parent: SPARK-42883 (was: SPARK-39199) > interpolate supports limit_area >

[jira] [Updated] (SPARK-38704) Support string `inclusive` parameter of `Series.between`

[ https://issues.apache.org/jira/browse/SPARK-38704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38704: - Parent: SPARK-42883 (was: SPARK-39199) > Support string `inclusive` parameter of

[jira] [Commented] (SPARK-39199) Implement pandas API missing parameters

[ https://issues.apache.org/jira/browse/SPARK-39199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703121#comment-17703121 ] Xinrong Meng commented on SPARK-39199: -- Please see

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40327: - Fix Version/s: (was: 3.4.0) > Increase pandas API coverage for pandas API on Spark >

  1   2   >