[jira] [Updated] (SPARK-43459) Enable OpsOnDiffFramesGroupByTests.test_groupby_multiindex_columns for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43459: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43458) Enable SeriesConversionTests.test_to_latex for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43458: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43459) Enable OpsOnDiffFramesGroupByTests.test_groupby_multiindex_columns for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43459: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43458) Enable SeriesConversionTests.test_to_latex for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43458: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43453) Enable OpsOnDiffFramesEnabledTests.test_concat_column_axis for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43453: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43452) Enable RollingTests.test_groupby_rolling_count for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43452: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43453) Enable OpsOnDiffFramesEnabledTests.test_concat_column_axis for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43453: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43452) Enable RollingTests.test_groupby_rolling_count for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43452: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43445) Enable GroupBySlowTests.test_split_apply_combine_on_series for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43445: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43451) Enable RollingTests.test_rolling_count for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43451: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43451) Enable RollingTests.test_rolling_count for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43451: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43445) Enable GroupBySlowTests.test_split_apply_combine_on_series for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43445: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43444) Enable GroupBySlowTests.test_value_counts for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43444: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable

[jira] [Updated] (SPARK-43444) Enable GroupBySlowTests.test_value_counts for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43444: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable

[jira] [Updated] (SPARK-43433) Match `GroupBy.nth` behavior with new pandas behavior

[ https://issues.apache.org/jira/browse/SPARK-43433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43433: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Match `GroupBy.nth`

[jira] [Updated] (SPARK-43433) Match `GroupBy.nth` behavior with new pandas behavior

[ https://issues.apache.org/jira/browse/SPARK-43433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43433: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Match `GroupBy.nth` behavior with

[jira] [Updated] (SPARK-43432) Fix `min_periods` for Rolling to work same as pandas

[ https://issues.apache.org/jira/browse/SPARK-43432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43432: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Fix `min_periods` for

[jira] [Updated] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0

[ https://issues.apache.org/jira/browse/SPARK-43304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43304: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Enable test_to_latex by

[jira] [Updated] (SPARK-43432) Fix `min_periods` for Rolling to work same as pandas

[ https://issues.apache.org/jira/browse/SPARK-43432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43432: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Fix `min_periods` for Rolling to

[jira] [Updated] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns

[ https://issues.apache.org/jira/browse/SPARK-43295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43295: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Make DataFrameGroupBy.sum support

[jira] [Updated] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0

[ https://issues.apache.org/jira/browse/SPARK-43304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43304: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Enable test_to_latex by supporting

[jira] [Updated] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns

[ https://issues.apache.org/jira/browse/SPARK-43295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43295: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Make

[jira] [Updated] (SPARK-43271) Match behavior with DataFrame.reindex with specifying `index`.

[ https://issues.apache.org/jira/browse/SPARK-43271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43271: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Match behavior with

[jira] [Updated] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43291: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Match behavior for

[jira] [Updated] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43291: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Match behavior for DataFrame.cov

[jira] [Updated] (SPARK-43282) Investigate DataFrame.sort_values with pandas behavior.

[ https://issues.apache.org/jira/browse/SPARK-43282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43282: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Investigate DataFrame.sort_values

[jira] [Updated] (SPARK-43282) Investigate DataFrame.sort_values with pandas behavior.

[ https://issues.apache.org/jira/browse/SPARK-43282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43282: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Investigate

[jira] [Updated] (SPARK-43271) Match behavior with DataFrame.reindex with specifying `index`.

[ https://issues.apache.org/jira/browse/SPARK-43271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43271: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Match behavior with

[jira] [Updated] (SPARK-43245) Fix DatetimeIndex.microsecond to return 'int32' instead of 'int64' type of Index.

[ https://issues.apache.org/jira/browse/SPARK-43245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43245: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Fix DatetimeIndex.microsecond to

[jira] [Updated] (SPARK-43241) MultiIndex.append not checking names for equality

[ https://issues.apache.org/jira/browse/SPARK-43241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43241: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > MultiIndex.append not

[jira] [Updated] (SPARK-43245) Fix DatetimeIndex.microsecond to return 'int32' instead of 'int64' type of Index.

[ https://issues.apache.org/jira/browse/SPARK-43245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43245: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Fix

[jira] [Updated] (SPARK-43241) MultiIndex.append not checking names for equality

[ https://issues.apache.org/jira/browse/SPARK-43241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43241: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > MultiIndex.append not checking

[jira] [Updated] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0

[ https://issues.apache.org/jira/browse/SPARK-43194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43194: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > PySpark 3.4.0 cannot convert

[jira] [Updated] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0

[ https://issues.apache.org/jira/browse/SPARK-43194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43194: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > PySpark 3.4.0 cannot

[jira] [Updated] (SPARK-42826) Add migration notes for update to supported pandas version.

[ https://issues.apache.org/jira/browse/SPARK-42826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42826: Parent: (was: SPARK-44101) Issue Type: Bug (was: Sub-task) > Add migration notes for

[jira] [Updated] (SPARK-43024) Upgrade pandas to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-43024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43024: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Upgrade pandas to 2.0.0

[jira] [Updated] (SPARK-43024) Upgrade pandas to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-43024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43024: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Upgrade pandas to 2.0.0 >

[jira] [Updated] (SPARK-42826) Add migration notes for update to supported pandas version.

[ https://issues.apache.org/jira/browse/SPARK-42826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42826: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Add migration notes for update to

[jira] [Updated] (SPARK-42826) Add migration notes for update to supported pandas version.

[ https://issues.apache.org/jira/browse/SPARK-42826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42826: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Add migration notes for update to

[jira] [Updated] (SPARK-42621) Add `inclusive` parameter for date_range

[ https://issues.apache.org/jira/browse/SPARK-42621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42621: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Add `inclusive` parameter for

[jira] [Updated] (SPARK-42826) Add migration notes for update to supported pandas version.

[ https://issues.apache.org/jira/browse/SPARK-42826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42826: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Add migration notes for

[jira] [Updated] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42593: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Deprecate & remove the APIs that

[jira] [Updated] (SPARK-42621) Add `inclusive` parameter for date_range

[ https://issues.apache.org/jira/browse/SPARK-42621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42621: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Add `inclusive`

[jira] [Updated] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42620: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Add `inclusive`

[jira] [Updated] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42620: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Add `inclusive` parameter for

[jira] [Updated] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42593: Parent: (was: SPARK-42618) Issue Type: Bug (was: Technical task) > Deprecate &

[jira] [Updated] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42593: Issue Type: Technical task (was: Sub-task) > Deprecate & remove the APIs that will be removed in

[jira] [Updated] (SPARK-42619) Add `show_counts` parameter for DataFrame.info

[ https://issues.apache.org/jira/browse/SPARK-42619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42619: Parent: SPARK-44101 Issue Type: Sub-task (was: Bug) > Add `show_counts` parameter for

[jira] [Updated] (SPARK-42619) Add `show_counts` parameter for DataFrame.info

[ https://issues.apache.org/jira/browse/SPARK-42619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42619: Parent: (was: SPARK-42618) Issue Type: Bug (was: Sub-task) > Add `show_counts`

[jira] [Updated] (SPARK-42618) Support pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42618: Issue Type: Umbrella (was: Task) > Support pandas 2.0.0. > - > >

[jira] [Updated] (SPARK-42617) Support `isocalendar`

[ https://issues.apache.org/jira/browse/SPARK-42617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42617: Parent: SPARK-44101 Issue Type: Sub-task (was: Improvement) > Support `isocalendar` >

[jira] [Updated] (SPARK-42617) Support `isocalendar`

[ https://issues.apache.org/jira/browse/SPARK-42617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42617: Parent: (was: SPARK-42618) Issue Type: Improvement (was: Sub-task) > Support

[jira] [Updated] (SPARK-42618) Support pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42618: Issue Type: Task (was: Improvement) > Support pandas 2.0.0. > - > >

[jira] [Updated] (SPARK-42618) Support pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42618: Issue Type: Improvement (was: Umbrella) > Support pandas 2.0.0. > - > >

[jira] [Created] (SPARK-44101) Support pandas 2

Haejoon Lee created SPARK-44101: --- Summary: Support pandas 2 Key: SPARK-44101 URL: https://issues.apache.org/jira/browse/SPARK-44101 Project: Spark Issue Type: Umbrella Components:

[jira] [Resolved] (SPARK-43703) Enable IndexesParityTests.test_monotonic

[ https://issues.apache.org/jira/browse/SPARK-43703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43703. - Resolution: Duplicate This is duplicated to SPARK-43611 > Enable

[jira] [Resolved] (SPARK-43675) Enable CategoricalOps.ne to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43675. - Resolution: Duplicate This is duplicated to SPARK-43620 > Enable CategoricalOps.ne to work

[jira] [Resolved] (SPARK-43670) Enable CategoricalOps.eq to work with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43670. - Resolution: Duplicate This is duplicated to SPARK-43620 > Enable CategoricalOps.eq to work

[jira] [Resolved] (SPARK-44067) Warning for the pandas-related behavior changes in next major release

[ https://issues.apache.org/jira/browse/SPARK-44067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-44067. - Fix Version/s: 3.5.0 Resolution: Fixed This is resolved by

[jira] [Reopened] (SPARK-42618) Support pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reopened SPARK-42618: - > Support pandas 2.0.0. > - > > Key: SPARK-42618 >

[jira] [Created] (SPARK-44067) Warning for the pandas-related behavior changes in next major release

Haejoon Lee created SPARK-44067: --- Summary: Warning for the pandas-related behavior changes in next major release Key: SPARK-44067 URL: https://issues.apache.org/jira/browse/SPARK-44067 Project: Spark

[jira] [Commented] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732932#comment-17732932 ] Haejoon Lee commented on SPARK-43291: - With the major release of pandas 2.0.0 on April 3, 2023,

[jira] [Created] (SPARK-44052) Add util to get proper Column or DataFrame class for Spark Connect.

Haejoon Lee created SPARK-44052: --- Summary: Add util to get proper Column or DataFrame class for Spark Connect. Key: SPARK-44052 URL: https://issues.apache.org/jira/browse/SPARK-44052 Project: Spark

[jira] [Updated] (SPARK-43619) Enable DataFrameSlowParityTests.test_udt

[ https://issues.apache.org/jira/browse/SPARK-43619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43619: Fix Version/s: 3.5.0 > Enable DataFrameSlowParityTests.test_udt >

[jira] [Updated] (SPARK-43661) Enable ReshapeParityTests.test_get_dummies_date_datetime

[ https://issues.apache.org/jira/browse/SPARK-43661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43661: Fix Version/s: 3.5.0 > Enable ReshapeParityTests.test_get_dummies_date_datetime >

[jira] [Resolved] (SPARK-43619) Enable DataFrameSlowParityTests.test_udt

[ https://issues.apache.org/jira/browse/SPARK-43619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43619. - Resolution: Resolved This is contained by SPARK-44036. > Enable

[jira] [Resolved] (SPARK-43661) Enable ReshapeParityTests.test_get_dummies_date_datetime

[ https://issues.apache.org/jira/browse/SPARK-43661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43661. - Resolution: Resolved This is contained by SPARK-44036. > Enable

[jira] [Created] (SPARK-44036) Cleanup & consolidate tickets to simplify the tasks.

Haejoon Lee created SPARK-44036: --- Summary: Cleanup & consolidate tickets to simplify the tasks. Key: SPARK-44036 URL: https://issues.apache.org/jira/browse/SPARK-44036 Project: Spark Issue

[jira] [Resolved] (SPARK-43710) Support functions.date_part for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43710. - Resolution: Duplicate It's duplicated by SPARK-43705 > Support functions.date_part for Spark

[jira] [Resolved] (SPARK-43653) Enable GroupBySlowParityTests.test_split_apply_combine_on_series

[ https://issues.apache.org/jira/browse/SPARK-43653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43653. - Resolution: Duplicate This is duplicated by SPARK-43445 > Enable

[jira] [Resolved] (SPARK-43652) Enable GroupBy.rank with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43652. - Resolution: Duplicate This is duplicated by SPARK-43611. > Enable GroupBy.rank with Spark

[jira] [Created] (SPARK-44033) Support list-like for binary ops

Haejoon Lee created SPARK-44033: --- Summary: Support list-like for binary ops Key: SPARK-44033 URL: https://issues.apache.org/jira/browse/SPARK-44033 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731449#comment-17731449 ] Haejoon Lee commented on SPARK-43291: - I'm currently doing an analysis of the usage of the pandas

[jira] [Updated] (SPARK-42618) Support pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42618: Summary: Support pandas 2.0.0. (was: Support pandas 2) > Support pandas 2.0.0. >

[jira] [Updated] (SPARK-42618) Support pandas 2

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42618: Summary: Support pandas 2 (was: Support pandas 2.0.0) > Support pandas 2 > > >

[jira] [Created] (SPARK-44004) Assign name & improve error message for frequent LEGACY errors.

Haejoon Lee created SPARK-44004: --- Summary: Assign name & improve error message for frequent LEGACY errors. Key: SPARK-44004 URL: https://issues.apache.org/jira/browse/SPARK-44004 Project: Spark

[jira] [Resolved] (SPARK-43669) Fix BinaryOps.lt to work with Spark Connect Column.

[ https://issues.apache.org/jira/browse/SPARK-43669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43669. - Fix Version/s: 3.5.0 Resolution: Fixed Fixed in 

[jira] [Resolved] (SPARK-43668) Fix BinaryOps.le to work with Spark Connect Column.

[ https://issues.apache.org/jira/browse/SPARK-43668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43668. - Fix Version/s: 3.5.0 Resolution: Fixed Fixed in 

[jira] [Resolved] (SPARK-43672) Enable CategoricalOps.gt to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43672. - Fix Version/s: 3.5.0 Resolution: Fixed > Enable CategoricalOps.gt to work with Spark

[jira] [Updated] (SPARK-43673) Enable CategoricalOps.le to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43673: Fix Version/s: 3.5.0 > Enable CategoricalOps.le to work with Spark Connect. >

[jira] [Updated] (SPARK-43674) Enable CategoricalOps.lt to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43674: Fix Version/s: 3.5.0 > Enable CategoricalOps.lt to work with Spark Connect. >

[jira] [Reopened] (SPARK-43672) Enable CategoricalOps.gt to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reopened SPARK-43672: - > Enable CategoricalOps.gt to work with Spark Connect. >

[jira] [Resolved] (SPARK-43674) Enable CategoricalOps.lt to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43674. - Resolution: Fixed This is resolved from https://github.com/apache/spark/pull/41310. > Enable

[jira] [Resolved] (SPARK-43673) Enable CategoricalOps.le to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43673. - Resolution: Fixed This is resolved from https://github.com/apache/spark/pull/41310. > Enable

[jira] [Resolved] (SPARK-43672) Enable CategoricalOps.gt to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43672. - Resolution: Fixed This is resolved from https://github.com/apache/spark/pull/41310. > Enable

[jira] [Created] (SPARK-43962) Improve error messages: CANNOT_DECODE_URL, CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE, CANNOT_PARSE_DECIMAL, CANNOT_READ_FILE_FOOTER, CANNOT_RECOGNIZE_HIVE_TYPE.

Haejoon Lee created SPARK-43962: --- Summary: Improve error messages: CANNOT_DECODE_URL, CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE, CANNOT_PARSE_DECIMAL, CANNOT_READ_FILE_FOOTER, CANNOT_RECOGNIZE_HIVE_TYPE. Key: SPARK-43962

[jira] [Commented] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729145#comment-17729145 ] Haejoon Lee commented on SPARK-43291: - Yeah, I will be sharing with the community how to handle

[jira] [Created] (SPARK-43960) DataFrameConversionTestsMixin is not tested properly.

Haejoon Lee created SPARK-43960: --- Summary: DataFrameConversionTestsMixin is not tested properly. Key: SPARK-43960 URL: https://issues.apache.org/jira/browse/SPARK-43960 Project: Spark Issue

[jira] [Created] (SPARK-43877) Fix behavior difference for compare binary functions.

Haejoon Lee created SPARK-43877: --- Summary: Fix behavior difference for compare binary functions. Key: SPARK-43877 URL: https://issues.apache.org/jira/browse/SPARK-43877 Project: Spark Issue

[jira] [Comment Edited] (SPARK-42497) Support of pandas API on Spark for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727310#comment-17727310 ] Haejoon Lee edited comment on SPARK-42497 at 5/30/23 2:55 AM: -- I apologize

[jira] [Commented] (SPARK-42497) Support of pandas API on Spark for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727310#comment-17727310 ] Haejoon Lee commented on SPARK-42497: - I apologize for the complexity here as well. In the case of

[jira] [Comment Edited] (SPARK-42497) Support of pandas API on Spark for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727310#comment-17727310 ] Haejoon Lee edited comment on SPARK-42497 at 5/30/23 2:52 AM: -- I apologize

[jira] [Comment Edited] (SPARK-42618) Support pandas 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727307#comment-17727307 ] Haejoon Lee edited comment on SPARK-42618 at 5/30/23 2:47 AM: -- I apologize

[jira] [Comment Edited] (SPARK-42618) Support pandas 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727307#comment-17727307 ] Haejoon Lee edited comment on SPARK-42618 at 5/30/23 2:46 AM: -- I apologize

[jira] [Comment Edited] (SPARK-42618) Support pandas 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727307#comment-17727307 ] Haejoon Lee edited comment on SPARK-42618 at 5/30/23 2:44 AM: -- I apologize

[jira] [Comment Edited] (SPARK-42618) Support pandas 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727307#comment-17727307 ] Haejoon Lee edited comment on SPARK-42618 at 5/30/23 2:43 AM: -- I apologize

[jira] [Commented] (SPARK-42618) Support pandas 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727307#comment-17727307 ] Haejoon Lee commented on SPARK-42618: - I apologize for the complexity. I have a bit simplified the

[jira] [Resolved] (SPARK-43566) Enable CategoricalTests.test_categories_setter for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43566. - Resolution: Duplicate This is contained by SPARK-43875. > Enable

[jira] [Resolved] (SPARK-43565) Enable CategoricalTests.test_as_ordered_unordered for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43565. - Resolution: Duplicate This is contained by SPARK-43875. > Enable

[jira] [Resolved] (SPARK-43605) Enable CategoricalTests.test_remove_categories for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43605. - Resolution: Duplicate This is contained by SPARK-43875. > Enable

<    1   2   3   4   5   6   7   8   9   10   >