[jira] [Resolved] (SPARK-42986) Migrate more PySpark errors onto error classes

2023-09-14 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-42986. - Resolution: Resolved > Migrate more PySpark errors onto error classes >

[jira] [Resolved] (SPARK-43020) Refactoring similar error classes such as `NOT_XXX`.

2023-09-14 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43020. - Resolution: Won't Fix > Refactoring similar error classes such as `NOT_XXX`. >

[jira] [Resolved] (SPARK-43047) Automate error class documentation

2023-09-14 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43047. - Resolution: Fixed > Automate error class documentation > -- > >

[jira] [Resolved] (SPARK-43048) Testing JVM-captured exceptions from Python side.

2023-09-14 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43048. - Resolution: Fixed > Testing JVM-captured exceptions from Python side. >

[jira] [Resolved] (SPARK-43571) Enable DateOpsTests.test_sub for pandas 2.0.0.

2023-09-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43571. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed This is fixed

[jira] [Resolved] (SPARK-43570) Enable DateOpsTests.test_rsub for pandas 2.0.0.

2023-09-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43570. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed This is fixed

[jira] [Created] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

2023-09-13 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45153: --- Summary: Rebalance testing time for `pyspark-pandas-connect-part1` Key: SPARK-45153 URL: https://issues.apache.org/jira/browse/SPARK-45153 Project: Spark

[jira] [Created] (SPARK-45123) Raise TypeError for DataFrame.interpolate when all columns are object-dtype.

2023-09-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45123: --- Summary: Raise TypeError for DataFrame.interpolate when all columns are object-dtype. Key: SPARK-45123 URL: https://issues.apache.org/jira/browse/SPARK-45123 Project:

[jira] [Updated] (SPARK-45121) Support Series.empty for Spark Connect.

2023-09-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-45121: Summary: Support Series.empty for Spark Connect. (was: Support Series.empty for Spark Connect.d)

[jira] [Created] (SPARK-45121) Support Series.empty for Spark Connect.d

2023-09-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45121: --- Summary: Support Series.empty for Spark Connect.d Key: SPARK-45121 URL: https://issues.apache.org/jira/browse/SPARK-45121 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-43533) Enable MultiIndex test for IndexesTests.test_difference

2023-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43533. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed > Enable

[jira] [Resolved] (SPARK-43499) Enable StatsTests.test_stat_functions_with_no_numeric_columns for pandas 2.0.0.

2023-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43499. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed This is

[jira] [Resolved] (SPARK-43497) Enable StatsTests.test_cov_corr_meta for pandas 2.0.0.

2023-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43497. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed This is

[jira] [Created] (SPARK-45065) Support Pandas 2.1.0

2023-09-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45065: --- Summary: Support Pandas 2.1.0 Key: SPARK-45065 URL: https://issues.apache.org/jira/browse/SPARK-45065 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-43291) Generate proper warning on different behavior with numeric_only

2023-09-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43291: Summary: Generate proper warning on different behavior with numeric_only (was: Match behavior

[jira] [Resolved] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0

2023-09-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43194. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed > PySpark 3.4.0

[jira] [Commented] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0

2023-09-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761667#comment-17761667 ] Haejoon Lee commented on SPARK-43194: - {code:java} >>> spark.sql("select now()").toPandas() 0

[jira] [Resolved] (SPARK-43872) Enable DataFramePlotMatplotlibTests for pandas 2.0.0.

2023-08-31 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43872. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed > Enable

[jira] [Created] (SPARK-45005) Reducing the CI time for slow pyspark-pandas-connect tests

2023-08-29 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45005: --- Summary: Reducing the CI time for slow pyspark-pandas-connect tests Key: SPARK-45005 URL: https://issues.apache.org/jira/browse/SPARK-45005 Project: Spark

[jira] [Created] (SPARK-44948) Update document related to removed Index object

2023-08-24 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44948: --- Summary: Update document related to removed Index object Key: SPARK-44948 URL: https://issues.apache.org/jira/browse/SPARK-44948 Project: Spark Issue Type:

[jira] [Created] (SPARK-44945) Automate PySpark error class documentation

2023-08-24 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44945: --- Summary: Automate PySpark error class documentation Key: SPARK-44945 URL: https://issues.apache.org/jira/browse/SPARK-44945 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-44844) Exclude `python/build/*` for local `lint-python` testing

2023-08-20 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-44844. - Resolution: Won't Fix It's not a general issue. > Exclude `python/build/*` for local

[jira] [Resolved] (SPARK-43452) Enable RollingTests.test_groupby_rolling_count for pandas 2.0.0.

2023-08-17 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43452. - Resolution: Duplicate This is contained by SPARK-43451 > Enable

[jira] [Resolved] (SPARK-43460) Enable OpsOnDiffFramesGroupByTests.test_groupby_different_lengths for pandas 2.0.0.

2023-08-17 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43460. - Resolution: Duplicate This is contained by SPARK-43459 > Enable

[jira] [Updated] (SPARK-43459) Enable OpsOnDiffFramesGroupByTests for pandas 2.0.0.

2023-08-17 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43459: Summary: Enable OpsOnDiffFramesGroupByTests for pandas 2.0.0. (was: Enable

[jira] [Updated] (SPARK-43607) Enable IndexesTests for pandas 2.0.0.

2023-08-17 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43607: Summary: Enable IndexesTests for pandas 2.0.0. (was: Enable IndexesTests.test_intersection for

[jira] [Resolved] (SPARK-43608) Enable IndexesTests.test_union for pandas 2.0.0.

2023-08-17 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43608. - Resolution: Duplicate This is contained by https://issues.apache.org/jira/browse/SPARK-43607 >

[jira] [Created] (SPARK-44844) Exclude `python/build/*` for local `lint-python` testing

2023-08-17 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44844: --- Summary: Exclude `python/build/*` for local `lint-python` testing Key: SPARK-44844 URL: https://issues.apache.org/jira/browse/SPARK-44844 Project: Spark Issue

[jira] [Created] (SPARK-44842) Support stat functions

2023-08-16 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44842: --- Summary: Support stat functions Key: SPARK-44842 URL: https://issues.apache.org/jira/browse/SPARK-44842 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44841) Support value_counts for pandas 2.0.0.

2023-08-16 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44841: --- Summary: Support value_counts for pandas 2.0.0. Key: SPARK-44841 URL: https://issues.apache.org/jira/browse/SPARK-44841 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44826) Resolve testing timeout issue from Spark Connect

2023-08-16 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44826: --- Summary: Resolve testing timeout issue from Spark Connect Key: SPARK-44826 URL: https://issues.apache.org/jira/browse/SPARK-44826 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43711) Support `pyspark.ml.feature.Bucketizer` and `pyspark.mllib.stat.KernelDensity` to work with Spark Connect.

2023-08-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43711: Affects Version/s: 4.0.0 (was: 3.5.0) Description: Repro:

[jira] [Updated] (SPARK-43711) Support `pyspark.ml.feature.Bucketizer` and `pyspark.mllib.stat.KernelDensity` to work with Spark Connect.

2023-08-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43711: Summary: Support `pyspark.ml.feature.Bucketizer` and `pyspark.mllib.stat.KernelDensity` to work

[jira] [Updated] (SPARK-43711) Support `pyspark.ml.feature.Bucketizer` and `pyspark.mllib.stat.KernelDensity` to work with Spark Connect.

2023-08-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43711: Component/s: MLlib (was: Pandas API on Spark) > Support

[jira] [Updated] (SPARK-43711) Support `pyspark.ml.feature.Bucketizer` to work with Spark Connect.

2023-08-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43711: Summary: Support `pyspark.ml.feature.Bucketizer` to work with Spark Connect. (was: Fix

[jira] [Created] (SPARK-44695) Improve error message for `DataFrame.toDF`.

2023-08-06 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44695: --- Summary: Improve error message for `DataFrame.toDF`. Key: SPARK-44695 URL: https://issues.apache.org/jira/browse/SPARK-44695 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-43241) MultiIndex.append not checking names for equality

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43241: Affects Version/s: 4.0.0 (was: 3.5.0) > MultiIndex.append not checking

[jira] [Updated] (SPARK-42621) Add `inclusive` parameter for date_range

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42621: Affects Version/s: 4.0.0 (was: 3.5.0) > Add `inclusive` parameter for

[jira] [Updated] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42620: Affects Version/s: 4.0.0 (was: 3.5.0) > Add `inclusive` parameter for

[jira] [Updated] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43194: Affects Version/s: 4.0.0 (was: 3.4.0) > PySpark 3.4.0 cannot convert

[jira] [Updated] (SPARK-42619) Add `show_counts` parameter for DataFrame.info

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42619: Affects Version/s: 4.0.0 (was: 3.5.0) > Add `show_counts` parameter

[jira] [Updated] (SPARK-42617) Support `isocalendar`

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42617: Affects Version/s: 4.0.0 (was: 3.5.0) > Support `isocalendar` >

[jira] [Updated] (SPARK-43271) Match behavior with DataFrame.reindex with specifying `index`.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43271: Affects Version/s: 4.0.0 (was: 3.5.0) > Match behavior with

[jira] [Updated] (SPARK-43451) Enable RollingTests.test_rolling_count for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43451: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43282) Investigate DataFrame.sort_values with pandas behavior.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43282: Affects Version/s: 4.0.0 (was: 3.5.0) > Investigate

[jira] [Updated] (SPARK-43245) Fix DatetimeIndex.microsecond to return 'int32' instead of 'int64' type of Index.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43245: Affects Version/s: 4.0.0 (was: 3.5.0) > Fix DatetimeIndex.microsecond

[jira] [Updated] (SPARK-43433) Match `GroupBy.nth` behavior with new pandas behavior

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43433: Affects Version/s: 4.0.0 (was: 3.5.0) > Match `GroupBy.nth` behavior

[jira] [Updated] (SPARK-43432) Fix `min_periods` for Rolling to work same as pandas

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43432: Affects Version/s: 4.0.0 (was: 3.5.0) > Fix `min_periods` for Rolling

[jira] [Updated] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43291: Affects Version/s: 4.0.0 (was: 3.5.0) > Match behavior for

[jira] [Updated] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43295: Affects Version/s: 4.0.0 (was: 3.5.0) > Make DataFrameGroupBy.sum

[jira] [Updated] (SPARK-43460) Enable OpsOnDiffFramesGroupByTests.test_groupby_different_lengths for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43460: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43453) Enable OpsOnDiffFramesEnabledTests.test_concat_column_axis for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43453: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43459) Enable OpsOnDiffFramesGroupByTests.test_groupby_multiindex_columns for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43459: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43476: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43458) Enable SeriesConversionTests.test_to_latex for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43458: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43452) Enable RollingTests.test_groupby_rolling_count for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43452: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43462) Enable SeriesDateTimeTests.test_date_subtraction for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43462: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43477) Enable SeriesStringTests.test_string_rsplit for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43477: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43497) Enable StatsTests.test_cov_corr_meta for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43497: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43498: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43478) Enable SeriesStringTests.test_string_split for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43478: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43506) Enable ArrowTests.test_toPandas_empty_columns for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43506: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43499) Enable StatsTests.test_stat_functions_with_no_numeric_columns for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43499: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43561) Enable DataFrameConversionTests.test_to_latex for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43561: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43562) Enable DataFrameTests.test_append for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43562: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43533) Enable MultiIndex test for IndexesTests.test_difference

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43533: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable MultiIndex test for

[jira] [Updated] (SPARK-43563) Enable CsvTests.test_read_csv_with_squeeze for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43563: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43570) Enable DateOpsTests.test_rsub for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43570: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable DateOpsTests.test_rsub

[jira] [Updated] (SPARK-43608) Enable IndexesTests.test_union for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43608: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable IndexesTests.test_union

[jira] [Updated] (SPARK-43705) Enable TimedeltaIndexTests.test_properties for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43705: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43644) Enable DatetimeIndexTests.test_indexer_between_time for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43644: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43606) Enable IndexesTests.test_index_basic for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43606: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43567) Enable CategoricalIndexTests.test_factorize for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43567: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43571) Enable DateOpsTests.test_sub for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43571: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable DateOpsTests.test_sub

[jira] [Updated] (SPARK-43607) Enable IndexesTests.test_intersection for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43607: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43568) Enable CategoricalIndexTests.test_categories_setter for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43568: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43633) Enable CategoricalIndexTests.test_remove_categories for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43633: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43811) Enable DataFrameTests.test_reindex for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43811: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43869) Enable GroupBySlowTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43869: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable GroupBySlowTests for

[jira] [Updated] (SPARK-43709) Enable NamespaceTests.test_date_range for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43709: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43812) Enable DataFrameTests.test_all for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43812: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable DataFrameTests.test_all

[jira] [Updated] (SPARK-43871) Enable SeriesDateTimeTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43871: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable SeriesDateTimeTests for

[jira] [Updated] (SPARK-43872) Enable DataFramePlotMatplotlibTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43872: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable

[jira] [Updated] (SPARK-43873) Enable DataFrameSlowTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43873: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable DataFrameSlowTests for

[jira] [Updated] (SPARK-43870) Enable SeriesTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43870: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable SeriesTests for pandas

[jira] [Updated] (SPARK-43874) Enable GroupByTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43874: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable GroupByTests for pandas

[jira] [Updated] (SPARK-43875) Enable CategoricalTests for pandas 2.0.0.

2023-08-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43875: Affects Version/s: 4.0.0 (was: 3.5.0) > Enable CategoricalTests for

[jira] [Commented] (SPARK-44033) Support list-like for binary ops

2023-07-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746167#comment-17746167 ] Haejoon Lee commented on SPARK-44033: - > Do we need to implement other binary ops just like this  

[jira] [Commented] (SPARK-44033) Support list-like for binary ops

2023-07-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745871#comment-17745871 ] Haejoon Lee commented on SPARK-44033: - Thanks for your interesting on this issue, [~gdhuper] .  >

[jira] [Created] (SPARK-44492) Resolve remaining AnalysisException

2023-07-20 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44492: --- Summary: Resolve remaining AnalysisException Key: SPARK-44492 URL: https://issues.apache.org/jira/browse/SPARK-44492 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36392) pandas fixed width file support

2023-07-18 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744375#comment-17744375 ] Haejoon Lee commented on SPARK-36392: - Not update yet here. [~gsdionis] , are you still interested

[jira] [Commented] (SPARK-42330) Assign name to _LEGACY_ERROR_TEMP_2175

2023-07-17 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744059#comment-17744059 ] Haejoon Lee commented on SPARK-42330: - Sure, take your time! > Assign name to

[jira] [Commented] (SPARK-42330) Assign name to _LEGACY_ERROR_TEMP_2175

2023-07-16 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743607#comment-17743607 ] Haejoon Lee commented on SPARK-42330: - [~kori73] Are you still working on this? Just confirming :) 

[jira] [Created] (SPARK-44372) Enable KernelDensity within Spark Connect

2023-07-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-44372: --- Summary: Enable KernelDensity within Spark Connect Key: SPARK-44372 URL: https://issues.apache.org/jira/browse/SPARK-44372 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-43629) Enable RDD dependent tests with Spark Connect

2023-07-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43629: Summary: Enable RDD dependent tests with Spark Connect (was: Enable RDD with Spark Connect) >

[jira] [Updated] (SPARK-43628) Enable SparkContext-related tests with Spark Connect

2023-07-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43628: Summary: Enable SparkContext-related tests with Spark Connect (was: Enable SparkContext with

[jira] [Updated] (SPARK-44276) Match behavior with pandas for `SeriesStringTests.test_string_replace`

2023-07-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-44276: Description: See https://github.com/apache/spark/pull/41823/files > Match behavior with pandas

[jira] [Comment Edited] (SPARK-44101) Support pandas 2

2023-07-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739506#comment-17739506 ] Haejoon Lee edited comment on SPARK-44101 at 7/3/23 9:10 AM: - Btw, I'd

[jira] [Comment Edited] (SPARK-44101) Support pandas 2

2023-07-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739506#comment-17739506 ] Haejoon Lee edited comment on SPARK-44101 at 7/3/23 9:10 AM: - Btw, I'd

[jira] [Updated] (SPARK-44101) Support pandas 2

2023-07-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-44101: Affects Version/s: 4.0.0 (was: 3.5.0) > Support pandas 2 >

<    1   2   3   4   5   6   7   8   9   10   >