Haejoon Lee created SPARK-43565:
---
Summary: Enable CategoricalTests.test_as_ordered_unordered for
pandas 2.0.0.
Key: SPARK-43565
URL: https://issues.apache.org/jira/browse/SPARK-43565
Project: Spark
Haejoon Lee created SPARK-43564:
---
Summary: Enable CategoricalTests.test_factorize for pandas 2.0.0.
Key: SPARK-43564
URL: https://issues.apache.org/jira/browse/SPARK-43564
Project: Spark
Issue
Haejoon Lee created SPARK-43563:
---
Summary: Enable CsvTests.test_read_csv_with_squeeze for pandas
2.0.0.
Key: SPARK-43563
URL: https://issues.apache.org/jira/browse/SPARK-43563
Project: Spark
Haejoon Lee created SPARK-43562:
---
Summary: Enable DataFrameTests.test_append for pandas 2.0.0.
Key: SPARK-43562
URL: https://issues.apache.org/jira/browse/SPARK-43562
Project: Spark
Issue
Haejoon Lee created SPARK-43561:
---
Summary: Enable DataFrameConversionTests.test_to_latex for pandas
2.0.0.
Key: SPARK-43561
URL: https://issues.apache.org/jira/browse/SPARK-43561
Project: Spark
Haejoon Lee created SPARK-43559:
---
Summary: Enable DataFrameSlowTests.test_iteritems for pandas 2.0.0.
Key: SPARK-43559
URL: https://issues.apache.org/jira/browse/SPARK-43559
Project: Spark
Haejoon Lee created SPARK-43560:
---
Summary: Enable DataFrameSlowTests.test_mad for pandas 2.0.0.
Key: SPARK-43560
URL: https://issues.apache.org/jira/browse/SPARK-43560
Project: Spark
Issue
Haejoon Lee created SPARK-43558:
---
Summary: Enable DataFrameSlowTests.test_product for pandas 2.0.0.
Key: SPARK-43558
URL: https://issues.apache.org/jira/browse/SPARK-43558
Project: Spark
Issue
Haejoon Lee created SPARK-43557:
---
Summary: Enable DataFrameSlowTests.test_between_time for pandas
2.0.0.
Key: SPARK-43557
URL: https://issues.apache.org/jira/browse/SPARK-43557
Project: Spark
Haejoon Lee created SPARK-43556:
---
Summary: Enable DataFrameSlowTests.test_describe for pandas 2.0.0.
Key: SPARK-43556
URL: https://issues.apache.org/jira/browse/SPARK-43556
Project: Spark
Haejoon Lee created SPARK-43555:
---
Summary: Enable GroupByTests.test_groupby_multiindex_columns for
pandas 2.0.0.
Key: SPARK-43555
URL: https://issues.apache.org/jira/browse/SPARK-43555
Project: Spark
Haejoon Lee created SPARK-43554:
---
Summary: Enable GroupByTests.test_basic_stat_funcs for pandas
2.0.0.
Key: SPARK-43554
URL: https://issues.apache.org/jira/browse/SPARK-43554
Project: Spark
Haejoon Lee created SPARK-43553:
---
Summary: Enable GroupByTests.test_mad for pandas 2.0.0.
Key: SPARK-43553
URL: https://issues.apache.org/jira/browse/SPARK-43553
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43552:
---
Summary: Enable GroupByTests.test_nth for pandas 2.0.0.
Key: SPARK-43552
URL: https://issues.apache.org/jira/browse/SPARK-43552
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43551:
---
Summary: Enable GroupByTests.test_prod for pandas 2.0.0.
Key: SPARK-43551
URL: https://issues.apache.org/jira/browse/SPARK-43551
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43550:
---
Summary: Enable SeriesTests.test_factorize for pandas 2.0.0.
Key: SPARK-43550
URL: https://issues.apache.org/jira/browse/SPARK-43550
Project: Spark
Issue
Haejoon Lee created SPARK-43547:
---
Summary: Update "Supported Pandas API" page to point out the
proper pandas docs
Key: SPARK-43547
URL: https://issues.apache.org/jira/browse/SPARK-43547
Project: Spark
Haejoon Lee created SPARK-43533:
---
Summary: Enable MultiIndex test for IndexesTests.test_difference
Key: SPARK-43533
URL: https://issues.apache.org/jira/browse/SPARK-43533
Project: Spark
Issue
Haejoon Lee created SPARK-43506:
---
Summary: Enable ArrowTests.test_toPandas_empty_columns for pandas
2.0.0.
Key: SPARK-43506
URL: https://issues.apache.org/jira/browse/SPARK-43506
Project: Spark
Haejoon Lee created SPARK-43499:
---
Summary: Enable
StatsTests.test_stat_functions_with_no_numeric_columns for pandas 2.0.0.
Key: SPARK-43499
URL: https://issues.apache.org/jira/browse/SPARK-43499
[
https://issues.apache.org/jira/browse/SPARK-43497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43497:
Description: Enable StatsTests.test_cov_corr_meta for pandas 2.0.0. (was:
Enable
[
https://issues.apache.org/jira/browse/SPARK-43497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43497:
Summary: Enable StatsTests.test_cov_corr_meta for pandas 2.0.0. (was:
Enable
Haejoon Lee created SPARK-43497:
---
Summary: Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.
Key: SPARK-43497
URL: https://issues.apache.org/jira/browse/SPARK-43497
Project: Spark
Haejoon Lee created SPARK-43498:
---
Summary: Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.
Key: SPARK-43498
URL: https://issues.apache.org/jira/browse/SPARK-43498
Project: Spark
Haejoon Lee created SPARK-43479:
---
Summary: Enable SeriesTests.test_between_time for pandas 2.0.0.
Key: SPARK-43479
URL: https://issues.apache.org/jira/browse/SPARK-43479
Project: Spark
Issue
Haejoon Lee created SPARK-43481:
---
Summary: Enable SeriesTests.test_product for pandas 2.0.0.
Key: SPARK-43481
URL: https://issues.apache.org/jira/browse/SPARK-43481
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43480:
---
Summary: Enable SeriesTests.test_iteritems for pandas 2.0.0.
Key: SPARK-43480
URL: https://issues.apache.org/jira/browse/SPARK-43480
Project: Spark
Issue
Haejoon Lee created SPARK-43476:
---
Summary: Enable SeriesStringTests.test_string_replace for pandas
2.0.0.
Key: SPARK-43476
URL: https://issues.apache.org/jira/browse/SPARK-43476
Project: Spark
Haejoon Lee created SPARK-43477:
---
Summary: Enable SeriesStringTests.test_string_rsplit for pandas
2.0.0.
Key: SPARK-43477
URL: https://issues.apache.org/jira/browse/SPARK-43477
Project: Spark
Haejoon Lee created SPARK-43478:
---
Summary: Enable SeriesStringTests.test_string_split for pandas
2.0.0.
Key: SPARK-43478
URL: https://issues.apache.org/jira/browse/SPARK-43478
Project: Spark
Haejoon Lee created SPARK-43469:
---
Summary: Enable SeriesTests.test_quantile for pandas 2.0.0.
Key: SPARK-43469
URL: https://issues.apache.org/jira/browse/SPARK-43469
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43468:
---
Summary: Enable SeriesTests.test_mad for pandas 2.0.0.
Key: SPARK-43468
URL: https://issues.apache.org/jira/browse/SPARK-43468
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43467:
---
Summary: Enable SeriesTests.test_between for pandas 2.0.0.
Key: SPARK-43467
URL: https://issues.apache.org/jira/browse/SPARK-43467
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43466:
---
Summary: Enable SeriesTests.test_astype for pandas 2.0.0.
Key: SPARK-43466
URL: https://issues.apache.org/jira/browse/SPARK-43466
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43465:
---
Summary: Enable SeriesTests.test_append for pandas 2.0.0.
Key: SPARK-43465
URL: https://issues.apache.org/jira/browse/SPARK-43465
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43463:
Description: Enable SeriesTests.test_rank for pandas 2.0.0.
Summary: Enable
Haejoon Lee created SPARK-43464:
---
Summary: Enable SeriesTests.test_value_counts for pandas 2.0.0.
Key: SPARK-43464
URL: https://issues.apache.org/jira/browse/SPARK-43464
Project: Spark
Issue
Haejoon Lee created SPARK-43463:
---
Summary: En
Key: SPARK-43463
URL: https://issues.apache.org/jira/browse/SPARK-43463
Project: Spark
Issue Type: Sub-task
Components: Pandas API on
Haejoon Lee created SPARK-43462:
---
Summary: Enable SeriesDateTimeTests.test_date_subtraction for
pandas 2.0.0.
Key: SPARK-43462
URL: https://issues.apache.org/jira/browse/SPARK-43462
Project: Spark
Haejoon Lee created SPARK-43460:
---
Summary: Enable
OpsOnDiffFramesGroupByTests.test_groupby_different_lengths for pandas 2.0.0.
Key: SPARK-43460
URL: https://issues.apache.org/jira/browse/SPARK-43460
Haejoon Lee created SPARK-43459:
---
Summary: Enable
OpsOnDiffFramesGroupByTests.test_groupby_multiindex_columns for pandas 2.0.0.
Key: SPARK-43459
URL: https://issues.apache.org/jira/browse/SPARK-43459
Haejoon Lee created SPARK-43458:
---
Summary: Enable SeriesConversionTests.test_to_latex for pandas
2.0.0.
Key: SPARK-43458
URL: https://issues.apache.org/jira/browse/SPARK-43458
Project: Spark
Haejoon Lee created SPARK-43451:
---
Summary: Enable RollingTests.test_rolling_count for pandas 2.0.0.
Key: SPARK-43451
URL: https://issues.apache.org/jira/browse/SPARK-43451
Project: Spark
Issue
Haejoon Lee created SPARK-43453:
---
Summary: Enable
OpsOnDiffFramesEnabledTests.test_concat_column_axis for pandas 2.0.0.
Key: SPARK-43453
URL: https://issues.apache.org/jira/browse/SPARK-43453
Project:
Haejoon Lee created SPARK-43452:
---
Summary: Enable RollingTests.test_groupby_rolling_count for pandas
2.0.0.
Key: SPARK-43452
URL: https://issues.apache.org/jira/browse/SPARK-43452
Project: Spark
Haejoon Lee created SPARK-43445:
---
Summary: Enable
GroupBySlowTests.test_split_apply_combine_on_series for pandas 2.0.0.
Key: SPARK-43445
URL: https://issues.apache.org/jira/browse/SPARK-43445
Project:
Haejoon Lee created SPARK-43444:
---
Summary: Enable GroupBySlowTests.test_value_counts for pandas
2.0.0.
Key: SPARK-43444
URL: https://issues.apache.org/jira/browse/SPARK-43444
Project: Spark
Haejoon Lee created SPARK-43433:
---
Summary: Match `GroupBy.nth` behavior with new pandas behavior
Key: SPARK-43433
URL: https://issues.apache.org/jira/browse/SPARK-43433
Project: Spark
Issue
Haejoon Lee created SPARK-43432:
---
Summary: Fix `min_periods` for Rolling to work same as pandas
Key: SPARK-43432
URL: https://issues.apache.org/jira/browse/SPARK-43432
Project: Spark
Issue
Haejoon Lee created SPARK-43353:
---
Summary: Migrate remaining session errors into error class
Key: SPARK-43353
URL: https://issues.apache.org/jira/browse/SPARK-43353
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43349:
---
Summary: Fix flaky test for `DataFrame` creation
Key: SPARK-43349
URL: https://issues.apache.org/jira/browse/SPARK-43349
Project: Spark
Issue Type: Bug
Haejoon Lee created SPARK-43335:
---
Summary: Migrate remaining Connect/SparkSQL errors into error
classes
Key: SPARK-43335
URL: https://issues.apache.org/jira/browse/SPARK-43335
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43315:
Summary: Migrate remaining errors from DataFrame(Reader|Writer) into error
class (was: Migrate
Haejoon Lee created SPARK-43315:
---
Summary: Migrate errors from DataFrame(Reader|Writer) into error
class
Key: SPARK-43315
URL: https://issues.apache.org/jira/browse/SPARK-43315
Project: Spark
Haejoon Lee created SPARK-43314:
---
Summary: Migrate Spark Connect client errors into error class
Key: SPARK-43314
URL: https://issues.apache.org/jira/browse/SPARK-43314
Project: Spark
Issue
Haejoon Lee created SPARK-43307:
---
Summary: Migrate PandasUDF value errors into error class
Key: SPARK-43307
URL: https://issues.apache.org/jira/browse/SPARK-43307
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43306:
---
Summary: Migrate `ValueError` from Spark SQL types into error class
Key: SPARK-43306
URL: https://issues.apache.org/jira/browse/SPARK-43306
Project: Spark
Haejoon Lee created SPARK-43304:
---
Summary: Enable test_to_latex by supporting jinja2>=3.0.0
Key: SPARK-43304
URL: https://issues.apache.org/jira/browse/SPARK-43304
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43303:
---
Summary: Migrate NotImplementedError into
PySparkNotImplementedError
Key: SPARK-43303
URL: https://issues.apache.org/jira/browse/SPARK-43303
Project: Spark
Haejoon Lee created SPARK-43296:
---
Summary: Migrate Spark Connect session errors into error class
Key: SPARK-43296
URL: https://issues.apache.org/jira/browse/SPARK-43296
Project: Spark
Issue
Haejoon Lee created SPARK-43295:
---
Summary: Make DataFrameGroupBy.sum support for string type columns
Key: SPARK-43295
URL: https://issues.apache.org/jira/browse/SPARK-43295
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43291:
Summary: Match behavior for DataFrame.cov on string DataFrame (was:
Re-enable test for
Haejoon Lee created SPARK-43291:
---
Summary: Re-enable test for DataFrame.cov on string DataFrame.
Key: SPARK-43291
URL: https://issues.apache.org/jira/browse/SPARK-43291
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43020:
Description:
We should consolidate the error classes that have a similar error messages into
[
https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43020:
Description:
We should consolidate the error classes that have a similar error messages into
[
https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43020:
Summary: Refactoring similar error classes such as `NOT_XXX`. (was: Add
main error class for
Haejoon Lee created SPARK-43282:
---
Summary: Investigate DataFrame.sort_values with pandas behavior.
Key: SPARK-43282
URL: https://issues.apache.org/jira/browse/SPARK-43282
Project: Spark
Issue
Haejoon Lee created SPARK-43276:
---
Summary: Migrate Spark Connect Window errors into error class
Key: SPARK-43276
URL: https://issues.apache.org/jira/browse/SPARK-43276
Project: Spark
Issue
Haejoon Lee created SPARK-43275:
---
Summary: Migrate Spark Connect GroupedData error into error class
Key: SPARK-43275
URL: https://issues.apache.org/jira/browse/SPARK-43275
Project: Spark
Issue
Haejoon Lee created SPARK-43274:
---
Summary: Introduce `PySparkNotImplementError`
Key: SPARK-43274
URL: https://issues.apache.org/jira/browse/SPARK-43274
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-43271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43271:
Summary: Match behavior with DataFrame.reindex with specifying `index`.
(was: Fix test
Haejoon Lee created SPARK-43271:
---
Summary: Fix test DataFrameTests.test_reindex with specifying
`index`.
Key: SPARK-43271
URL: https://issues.apache.org/jira/browse/SPARK-43271
Project: Spark
Haejoon Lee created SPARK-43262:
---
Summary: Migrate Spark Connect Structured Streaming errors into
error class
Key: SPARK-43262
URL: https://issues.apache.org/jira/browse/SPARK-43262
Project: Spark
Haejoon Lee created SPARK-43261:
---
Summary: Migrate `TypeError` from Spark SQL types into error class
Key: SPARK-43261
URL: https://issues.apache.org/jira/browse/SPARK-43261
Project: Spark
Haejoon Lee created SPARK-43260:
---
Summary: Migrate the Spark SQL pandas arrow type errors into error
class.
Key: SPARK-43260
URL: https://issues.apache.org/jira/browse/SPARK-43260
Project: Spark
Haejoon Lee created SPARK-43245:
---
Summary: Fix DatetimeIndex.microsecond to return 'int32' instead
of 'int64' type of Index.
Key: SPARK-43245
URL: https://issues.apache.org/jira/browse/SPARK-43245
Haejoon Lee created SPARK-43241:
---
Summary: MultiIndex.append not checking names for equality
Key: SPARK-43241
URL: https://issues.apache.org/jira/browse/SPARK-43241
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43234:
---
Summary: Migrate ValueError from Connect DataFrame into error class
Key: SPARK-43234
URL: https://issues.apache.org/jira/browse/SPARK-43234
Project: Spark
Haejoon Lee created SPARK-43212:
---
Summary: Migrate Structured Streaming errors into error class
Key: SPARK-43212
URL: https://issues.apache.org/jira/browse/SPARK-43212
Project: Spark
Issue
Haejoon Lee created SPARK-43210:
---
Summary: Introduce PySparkAssersionError
Key: SPARK-43210
URL: https://issues.apache.org/jira/browse/SPARK-43210
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-43209:
---
Summary: Migrate Expression errors into error class
Key: SPARK-43209
URL: https://issues.apache.org/jira/browse/SPARK-43209
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43178:
---
Summary: Migrate UDF errors into error class
Key: SPARK-43178
URL: https://issues.apache.org/jira/browse/SPARK-43178
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713391#comment-17713391
]
Haejoon Lee edited comment on SPARK-42663 at 4/18/23 5:20 AM:
--
Sorry for
[
https://issues.apache.org/jira/browse/SPARK-42663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee resolved SPARK-42663.
-
Resolution: Fixed
Fixed from SPARK-42859
> Fix `default_session` to work properly
>
[
https://issues.apache.org/jira/browse/SPARK-42663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713391#comment-17713391
]
Haejoon Lee commented on SPARK-42663:
-
Sorry for the late responding, [~Wencong Liu] . It's resolved
[
https://issues.apache.org/jira/browse/SPARK-43078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee resolved SPARK-43078.
-
Resolution: Duplicate
> Separate test into `pyspark-conenct-pandas` and
Haejoon Lee created SPARK-43159:
---
Summary: Refine `column_op` to use lambda function instead of
Column API.
Key: SPARK-43159
URL: https://issues.apache.org/jira/browse/SPARK-43159
Project: Spark
Haejoon Lee created SPARK-43078:
---
Summary: Separate test into `pyspark-conenct-pandas` and
`pyspark-connect-pandas-slow`
Key: SPARK-43078
URL: https://issues.apache.org/jira/browse/SPARK-43078
Project:
[
https://issues.apache.org/jira/browse/SPARK-43076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17710008#comment-17710008
]
Haejoon Lee commented on SPARK-43076:
-
I'm working on it
> Removing the dependency on `grpcio` when
Haejoon Lee created SPARK-43076:
---
Summary: Removing the dependency on `grpcio` when remote session
is not used.
Key: SPARK-43076
URL: https://issues.apache.org/jira/browse/SPARK-43076
Project: Spark
Haejoon Lee created SPARK-43059:
---
Summary: Migrate TypeError from DataFrame(Reader|Writer) into
error class
Key: SPARK-43059
URL: https://issues.apache.org/jira/browse/SPARK-43059
Project: Spark
Haejoon Lee created SPARK-43057:
---
Summary: Migrate Spark Connect Column errors into error class
Key: SPARK-43057
URL: https://issues.apache.org/jira/browse/SPARK-43057
Project: Spark
Issue
Haejoon Lee created SPARK-43048:
---
Summary: Testing JVM-captured exceptions from Python side.
Key: SPARK-43048
URL: https://issues.apache.org/jira/browse/SPARK-43048
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43047:
---
Summary: Automate error class documentation
Key: SPARK-43047
URL: https://issues.apache.org/jira/browse/SPARK-43047
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-43045:
---
Summary: Clean-up remaining mypy failure
Key: SPARK-43045
URL: https://issues.apache.org/jira/browse/SPARK-43045
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-43024:
---
Summary: Upgrade pandas to 2.0.0
Key: SPARK-43024
URL: https://issues.apache.org/jira/browse/SPARK-43024
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-43020:
---
Summary: Add main error class for type errors
Key: SPARK-43020
URL: https://issues.apache.org/jira/browse/SPARK-43020
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-43013:
---
Summary: Migrate ValueError from DataFrame into PySparkValueError.
Key: SPARK-43013
URL: https://issues.apache.org/jira/browse/SPARK-43013
Project: Spark
Haejoon Lee created SPARK-43010:
---
Summary: Migrate Column errors into error class
Key: SPARK-43010
URL: https://issues.apache.org/jira/browse/SPARK-43010
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee resolved SPARK-42914.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Resolved
801 - 900 of 1593 matches
Mail list logo
