[
https://issues.apache.org/jira/browse/SPARK-48759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-48759:
---
Summary: Add migration doc for CREATE TABLE AS SELECT behavior change
behavior change since Spark
Amanda Liu created SPARK-48759:
--
Summary: Add migration doc for CREATE TABLE behavior change
behavior change since Spark 3.4
Key: SPARK-48759
URL: https://issues.apache.org/jira/browse/SPARK-48759
Amanda Liu created SPARK-48740:
--
Summary: Catch missing window specification error early
Key: SPARK-48740
URL: https://issues.apache.org/jira/browse/SPARK-48740
Project: Spark
Issue Type: Task
Amanda Liu created SPARK-48676:
--
Summary: Structured Logging Framework Scala Style Migration [Part
2]
Key: SPARK-48676
URL: https://issues.apache.org/jira/browse/SPARK-48676
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu resolved SPARK-48632.
Resolution: Not A Problem
> Remove unused LogKeys
> -
>
>
Amanda Liu created SPARK-48632:
--
Summary: Remove unused LogKeys
Key: SPARK-48632
URL: https://issues.apache.org/jira/browse/SPARK-48632
Project: Spark
Issue Type: Sub-task
Components:
Amanda Liu created SPARK-48623:
--
Summary: Structured Logging Framework Scala Style Migration
Key: SPARK-48623
URL: https://issues.apache.org/jira/browse/SPARK-48623
Project: Spark
Issue Type:
Amanda Liu created SPARK-48592:
--
Summary: Add scala style check for logging message inline variables
Key: SPARK-48592
URL: https://issues.apache.org/jira/browse/SPARK-48592
Project: Spark
Issue
Amanda Liu created SPARK-46910:
--
Summary: Eliminate JDK Requirement in PySpark Installation
Key: SPARK-46910
URL: https://issues.apache.org/jira/browse/SPARK-46910
Project: Spark
Issue Type:
Amanda Liu created SPARK-45729:
--
Summary: Fix PySpark testing guide links
Key: SPARK-45729
URL: https://issues.apache.org/jira/browse/SPARK-45729
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44712:
---
Description: Migrate assert_eq to assertDataFrameEqual in this file:
Amanda Liu created SPARK-44712:
--
Summary: Migrate test_timedelta_ops assert_eq to use
assertDataFrameEqual
Key: SPARK-44712
URL: https://issues.apache.org/jira/browse/SPARK-44712
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44711:
---
Description:
Migrate assert_eq to assertDataFrameEqual in this file:
Amanda Liu created SPARK-44711:
--
Summary: Migrate test_series_conversion assert_eq to use
assertDataFrameEqual
Key: SPARK-44711
URL: https://issues.apache.org/jira/browse/SPARK-44711
Project: Spark
Amanda Liu created SPARK-44708:
--
Summary: Migrate test_reset_index assert_eq to use
assertDataFrameEqual
Key: SPARK-44708
URL: https://issues.apache.org/jira/browse/SPARK-44708
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44597:
---
Description: Migrate tests to new test utils in this file:
python/pyspark/pandas/tests/test_sql.py
[
https://issues.apache.org/jira/browse/SPARK-44589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44589:
---
Description:
The Jira ticket SPARK-44042 SPIP: PySpark Test Framework introduces a new
PySpark
Amanda Liu created SPARK-44682:
--
Summary: Make pandas error class message_parameters strings
Key: SPARK-44682
URL: https://issues.apache.org/jira/browse/SPARK-44682
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44548:
---
Summary: Add support for pandas-on-Spark DataFrame assertDataFrameEqual
(was: Add support for
Amanda Liu created SPARK-44665:
--
Summary: Add support for pandas DataFrame assertDataFrameEqual
Key: SPARK-44665
URL: https://issues.apache.org/jira/browse/SPARK-44665
Project: Spark
Issue
Amanda Liu created SPARK-44652:
--
Summary: Raise error when only one df is None
Key: SPARK-44652
URL: https://issues.apache.org/jira/browse/SPARK-44652
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44645:
---
Summary: Update assertDataFrameEqual docs error example output (was:
Update assertDataFrame docs
Amanda Liu created SPARK-44645:
--
Summary: Update assertDataFrame docs error example output
Key: SPARK-44645
URL: https://issues.apache.org/jira/browse/SPARK-44645
Project: Spark
Issue Type:
Amanda Liu created SPARK-44629:
--
Summary: Publish PySpark Test Guidelines webpage
Key: SPARK-44629
URL: https://issues.apache.org/jira/browse/SPARK-44629
Project: Spark
Issue Type: Sub-task
Amanda Liu created SPARK-44617:
--
Summary: Support comparison between list of Rows
Key: SPARK-44617
URL: https://issues.apache.org/jira/browse/SPARK-44617
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44617:
---
Summary: Support comparison between lists of Rows (was: Support comparison
between list of Rows)
[
https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44597:
---
Description:
The Jira ticket [[SPARK-44042] SPIP: PySpark Test Framework
[
https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44597:
---
Description:
The Jira ticket [SPARK-44042] SPIP: PySpark Test Framework introduces a new
PySpark
[
https://issues.apache.org/jira/browse/SPARK-44603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44603:
---
Summary: Add pyspark.testing to setup.py (was: Add pyspark.testing.utils
to setup.py)
> Add
Amanda Liu created SPARK-44603:
--
Summary: Add pyspark.testing.utils to Python Setup
Key: SPARK-44603
URL: https://issues.apache.org/jira/browse/SPARK-44603
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44603:
---
Summary: Add pyspark.testing.utils to setup.py (was: Add
pyspark.testing.utils to Python Setup)
>
Amanda Liu created SPARK-44597:
--
Summary: Migrate test_sql assert_eq to use assertDataFrameEqual
Key: SPARK-44597
URL: https://issues.apache.org/jira/browse/SPARK-44597
Project: Spark
Issue
Amanda Liu created SPARK-44596:
--
Summary: Fix pandas-on-Spark type checks for assertDataFrameEqual
Key: SPARK-44596
URL: https://issues.apache.org/jira/browse/SPARK-44596
Project: Spark
Issue
Amanda Liu created SPARK-44589:
--
Summary: Migrate PySpark tests to use PySpark built-in test utils
Key: SPARK-44589
URL: https://issues.apache.org/jira/browse/SPARK-44589
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44218:
---
Summary: Customize diff log in assertDataFrameEqual error message format
(was: Customize
[
https://issues.apache.org/jira/browse/SPARK-44218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44218:
---
Summary: Customize context_diff in assertDataFrameEqual error message
format (was: Add improved
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests
Amanda Liu created SPARK-44548:
--
Summary: Add support for pandas DataFrame assertDataFrameEqual
Key: SPARK-44548
URL: https://issues.apache.org/jira/browse/SPARK-44548
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests
Amanda Liu created SPARK-44546:
--
Summary: Add a dev utility to generate PySpark tests with LLM
Key: SPARK-44546
URL: https://issues.apache.org/jira/browse/SPARK-44546
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44061:
---
Summary: Add assertDataFrameEqual util function (was: Add
assertDataFrameEquality util function)
Amanda Liu created SPARK-44453:
--
Summary: Use difflib to display errors in assertDataFrameEqual
Key: SPARK-44453
URL: https://issues.apache.org/jira/browse/SPARK-44453
Project: Spark
Issue
Amanda Liu created SPARK-6:
--
Summary: Add checks for expected list type special cases
Key: SPARK-6
URL: https://issues.apache.org/jira/browse/SPARK-6
Project: Spark
Issue Type:
Amanda Liu created SPARK-44413:
--
Summary: Clarify error for unsupported arg data type in
assertDataFrameEqual
Key: SPARK-44413
URL: https://issues.apache.org/jira/browse/SPARK-44413
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44216:
---
Summary: Make assertSchemaEqual API public (was: Make assertSchemaEqual
API with ignore_nullable
Amanda Liu created SPARK-44397:
--
Summary: Expose assertDataFrameEqual in pyspark.testing.utils
Key: SPARK-44397
URL: https://issues.apache.org/jira/browse/SPARK-44397
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44217:
---
Summary: Allow custom precision for fp approx equality (was: Add
assert_approx_df_equality util
[
https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44216:
---
Summary: Add assertSchemaEqual API with ignore_nullable optional flag
(was: Add improved error
[
https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44216:
---
Summary: Make assertSchemaEqual API with ignore_nullable optional flag
(was: Add assertSchemaEqual
[
https://issues.apache.org/jira/browse/SPARK-44363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44363:
---
Summary: Display percent of unequal rows in DataFrame comparison (was:
Display percent of unequal
[
https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44061:
---
Summary: Add assertDataFrameEquality util function (was: Add
assert_df_equality util function)
>
Amanda Liu created SPARK-44364:
--
Summary: Support List[Row] data type for expected DataFrame
argument
Key: SPARK-44364
URL: https://issues.apache.org/jira/browse/SPARK-44364
Project: Spark
Amanda Liu created SPARK-44363:
--
Summary: Display percent of unequal rows in dataframe comparison
Key: SPARK-44363
URL: https://issues.apache.org/jira/browse/SPARK-44363
Project: Spark
Issue
Amanda Liu created SPARK-44357:
--
Summary: Add pyspark_testing module for GHA tests
Key: SPARK-44357
URL: https://issues.apache.org/jira/browse/SPARK-44357
Project: Spark
Issue Type: Sub-task
Amanda Liu created SPARK-44218:
--
Summary: Add improved error message formatting for
assert_approx_df_equality
Key: SPARK-44218
URL: https://issues.apache.org/jira/browse/SPARK-44218
Project: Spark
Amanda Liu created SPARK-44217:
--
Summary: Add assert_approx_df_equality util function
Key: SPARK-44217
URL: https://issues.apache.org/jira/browse/SPARK-44217
Project: Spark
Issue Type: Sub-task
Amanda Liu created SPARK-44216:
--
Summary: Add improved error message formatting for
assert_df_equality
Key: SPARK-44216
URL: https://issues.apache.org/jira/browse/SPARK-44216
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735747#comment-17735747
]
Amanda Liu commented on SPARK-44042:
[~ste...@apache.org] thank you for the comment! i agree that
Amanda Liu created SPARK-44062:
--
Summary: Add PySparkTestBase unit test class
Key: SPARK-44062
URL: https://issues.apache.org/jira/browse/SPARK-44062
Project: Spark
Issue Type: Sub-task
Amanda Liu created SPARK-44061:
--
Summary: Add assert_df_equality util function
Key: SPARK-44061
URL: https://issues.apache.org/jira/browse/SPARK-44061
Project: Spark
Issue Type: Sub-task
Amanda Liu created SPARK-44042:
--
Summary: SPIP: PySpark Test Framework
Key: SPARK-44042
URL: https://issues.apache.org/jira/browse/SPARK-44042
Project: Spark
Issue Type: New Feature
Amanda Liu created SPARK-43940:
--
Summary: Write test for CANNOT_FIND_BATCH (Prev
_LEGACY_ERROR_TEMP_2132)
Key: SPARK-43940
URL: https://issues.apache.org/jira/browse/SPARK-43940
Project: Spark
65 matches
Mail list logo
