Wei Liu created SPARK-47174:
---
Summary: Client Side Listener - Server side implementation
Key: SPARK-47174
URL: https://issues.apache.org/jira/browse/SPARK-47174
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820828#comment-17820828
]
Wei Liu commented on SPARK-47174:
-
im working on this
> Client Side Listener - Server s
Wei Liu created SPARK-47173:
---
Summary: fix typo in new streaming query listener explanation
Key: SPARK-47173
URL: https://issues.apache.org/jira/browse/SPARK-47173
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-46995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-46995:
-
Component/s: SQL
> Allow AQE coalesce final stage in SQL cached plan
> -
Ziqi Liu created SPARK-46995:
Summary: Allow AQE coalesce final stage in SQL cached plan
Key: SPARK-46995
URL: https://issues.apache.org/jira/browse/SPARK-46995
Project: Spark
Issue Type: Improve
Amanda Liu created SPARK-46910:
--
Summary: Eliminate JDK Requirement in PySpark Installation
Key: SPARK-46910
URL: https://issues.apache.org/jira/browse/SPARK-46910
Project: Spark
Issue Type: Imp
Wei Liu created SPARK-46873:
---
Summary: PySpark spark.streams should not recreate new
StreamingQueryManager
Key: SPARK-46873
URL: https://issues.apache.org/jira/browse/SPARK-46873
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-44460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu closed SPARK-44460.
---
> Pass user auth credential to Python workers for foreachBatch and listener
> --
[
https://issues.apache.org/jira/browse/SPARK-46627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-46627:
Attachment: Screenshot 2024-01-08 at 15.06.24.png
> Streaming UI hover-over shows incorrect value
> --
[
https://issues.apache.org/jira/browse/SPARK-46627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804513#comment-17804513
]
Wei Liu commented on SPARK-46627:
-
Also batch percent doesn't add to 100% now:
!Screens
[
https://issues.apache.org/jira/browse/SPARK-46627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-46627:
Attachment: Screenshot 2024-01-08 at 1.55.57 PM.png
> Streaming UI hover-over shows incorrect value
>
[
https://issues.apache.org/jira/browse/SPARK-46627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804481#comment-17804481
]
Wei Liu commented on SPARK-46627:
-
Hi Kent : ) [~yao]
I was wondering if you have cont
[
https://issues.apache.org/jira/browse/SPARK-46627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-46627:
Description:
Running a simple streaming query:
val df = spark.readStream.format("rate").option("rowsPerSe
Wei Liu created SPARK-46627:
---
Summary: Streaming UI hover-over shows incorrect value
Key: SPARK-46627
URL: https://issues.apache.org/jira/browse/SPARK-46627
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-46384:
Summary: Streaming UI doesn't display graph correctly (was: Streaming UI
doesn't show graph)
> Streaming
[
https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-46384:
Summary: Structured Streaming UI doesn't display graph correctly (was:
Streaming UI doesn't display graph
Wei Liu created SPARK-46384:
---
Summary: Streaming UI doesn't show graph
Key: SPARK-46384
URL: https://issues.apache.org/jira/browse/SPARK-46384
Project: Spark
Issue Type: Task
Components:
fred liu created SPARK-46279:
Summary: Support write partition values to data files
Key: SPARK-46279
URL: https://issues.apache.org/jira/browse/SPARK-46279
Project: Spark
Issue Type: Improvement
Wei Liu created SPARK-46250:
---
Summary: Deflake test_parity_listener
Key: SPARK-46250
URL: https://issues.apache.org/jira/browse/SPARK-46250
Project: Spark
Issue Type: Task
Components: Con
Wei Liu created SPARK-45845:
---
Summary: Streaming UI add number of evicted state rows
Key: SPARK-45845
URL: https://issues.apache.org/jira/browse/SPARK-45845
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-45834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiayi Liu updated SPARK-45834:
--
Description:
Spark uses the formula {{ck / sqrt(xMk * yMk)}} to calculate the Pearson
Correlation Coe
Amanda Liu created SPARK-45729:
--
Summary: Fix PySpark testing guide links
Key: SPARK-45729
URL: https://issues.apache.org/jira/browse/SPARK-45729
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-45637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-45637:
Description:
According to documentation update (SPARK-42591) resulting from SPARK-42376,
Spark 3.5.0 shou
Wei Liu created SPARK-45677:
---
Summary: Observe API error logging
Key: SPARK-45677
URL: https://issues.apache.org/jira/browse/SPARK-45677
Project: Spark
Issue Type: Task
Components: Struct
[
https://issues.apache.org/jira/browse/SPARK-45053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-45053:
Description: Currently the syntax of the python version mismatching is a
little bit confusing, it uses (3,
Wei Liu created SPARK-45056:
---
Summary: Add process termination tests for Python foreachBatch and
StreamingQueryListener
Key: SPARK-45056
URL: https://issues.apache.org/jira/browse/SPARK-45056
Project: Spark
Wei Liu created SPARK-45053:
---
Summary: Improve python version mismatch logging
Key: SPARK-45053
URL: https://issues.apache.org/jira/browse/SPARK-45053
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-44971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44971:
Issue Type: Bug (was: New Feature)
> [BUG Fix] PySpark StreamingQuerProgress fromJson
>
Wei Liu created SPARK-44971:
---
Summary: [BUG Fix] PySpark StreamingQuerProgress fromJson
Key: SPARK-44971
URL: https://issues.apache.org/jira/browse/SPARK-44971
Project: Spark
Issue Type: New Featu
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-44930:
-
Description: Currently, ApplyFunctionExpression is unfoldable because
inherits the default value
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-44930:
-
Description: Currently, ApplyFunctionExpression is unfoldable because
inherits the default value
Xianyang Liu created SPARK-44930:
Summary: Deterministic ApplyFunctionExpression should be foldable
Key: SPARK-44930
URL: https://issues.apache.org/jira/browse/SPARK-44930
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-44917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu resolved SPARK-44917.
-
Resolution: Not A Problem
> PySpark Streaming DataStreamWriter table API
> -
Wei Liu created SPARK-44917:
---
Summary: PySpark Streaming DataStreamWriter table API
Key: SPARK-44917
URL: https://issues.apache.org/jira/browse/SPARK-44917
Project: Spark
Issue Type: New Feature
Xianyang Liu created SPARK-44913:
Summary: DS V2 supports push down V2 UDF that has magic method
Key: SPARK-44913
URL: https://issues.apache.org/jira/browse/SPARK-44913
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-44460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17757087#comment-17757087
]
Wei Liu commented on SPARK-44460:
-
[~rangadi] This seems to be a Databricks internal iss
Wei Liu created SPARK-44839:
---
Summary: Better error logging when user accesses spark session in
foreachBatch and Listener
Key: SPARK-44839
URL: https://issues.apache.org/jira/browse/SPARK-44839
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754280#comment-17754280
]
Wei Liu commented on SPARK-44808:
-
This seems to be against the design principle of spar
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu resolved SPARK-44808.
-
Resolution: Won't Do
> refreshListener() API on StreamingQueryManager for spark connect
> --
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44808:
Description:
I’m thinking of an improvement for connect python listener and foreachBatch.
Currently if yo
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44808:
Description:
I’m thinking of an improvement for connect python listener and foreachBatch.
Currently if yo
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44808:
Description:
I’m thinking of an improvement for connect python listener and foreachBatch.
Currently if yo
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44808:
Description:
I’m thinking of an improvement for connect python listener and foreachBatch.
Currently if yo
Wei Liu created SPARK-44808:
---
Summary: refreshListener() API on StreamingQueryManager for spark
connect
Key: SPARK-44808
URL: https://issues.apache.org/jira/browse/SPARK-44808
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44808:
Description:
I’m thinking of an improvement for python listener and foreachBatch. Currently
if you define
Wei Liu created SPARK-44764:
---
Summary: Streaming process improvement
Key: SPARK-44764
URL: https://issues.apache.org/jira/browse/SPARK-44764
Project: Spark
Issue Type: New Feature
Compone
[
https://issues.apache.org/jira/browse/SPARK-44712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44712:
---
Description: Migrate assert_eq to assertDataFrameEqual in this file:
[python/pyspark/pandas/tests/d
Amanda Liu created SPARK-44712:
--
Summary: Migrate test_timedelta_ops assert_eq to use
assertDataFrameEqual
Key: SPARK-44712
URL: https://issues.apache.org/jira/browse/SPARK-44712
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44711:
---
Description:
Migrate assert_eq to assertDataFrameEqual in this file:
[python/pyspark/pandas/tests/
Amanda Liu created SPARK-44711:
--
Summary: Migrate test_series_conversion assert_eq to use
assertDataFrameEqual
Key: SPARK-44711
URL: https://issues.apache.org/jira/browse/SPARK-44711
Project: Spark
Amanda Liu created SPARK-44708:
--
Summary: Migrate test_reset_index assert_eq to use
assertDataFrameEqual
Key: SPARK-44708
URL: https://issues.apache.org/jira/browse/SPARK-44708
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44597:
---
Description: Migrate tests to new test utils in this file:
python/pyspark/pandas/tests/test_sql.py
[
https://issues.apache.org/jira/browse/SPARK-44589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44589:
---
Description:
The Jira ticket SPARK-44042 SPIP: PySpark Test Framework introduces a new
PySpark test
Amanda Liu created SPARK-44682:
--
Summary: Make pandas error class message_parameters strings
Key: SPARK-44682
URL: https://issues.apache.org/jira/browse/SPARK-44682
Project: Spark
Issue Type: Su
[
https://issues.apache.org/jira/browse/SPARK-44548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44548:
---
Summary: Add support for pandas-on-Spark DataFrame assertDataFrameEqual
(was: Add support for panda
Amanda Liu created SPARK-44665:
--
Summary: Add support for pandas DataFrame assertDataFrameEqual
Key: SPARK-44665
URL: https://issues.apache.org/jira/browse/SPARK-44665
Project: Spark
Issue Type:
Amanda Liu created SPARK-44652:
--
Summary: Raise error when only one df is None
Key: SPARK-44652
URL: https://issues.apache.org/jira/browse/SPARK-44652
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44645:
---
Summary: Update assertDataFrameEqual docs error example output (was:
Update assertDataFrame docs er
Amanda Liu created SPARK-44645:
--
Summary: Update assertDataFrame docs error example output
Key: SPARK-44645
URL: https://issues.apache.org/jira/browse/SPARK-44645
Project: Spark
Issue Type: Sub-
Amanda Liu created SPARK-44629:
--
Summary: Publish PySpark Test Guidelines webpage
Key: SPARK-44629
URL: https://issues.apache.org/jira/browse/SPARK-44629
Project: Spark
Issue Type: Sub-task
Amanda Liu created SPARK-44617:
--
Summary: Support comparison between list of Rows
Key: SPARK-44617
URL: https://issues.apache.org/jira/browse/SPARK-44617
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44617:
---
Summary: Support comparison between lists of Rows (was: Support comparison
between list of Rows)
>
[
https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44597:
---
Description:
The Jira ticket [[SPARK-44042] SPIP: PySpark Test Framework
|https://issues.apache.org
[
https://issues.apache.org/jira/browse/SPARK-44597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44597:
---
Description:
The Jira ticket [SPARK-44042] SPIP: PySpark Test Framework introduces a new
PySpark t
[
https://issues.apache.org/jira/browse/SPARK-44603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44603:
---
Summary: Add pyspark.testing to setup.py (was: Add pyspark.testing.utils
to setup.py)
> Add pyspar
Amanda Liu created SPARK-44603:
--
Summary: Add pyspark.testing.utils to Python Setup
Key: SPARK-44603
URL: https://issues.apache.org/jira/browse/SPARK-44603
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44603:
---
Summary: Add pyspark.testing.utils to setup.py (was: Add
pyspark.testing.utils to Python Setup)
>
Amanda Liu created SPARK-44597:
--
Summary: Migrate test_sql assert_eq to use assertDataFrameEqual
Key: SPARK-44597
URL: https://issues.apache.org/jira/browse/SPARK-44597
Project: Spark
Issue Type
Amanda Liu created SPARK-44596:
--
Summary: Fix pandas-on-Spark type checks for assertDataFrameEqual
Key: SPARK-44596
URL: https://issues.apache.org/jira/browse/SPARK-44596
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-44460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44460:
Description:
No user specific credentials are sent to Python worker that runs user functions
like foreach
[
https://issues.apache.org/jira/browse/SPARK-44577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748745#comment-17748745
]
Linhong Liu commented on SPARK-44577:
-
[~fanjia] could you make a followup PR to fix
[
https://issues.apache.org/jira/browse/SPARK-44577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748746#comment-17748746
]
Linhong Liu commented on SPARK-44577:
-
cc [~cloud_fan]
> INSERT BY NAME returns no
Amanda Liu created SPARK-44589:
--
Summary: Migrate PySpark tests to use PySpark built-in test utils
Key: SPARK-44589
URL: https://issues.apache.org/jira/browse/SPARK-44589
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-44218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44218:
---
Summary: Customize diff log in assertDataFrameEqual error message format
(was: Customize context_di
[
https://issues.apache.org/jira/browse/SPARK-44218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44218:
---
Summary: Customize context_diff in assertDataFrameEqual error message
format (was: Add improved err
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests using
Amanda Liu created SPARK-44548:
--
Summary: Add support for pandas DataFrame assertDataFrameEqual
Key: SPARK-44548
URL: https://issues.apache.org/jira/browse/SPARK-44548
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests using
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests using
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests using
[
https://issues.apache.org/jira/browse/SPARK-44546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44546:
---
Description:
h2. Summary
This ticket adds a dev utility script to help generate PySpark tests using
Amanda Liu created SPARK-44546:
--
Summary: Add a dev utility to generate PySpark tests with LLM
Key: SPARK-44546
URL: https://issues.apache.org/jira/browse/SPARK-44546
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44516:
Summary: Spark Connect Python StreamingQueryListener removeListener method
actually shut down the listener
Wei Liu created SPARK-44516:
---
Summary: Spark Connect Python StreamingQueryListener
removeListener method
Key: SPARK-44516
URL: https://issues.apache.org/jira/browse/SPARK-44516
Project: Spark
Issu
Wei Liu created SPARK-44515:
---
Summary: Code Improvement: PySpark add util function to set python
version
Key: SPARK-44515
URL: https://issues.apache.org/jira/browse/SPARK-44515
Project: Spark
Issu
Wei Liu created SPARK-44502:
---
Summary: Add mission versionchanged field to docs
Key: SPARK-44502
URL: https://issues.apache.org/jira/browse/SPARK-44502
Project: Spark
Issue Type: New Feature
Ziqi Liu created SPARK-44485:
Summary: optimize generateTreeString code path
Key: SPARK-44485
URL: https://issues.apache.org/jira/browse/SPARK-44485
Project: Spark
Issue Type: Improvement
Wei Liu created SPARK-44484:
---
Summary: Add missing json field batchDuration to
StreamingQueryProgress
Key: SPARK-44484
URL: https://issues.apache.org/jira/browse/SPARK-44484
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44061:
---
Summary: Add assertDataFrameEqual util function (was: Add
assertDataFrameEquality util function)
>
Amanda Liu created SPARK-44453:
--
Summary: Use difflib to display errors in assertDataFrameEqual
Key: SPARK-44453
URL: https://issues.apache.org/jira/browse/SPARK-44453
Project: Spark
Issue Type:
Amanda Liu created SPARK-6:
--
Summary: Add checks for expected list type special cases
Key: SPARK-6
URL: https://issues.apache.org/jira/browse/SPARK-6
Project: Spark
Issue Type: Sub-t
Amanda Liu created SPARK-44413:
--
Summary: Clarify error for unsupported arg data type in
assertDataFrameEqual
Key: SPARK-44413
URL: https://issues.apache.org/jira/browse/SPARK-44413
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44216:
---
Summary: Make assertSchemaEqual API public (was: Make assertSchemaEqual
API with ignore_nullable op
Amanda Liu created SPARK-44397:
--
Summary: Expose assertDataFrameEqual in pyspark.testing.utils
Key: SPARK-44397
URL: https://issues.apache.org/jira/browse/SPARK-44397
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44217:
---
Summary: Allow custom precision for fp approx equality (was: Add
assert_approx_df_equality util fun
[
https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44216:
---
Summary: Add assertSchemaEqual API with ignore_nullable optional flag
(was: Add improved error mess
[
https://issues.apache.org/jira/browse/SPARK-44216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44216:
---
Summary: Make assertSchemaEqual API with ignore_nullable optional flag
(was: Add assertSchemaEqual
[
https://issues.apache.org/jira/browse/SPARK-44363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44363:
---
Summary: Display percent of unequal rows in DataFrame comparison (was:
Display percent of unequal r
[
https://issues.apache.org/jira/browse/SPARK-44061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amanda Liu updated SPARK-44061:
---
Summary: Add assertDataFrameEquality util function (was: Add
assert_df_equality util function)
> A
Amanda Liu created SPARK-44364:
--
Summary: Support List[Row] data type for expected DataFrame
argument
Key: SPARK-44364
URL: https://issues.apache.org/jira/browse/SPARK-44364
Project: Spark
Issu
101 - 200 of 2591 matches
Mail list logo
