This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new b4bf9ec065bf [SPARK-46269][PS] Enable more NumPy compatibility function tests b4bf9ec065bf is described below commit b4bf9ec065bf3538e3780a833b6c5dec7b602cf2 Author: Haejoon Lee <haejoon....@databricks.com> AuthorDate: Tue Dec 5 08:33:38 2023 -0800 [SPARK-46269][PS] Enable more NumPy compatibility function tests ### What changes were proposed in this pull request? This PR proposes to enable NumPy compatibility function tests for `arccos`, `exp`, `expm1` and `floor_divide`. ### Why are the changes needed? To improve the test coverage for NumPy compatibility function. ### Does this PR introduce _any_ user-facing change? No, this improves the test coverage. ### How was this patch tested? The existing CI should pass. For flaky tests, manually ran 50 times on local envs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #44186 from itholic/enable_numpy_tests. Authored-by: Haejoon Lee <haejoon....@databricks.com> Signed-off-by: Dongjoon Hyun <dh...@apple.com> --- python/pyspark/pandas/tests/test_numpy_compat.py | 6 +----- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/python/pyspark/pandas/tests/test_numpy_compat.py b/python/pyspark/pandas/tests/test_numpy_compat.py index 986083d0d3af..931e5475c36f 100644 --- a/python/pyspark/pandas/tests/test_numpy_compat.py +++ b/python/pyspark/pandas/tests/test_numpy_compat.py @@ -26,21 +26,17 @@ from pyspark.testing.sqlutils import SQLTestUtils class NumPyCompatTestsMixin: blacklist = [ - # Koalas does not currently support + # Pandas-on-Spark does not currently support "conj", "conjugate", "isnat", "matmul", "frexp", # Values are close enough but tests failed. - "arccos", - "exp", - "expm1", "log", # flaky "log10", # flaky "log1p", # flaky "modf", - "floor_divide", # flaky ] @property --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org