[
https://issues.apache.org/jira/browse/SPARK-54494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-54494.
----------------------------------
Fix Version/s: 4.0.2
Resolution: Fixed
Fixed in https://github.com/apache/spark/pull/53222
> Reeanble test_memory_profiler_map_in_pandas_not_supported /
> test_memory_profiler_pandas_udf_iterator_not_supported
> -------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-54494
> URL: https://issues.apache.org/jira/browse/SPARK-54494
> Project: Spark
> Issue Type: Sub-task
> Components: Tests
> Affects Versions: 4.1.0, 4.0.1, 4.2.0
> Reporter: Hyukjin Kwon
> Assignee: Takuya Ueshin
> Priority: Major
> Fix For: 4.0.2
>
>
> {code}
> ======================================================================
> FAIL [0.222s]: test_memory_profiler_map_in_pandas_not_supported
> (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_map_in_pandas_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
> "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py",
> line 395, in test_memory_profiler_map_in_pandas_not_supported
> self.assertEqual(0, len(self.profile_results),
> str(self.profile_results.keys()))
> AssertionError: 0 != 1 : dict_keys([29615])
> ======================================================================
> FAIL [0.593s]: test_memory_profiler_pandas_udf_iterator_not_supported
> (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
> "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py",
> line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
> self.assertEqual(1, len(self.profile_results),
> str(self.profile_results.keys()))
> AssertionError: 1 != 3 : dict_keys([29647, 29648, 29650])
> ======================================================================
> FAIL [0.217s]: test_memory_profiler_map_in_pandas_not_supported
> (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_map_in_pandas_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
> "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py",
> line 395, in test_memory_profiler_map_in_pandas_not_supported
> self.assertEqual(0, len(self.profile_results),
> str(self.profile_results.keys()))
> AssertionError: 0 != 1 : dict_keys([30115])
> ======================================================================
> FAIL [0.622s]: test_memory_profiler_pandas_udf_iterator_not_supported
> (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
> "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py",
> line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
> self.assertEqual(1, len(self.profile_results),
> str(self.profile_results.keys()))
> AssertionError: 1 != 3 : dict_keys([30147, 30148, 30150])
> ----------------------------------------------------------------------
> Ran 33 tests in 13.199s
> FAILED (failures=4)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
