[
https://issues.apache.org/jira/browse/SPARK-26559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-26559.
----------------------------------
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fixed in https://github.com/apache/spark/pull/23484
> ML image can't work with numpy versions prior to 1.9
> ----------------------------------------------------
>
> Key: SPARK-26559
> URL: https://issues.apache.org/jira/browse/SPARK-26559
> Project: Spark
> Issue Type: Bug
> Components: ML, PySpark
> Affects Versions: 3.0.0
> Reporter: Liang-Chi Hsieh
> Assignee: Liang-Chi Hsieh
> Priority: Major
> Fix For: 2.4.1, 3.0.0
>
>
> ML image can't work with numpy version prior to 1.9 now.
> Current pyspark test can show it:
> {code:java}
> test_read_images (pyspark.ml.tests.test_image.ImageReaderTest) ... ERROR
>
> test_read_images_multiple_times
> (pyspark.ml.tests.test_image.ImageReaderTest2) ... ok
>
>
>
> ======================================================================
>
> ERROR: test_read_images (pyspark.ml.tests.test_image.ImageReaderTest)
>
> ----------------------------------------------------------------------
>
> Traceback (most recent call last):
> File
> "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/tests/test_image.py",
> line 36, in test_read_images
> self.assertEqual(ImageSchema.toImage(array, origin=first_row[0]),
> first_row)
>
> File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/image.py",
> line 193, in toImage
> data = bytearray(array.astype(dtype=np.uint8).ravel().tobytes())
>
> AttributeError: 'numpy.ndarray' object has no attribute 'tobytes'
>
>
>
> ----------------------------------------------------------------------
> Ran 2 tests in 29.040s
>
>
>
> FAILED (errors=1)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
