Patrick Marx created SPARK-48710:
------------------------------------
Summary: Incompatibilities with NumPy 2.0
Key: SPARK-48710
URL: https://issues.apache.org/jira/browse/SPARK-48710
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 4.0.0
Reporter: Patrick Marx
PySpark references some code which was removed with NumPy 2.0.
{{python/pyspark/pandas/strings.py}}:
* {{np.NaN}} was removed, should be replaced with {{np.nan}}
{{python/pyspark/pandas/typedef/typehints.py}}
* {{np.string_}} was removed, [is an alias
for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3134]
{{np.bytes_}}
* {{np.float_}} was removed, [is defined the same
as|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3042-3043]
{{np.double}}
* {{np.unicode_}} was removed, [is an alias
for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3148]
{{np.str_}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
