[
https://issues.apache.org/jira/browse/SPARK-48710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Marx updated SPARK-48710:
---------------------------------
Affects Version/s: 3.5.1
> Incompatibilities with NumPy 2.0
> --------------------------------
>
> Key: SPARK-48710
> URL: https://issues.apache.org/jira/browse/SPARK-48710
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 4.0.0, 3.5.1
> Reporter: Patrick Marx
> Priority: Major
>
> PySpark references some code which was removed with NumPy 2.0.
> {{python/pyspark/pandas/strings.py}}:
> * {{np.NaN}} was removed, should be replaced with {{np.nan}}
> {{python/pyspark/pandas/typedef/typehints.py}}
> * {{np.string_}} was removed, [is an alias
> for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3134]
> {{np.bytes_}}
> * {{np.float_}} was removed, [is defined the same
> as|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3042-3043]
> {{np.double}}
> * {{np.unicode_}} was removed, [is an alias
> for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3148]
> {{np.str_}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
