Patrick Marx created SPARK-48710: ------------------------------------ Summary: Incompatibilities with NumPy 2.0 Key: SPARK-48710 URL: https://issues.apache.org/jira/browse/SPARK-48710 Project: Spark Issue Type: Bug Components: PySpark Affects Versions: 4.0.0 Reporter: Patrick Marx
PySpark references some code which was removed with NumPy 2.0. {{python/pyspark/pandas/strings.py}}: * {{np.NaN}} was removed, should be replaced with {{np.nan}} {{python/pyspark/pandas/typedef/typehints.py}} * {{np.string_}} was removed, [is an alias for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3134] {{np.bytes_}} * {{np.float_}} was removed, [is defined the same as|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3042-3043] {{np.double}} * {{np.unicode_}} was removed, [is an alias for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3148] {{np.str_}} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org