[
https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elhoussine Talab updated SPARK-40376:
-
Description:
Using `np.bool` generates this warning:
{quote}
UserWarning: toPandas attempted Arrow optimization because
'spark.sql.execution.arrow.pyspark.enabled' is set to true, but has reached the
error below and can not continue. Note that
'spark.sql.execution.arrow.pyspark.fallback.enabled' does not have an effect on
failures in the middle of computation.
3070E `np.bool` is a deprecated alias for the builtin
`bool`. To silence this warning, use `bool` by itself. Doing this will not
modify any behavior and is safe. If you specifically wanted the numpy scalar
type, use `np.bool_` here.
3071E Deprecated in NumPy 1.20; for more details and
guidance: [https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations]
{quote}
See Numpy's deprecation statement here:
[https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations]
was:
Using `np.bool` generates this warning:
```
UserWarning: toPandas attempted Arrow optimization because
'spark.sql.execution.arrow.pyspark.enabled' is set to true, but has reached the
error below and can not continue. Note that
'spark.sql.execution.arrow.pyspark.fallback.enabled' does not have an effect on
failures in the middle of computation.
3070E `np.bool` is a deprecated alias for the builtin
`bool`. To silence this warning, use `bool` by itself. Doing this will not
modify any behavior and is safe. If you specifically wanted the numpy scalar
type, use `np.bool_` here.
3071E Deprecated in NumPy 1.20; for more details and
guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
```
See Numpy's deprecation statement here:
https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
> `np.bool` will be deprecated
>
>
> Key: SPARK-40376
> URL: https://issues.apache.org/jira/browse/SPARK-40376
> Project: Spark
> Issue Type: Bug
> Components: Optimizer
>Affects Versions: 3.3.0
>Reporter: Elhoussine Talab
>Priority: Major
>
> Using `np.bool` generates this warning:
> {quote}
> UserWarning: toPandas attempted Arrow optimization because
> 'spark.sql.execution.arrow.pyspark.enabled' is set to true, but has reached
> the error below and can not continue. Note that
> 'spark.sql.execution.arrow.pyspark.fallback.enabled' does not have an effect
> on failures in the middle of computation.
> 3070E `np.bool` is a deprecated alias for the builtin
> `bool`. To silence this warning, use `bool` by itself. Doing this will not
> modify any behavior and is safe. If you specifically wanted the numpy scalar
> type, use `np.bool_` here.
> 3071E Deprecated in NumPy 1.20; for more details and
> guidance: [https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations]
> {quote}
>
> See Numpy's deprecation statement here:
> [https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org