Hyukjin Kwon created SPARK-32422:
------------------------------------
Summary: Don't skip pandas UDF tests in IntegratedUDFTestUtils
Key: SPARK-32422
URL: https://issues.apache.org/jira/browse/SPARK-32422
Project: Spark
Issue Type: Sub-task
Components: Tests
Affects Versions: 3.1.0
Reporter: Hyukjin Kwon
Currently, pandas UDF test cases are being skipped as below:
{code}
[info] - udf/postgreSQL/udf-case.sql - Scalar Pandas UDF is skipped because
pyspark,pandas and/or pyarrow were not available in [python3.6]. !!! IGNORED !!!
[info] - udf/postgreSQL/udf-select_having.sql - Scala UDF (2 seconds, 327
milliseconds)
[info] - udf/postgreSQL/udf-select_having.sql - Regular Python UDF (3 seconds,
656 milliseconds)
[info] - udf/postgreSQL/udf-select_having.sql - Scalar Pandas UDF is skipped
because pyspark,pandas and/or pyarrow were not available in [python3.6]. !!!
IGNORED !!!
[info] - udf/postgreSQL/udf-select_implicit.sql - Scala UDF (6 seconds, 769
milliseconds)
[info] - udf/postgreSQL/udf-select_implicit.sql - Regular Python UDF (10
seconds, 487 milliseconds)
[info] - udf/postgreSQL/udf-select_implicit.sql - Scalar Pandas UDF is skipped
because pyspark,pandas and/or pyarrow were not available in [python3.6]. !!!
IGNORED !!!
[info] - udf/postgreSQL/udf-aggregates_part3.sql - Scala UDF (119 milliseconds)
[info] - udf/postgreSQL/udf-aggregates_part3.sql - Regular Python UDF (229
milliseconds)
[info] - udf/postgreSQL/udf-aggregates_part3.sql - Scalar Pandas UDF is skipped
because pyspark,pandas and/or pyarrow were not available in [python3.6]. !!!
IGNORED !!!
[info] - udf/postgreSQL/udf-aggregates_part2.sql - Scala UDF (2 seconds, 376
milliseconds)
[info] - udf/postgreSQL/udf-aggregates_part2.sql - Regular Python UDF (2
seconds, 449 milliseconds)
[info] - udf/postgreSQL/udf-aggregates_part2.sql - Scalar Pandas UDF is skipped
because pyspark,pandas and/or pyarrow were not available in [python3.6]. !!!
IGNORED !!!
[info] - udf/postgreSQL/udf-aggregates_part1.sql - Scala UDF (3 seconds, 634
milliseconds)
[info] - udf/postgreSQL/udf-aggregates_part1.sql - Regular Python UDF (5
seconds, 899 milliseconds)
[info] - udf/postgreSQL/udf-aggregates_part1.sql - Scalar Pandas UDF is skipped
because pyspark,pandas and/or pyarrow were not available in [python3.6]. !!!
IGNORED !!!
{code}
in GitBub Actions. We should test them
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
