Xinrong Meng created SPARK-43412:
------------------------------------
Summary: Introduce `SQL_ARROW_BATCHED_UDF` EvalType for
Arrow-optimized Python UDFs
Key: SPARK-43412
URL: https://issues.apache.org/jira/browse/SPARK-43412
Project: Spark
Issue Type: Sub-task
Components: Connect, PySpark
Affects Versions: 3.5.0
Reporter: Xinrong Meng
We are about to improve nested non-atomic input/output support of an
Arrow-optimized Python UDF.
However, currently, it shares the same EvalType with a pickled Python UDF, but
the same implementation with a Pandas UDF.
Introducing an EvalType enables isolating the changes to Arrow-optimized Python
UDFs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
