[
https://issues.apache.org/jira/browse/SPARK-48008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengfei Xu updated SPARK-48008:
-------------------------------
Description:
Currently Spark Connect supports only UDFs. We need to add support for UDAFs,
specifically `Aggregator[INT, BUF, OUT]`.
The user-facing API should not change, which includes Aggregator methods and
the `spark.udf.register("agg", udaf(agg))` API.
was:
Currently Spark Connect supports only UDFs. We need to add support for UDAFs,
specifically `Aggregator[INT, BUF, OUT]`.
The user-facing API should not change, which includes Aggregator methods and
the `
spark.udf.register("agg", udaf(agg))` API.
> Support UDAF in Spark Connect
> -----------------------------
>
> Key: SPARK-48008
> URL: https://issues.apache.org/jira/browse/SPARK-48008
> Project: Spark
> Issue Type: New Feature
> Components: Connect
> Affects Versions: 4.0.0
> Reporter: Pengfei Xu
> Priority: Major
>
> Currently Spark Connect supports only UDFs. We need to add support for UDAFs,
> specifically `Aggregator[INT, BUF, OUT]`.
> The user-facing API should not change, which includes Aggregator methods and
> the `spark.udf.register("agg", udaf(agg))` API.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
