[jira] [Created] (SPARK-48510) Support UDAF.toColumn API in Spark Connect

2024-06-03 Thread Pengfei Xu (Jira) 
Pengfei Xu created SPARK-48510:
--

 Summary: Support UDAF.toColumn API in Spark Connect
 Key: SPARK-48510
 URL: https://issues.apache.org/jira/browse/SPARK-48510
 Project: Spark
  Issue Type: New Feature
  Components: Connect
Affects Versions: 4.0.0
Reporter: Pengfei Xu


Following up on https://issues.apache.org/jira/browse/SPARK-48008, we still 
have to support udaf.toColumn API in Spark Connect.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-48008) Support UDAF in Spark Connect

2024-04-26 Thread Pengfei Xu (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-48008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pengfei Xu updated SPARK-48008:
---
Description: 
Currently Spark Connect supports only UDFs. We need to add support for UDAFs, 
specifically `Aggregator[INT, BUF, OUT]`.

The user-facing API should not change, which includes Aggregator methods and 
the `spark.udf.register("agg", udaf(agg))` API.

  was:
Currently Spark Connect supports only UDFs. We need to add support for UDAFs, 
specifically `Aggregator[INT, BUF, OUT]`.

The user-facing API should not change, which includes Aggregator methods and 
the `
spark.udf.register("agg", udaf(agg))` API.


> Support UDAF in Spark Connect
> -
>
> Key: SPARK-48008
> URL: https://issues.apache.org/jira/browse/SPARK-48008
> Project: Spark
>  Issue Type: New Feature
>  Components: Connect
>Affects Versions: 4.0.0
>Reporter: Pengfei Xu
>Priority: Major
>
> Currently Spark Connect supports only UDFs. We need to add support for UDAFs, 
> specifically `Aggregator[INT, BUF, OUT]`.
> The user-facing API should not change, which includes Aggregator methods and 
> the `spark.udf.register("agg", udaf(agg))` API.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Created] (SPARK-47545) [Connect] DF observe support for the scala client

2024-03-25 Thread Pengfei Xu (Jira) 
Pengfei Xu created SPARK-47545:
--

 Summary: [Connect] DF observe support for the scala client
 Key: SPARK-47545
 URL: https://issues.apache.org/jira/browse/SPARK-47545
 Project: Spark
  Issue Type: New Feature
  Components: Connect
Affects Versions: 4.0.0
Reporter: Pengfei Xu






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org