[ https://issues.apache.org/jira/browse/DATAFU-174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817330#comment-17817330 ]
Eyal Allweil commented on DATAFU-174: ------------------------------------- Pull request: https://github.com/apache/datafu/pull/42 > Remove deprecated SparkUDAFs > ---------------------------- > > Key: DATAFU-174 > URL: https://issues.apache.org/jira/browse/DATAFU-174 > Project: DataFu > Issue Type: Improvement > Affects Versions: 2.1.0 > Reporter: Eyal Allweil > Assignee: Eyal Allweil > Priority: Major > Fix For: 2.1.0 > > Time Spent: 10m > Remaining Estimate: 0h > > As described in > [DATAFU-173|https://issues.apache.org/jira/browse/DATAFU-173], in order to > upgrade to Spark 3.2.0 (or greater), we will need to remove the classes in > [SparkUDAFs|https://github.com/apache/datafu/blob/2.0.0/datafu-spark/src/main/scala/datafu/spark/SparkUDAFs.scala] > that extend UserDefinedAggregateFunction. > Users will be able to use the same functionality in > [Aggregators|https://github.com/apache/datafu/blob/2.0.0/datafu-spark/src/main/scala/datafu/spark/Aggregators.scala]. -- This message was sent by Atlassian Jira (v8.20.10#820010)