WangGuangxin opened a new pull request, #12910:
URL: https://github.com/apache/gluten/pull/12910
## What changes are proposed in this pull request?
This PR extends `HiveUDFTransformer` to recognize `HiveGenericUDTF` in
addition to
`HiveSimpleUDF` and `HiveGenericUDF`.
Previously, `HiveUDFTransformer` only handled Hive simple UDFs and generic
UDFs
when checking whether an expression is a Hive UDF and when extracting the
Hive
function name and implementation class. As a result, `HiveGenericUDTF`
could not
be recognized or mapped through the same transformer path.
This patch updates `HiveUDFTransformer` so that:
- `isHiveUDF` returns true for `HiveGenericUDTF`
- `getHiveUDFNameAndClassName` can extract the function name and class
name from
`HiveGenericUDTF`
In addition, this PR adds unit tests to verify that `HiveGenericUDTF` is
properly
recognized, mapped, and converted through `HiveUDFTransformer` across
supported
Spark versions.
## How was this patch tested?
Added unit tests in `gluten-ut` for Spark 3.3, 3.4, 3.5, 4.0, and 4.1 to
verify:
- a `HiveGenericUDTF` can be found from the analyzed plan
- `HiveUDFTransformer.isHiveUDF` recognizes it correctly
- `HiveUDFTransformer.getHiveUDFNameAndClassName` returns the expected
function
name and implementation class
- `HiveUDFTransformer.replaceWithExpressionTransformer` can map it to a
`GenericExpressionTransformer`
## Was this patch authored or co-authored using generative AI tooling?
Generated-by: TraeCode GPT-5
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
