It's hard to evaluate without knowing what you're doing. Generally, using a
built-in function will be fastest. pandas UDFs can be faster than normal
UDFs if you can take advantage of processing multiple rows at once.
On Tue, Mar 7, 2023 at 6:47 AM neha garde wrote:
> Hello All,
>
> I need help
Hello All,
I need help deciding on what is better, pandas udfs or inbuilt functions
I have to perform a transformation where I managed to compare the two for a
few thousand records
and pandas_udf infact performed better.
Given the complexity of the transformation, I also found pandas_udf makes
it