How to create spark udf use functioncatalog?

2023-05-03 Thread tzxxh
We are using spark.Today I see the FunctionCatalog , and I have seen the source of spark\sql\core\src\test\scala\org\apache\spark\sql\connector\DataSourceV2FunctionSuite.scala and have implements the ScalarFunction.But I still not know how to register it in sql

Re: How to create spark udf use functioncatalog?

2023-04-14 Thread Jacek Laskowski
Hi, I'm not sure I understand the question, but if your question is how to register (plug-in) your own custom FunctionCatalog, it's through spark.sql.catalog configuration property, e.g. spark.sql.catalog.catalog-name=com.example.YourCatalogClass spark.sql.catalog registers a CatalogPlugin that

How to create spark udf use functioncatalog?

2023-04-14 Thread ??????
We are using spark.Today I see the FunctionCatalog , and I haveseen the source of spark\sql\core\src\test\scala\org\apache\spark\sql\connector\DataSourceV2FunctionSuite.scala and have implements theScalarFunction.But i still not konw how toregisterit in sql