Mich, I don't think the invalidation will be necessary in our case as there is no plan to preprocess or compile the procedures into executable objects. They will be loaded and executed on demand via the Catalog API.
пт, 10 трав. 2024 р. о 10:37 Mich Talebzadeh <mich.talebza...@gmail.com> пише: > Hi, > > If the underlying table changes (DDL), if I recall from RDBMSs like > Oracle, the stored procedure will be invalidated as it is a compiled > object. How is this going to be handled? Does it follow the same mechanism? > > Thanks > > Mich Talebzadeh, > Technologist | Architect | Data Engineer | Generative AI | FinCrime > London > United Kingdom > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* The information provided is correct to the best of my > knowledge but of course cannot be guaranteed . It is essential to note > that, as with any advice, quote "one test result is worth one-thousand > expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von > Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". > > > On Sat, 20 Apr 2024 at 02:34, Anton Okolnychyi <aokolnyc...@gmail.com> > wrote: > >> Hi folks, >> >> I'd like to start a discussion on SPARK-44167 that aims to enable >> catalogs to expose custom routines as stored procedures. I believe this >> functionality will enhance Spark’s ability to interact with external >> connectors and allow users to perform more operations in plain SQL. >> >> SPIP [1] contains proposed API changes and parser extensions. Any >> feedback is more than welcome! >> >> Unlike the initial proposal for stored procedures with Python [2], this >> one focuses on exposing pre-defined stored procedures via the catalog API. >> This approach is inspired by a similar functionality in Trino and avoids >> the challenges of supporting user-defined routines discussed earlier [3]. >> >> Liang-Chi was kind enough to shepherd this effort. Thanks! >> >> - Anton >> >> [1] - >> https://docs.google.com/document/d/1rDcggNl9YNcBECsfgPcoOecHXYZOu29QYFrloo2lPBg/ >> [2] - >> https://docs.google.com/document/d/1ce2EZrf2BxHu7TjfGn4TgToK3TBYYzRkmsIVcfmkNzE/ >> [3] - https://lists.apache.org/thread/lkjm9r7rx7358xxn2z8yof4wdknpzg3l >> >> >> >>
