+1 we should have this .. a lot of other projects and DBMSes have this too, and we currently don't have a way to handle them within Apache Spark.
Disclaimer: I am the shepherd of this SPIP. On Thu, 31 Aug 2023 at 09:31, Allison Wang <allison.w...@databricks.com.invalid> wrote: > Hi Mich, > > I've updated the permissions on the document. Please feel free to leave > comments. > Thanks, > Allison > > On Wed, Aug 30, 2023 at 3:44 PM Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > >> Hi, >> >> Great. Please allow edit access on SPIP or ability to comment. >> >> Thanks >> >> Mich Talebzadeh, >> Distinguished Technologist, Solutions Architect & Engineer >> London >> United Kingdom >> >> >> view my Linkedin profile >> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >> >> >> https://en.everybodywiki.com/Mich_Talebzadeh >> >> >> >> *Disclaimer:* Use it at your own risk. Any and all responsibility for >> any loss, damage or destruction of data or any other property which may >> arise from relying on this email's technical content is explicitly >> disclaimed. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> >> On Wed, 30 Aug 2023 at 23:29, Allison Wang >> <allison.w...@databricks.com.invalid> wrote: >> >>> Hi all, >>> >>> I would like to start a discussion on “Python Stored Procedures". >>> >>> This proposal aims to extend Spark SQL by introducing support for stored >>> procedures, starting with Python as the procedural language. This will >>> enable users to run complex logic using Python within their SQL workflows >>> and save these routines in catalogs like HMS for future use. >>> >>> *SPIP*: >>> https://docs.google.com/document/d/1ce2EZrf2BxHu7TjfGn4TgToK3TBYYzRkmsIVcfmkNzE/edit?usp=sharing >>> *JIRA*: https://issues.apache.org/jira/browse/SPARK-45023 >>> >>> Looking forward to your feedback! >>> >>> Thanks, >>> Allison >>> >>>