DataFrame view stores the logical plan, while SQL view stores SQL text. I don't think we can support this feature until we have a reliable way to materialize logical plans.
On Sun, Jun 4, 2023 at 10:31 PM Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Try sending it to d...@spark.apache.org (and join that group) > > You need to raise a JIRA for this request plus related doc related > > > Example JIRA > > https://issues.apache.org/jira/browse/SPARK-42485 > > and the related *Spark project improvement proposals (SPIP) *to be filled > in > > https://spark.apache.org/improvement-proposals.html > > > HTH > > > Mich Talebzadeh, > Lead Solutions Architect/Engineering Lead > Palantir Technologies Limited > London > United Kingdom > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Sun, 4 Jun 2023 at 12:38, keen <kee...@gmx.net> wrote: > >> Do Spark **devs** read this mailing list? >> Is there another/a better way to make feature requests? >> I tried in the past to write a mail to the dev mailing list but it did >> not show at all. >> >> Cheers >> >> keen <kee...@gmx.net> schrieb am Do., 1. Juni 2023, 07:11: >> >>> Hi all, >>> currently only *temporary* Spark Views can be created from a DataFrame >>> (df.createOrReplaceTempView or df.createOrReplaceGlobalTempView). >>> >>> When I want a *permanent* Spark View I need to specify it via Spark SQL >>> (CREATE VIEW AS SELECT ...). >>> >>> Sometimes it is easier to specify the desired logic of the View through >>> Spark/PySpark DataFrame API. >>> Therefore, I'd like to suggest to implement a new PySpark method that >>> allows creating a *permanent* Spark View from a DataFrame >>> (df.createOrReplaceView). >>> >>> see also: >>> >>> https://community.databricks.com/s/question/0D53f00001PANVgCAP/is-there-a-way-to-create-a-nontemporary-spark-view-with-pyspark >>> >>> Regards >>> Martin >>> >>
