Sean,

The method name is very clear "createOrReplaceTempView"  doesn't make any
sense to throw an exception because this view already exists. Spark 3.2.x
is breaking back compatibility with no reason or sense.


On Mon, Dec 13, 2021 at 12:53 PM Sean Owen <sro...@gmail.com> wrote:

> The error looks 'valid' - you define a temp view in terms of its own
> previous version, which doesn't quite make sense - somewhere the new
> definition depends on the old definition. I think it just correctly
> surfaces as an error now,.
>
> On Mon, Dec 13, 2021 at 9:41 AM Daniel de Oliveira Mantovani <
> daniel.oliveira.mantov...@gmail.com> wrote:
>
>> Hello team,
>>
>> I've found this issue while I was porting my project from Apache Spark
>> 3.1.x to 3.2.x.
>>
>>
>> https://stackoverflow.com/questions/69937415/spark-3-2-0-the-different-dataframe-createorreplacetempview-the-same-name-tempvi
>>
>> Do we have a bug for that in apache-spark or I need to create one ?
>>
>> Thank you so much
>>
>> [info] com.github.music.of.the.ainur.almaren.Test *** ABORTED ***
>> [info]   org.apache.spark.sql.AnalysisException: Recursive view
>> `__TABLE__` detected (cycle: `__TABLE__` -> `__TABLE__`)
>> [info]   at
>> org.apache.spark.sql.errors.QueryCompilationErrors$.recursiveViewDetectedError(QueryCompilationErrors.scala:2045)
>> [info]   at
>> org.apache.spark.sql.execution.command.ViewHelper$.checkCyclicViewReference(views.scala:515)
>> [info]   at
>> org.apache.spark.sql.execution.command.ViewHelper$.$anonfun$checkCyclicViewReference$2(views.scala:522)
>> [info]   at
>> org.apache.spark.sql.execution.command.ViewHelper$.$anonfun$checkCyclicViewReference$2$adapted(views.scala:522)
>> [info]   at scala.collection.Iterator.foreach(Iterator.scala:941)
>> [info]   at scala.collection.Iterator.foreach$(Iterator.scala:941)
>> [info]   at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
>> [info]   at scala.collection.IterableLike.foreach(IterableLike.scala:74)
>> [info]   at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
>> [info]   at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
>>
>> --
>>
>> --
>> Daniel Mantovani
>>
>>

-- 

--
Daniel Mantovani

Reply via email to