Hi all,
I'm trying to use dropTempTable() after the respective Temporary Table's
use is over (to free up the memory for next calculations).
Newer Spark Session doesn't need sqlContext, so, it is confusing me on how
to use the function.
1) Tried, same DF which I used to register a temp table to do -
DF.dropTempTable('xyz')
Didn't work.
2) Tried following way too, as spark internally invokes sqlContext too
along with sparkContext, but didn't work -
spark.dropTempTable('xyz')
3) Tried spark.catalog to drop, this failed too -
spark.catalog.dropTempTable('xyz')
What to do? 1.6 examples on internet are not working in the 2.3 version for
dropTempTable().
Thanks,
Aakash.
