Re: Spark2 DataFrameWriter.saveAsTable defaults to external table if path is provided

2019-02-13 Thread Horváth Péter Gergely
t; an insert? > > Alternatively try create table as select. Iirc hive creates managed tables > this way. > > I've not confirmed this works but I think that might be worth trying. > > I hope that helps. > > Kind regards > Chris > > On Wed., 13 Feb. 2019, 10:44 pm Horváth Pé

Spark2 DataFrameWriter.saveAsTable defaults to external table if path is provided

2019-02-13 Thread Horváth Péter Gergely
Dear All, I am facing a strange issue with Spark 2.3, where I would like to create a MANAGED table out of the content of a DataFrame with the storage path overridden. Apparently, when one tries to create a Hive table via DataFrameWriter.saveAsTable, supplying a "path" option causes Spark to