Re: difference between dataframe and dataframwrite

I believe it depends on your Spark application. To write to Hive, use dataframe.saveAsTable To write to S3, use dataframe.write.parquet(“s3://”) Hope this helps. Richard > On Jun 16, 2016, at 9:54 AM, Natu Lauchande wrote: > > Does

RE: difference between dataframe and dataframwrite

Hi Does anyone know wich one aws emr uses by default? Thanks, Natu On Jun 16, 2016 5:12 PM, "David Newberger" wrote: > DataFrame is a collection of data which is organized into named columns. > > DataFrame.write is an interface for saving the contents of a

RE: difference between dataframe and dataframwrite

DataFrame is a collection of data which is organized into named columns. DataFrame.write is an interface for saving the contents of a DataFrame to external storage. Hope this helps David Newberger From: pseudo oduesp [mailto:pseudo20...@gmail.com] Sent: Thursday, June 16, 2016 9:43 AM To: