I believe it depends on your Spark application.
To write to Hive, use
dataframe.saveAsTable
To write to S3, use
dataframe.write.parquet(“s3://”)
Hope this helps.
Richard
> On Jun 16, 2016, at 9:54 AM, Natu Lauchande wrote:
>
> Does
Hi
Does anyone know wich one aws emr uses by default?
Thanks,
Natu
On Jun 16, 2016 5:12 PM, "David Newberger"
wrote:
> DataFrame is a collection of data which is organized into named columns.
>
> DataFrame.write is an interface for saving the contents of a DataFrame to
> external storage.
>
>
>
DataFrame is a collection of data which is organized into named columns.
DataFrame.write is an interface for saving the contents of a DataFrame to
external storage.
Hope this helps
David Newberger
From: pseudo oduesp [mailto:pseudo20...@gmail.com]
Sent: Thursday, June 16, 2016 9:43 AM
To: user
