Re: JDBC Dialect for saving DataFrame into Vertica Table

2016-05-27 Thread Aaron Ilovici
PM To: Mohammed Guller <moham...@glassbeam.com> Cc: Aaron Ilovici <ailov...@wayfair.com>, "user@spark.apache.org" <user@spark.apache.org>, "d...@spark.apache.org" <d...@spark.apache.org> Subject: Re: JDBC Dialect for saving DataFrame into Vertica Table

Re: JDBC Dialect for saving DataFrame into Vertica Table

2016-05-26 Thread Reynold Xin
Data Analytics with Spark > <http://www.amazon.com/Big-Data-Analytics-Spark-Practitioners/dp/1484209656/> > > > > *From:* Aaron Ilovici [mailto:ailov...@wayfair.com] > *Sent:* Thursday, May 26, 2016 8:08 AM > *To:* user@spark.apache.org; d...@spark.apache.org > *Subject:*

RE: JDBC Dialect for saving DataFrame into Vertica Table

2016-05-26 Thread Mohammed Guller
ics-Spark-Practitioners/dp/1484209656/> From: Aaron Ilovici [mailto:ailov...@wayfair.com] Sent: Thursday, May 26, 2016 8:08 AM To: user@spark.apache.org; d...@spark.apache.org Subject: JDBC Dialect for saving DataFrame into Vertica Table I am attempting to write a DataFrame of Rows to Verti

JDBC Dialect for saving DataFrame into Vertica Table

2016-05-26 Thread Aaron Ilovici
I am attempting to write a DataFrame of Rows to Vertica via DataFrameWriter's jdbc function in the following manner: dataframe.write().mode(SaveMode.Append).jdbc(url, table, properties); This works when there are no NULL values in any of the Rows in my DataFrame. However, when there are rows,