RE: Spark and SQL Server

2015-07-20 Thread Young, Matthew T
Liu [dav...@databricks.com] Sent: Monday, July 20, 2015 9:08 AM To: Young, Matthew T Cc: user@spark.apache.org Subject: Re: Spark and SQL Server Sorry for the confusing. What's the other issues? On Mon, Jul 20, 2015 at 8:26 AM, Young, Matthew T matthew.t.yo...@intel.com wrote: Thanks Davies

RE: Spark and SQL Server

2015-07-20 Thread Young, Matthew T
/pyspark.sql.html#pyspark.sql.DataFrameWriter. I will keep this distinction in mind going forward. I guess we have to wait for Microsoft to release an SQL Server connector for Spark to resolve the other issues. Cheers, -- Matthew Young From: Davies Liu [dav

Re: Spark and SQL Server

2015-07-20 Thread Davies Liu
connector for Spark to resolve the other issues. Cheers, -- Matthew Young From: Davies Liu [dav...@databricks.com] Sent: Saturday, July 18, 2015 12:45 AM To: Young, Matthew T Cc: user@spark.apache.org Subject: Re: Spark and SQL Server I think you have

Re: Spark and SQL Server

2015-07-18 Thread Davies Liu
I think you have a mistake on call jdbc(), it should be: jdbc(self, url, table, mode, properties) You had use properties as the third parameter. On Fri, Jul 17, 2015 at 10:15 AM, Young, Matthew T matthew.t.yo...@intel.com wrote: Hello, I am testing Spark interoperation with SQL Server via

Spark and SQL Server

2015-07-17 Thread Young, Matthew T
Hello, I am testing Spark interoperation with SQL Server via JDBC with Microsoft’s 4.2 JDBC Driver. Reading from the database works ok, but I have encountered a couple of issues writing back. In Scala 2.10 I can write back to the database except for a couple of types. 1. When I read