Re: Pulling data from a secured SQL database

2015-10-31 Thread Michael Armbrust
I would try using the JDBC Data Source and save the data to parquet . You can then put that data on your Spark cluster (probably

Re: Pulling data from a secured SQL database

2015-10-31 Thread Deenar Toraskar
Thomas I have the same problem, though in my case getting Kerberos authentication to MSSQLServer from the cluster nodes does not seem to be supported. There are a couple of options that come to mind. 1) You can pull the data running sqoop in local mode on the smaller development machines and

RE: Pulling data from a secured SQL database

2015-10-30 Thread Young, Matthew T
workflow. -Original Message- From: Thomas Ginter [mailto:thomas.gin...@utah.edu] Sent: Friday, October 30, 2015 10:49 AM To: user@spark.apache.org Subject: Pulling data from a secured SQL database I am working in an environment where data is stored in MS SQL Server. It has been s

Pulling data from a secured SQL database

2015-10-30 Thread Thomas Ginter
I am working in an environment where data is stored in MS SQL Server. It has been secured so that only a specific set of machines can access the database through an integrated security Microsoft JDBC connection. We also have a couple of beefy linux machines we can use to host a Spark cluster