RE: Run SQL on files directly

Thanks Subhash I am familiar with the other APIs but I am curios about this specific one and I could not figure it out from the git repository. Best regards, David (דודו) Markovitz Technology Solutions Professional, Data Platform Microsoft Israel Mobile: +972-525-834-304 Office:

Re: Run SQL on files directly

Hi David, I’m not sure if that is possible, but why not just read the CSV file using the Scala API, specifying those options, and then query it using SQL by creating a temp view? Thanks, Subhash Sent from my iPhone > On Dec 8, 2018, at 12:39 PM, David Markovitz > wrote: > > Hi > Spark

Run SQL on files directly

Hi Spark SQL supports direct querying on files (here), e.g. – select * from csv.`/my/path/myfile.csv` Does anybody know if it possible to pass options (sep, header, encoding etc.) with