Re: Spark Thrift Server - Skip header when load data from local file

2017-02-14 Thread ayan guha
I doubt you can do that. Create a staging table and then insert into main table after filtering the header On Wed, 15 Feb 2017 at 4:01 pm, kumar r wrote: > Hi, > > I want to load data from csv file to Spark table using Spark thrift > server. When i load, header(first line)

Spark Thrift Server - Skip header when load data from local file

2017-02-14 Thread kumar r
Hi, I want to load data from csv file to Spark table using Spark thrift server. When i load, header(first line) should be ignored. I have used tblproperties("skip.header.line.count"="1") option. But its not working and first line also included. Below is spark sql query i have tried. create