Re: Not able to remove header from a text file while creating a data frame .

2017-03-04 Thread KhajaAsmath Mohammed
You have to use below. Include the com.databricks.spark.csv in sbt or maven before doing it. If doing on spark submit, then you need to add as --jars or --packages .. sqlContext.read.format("com.databricks.spark.csv").option("header", "true").option("delimiter",

Not able to remove header from a text file while creating a data frame .

2017-03-04 Thread PSwain
Hi All, I am reading a text file to create a dataframe . While I am trying to exclude header form the text file I am not able r to do it . Now my concern is how to know what all options are there that I can use while reading from a source , I checked the API , there the Arguments in option