Re: CSV empty columns handling in Spark 2.0.2

I think this is fixed in https://github.com/apache/spark/pull/15767 This should be fixed in 2.1.0. 2017-03-17 3:28 GMT+09:00 George Obama : > Hello, > > > > I am using spark 2.0.2 to read the CSV file with empty columns and is > hitting the issue: > > scala>val df =

CSV empty columns handling in Spark 2.0.2

Hello, I am using spark 2.0.2 to read the CSV file with empty columns and is hitting the issue: scala>val df = sqlContext.read.option("header", true).option("inferSchema", true).csv("file location") 17/03/13 07:26:26 WARN DataSource: Error while looking for metadata directory. scala>