Re: 2.0.0: AnalysisException when reading csv/json files with dots in periods

2016-08-05 Thread Kiran Chitturi
Nevermind, there is already a Jira open for this https://issues.apache.org/jira/browse/SPARK-16698 On Fri, Aug 5, 2016 at 5:33 PM, Kiran Chitturi < kiran.chitt...@lucidworks.com> wrote: > Hi, > > During our upgrade to 2.0.0, we found this issue with one of our failing > tests. > > Any csv/json

2.0.0: AnalysisException when reading csv/json files with dots in periods

2016-08-05 Thread Kiran Chitturi
Hi, During our upgrade to 2.0.0, we found this issue with one of our failing tests. Any csv/json files that contains field names with dots are unreadable using DataFrames. My sample csv file: flag_s,params.url_s > test,http://www.google.com In spark-shell, I ran the following code: scala>