Re: Spark SQL: org.apache.spark.sql.AnalysisException: cannot resolve "some columns" given input columns.

Please see: [SPARK-13953][SQL] Specifying the field name for corrupted record via option at JSON datasource FYI On Tue, Jun 7, 2016 at 10:18 AM, Jerry Wong wrote: > Hi, > > Two JSON files but one of them miss some columns, like > > {"firstName": "Jack", "lastName":

Spark SQL: org.apache.spark.sql.AnalysisException: cannot resolve "some columns" given input columns.

Hi, Two JSON files but one of them miss some columns, like {"firstName": "Jack", "lastName": "Nelson"} {"firstName": "Landy", "middleName": "Ken", "lastName": "Yong"} slqContext.sql("select firstName as first_name, middleName as middle_name, lastName as last_name from jsonTable) But there are