[ https://issues.apache.org/jira/browse/SPARK-18097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Davies Liu updated SPARK-18097: ------------------------------- Description: When the schema of Hive table is broken, we can't drop the table using Spark SQL, for example {code} Error in SQL statement: QueryExecutionException: FAILED: IllegalArgumentException Error: > expected at the position 10 of 'ss:string:struct<>' but ':' is found. {code} was: When the schema of Hive table is broken, we can't drop the table using Spark SQL, for example {code} Error in SQL statement: QueryExecutionException: FAILED: IllegalArgumentException Error: > expected at the position 4443 of 'struct<AVG_OPTION_CODE:struct<similarity:double,source:string>,AVG_OPTION_DETAIL:struct<similarity:double,source:string>,EXT_COLOR_CODE:struct<similarity:double,source:string>,EXT_COLOR_NAME:struct<similarity:double,source:string>,INT_COLOR_CODE:struct<similarity:double,source:string>,INT_COLOR_NAME:struct<similarity:double,source:string>,OEM_CODE:struct<similarity:double,source:string>,TRIM:struct<similarity:double,source:string>>:struct<DMI_CPO:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,DMI_EDDIRECT:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,DMI_THIRDPARTY:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,DOMINION:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,EBIZAUTOS:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,VAST_HOSTED:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CO:string:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>' but ':' is found. {code} > Can't drop a table from Hive if the schema is corrupt > ----------------------------------------------------- > > Key: SPARK-18097 > URL: https://issues.apache.org/jira/browse/SPARK-18097 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.0.1 > Reporter: Davies Liu > > When the schema of Hive table is broken, we can't drop the table using Spark > SQL, for example > {code} > Error in SQL statement: QueryExecutionException: FAILED: > IllegalArgumentException Error: > expected at the position 10 of > 'ss:string:struct<>' but ':' is found. > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org