Simeon Simeonov created SPARK-9761: -------------------------------------- Summary: Inconsistent metadata handling with ALTER TABLE Key: SPARK-9761 URL: https://issues.apache.org/jira/browse/SPARK-9761 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.4.1 Environment: Ubuntu on AWS Reporter: Simeon Simeonov
Schema changes made with {{ALTER TABLE}} are not shown in {{DESCRIBE TABLE}}. The table in question was created with {{HiveContext.read.json()}}. Steps: # {{alter table dimension_components add columns (z string);}} succeeds. # {{describe dimension_components;}} does not show the new column, even after restarting spark-sql. # A second {{alter table dimension_components add columns (z string);}} fails with RROR exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: Duplicate column name: z Full spark-sql output [here|https://gist.github.com/ssimeonov/d9af4b8bb76b9d7befde]. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org