Simeon Simeonov created SPARK-9761:
--------------------------------------
Summary: Inconsistent metadata handling with ALTER TABLE
Key: SPARK-9761
URL: https://issues.apache.org/jira/browse/SPARK-9761
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.4.1
Environment: Ubuntu on AWS
Reporter: Simeon Simeonov
Schema changes made with {{ALTER TABLE}} are not shown in {{DESCRIBE TABLE}}.
The table in question was created with {{HiveContext.read.json()}}.
Steps:
# {{alter table dimension_components add columns (z string);}} succeeds.
# {{describe dimension_components;}} does not show the new column, even after
restarting spark-sql.
# A second {{alter table dimension_components add columns (z string);}} fails
with RROR exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException:
Duplicate column name: z
Full spark-sql output
[here|https://gist.github.com/ssimeonov/d9af4b8bb76b9d7befde].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
