[jira] [Commented] (HIVE-9866) Changing a column's type doesn't change column stats type in metastore
[
https://issues.apache.org/jira/browse/HIVE-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358384#comment-14358384
]
Chaoyu Tang commented on HIVE-9866:
---
Patch to HIVE-9720 has been submitted and requested for review. It should
include the fix to this issue reported in this JIRA.
Changing a column's type doesn't change column stats type in metastore
---
Key: HIVE-9866
URL: https://issues.apache.org/jira/browse/HIVE-9866
Project: Hive
Issue Type: Bug
Reporter: Henry Robinson
Assignee: Chaoyu Tang
If I have a table {{at}}, with a column {{id}} of type {{DOUBLE}}, the
metastore will have an entry in {{TAB_COL_STATS}} something like:
{code}
hive_ms= select TABLE_NAME, COLUMN_NAME, COLUMN_TYPE from
TAB_COL_STATS WHERE TBL_ID = 1341 AND COLUMN_NAME = 'id';
TABLE_NAME | COLUMN_NAME | COLUMN_TYPE
+-+-
at | id | DOUBLE
{code}
If in Hive I then do:
{{hive alter table at change column id id int;}}
The {{COLUMN_TYPE}} column does not change in the metastore. This means that
any subsequent attempts to change the column statistics through the metastore
client via {{updateTableColumnStatistics()}} will silently fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9866) Changing a column's type doesn't change column stats type in metastore
[
https://issues.apache.org/jira/browse/HIVE-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350483#comment-14350483
]
Chaoyu Tang commented on HIVE-9866:
---
Thanks [~damien.carol] for the comment. It is also the solution I thought. I am
working on a fix for both this JIRA and HIVE-9720. AlterTable needs also update
the entries in TAB_COL_STATS/PART_COL_STATS.
Changing a column's type doesn't change column stats type in metastore
---
Key: HIVE-9866
URL: https://issues.apache.org/jira/browse/HIVE-9866
Project: Hive
Issue Type: Bug
Reporter: Henry Robinson
Assignee: Chaoyu Tang
If I have a table {{at}}, with a column {{id}} of type {{DOUBLE}}, the
metastore will have an entry in {{TAB_COL_STATS}} something like:
{code}
hive_ms= select TABLE_NAME, COLUMN_NAME, COLUMN_TYPE from
TAB_COL_STATS WHERE TBL_ID = 1341 AND COLUMN_NAME = 'id';
TABLE_NAME | COLUMN_NAME | COLUMN_TYPE
+-+-
at | id | DOUBLE
{code}
If in Hive I then do:
{{hive alter table at change column id id int;}}
The {{COLUMN_TYPE}} column does not change in the metastore. This means that
any subsequent attempts to change the column statistics through the metastore
client via {{updateTableColumnStatistics()}} will silently fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9866) Changing a column's type doesn't change column stats type in metastore
[
https://issues.apache.org/jira/browse/HIVE-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350318#comment-14350318
]
Damien Carol commented on HIVE-9866:
A simple strategy, invalidate the stats for the changed column.
Changing a column's type doesn't change column stats type in metastore
---
Key: HIVE-9866
URL: https://issues.apache.org/jira/browse/HIVE-9866
Project: Hive
Issue Type: Bug
Reporter: Henry Robinson
Assignee: Chaoyu Tang
If I have a table {{at}}, with a column {{id}} of type {{DOUBLE}}, the
metastore will have an entry in {{TAB_COL_STATS}} something like:
{code}
hive_ms= select TABLE_NAME, COLUMN_NAME, COLUMN_TYPE from
TAB_COL_STATS WHERE TBL_ID = 1341 AND COLUMN_NAME = 'id';
TABLE_NAME | COLUMN_NAME | COLUMN_TYPE
+-+-
at | id | DOUBLE
{code}
If in Hive I then do:
{{hive alter table at change column id id int;}}
The {{COLUMN_TYPE}} column does not change in the metastore. This means that
any subsequent attempts to change the column statistics through the metastore
client via {{updateTableColumnStatistics()}} will silently fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
