[
https://issues.apache.org/jira/browse/HIVE-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vaibhav Gumashta updated HIVE-13776:
------------------------------------
Description:
We're seeing msck repair fail randomly for a directory layout like this:
{code}
/table/timestamp=2015-05-01
/table/timestamp=2015-05-01/type=open
/table/timestamp=2015-05-01/type=open/num=1/file-1
/table/timestamp=2015-05-01/type=open/num=1/file-2
{code}
The table is partitioned by timestamp (date), type (string) and num (integer).
Running MCSK repair succeeds for some files, but intermittently throws an
exception like this:
{code}
MetaException(message:Expected 1 components, got 3
(timestamp=2015-05-01/type=open/num=1))
{code}
Appears that there is a bug in DDLTask.mcsk
(https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832).
was:
We're seeing msck repair fail randomly for a directory layout like this:
{code}
/table/timestamp=2015-05-01
/table/timestamp=2015-05-01/type=open
/table/timestamp=2015-05-01/type=open/num=1/file-1
/table/timestamp=2015-05-01/type=open/num=1/file-2
{code}
The table is partitioned by timestamp (date), type (string) and num (integer).
Running MCSK repair succeeds for some files, but intermittently throws an
exception like this:
{code}
MCSK repair fails for some tables with MetaException(message:Expected 1
components, got 3 (timestamp=2015-05-01/type=open/num=1))
{code}
Appears that there is a bug in DDLTask.mcsk
(https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832).
> MCSK repair fails for some tables with MetaException(message:Expected 1
> components, got 3 (timestamp=2015-05-01/type=open/num=1))
> ---------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-13776
> URL: https://issues.apache.org/jira/browse/HIVE-13776
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.2.1
> Reporter: Vaibhav Gumashta
>
> We're seeing msck repair fail randomly for a directory layout like this:
> {code}
> /table/timestamp=2015-05-01
> /table/timestamp=2015-05-01/type=open
> /table/timestamp=2015-05-01/type=open/num=1/file-1
> /table/timestamp=2015-05-01/type=open/num=1/file-2
> {code}
> The table is partitioned by timestamp (date), type (string) and num
> (integer). Running MCSK repair succeeds for some files, but intermittently
> throws an exception like this:
> {code}
> MetaException(message:Expected 1 components, got 3
> (timestamp=2015-05-01/type=open/num=1))
> {code}
> Appears that there is a bug in DDLTask.mcsk
> (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
