[ https://issues.apache.org/jira/browse/HIVE-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vaibhav Gumashta updated HIVE-13776: ------------------------------------ Description: We're seeing msck repair fail randomly for a directory layout like this: {code} /table/timestamp=2015-05-01 /table/timestamp=2015-05-01/type=open /table/timestamp=2015-05-01/type=open/num=1/file-1 /table/timestamp=2015-05-01/type=open/num=1/file-2 {code} The table is partitioned by timestamp (date), type (string) and num (integer). Running MCSK repair succeeds for some files, but intermittently throws an exception like this: {code} MetaException(message:Expected 1 components, got 3 (timestamp=2015-05-01/type=open/num=1)) {code} Appears that there is a bug in DDLTask.mcsk (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832). was: We're seeing msck repair fail randomly for a directory layout like this: {code} /table/timestamp=2015-05-01 /table/timestamp=2015-05-01/type=open /table/timestamp=2015-05-01/type=open/num=1/file-1 /table/timestamp=2015-05-01/type=open/num=1/file-2 {code} The table is partitioned by timestamp (date), type (string) and num (integer). Running MCSK repair succeeds for some files, but intermittently throws an exception like this: {code} MCSK repair fails for some tables with MetaException(message:Expected 1 components, got 3 (timestamp=2015-05-01/type=open/num=1)) {code} Appears that there is a bug in DDLTask.mcsk (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832). > MCSK repair fails for some tables with MetaException(message:Expected 1 > components, got 3 (timestamp=2015-05-01/type=open/num=1)) > --------------------------------------------------------------------------------------------------------------------------------- > > Key: HIVE-13776 > URL: https://issues.apache.org/jira/browse/HIVE-13776 > Project: Hive > Issue Type: Bug > Affects Versions: 1.2.1 > Reporter: Vaibhav Gumashta > > We're seeing msck repair fail randomly for a directory layout like this: > {code} > /table/timestamp=2015-05-01 > /table/timestamp=2015-05-01/type=open > /table/timestamp=2015-05-01/type=open/num=1/file-1 > /table/timestamp=2015-05-01/type=open/num=1/file-2 > {code} > The table is partitioned by timestamp (date), type (string) and num > (integer). Running MCSK repair succeeds for some files, but intermittently > throws an exception like this: > {code} > MetaException(message:Expected 1 components, got 3 > (timestamp=2015-05-01/type=open/num=1)) > {code} > Appears that there is a bug in DDLTask.mcsk > (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832). -- This message was sent by Atlassian JIRA (v6.3.4#6332)