[
https://issues.apache.org/jira/browse/HIVE-29799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18102388#comment-18102388
]
László Bodor commented on HIVE-29799:
-------------------------------------
finally decided to fix this in HIVE-29798, as both of these are related to
union file layout to acid conversion
> Table containing flattened union files cannot be converted to ACID
> ------------------------------------------------------------------
>
> Key: HIVE-29799
> URL: https://issues.apache.org/jira/browse/HIVE-29799
> Project: Hive
> Issue Type: Bug
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Labels: pull-request-available
>
> Discovered while testing HIVE-29798, see in PR:
> https://github.com/apache/hive/pull/6675
> MoveTask.flattenUnionSubdirectories produces <index>_000000_0 files (three
> numeric parts) which don't match the metastore's ORIGINAL_PATTERN
> ([0-9]+_[0-9]+), so a subsequent ACID conversion is rejected by
> TransactionalValidationListener.validateTableStructureForPath with
> "Unexpected data file name format". The tests assert exactly that failure and
> include a comment pointing at what should change to make them assert
> successful conversion instead.
> 1. Reconsider the file format after flattening
> 2. Prepare ACID format patterns to consume these files: 1_000000_0,
> 2_000000_0 f, 3_000000_0 ...
> I would go for 1) first, then worst case 2)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
