[ 
https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242045#comment-14242045
 ] 

Prasanth Jayachandran commented on HIVE-9076:
---------------------------------------------

[~navis] Log file should tell what files are renamed, moved and merged. Would 
it be possible to get the logs from OrcFileMergeOperator, 
AbstractFileMergeOperator and MergeFileMapper?

> incompatFileSet in AbstractFileMergeOperator should be marked to skip task id 
> check
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-9076
>                 URL: https://issues.apache.org/jira/browse/HIVE-9076
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> In some file composition, AbstractFileMergeOperator removes incompatible 
> files. For example,
> {noformat}
> 000000_0 (v12)
> 000000_0_copy_1 (v12)
> 000000_1 (v11)
> 000000_1_copy_1 (v11)
> 000000_1_copy_2 (v11)
> 000000_2 (v12)
> {noformat}
> 000000_1 (v11) will be removed because 000000 is assigned to new merged file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to