[
https://issues.apache.org/jira/browse/HIVE-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan updated HIVE-16898:
------------------------------------
Attachment: HIVE-16898.8.patch
Added 8.patch with below changes.
- Rebased against master
- Fixed the bugs in handling for FileNotFoundException flow after distCp.
- Some code clean-up.
Request [~thejas], [~anishek] to please review the same.
cc [~daijy]
> Validation of source file after distcp in repl load
> ----------------------------------------------------
>
> Key: HIVE-16898
> URL: https://issues.apache.org/jira/browse/HIVE-16898
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.0.0
> Reporter: anishek
> Assignee: Sankar Hariappan
> Fix For: 3.0.0
>
> Attachments: HIVE-16898.1.patch, HIVE-16898.2.patch,
> HIVE-16898.3.patch, HIVE-16898.4.patch, HIVE-16898.5.patch,
> HIVE-16898.6.patch, HIVE-16898.7.patch, HIVE-16898.8.patch
>
>
> time between deciding the source and destination path for distcp to invoking
> of distcp can have a change of the source file, hence distcp might copy the
> wrong file to destination, hence we should an additional check on the
> checksum of the source file path after distcp finishes to make sure the path
> didnot change during the copy process. if it has take additional steps to
> delete the previous file on destination and copy the new source and repeat
> the same process as above till we copy the correct file.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
