Shahrukh created MAPREDUCE-7345:
-----------------------------------
Summary: SnapshotDiff not showing correct report
Key: MAPREDUCE-7345
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7345
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 3.1.1
Environment: We are using HDP 3.1.0.0-78
Reporter: Shahrukh
Attachments: image2021-4-26_17-7-53.png, image2021-4-26_17-9-14.png
We are doing incremental backup of hive tables using distcp -diff on the basis
of two snapshots.
But sometimes this distcp is failing with error that particular file is not
present in snapshots source directory.
When we do Snapshodiff between two snapshots, it shows some of the files are
added
but when we do 'hdfs dfs -ls' for these files on snapshot folders. it shows
file not present.
We suspect
* its issue with Snapshotdiff.
* or related hive compaction, as we get error only for hive delta/base files.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
