Balu Vellanki created FALCON-2029:
-------------------------------------
Summary: HDFS-8828 requires Falcon to update Snapshot based
mirroring extension
Key: FALCON-2029
URL: https://issues.apache.org/jira/browse/FALCON-2029
Project: Falcon
Issue Type: Bug
Affects Versions: 0.10
Reporter: Balu Vellanki
Assignee: Balu Vellanki
Priority: Critical
Fix For: trunk, 0.10
HDFS-8828 has introduced the following backward incompatible behavior in Hadoop
2.8.0 (as yet unreleased version). "-delete" option in snapshot based distcp
is invalid. Distcp utilizes the snapshot diff report to build diff copy list,
if Falcon provides the "-delete" option an exception will be thrown unless the
method DistCpOptions.validate() is called before running distcp execute method.
Where as in Hadoop 2.7.*, Falcon is required to provide "-delete" option for
snapshot based distcp.
HDFS snapshot based mirroring extension provided as part of Falcon 0.10 release
(and trunk) is supposed to work with Hadoop 2.7.1 and above. To make the code
work with both 2.7.*, 2.8.* and future versions, Falcon should call the
validate method on distcp options. If the method does not exist (in 2.7.1),
Falcon should catch the exception and proceed with distCp.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
