[
https://issues.apache.org/jira/browse/FALCON-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158541#comment-14158541
]
Venkatesh Seetharam commented on FALCON-668:
--------------------------------------------
I tested it but all replication jobs fail:
{code}
<java xmlns="uri:oozie:workflow:0.3">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<configuration>
<property>
<name>oozie.launcher.mapreduce.job.user.classpath.first</name>
<value>true</value>
</property>
<property>
<name>mapred.job.queue.name</name>
<value>${queueName}</value>
</property>
<property>
<name>oozie.launcher.mapred.job.priority</name>
<value>${jobPriority}</value>
</property>
<property>
<name>oozie.action.sharelib.for.java</name>
<value>distcp</value>
</property>
</configuration>
<main-class>org.apache.falcon.replication.FeedReplicator</main-class>
<arg>-Dfalcon.include.path=${sourceRelativePaths}</arg>
<arg>-Dmapred.job.queue.name=${queueName}</arg>
<arg>-Dmapred.job.priority=${jobPriority}</arg>
<arg>-maxMaps</arg>
<arg>${maxMaps}</arg>
<arg>-mapBandwidthKB</arg>
<arg>${mapBandwidthKB}</arg>
<arg>-sourcePaths</arg>
<arg>${distcpSourcePaths}</arg>
<arg>-targetPath</arg>
<arg>${distcpTargetPaths}</arg>
<arg>-falconFeedStorageType</arg>
<arg>${falconFeedStorageType}</arg>
<arg>-overwrite</arg>
<arg>${overwrite}</arg>
<arg>-ignoreErrors</arg>
<arg>${ignoreErrors}</arg>
<arg>-skipChecksum</arg>
<arg>${skipChecksum}</arg>
<arg>-removeDeletedFiles</arg>
<arg>${removeDeletedFiles}</arg>
<arg>-preserveBlockSize</arg>
<arg>${preserveBlockSize}</arg>
<arg>-preserveReplicationCount</arg>
<arg>${preserveReplicationCount}</arg>
<arg>-preservePermissions</arg>
<arg>${preservePermissions}</arg>
</java>
{code}
EL_ERROR: variable [overwrite] cannot be resolved
> FeedReplicator improvement to include more DistCP options
> ----------------------------------------------------------
>
> Key: FALCON-668
> URL: https://issues.apache.org/jira/browse/FALCON-668
> Project: Falcon
> Issue Type: Bug
> Components: replication
> Reporter: Sowmya Ramesh
> Assignee: Sowmya Ramesh
> Fix For: 0.6
>
> Attachments: FALCON-668.patch, FALCON-668.v1.patch,
> FALCON-668.v2.patch
>
>
> FeedReplicator improvement to include more DistCP options listed below
> * overwrite
> * ignore errors
> * skip checksum
> * remove deleted files
> * preserve block size
> * preserve replication count
> * preserve permissions
> Also currently in FeedReplicator FEED_STORAGETYPE is used to determine usage
> of custom replicator and need to do post processing.
> Instead falcon.include.path should be used. If falcon.include.path is set
> then use custom replicator and do post processing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
