[
https://issues.apache.org/jira/browse/MAPREDUCE-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13653557#comment-13653557
]
Siddharth Seth commented on MAPREDUCE-5217:
-------------------------------------------
Alejandro, does Oozie work on secure clusters with both branch-1 and branch-2 ?
Looking at the code, it looks like branch-2 will work - since credentials are
copied over from the current ugi by the Job class in branch-2 (Job(JobConf
conf)). However, branch-1 is missing this code.
I'm in favour of committing this to branch-1, rather than making changes to
branch-1 client code - since there's a reasonable difference between the client
code on the two branches, and this isn't necessarily the correct behaviour - if
Jobs are trying to control their token set. Will create a separate jira for
this.
> DistCp fails when launched by Oozie in a secure cluster
> -------------------------------------------------------
>
> Key: MAPREDUCE-5217
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5217
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp, security
> Affects Versions: trunk, 1.1.2, 2.0.4-alpha
> Environment: Hadoop secure cluster
> Reporter: Venkat Ranganathan
> Assignee: Venkat Ranganathan
> Attachments: MAPREDUCE-5217-branch-1.patch,
> MAPREDUCE-5217-branch-1.patch.2, MAPREDUCE-5217-branch-1.patch.3,
> MAPREDUCE-5217-trunk.patch, MAPREDUCE-5217-trunk.patch,
> MAPREDUCE-5217-trunk.patch.2, MAPREDUCE-5217-trunk.patch.3
>
>
> As mentioned in MAPREDUCE-4324, Oozie has the following boilerplate code in
> in the main launcher for Pig, Hive, MR and Sqoop actions.
> if (System.getenv("HADOOP_TOKEN_FILE_LOCATION") != null) {
> jobConf.set("mapreduce.job.credentials.binary",
> System.getenv("HADOOP_TOKEN_FILE_LOCATION"));
> }
> For Java action, which does not have a main launcher in oozie, the above
> codecan be added by the user as the user purportedly has the code that is
> launched.
> But for DistCp action, the user has no such luxury. The solution attempted in
> MAPREDUCE-4324 would have helped DistCp, but it was not implemented as it
> would break MAPREDUCE-3727. So, we have to fix DistCp and
> add the same boilerplate code so that DistCp action can be launched by Oozie
> in a secure cluster.
> The code added checks for an System env. variable to be set which is not
> typically set in normal command line execution of DistCp, DistCp runs fine
> with commnad line usage both in secure and non-secure cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
