[ https://issues.apache.org/jira/browse/OOZIE-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054891#comment-17054891 ]
Hadoop QA commented on OOZIE-3586: ---------------------------------- PreCommit-OOZIE-Build started > Oozie spark actions using --keytab fail due to duplicate dist. cache > -------------------------------------------------------------------- > > Key: OOZIE-3586 > URL: https://issues.apache.org/jira/browse/OOZIE-3586 > Project: Oozie > Issue Type: Bug > Reporter: Janos Makai > Assignee: Janos Makai > Priority: Major > Attachments: OOZIE-3586-001.patch, OOZIE-3586-002.patch, > OOZIE-3586-003.patch > > > In CDH 6.x, on the Hadoop 3 rebase, it is now a failure if items are added > multiple times to the distributed cache. In CDH5, this was a warning. This is > not an issue for most uses, as adding multiple times typically is user error, > but this completely breaks Spark actions with keytabs (--keytab). > Oozie spark actions add everything in the distributed cache of the launcher > job to the distributed cache of the spark job, meaning the keytab is already > there, then the --keytab argument tries to add it again causing the failure > [0]. > [0] > Caused by: java.lang.IllegalArgumentException: Attempt to add > (.../filename.keytab#filename.keytab) multiple times to the distributed cache. -- This message was sent by Atlassian Jira (v8.3.4#803005)