Janos Makai created OOZIE-3586:
----------------------------------
Summary: Oozie spark actions using --keytab fail due to duplicate
dist. cache
Key: OOZIE-3586
URL: https://issues.apache.org/jira/browse/OOZIE-3586
Project: Oozie
Issue Type: Bug
Reporter: Janos Makai
Assignee: Janos Makai
In CDH 6.x, on the Hadoop 3 rebase, it is now a failure if items are added
multiple times to the distributed cache. In CDH5, this was a warning. This is
not an issue for most uses, as adding multiple times typically is user error,
but this completely breaks Spark actions with keytabs (--keytab).
Oozie spark actions add everything in the distributed cache of the launcher job
to the distributed cache of the spark job, meaning the keytab is already there,
then the --keytab argument tries to add it again causing the failure [0].
[0]
Caused by: java.lang.IllegalArgumentException: Attempt to add
(.../filename.keytab#filename.keytab) multiple times to the distributed cache.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
