[ 
https://issues.apache.org/jira/browse/SAMZA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056404#comment-15056404
 ] 

Chen Song commented on SAMZA-727:
---------------------------------

I have successfully run this on our kerberized cluster for weeks. So far 
everything is good, except for the following:

The current limitation only requests a HDFS delegation token at the start of 
the job submission. Since the delegation token will be expired after 7 days, it 
will have one limitation.

* If the job needs interactions with HDFS (read or write) after 7 days, it may 
fail.
* If there are tasks failed after 7 days, the AM may not be able to launch new 
containers because of expired HDFS token.

So we can either
* Go ahead and merge this one, and address the above later
* Hold off and investigate options for the above one (we can use the approach 
using static keytab files, like what Slider uses)

> Support for Kerberos
> --------------------
>
>                 Key: SAMZA-727
>                 URL: https://issues.apache.org/jira/browse/SAMZA-727
>             Project: Samza
>          Issue Type: New Feature
>          Components: yarn
>    Affects Versions: 0.9.0
>         Environment: YARN with Kerberos
>            Reporter: Qi FU
>            Assignee: Chen Song
>         Attachments: SAMZA-727.patch
>
>
> Samza doesn't support Kerberos, which is very common for YARN cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to