Sandeep Devaiah created GOBBLIN-1286:
----------------------------------------

             Summary: Support fetching multiple DFS tokens for HDFS Federation
                 Key: GOBBLIN-1286
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1286
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: misc
            Reporter: Sandeep Devaiah


Currently org.apache.gobblin.util.hadoop.TokenUtils#getHdfsToken adds the 
DistributedFileSystem's delegation token to the Credential's object. However, 
if the DFS is federated, then only one token for the primary name node is 
fetched and tokens for child namenodes are not fetched.

Hence this method needs to be updated to use 
org.apache.hadoop.fs.FileSystem#addDelegationTokens instead of 
org.apache.hadoop.fs.FileSystem#getDelegationTokens which automatically fetches 
the delegation tokens for all child FS as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to