[ 
https://issues.apache.org/jira/browse/HADOOP-7602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095547#comment-13095547
 ] 

Daryn Sharp commented on HADOOP-7602:
-------------------------------------

I was actually working on this same problem...  The issue is {{TokenCache}} is 
attempting to get tokens for a non-server based authority.  
{{buildDTServiceName}} is documented as returning ip:port.  It's only called by 
a {{FileSystem}} to set its token's service.

Having {{buildDTServiceName}} return an empty string to satisfy bad behavior in 
the {{TokenCache}} doesn't feel right.  I'd prefer an exception like {{new 
IllegalArgumentException( uri + "does not have a server-based authority)}} to 
guard against accidental invocation in the future.

Then back in {{TokenCache.obtainTokensForNamenodesInternal}}, add:
{code}
if (fs.getUri().getAuthority() == null) continue;
{code}
Otherwise the empty string would cause it to go through the machinations of 
trying to get a token.

(Note: the need for this check should soon go away because the fixing of token 
renewal causes the {{TokenCache}} to only request tokens for a {{FileSystem}} 
that implements tokens)


> wordcount, sort etc on har files fails with NPE
> -----------------------------------------------
>
>                 Key: HADOOP-7602
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7602
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0, 0.20.206.0
>            Reporter: John George
>            Assignee: John George
>             Fix For: 0.20.205.0
>
>         Attachments: hadoop-7602.patch
>
>
> wordcount, sort etc on har files fails with 
> NPE@createSocketAddr(NetUtils.java:137). 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to