[ 
https://issues.apache.org/jira/browse/KNOX-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260176#comment-14260176
 ] 

Kevin Minder commented on KNOX-482:
-----------------------------------

Attached is the patch containing the changes (ie hacks) I made to get DistCp to 
work in secure mode via Knox.  So many things that need real solutions here...  
Also attached the relevant config files for reference. 

The one especially weird thing is this in core-site.xml which was required to 
allow Knox to participate in a delegation token exchanges between the YARN 
ResourceManager and HDFS.  I'm not sure how acceptable this will be in the 
field.

    <property>
      <name>hadoop.proxyuser.knox.groups</name>
      <value>users,hadoop</value>
    </property>


The change in HadoopAuthPostFilter is probably a valid one in that it insures 
the full Kerberos principal (e.g. 
ambari-qa/[email protected]) is used when present.

There are two really bad hacks in the patch.

    In WebHdfsDepoymentContributor, the filter chain for the DN URLs has all 
but the rewrite and dispatch providers removed.  This assumes that the DN will 
protect itself by requiring a block access tokens.  Of special concern would be 
what this means for DN UI URLs.
    For access to NN if there is a delegation token the token itself is used as 
the principal.  This will certainly cause issues for down stream processing 
that assumes that this will be a real user principal.
        In IdentityAsserterHttpServletRequestWrapper if there is a delegation 
token that is used as the actual principal name. 
        In HadoopAuthFilter, if there is a delegation token present a Subject 
is created with the value of the token used as the PrimparyPrincipal. 

> Support DistCp via Knox
> -----------------------
>
>                 Key: KNOX-482
>                 URL: https://issues.apache.org/jira/browse/KNOX-482
>             Project: Apache Knox
>          Issue Type: New Feature
>          Components: Server
>    Affects Versions: 0.6.0
>            Reporter: Kevin Minder
>             Fix For: 0.6.0
>
>         Attachments: core-site.xml, default.xml, distcp-poc.patch, 
> gateway-site.xml
>
>
> Support the use of Knox in hadoop distcp use cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to