[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Tags: security Release Note: mapreduce.job.hdfs-servers - declares hdfs servers to be used by the job, so client can pre-fetch delegation tokens for thsese servers (comma separated list of NameNodes). > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik >Assignee: Boris Shkolnik > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, > MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, > MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, > MAPREDUCE-1383-BP20-6.patch, MAPREDUCE-1383-BP20-7.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-7.patch moved TestTokenCache.java from hadoop/security to hadoop/mapreduce/security > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik >Assignee: Boris Shkolnik > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, > MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, > MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, > MAPREDUCE-1383-BP20-6.patch, MAPREDUCE-1383-BP20-7.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-6.patch merged backport > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik >Assignee: Boris Shkolnik > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, > MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, > MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, > MAPREDUCE-1383-BP20-6.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-5.patch backport. fixed a typo (append()=>sb.append) in TokenCache.java > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik >Assignee: Boris Shkolnik > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, > MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, > MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated MAPREDUCE-1383: --- Resolution: Fixed Fix Version/s: 0.22.0 Assignee: Boris Shkolnik Status: Resolved (was: Patch Available) I just committed this. Thanks, Boris! > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik >Assignee: Boris Shkolnik > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, > MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, > MAPREDUCE-1383-BP20-4.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-4.patch same change (ip:port) for backport. > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, > MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, > MAPREDUCE-1383-BP20-4.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boris Shkolnik updated MAPREDUCE-1383:
--
Attachment: MAPREDUCE-1383-11.patch
bq.The "/IP:PORT" looks odd. Please change the service to be
:PORT.
After discussion with Kan, we aggreed on "IP:PORT". Kan will match in his
implementation.
here is my diff:
< -
sb.append(NetUtils.normalizeHostName(uri.getHost())).append(":").append(port);
---
> +
> sb.append("/").append(NetUtils.normalizeHostName(uri.getHost())).append(":").append(port);
> Allow storage and caching of delegation token.
> --
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
>Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch,
> MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch,
> MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going
> to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-3.patch Patch for earlier version of Hadoop. Not for commit here. > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, > MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Patch Available (was: Open) > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, > MAPREDUCE-1383-9.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-10.patch make sure DelegetionToken.setService() is "/IP:PORT" > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, > MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, > MAPREDUCE-1383-9.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Open (was: Patch Available) > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Patch Available (was: Open) > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-9.patch addressed review comments. changed ivy.xml in mamuk to include hdfs.jar changed service field in the Delegation Token to "inet_addr:port" > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Open (was: Patch Available) > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Patch Available (was: Open) > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-6.patch > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-5.patch preliminary patch > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, > MAPREDUCE-1383-5.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-2.patch changed DfsClient to DistributedFileSystem changed references thru tokenStorage to TokenCache. > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-1.patch before submitting a job - contact all the namenodes (specified in the conf) to get their corresponding delegation token. > Allow storage and caching of delegation token. > -- > > Key: MAPREDUCE-1383 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Boris Shkolnik > Attachments: MAPREDUCE-1383-1.patch > > > Client needs to obtain delegation tokens from all the NameNodes it is going > to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
