[jira] [Resolved] (MAPREDUCE-7043) Make EventHubs system configs compatible with Samza standalone
[ https://issues.apache.org/jira/browse/MAPREDUCE-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik resolved MAPREDUCE-7043. --- Resolution: Invalid > Make EventHubs system configs compatible with Samza standalone > -- > > Key: MAPREDUCE-7043 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7043 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Boris Shkolnik >Assignee: Boris Shkolnik >Priority: Major > > EventHubs configs are using the old style configs (system.*.streams.*.config). > It needs to be moved to the new stream-id configs. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7043) Make EventHubs system configs compatible with Samza standalone
Boris Shkolnik created MAPREDUCE-7043: - Summary: Make EventHubs system configs compatible with Samza standalone Key: MAPREDUCE-7043 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7043 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik EventHubs configs are using the old style configs (system.*.streams.*.config). It needs to be moved to the new stream-id configs. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR-2420.22-3.patch patch for previous version(.22) using DFSConfigKeys.DFS_HTTPS_PORT_KEY instead of string value. JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Fix For: 0.23.0 Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.22-2.patch, MR-2420.22-3.patch, MR-2420.patch, MR2420-2.patch, MR2420-3.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR2420-2.patch patch for trunk JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.22-2.patch, MR-2420.patch, MR2420-2.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13026636#comment-13026636 ] Boris Shkolnik commented on MAPREDUCE-2420: --- +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] -1 tests included. The patch doesn't appear to include any new or modified tests. [exec] Please justify why no new tests are needed for this patch. [exec] Also please list what manual steps were performed to verify this patch. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] [exec] No unit tests, but I did manual testing using discp copying from the same cluster or from 0.20 one JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.22-2.patch, MR-2420.patch, MR2420-2.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13026690#comment-13026690 ] Boris Shkolnik commented on MAPREDUCE-2420: --- ran the ant test and it passed. JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.22-2.patch, MR-2420.patch, MR2420-2.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR2420-3.patch changed dfs.https.port to DFSConfigKeys JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.22-2.patch, MR-2420.patch, MR2420-2.patch, MR2420-3.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR-2420.22-2.patch JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.22-2.patch, MR-2420.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR-2420.22-1.patch preliminary patch for .22 JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.22-1.patch, MR-2420.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR-2420.patch JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2420: -- Attachment: MR-2420-1.patch implemented some of Devaraj's comments. also set stack to empty for artificially created exceptions (on the client side). Agree with Devaraj that we need a more generic solution for all types of token. Please open a Jira on this and put these requirements in. JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
[ https://issues.apache.org/jira/browse/MAPREDUCE-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13016076#comment-13016076 ] Boris Shkolnik commented on MAPREDUCE-2420: --- committed to branch-20-security. JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MR-2420-1.patch, MR-2420.patch in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-2420) JobTracker should be able to renew delegation token over HTTP
JobTracker should be able to renew delegation token over HTTP - Key: MAPREDUCE-2420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2420 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.4 Reporter: Boris Shkolnik Assignee: Boris Shkolnik in case JobTracker has to talk to a NameNode running a different version (RPC version mismatch), Jobtracker should be able to fall back to HTTP renewal. Example of the case - running distcp between different versions using hfpt. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (MAPREDUCE-1951) SecurityAuth.audit file created after every test run
[ https://issues.apache.org/jira/browse/MAPREDUCE-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik resolved MAPREDUCE-1951. --- Resolution: Duplicate duplicate of HADOOP-6970 SecurityAuth.audit file created after every test run Key: MAPREDUCE-1951 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1951 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects Versions: 0.22.0 Reporter: Amar Kamat After every test run, a SecurityAuth.audit file gets created in the $HADOOP_HOME folder which is not cleaned up. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (MAPREDUCE-2050) TestMRCLI fails on trunk
[
https://issues.apache.org/jira/browse/MAPREDUCE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boris Shkolnik reassigned MAPREDUCE-2050:
-
Assignee: Boris Shkolnik
TestMRCLI fails on trunk
Key: MAPREDUCE-2050
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2050
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: security, test
Affects Versions: 0.22.0
Reporter: Amareshwari Sriramadasu
Assignee: Boris Shkolnik
Fix For: 0.22.0
TestMRCLI fails with following error:
{noformat}
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(150)) - Test ID: [1]
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(151)) -Test Description:
[refreshServiceAcl: refreshing security authorization policy for jobtracker]
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(152)) -
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(156)) - Test Commands: [-jt
JOBTRACKER -refreshServiceAcl ]
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(160)) -
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(167)) -
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(171)) - Comparator:
[ExactComparator]
2010-09-02 14:23:25,975 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(173)) - Comparision result:
[fail]
2010-09-02 14:23:25,975 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(175)) - Expected output: []
2010-09-02 14:23:25,975 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(177)) - Actual output:
[refreshServiceAcl: Kerberos service principal name isn't configured properly
(should have 3 parts):
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2050) TestMRCLI fails on trunk
[
https://issues.apache.org/jira/browse/MAPREDUCE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12905981#action_12905981
]
Boris Shkolnik commented on MAPREDUCE-2050:
---
I think it is related to Client callinb ConnectionId.getRemotePrincipal() for
non-secure cluster.
This call should be conditioned by UGI.securityEnabled() constrain.
So the actual fix will be in HADOOP-COMMON.
TestMRCLI fails on trunk
Key: MAPREDUCE-2050
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2050
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: security, test
Affects Versions: 0.22.0
Reporter: Amareshwari Sriramadasu
Assignee: Boris Shkolnik
Fix For: 0.22.0
TestMRCLI fails with following error:
{noformat}
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(150)) - Test ID: [1]
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(151)) -Test Description:
[refreshServiceAcl: refreshing security authorization policy for jobtracker]
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(152)) -
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(156)) - Test Commands: [-jt
JOBTRACKER -refreshServiceAcl ]
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(160)) -
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(167)) -
2010-09-02 14:23:25,974 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(171)) - Comparator:
[ExactComparator]
2010-09-02 14:23:25,975 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(173)) - Comparision result:
[fail]
2010-09-02 14:23:25,975 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(175)) - Expected output: []
2010-09-02 14:23:25,975 INFO cli.CLITestHelper
(CLITestHelper.java:displayResults(177)) - Actual output:
[refreshServiceAcl: Kerberos service principal name isn't configured properly
(should have 3 parts):
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2005) TestDelegationTokenRenewal fails
[ https://issues.apache.org/jira/browse/MAPREDUCE-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2005: -- Attachment: MAPREDUCE-2005-1.patch TestDelegationTokenRenewal fails Key: MAPREDUCE-2005 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2005 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-2005-1.patch, MAPREDUCE-2005-YH20.patch looks like the problem is in host resolution. test is using localhost:0, but in DelegationTokenRenewal we use getCannonicalName() for localhost, and on some machine it is not localhost Fix - change test to use getCannonicalName too. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-2005) TestDelegationTokenRenewal fails
[ https://issues.apache.org/jira/browse/MAPREDUCE-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-2005: - Assignee: Boris Shkolnik TestDelegationTokenRenewal fails Key: MAPREDUCE-2005 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2005 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-2005-YH20.patch looks like the problem is in host resolution. test is using localhost:0, but in DelegationTokenRenewal we use getCannonicalName() for localhost, and on some machine it is not localhost Fix - change test to use getCannonicalName too. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2005) TestDelegationTokenRenewal fails
[ https://issues.apache.org/jira/browse/MAPREDUCE-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-2005: -- Attachment: MAPREDUCE-2005-YH20.patch for previous version, not for commit I've also updated some comments and debug lines TestDelegationTokenRenewal fails Key: MAPREDUCE-2005 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2005 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-2005-YH20.patch looks like the problem is in host resolution. test is using localhost:0, but in DelegationTokenRenewal we use getCannonicalName() for localhost, and on some machine it is not localhost Fix - change test to use getCannonicalName too. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1958) using delegation token over hftp for long running clients (part of hdfs 1296)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12893304#action_12893304 ] Boris Shkolnik commented on MAPREDUCE-1958: --- +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 5 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] using delegation token over hftp for long running clients (part of hdfs 1296) - Key: MAPREDUCE-1958 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1958 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1958-1.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1958) using delegation token over hftp for long running clients (part of hdfs 1296)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1958: -- Attachment: MAPREDUCE-1958-1.patch ran tests. all passed. using delegation token over hftp for long running clients (part of hdfs 1296) - Key: MAPREDUCE-1958 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1958 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1958-1.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1718: -- Attachment: MAPREDUCE-1718-4.patch merged with the trunk. modified test to verify value set in conf . job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1718-2.patch, MAPREDUCE-1718-3.patch, MAPREDUCE-1718-4.patch, MAPREDUCE-1718-BP20-1.patch, MAPREDUCE-1718-BP20-2.patch the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1718: -- Attachment: MAPREDUCE-1718-4.patch merged with trunk. Ran tests all passed (except TestRumenJobTraces - see MAPREDUCE-1925) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1718-2.patch, MAPREDUCE-1718-3.patch, MAPREDUCE-1718-4.patch, MAPREDUCE-1718-4.patch, MAPREDUCE-1718-BP20-1.patch, MAPREDUCE-1718-BP20-2.patch the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1718: -- Attachment: MAPREDUCE-1718-3.patch job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1718-2.patch, MAPREDUCE-1718-3.patch, MAPREDUCE-1718-BP20-1.patch, MAPREDUCE-1718-BP20-2.patch the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1958) using delegation token over hftp for long running clients (part of hdfs 1296)
using delegation token over hftp for long running clients (part of hdfs 1296) - Key: MAPREDUCE-1958 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1958 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1935) HFTP needs to be updated to use delegation tokens (from HDFS-1007)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1935: -- Attachment: MAPREDUCE-1935-1.patch HFTP needs to be updated to use delegation tokens (from HDFS-1007) -- Key: MAPREDUCE-1935 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1935 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1935-1.patch, MAPREDUCE-1935.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1935) HFTP needs to be updated to use delegation tokens (from HDFS-1007)
HFTP needs to be updated to use delegation tokens (from HDFS-1007) -- Key: MAPREDUCE-1935 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1935 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1935) HFTP needs to be updated to use delegation tokens (from HDFS-1007)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1935: - Assignee: Boris Shkolnik HFTP needs to be updated to use delegation tokens (from HDFS-1007) -- Key: MAPREDUCE-1935 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1935 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1935) HFTP needs to be updated to use delegation tokens (from HDFS-1007)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1935: -- Attachment: MAPREDUCE-1935.patch ran tests - all passed except TestRumenJobTraces which is non-related (MAPREDUCE-1925) ran test-patch: [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 3 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] [exec] HFTP needs to be updated to use delegation tokens (from HDFS-1007) -- Key: MAPREDUCE-1935 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1935 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1935.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1855: -- Attachment: MAPREDUCE-1855-6.patch refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815) - Key: MAPREDUCE-1855 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1855 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1855-1.patch, MAPREDUCE-1855-5.patch, MAPREDUCE-1855-6.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1855: -- Attachment: MAPREDUCE-1855-5.patch refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815) - Key: MAPREDUCE-1855 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1855 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1855-1.patch, MAPREDUCE-1855-5.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815)
refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815) - Key: MAPREDUCE-1855 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1855 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1855: -- Attachment: MAPREDUCE-1855-1.patch refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815) - Key: MAPREDUCE-1855 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1855 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1855-1.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1836) Refresh for proxy superuser config (mr part for HDFS-1096)
Refresh for proxy superuser config (mr part for HDFS-1096) -- Key: MAPREDUCE-1836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1836 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1836) Refresh for proxy superuser config (mr part for HDFS-1096)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1836: -- Release Note: changing name of the protocol (may be used in hadoop-policy.xml) from security.refresh.usertogroups.mappings.protocol.acl to security.refresh.user.mappings.protocol.acl Refresh for proxy superuser config (mr part for HDFS-1096) -- Key: MAPREDUCE-1836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1836 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1836) Refresh for proxy superuser config (mr part for HDFS-1096)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1836: -- Attachment: MAPREDUCE-1836-1.patch Refresh for proxy superuser config (mr part for HDFS-1096) -- Key: MAPREDUCE-1836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1836 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1836-1.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1836) Refresh for proxy superuser config (mr part for HDFS-1096)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1836: -- Attachment: MAPREDUCE-1836-2.patch added test Refresh for proxy superuser config (mr part for HDFS-1096) -- Key: MAPREDUCE-1836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1836 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1836-1.patch, MAPREDUCE-1836-2.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1836) Refresh for proxy superuser config (mr part for HDFS-1096)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12874860#action_12874860 ] Boris Shkolnik commented on MAPREDUCE-1836: --- ran test and test-patch manually. Refresh for proxy superuser config (mr part for HDFS-1096) -- Key: MAPREDUCE-1836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1836 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1836-1.patch, MAPREDUCE-1836-2.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1801) do not throw exception if cannot get a delegation token, it may be from a unsecured cluster (part of HDFS-1044)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1801: -- Attachment: MAPREDUCE_1801.patch do not throw exception if cannot get a delegation token, it may be from a unsecured cluster (part of HDFS-1044) --- Key: MAPREDUCE-1801 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1801 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE_1801.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1801) do not throw exception if cannot get a delegation token, it may be from a unsecured cluster (part of HDFS-1044)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1801: -- Status: Patch Available (was: Open) do not throw exception if cannot get a delegation token, it may be from a unsecured cluster (part of HDFS-1044) --- Key: MAPREDUCE-1801 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1801 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE_1801.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1801) do not throw exception if cannot get a delegation token, it may be from a unsecured cluster (part of HDFS-1044)
do not throw exception if cannot get a delegation token, it may be from a unsecured cluster (part of HDFS-1044) --- Key: MAPREDUCE-1801 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1801 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1798) normalize property names for JT kerberos principal names in configuration (from HADOOP 6633)
normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) Key: MAPREDUCE-1798 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1798 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1798) normalize property names for JT kerberos principal names in configuration (from HADOOP 6633)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1798: - Assignee: Boris Shkolnik normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) Key: MAPREDUCE-1798 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1798 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1798) normalize property names for JT kerberos principal names in configuration (from HADOOP 6633)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1798: -- Status: Patch Available (was: Open) normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) Key: MAPREDUCE-1798 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1798 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1798.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1798) normalize property names for JT kerberos principal names in configuration (from HADOOP 6633)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1798: -- Attachment: MAPREDUCE-1798.patch normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) Key: MAPREDUCE-1798 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1798 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1798.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12867637#action_12867637 ] Boris Shkolnik commented on MAPREDUCE-1558: --- run tests manually. all passed. specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) - Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1558.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1787) Remove verbose logging from the Groups class
[
https://issues.apache.org/jira/browse/MAPREDUCE-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12867202#action_12867202
]
Boris Shkolnik commented on MAPREDUCE-1787:
---
moved by mistake. moving back to COMMON.
Remove verbose logging from the Groups class
Key: MAPREDUCE-1787
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1787
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Boris Shkolnik
Attachments: HADOOP-6598-BP20-Fix.patch, HADOOP-6598-BP20.patch,
HADOOP-6598.patch
{quote}
2010-02-25 08:30:52,269 INFO security.Groups (Groups.java:init(60)) -
Group m
apping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
cacheTimeout
=30
...
2010-02-25 08:30:57,872 INFO security.Groups (Groups.java:getGroups(76)) -
Retu
rning cached groups for 'oom'
{quote}
should both be demoted to debug level.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12867258#action_12867258 ] Boris Shkolnik commented on MAPREDUCE-1539: --- ran tests manually all passed. authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1539-1.patch, MAPREDUCE-1539-2.patch, MAPREDUCE-1539-3.patch authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1539: -- Attachment: MAPREDUCE-1539-5.patch authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1539-1.patch, MAPREDUCE-1539-2.patch, MAPREDUCE-1539-3.patch, MAPREDUCE-1539-5.patch authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1539: -- Attachment: MAPREDUCE-1539-3.patch merged with trunk authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1539-1.patch, MAPREDUCE-1539-2.patch, MAPREDUCE-1539-3.patch authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12860461#action_12860461 ] Boris Shkolnik commented on MAPREDUCE-1718: --- shouldn't. it is used as a key, so it just needs to be the same in both cases. job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1718-BP20-1.patch, MAPREDUCE-1718-BP20-2.patch the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1718: -- Attachment: MAPREDUCE-1718-BP20-2.patch moved utility method to SecurityUtil.java job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1718-BP20-1.patch, MAPREDUCE-1718-BP20-2.patch the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1718: - Assignee: Boris Shkolnik job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1718) job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem
[ https://issues.apache.org/jira/browse/MAPREDUCE-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1718: -- Attachment: MAPREDUCE-1718-BP20-1.patch for previous version, not for commit job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem --- Key: MAPREDUCE-1718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1718 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1718-BP20-1.patch the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT. Fix. change it to always be IP. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1714) Delegation Token is scheduled for renewal when previous renewal faild with AccessControlException
[ https://issues.apache.org/jira/browse/MAPREDUCE-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1714: - Assignee: Boris Shkolnik Delegation Token is scheduled for renewal when previous renewal faild with AccessControlException - Key: MAPREDUCE-1714 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1714 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik In case of failed renewal (with AccessControlException) we should not schedule another renewal (because it till fail too). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1714) Delegation Token is scheduled for renewal when previous renewal faild with AccessControlException
Delegation Token is scheduled for renewal when previous renewal faild with AccessControlException - Key: MAPREDUCE-1714 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1714 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik In case of failed renewal (with AccessControlException) we should not schedule another renewal (because it till fail too). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1714) Delegation Token is scheduled for renewal when previous renewal faild with AccessControlException
[ https://issues.apache.org/jira/browse/MAPREDUCE-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik resolved MAPREDUCE-1714. --- Resolution: Duplicate duplicate of MAPREDUCE-1701 Delegation Token is scheduled for renewal when previous renewal faild with AccessControlException - Key: MAPREDUCE-1714 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1714 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik In case of failed renewal (with AccessControlException) we should not schedule another renewal (because it till fail too). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1701) AccessControlException while renewing a delegation token in not correctly handled in the JobTracker
[ https://issues.apache.org/jira/browse/MAPREDUCE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1701: - Assignee: Boris Shkolnik (was: Devaraj Das) AccessControlException while renewing a delegation token in not correctly handled in the JobTracker --- Key: MAPREDUCE-1701 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1701 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 The timer task for renewing delegation token gets scheduled even when an AccessControlException is obtained. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1701) AccessControlException while renewing a delegation token in not correctly handled in the JobTracker
[ https://issues.apache.org/jira/browse/MAPREDUCE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1701: -- Attachment: MAPREDUCE-1701-BP20-1.patch for previous version, not for commit AccessControlException while renewing a delegation token in not correctly handled in the JobTracker --- Key: MAPREDUCE-1701 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1701 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1701-BP20-1.patch The timer task for renewing delegation token gets scheduled even when an AccessControlException is obtained. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client
[ https://issues.apache.org/jira/browse/MAPREDUCE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12857133#action_12857133 ] Boris Shkolnik commented on MAPREDUCE-1516: --- 1. having two asserts doesn't make sense: Assert.assertTrue(token != null); Assert.fail(Delegation token should not be issued without Kerberos authentication); otherwise looks good. JobTracker should issue a delegation token only for kerberos authenticated client - Key: MAPREDUCE-1516 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1516 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey Attachments: MR-1516.1.patch, MR-1516.2.patch, MR-1516.3.patch, MR-1516.4.patch, MR-1516.5.patch Delegation tokens should be issued only if the client is kerberos authenticated. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1558: -- Release Note: new config: hadoop.security.service.user.name.key this setting points to the server principal for RefreshUserToGroupMappingsProtocol. The value should be either NN or JT principal depending if it is used in DFAdmin or MRAdmin. The value is set by the application. No need for default value. was: adds new conf setting: CommonConfigurationKeys.HADOOP_SECURITY_SERVICE_USER_NAME_KEY this setting points to the server principal for RefreshUserToGroupMappingsProtocol. The value should be either NN or JT principal depending if it is used in DFAdmin or MRAdmin. specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) - Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1558.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Release Note: mapreduce.job.complete.cancel.delegation.tokens - if false - don't cancel delegation token renewal when the job is complete, because it may be used by some other job. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: 1430-BP20-Add.patch, 1430-bp20-bugfix.patch, 1430-dd1.patch, 1430-dd2.patch, 1430-dd3.patch, 1430-dd4-BP20.patch, 1430-dd4.patch, MAPREDUCE-1430-12.patch, MAPREDUCE-1430-13.patch, MAPREDUCE-1430-14.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1338) need security keys storage solution
[ https://issues.apache.org/jira/browse/MAPREDUCE-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1338: -- Tags: security Release Note: new command line argument: tokensFile - path to the file with clients secret keys in JSON format need security keys storage solution --- Key: MAPREDUCE-1338 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1338 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: HADOOP-6325.patch, MAPREDUCE-1338-10.patch, MAPREDUCE-1338-2.patch, MAPREDUCE-1338-4.patch, MAPREDUCE-1338-6.patch, MAPREDUCE-1338-7.patch, MAPREDUCE-1338-8.patch, MAPREDUCE-1338-9.patch, MAPREDUCE-1338-BP20-2.patch, MAPREDUCE-1338-BP20-3.patch, MAPREDUCE-1338.patch set, get, store, load security keys key alias - byte[] key value - byte[] store/load from DataInput/Output stream -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1529) TokenCache - needs api to clear the cache.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik resolved MAPREDUCE-1529. --- Resolution: Won't Fix this is solved by moving the cache form static to per-thread variable. TokenCache - needs api to clear the cache. -- Key: MAPREDUCE-1529 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1529 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik It may cause some tests to fail (ones that run multiple jobs from the same process). For example TestQueueManager -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1558: -- Tags: security Release Note: adds new conf setting: CommonConfigurationKeys.HADOOP_SECURITY_SERVICE_USER_NAME_KEY this setting points to the server principal for RefreshUserToGroupMappingsProtocol. The value should be either NN or JT principal depending if it is used in DFAdmin or MRAdmin. specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) - Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1558.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1539: -- Tags: security authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1539-1.patch, MAPREDUCE-1539-2.patch authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12842556#action_12842556 ] Boris Shkolnik commented on MAPREDUCE-1558: --- This setting is a part of mapred-site, and is not available from conf. So I need the JobConf. specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) - Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1558.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)
specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) - Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1558: - Assignee: Boris Shkolnik specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) - Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1539: - Assignee: Boris Shkolnik authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1539: -- Attachment: MAPREDUCE-1539-1.patch authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1539-1.patch authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1539: -- Attachment: MAPREDUCE-1539-2.patch merged with trunk authorization checks for inter-server protocol (based on HADOOP-6600) - Key: MAPREDUCE-1539 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1539 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Attachments: MAPREDUCE-1539-1.patch, MAPREDUCE-1539-2.patch authorization checks for inter-server protocol (based on HADOOP-6600) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1532) Delegation token is obtained as the superuser
[ https://issues.apache.org/jira/browse/MAPREDUCE-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838712#action_12838712 ] Boris Shkolnik commented on MAPREDUCE-1532: --- I've reviewed DelegationTokenRenewal related parts. Changes to DelegationTokenRenewal.java look fine. In TestDTR: 1. I don't think it is a good idea to sleep for 10 seconds every time. If you feel it can take long then the currently specified time - increase the number of attempts, but not the attempt span. So in the good case we don't slow tests too much. 2. the attempt thing is really needed only in the first part of the test. In the second part we test negative case - it should never be renewed. So one try or 3 seconds should suffice. Delegation token is obtained as the superuser - Key: MAPREDUCE-1532 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1532 Project: Hadoop Map/Reduce Issue Type: Bug Components: job submission, security Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 Attachments: 1532-bp20.1.patch, 1532-bp20.2.patch, 1532-bp20.4.patch When the UserGroupInformation.doAs is invoked for proxy users, the delegation token is incorrectly obtained as the real user. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: 1430-BP20-Add.patch 1430-BP20-Add.patch - for previous hadoop version Takes care of TestQueueManager Running tests now. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: 1430-BP20-Add.patch, 1430-dd1.patch, 1430-dd2.patch, 1430-dd3.patch, 1430-dd4-BP20.patch, 1430-dd4.patch, MAPREDUCE-1430-12.patch, MAPREDUCE-1430-13.patch, MAPREDUCE-1430-14.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1529) TokenCache - needs api to clear the cache.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik reassigned MAPREDUCE-1529: - Assignee: Boris Shkolnik TokenCache - needs api to clear the cache. -- Key: MAPREDUCE-1529 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1529 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik Assignee: Boris Shkolnik It may cause some tests to fail (ones that run multiple jobs from the same process). For example TestQueueManager -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1529) TokenCache - needs api to clear the cache.
TokenCache - needs api to clear the cache. -- Key: MAPREDUCE-1529 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1529 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Boris Shkolnik It may cause some tests to fail (ones that run multiple jobs from the same process). For example TestQueueManager -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12836419#action_12836419 ] Boris Shkolnik commented on MAPREDUCE-1430: --- 1) LOG.info changed to LOG.debug in DelegationTokenRenewal.java. I think we should leave at least one LOG.info in the registration. Otherwise we won't be tell what the problem was if it happened. otherwise it is good. +1 JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: 1430-dd1.patch, 1430-dd2.patch, MAPREDUCE-1430-12.patch, MAPREDUCE-1430-13.patch, MAPREDUCE-1430-14.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12836473#action_12836473 ] Boris Shkolnik commented on MAPREDUCE-1430: --- test-patch for 1430-dd4.patch [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 6 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: 1430-dd1.patch, 1430-dd2.patch, 1430-dd3.patch, 1430-dd4.patch, MAPREDUCE-1430-12.patch, MAPREDUCE-1430-13.patch, MAPREDUCE-1430-14.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: 1430-dd4-BP20.patch 1430-dd4-BP20.patch - for previous HADOOP version, not for commit JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: 1430-dd1.patch, 1430-dd2.patch, 1430-dd3.patch, 1430-dd4-BP20.patch, 1430-dd4.patch, MAPREDUCE-1430-12.patch, MAPREDUCE-1430-13.patch, MAPREDUCE-1430-14.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12835866#action_12835866 ] Boris Shkolnik commented on MAPREDUCE-1430: --- 1) The hashmap for delegation tokens could use the JobID object as the key yes it could. it could use jobid.toString() too. 2) I don't see a good motivation for having equals and hashcode implementations in the private class DelegationTokenToRenew. The implementations can be improved as well but I don't see a strong reason for introducing them in this patch. Equals is needed to for contains() to work correctly (comparing actual Tokens instead of DelegationTokenToRenew. 3) The initial value of newExpirationDate could be 60 minutes. I don't see the need for initializing it to -1 and then setting it to some other value based on that. This setting is protecting from unexpected/erroneous returns from dfs.renewDelegationToken(). 4) In removeDelegationTokenRenewal, the checks for the jobid for the tokens is redundant. The hashmap already provides you with that list. Removed. 5) The DelegationTokenToRenew class doesn't need to store the jobID at all. Everywhere the jobID could be passed as argument to the methods where it is required. This is how it is passed around. 6) When would alreadyInMap ever return true? If it never does, i suggest we remove this check. This is to protect from erroneous calls, to avoid same DelegationToken to be added twice. 7) You haven't synchronized on the accesses to delegationTokens object everywhere. Maybe, a better approach would be to just define the object as a synchronized. Well, the only non-protected write access is with clear() method in close() which is called when JT is shutting down. But, just to make the things safer, I will make the map synchronized. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-12.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: MAPREDUCE-1430-13.patch addressed Devaraj's review. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-12.patch, MAPREDUCE-1430-13.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: MAPREDUCE-1430-12.patch merged with m1503 JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-12.patch, MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1503) Push HADOOP-6551 into MapReduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1503: -- +1 looks good Push HADOOP-6551 into MapReduce --- Key: MAPREDUCE-1503 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1503 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: m-1503.patch We need to throw readable exceptions instead of returning false. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12835099#action_12835099 ] Boris Shkolnik commented on MAPREDUCE-1430: --- bq.1) For (3), it should be that, cancellation is done for tokens owned by jobs that have mapreduce.job.cancel.delegation.tokens set to true, when the job is done. The idea is to immediately cancel the tokens once the job is done unless the user sets mapreduce.job.cancel.delegation.tokens to false (in which case it probably means that the user launched jobs from tasks of the job in question, and these new jobs would be using the same tokens for talking to the hdfs). For cancelling the token you should invoke the appropriate RPC. Thinking about it, the config could be named to something like mapreduce.job.complete.cancel.delegation.tokens Added cancellation for completed jobs (unless mapreduce.job.complete.cancel.delegation.tokens is set to false (default is true) bq. 2) Please make the DelegationTokenRenewal class package private. It is used from JobTracker so it must remain public. Added @InterfaceAudience.Private. bq. 3) renewalTimer should be a daemon thread. Done. bq. 4) Methods like getDfsForToken could be declared as private. Done. bq. 5) The logic for setting the renewal to 60 minutes on an exception should be within the renewDelegationToken method (newExpirationDate could be initialized to that). Done. bq. 6) You don't need synchronization on delegationTokens in the setTimerForTokenRenewal method. Done. bq. 7) The delegationTokens list could be a HashSet instead Actually, if we want direct access it should be a MAP keyed by jobId. And that will point to a list. So I changed it to MapString, ListDTToRenew I've also 8) modified Test to verify cancellation of the token. 9) moved registration for renewal to job initialization and cancelation to garbageCollect() 10) specified default for mapreduce.job.complete.cancel.delegation.tokens to true in mapred-default.xml 11) change all Boolean renew/cancelToken to long and more.. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: MAPREDUCE-1430-8.patch JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch, MAPREDUCE-1430-8.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12834358#action_12834358 ] Boris Shkolnik commented on MAPREDUCE-1430: --- bq.1) The class DelegationTokenRenewal could be named better It seems logical to me. If you have better suggestions please share. bq. 2) I am having trouble understanding what you have done in DelegationTokenRenewal to do with resetting of timers. When the JobTracker first renews the token, it can check when the token is supposed to be renewed again, and create a corresponding TimerTask. Then cancel the TimerTask when the job is done. The Timer object needs to be created only once, right? This way you will create multiple timer objects. In the current design only one timer object is created - for the next expiring token. bq. 3) You should have the cancellation of tokens based on a boolean configuration like mapreduce.job.cancel.delegation.tokens. this is a new requirement. I will add it. I assume is the value is 'false' - we don't cancel any tokens for the job? (not registering them up for renewal). bq. 4) The KIND defined in DelegationTokenRenewal should come from the DelegationTokenIdentifier in HDFS it is package private. One would need to modify HDFS for it. bq. 5) The place where the delegation tokens are registered for renewal is not correct. Note that the JobInProgress constructor uses a token to copy the jobconf file from the hdfs and by then the token for accessing the jobconf should have got renewed. The renewal should happen before the JobInProgress is constructed in submitJob. I don't think it is critical. Tokens don't really need to be renewed immediately. So the token is perfectly valid at this point. bq. 6) Also, now that we have MapReduce delegation tokens, it will be nice to have the class DelegationTokenRenewal not assume only hdfs delegation tokens. Well, we talked about it - and I understood that we DON'T want to renew MapReduce tokens in JobTracker. bq.7) The Timer should be cancelled when the JobTracker is stopped. Ok. Will do. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-5.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: MAPREDUCE-1430-6.patch fixed 2,3,5,6,7 from Devaraj's comments JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-5.patch, MAPREDUCE-1430-6.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1430: -- Attachment: MAPREDUCE-1430-5.patch JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1430-5.patch JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1432) Add the hooks in JobTracker and TaskTracker to load tokens from the token cache into the user's UGI
[ https://issues.apache.org/jira/browse/MAPREDUCE-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1432: -- Attachment: MAPREDUCE-1432-BP20-2.patch Add the hooks in JobTracker and TaskTracker to load tokens from the token cache into the user's UGI --- Key: MAPREDUCE-1432 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1432 Project: Hadoop Map/Reduce Issue Type: New Feature Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 Attachments: 1432.1.patch, 1432.2.patch, 1432.patch, MAPREDUCE-1432-BP20-2.patch, MAPREDUCE-1432-BP20.patch Related to HADOOP-6520. Here it is about putting hooks in the JobTracker/TaskTracker for loading tokens in the user's UGI. This is required when job files are copied from the HDFS on behalf of the user. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-6.patch merged backport Allow storage and caching of delegation token. -- Key: MAPREDUCE-1383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, MAPREDUCE-1383-BP20-6.patch Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-BP20-7.patch moved TestTokenCache.java from hadoop/security to hadoop/mapreduce/security Allow storage and caching of delegation token. -- Key: MAPREDUCE-1383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Assignee: Boris Shkolnik Fix For: 0.22.0 Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, MAPREDUCE-1383-BP20-6.patch, MAPREDUCE-1383-BP20-7.patch Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1432) Add the hooks in JobTracker and TaskTracker to load tokens from the token cache into the user's UGI
[ https://issues.apache.org/jira/browse/MAPREDUCE-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1432: -- Attachment: MAPREDUCE-1432-BP20.patch Patch for earlier version of Hadoop. Not for commit here. Add the hooks in JobTracker and TaskTracker to load tokens from the token cache into the user's UGI --- Key: MAPREDUCE-1432 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1432 Project: Hadoop Map/Reduce Issue Type: New Feature Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 Attachments: 1432.1.patch, 1432.2.patch, 1432.patch, MAPREDUCE-1432-BP20.patch Related to HADOOP-6520. Here it is about putting hooks in the JobTracker/TaskTracker for loading tokens in the user's UGI. This is required when job files are copied from the HDFS on behalf of the user. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Attachment: MAPREDUCE-1383-11.patch bq.The /IP:PORT looks odd. Please change the service to be IP-ADDRESS-OF-HOST:PORT. After discussion with Kan, we aggreed on IP:PORT. Kan will match in his implementation. here is my diff: - sb.append(NetUtils.normalizeHostName(uri.getHost())).append(:).append(port); --- + sb.append(/).append(NetUtils.normalizeHostName(uri.getHost())).append(:).append(port); Allow storage and caching of delegation token. -- Key: MAPREDUCE-1383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12806477#action_12806477 ] Boris Shkolnik commented on MAPREDUCE-1430: --- We may need to add an expiration date to the o.a.h.security.Token class Created HADOOP-6523 for this. JobTracker should be able to renew delegation tokens for the jobs - Key: MAPREDUCE-1430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1430 Project: Hadoop Map/Reduce Issue Type: New Feature Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Open (was: Patch Available) Allow storage and caching of delegation token. -- Key: MAPREDUCE-1383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Patch Available (was: Open) Allow storage and caching of delegation token. -- Key: MAPREDUCE-1383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1405) unchecked cast warnings in trunk
[
https://issues.apache.org/jira/browse/MAPREDUCE-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boris Shkolnik resolved MAPREDUCE-1405.
---
Resolution: Fixed
Will be fixed as a part of MAPRED-1383
unchecked cast warnings in trunk
Key: MAPREDUCE-1405
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1405
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Chris Douglas
Priority: Trivial
{noformat}
compile-mapred-classes:
[jsp-compile] 10/01/24 15:16:55 WARN compiler.TldLocationsCache: Internal
Error: File /WEB-INF/web.xml not found
[javac] Compiling 494 source files to /.../mapred/build/classes
[javac] /.../mapred/src/java/org/apache/hadoop/mapred/Child.java:159:
warning: [unchecked] unchecked cast
[javac] found : org.apache.hadoop.security.token.Tokencapture#981 of ?
extends org.apache.hadoop.security.token.TokenIdentifier
[javac] required:
org.apache.hadoop.security.token.Tokenorg.apache.hadoop.mapreduce.security.token.JobTokenIdentifier
[javac] TokenJobTokenIdentifier jt =
(TokenJobTokenIdentifier)ts.getJobToken();
[javac]
^
[javac]
/.../mapred/src/java/org/apache/hadoop/mapred/TaskTracker.java:922: warning:
[unchecked] unchecked cast
[javac] found : org.apache.hadoop.security.token.Tokencapture#810 of ?
extends org.apache.hadoop.security.token.TokenIdentifier
[javac] required:
org.apache.hadoop.security.token.Tokenorg.apache.hadoop.mapreduce.security.token.JobTokenIdentifier
[javac] TokenJobTokenIdentifier jt =
(TokenJobTokenIdentifier)ts.getJobToken();
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of delegation token.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1383: -- Status: Open (was: Patch Available) Allow storage and caching of delegation token. -- Key: MAPREDUCE-1383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Boris Shkolnik Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
