[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105353#comment-13105353
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Hdfs-trunk #801 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/801/])
MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105333#comment-13105333
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Mapreduce-trunk #831 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/831/])
MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105340#comment-13105340
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Mapreduce-0.23-Build #5 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/5/])
MAPREDUCE-3007. svn merge -c r1171051 --ignore-ancestry ../../trunk/
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171057
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105304#comment-13105304
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Hdfs-0.23-Build #7 (See
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/7/])
MAPREDUCE-3007. svn merge -c r1171051 --ignore-ancestry ../../trunk/
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171057
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105280#comment-13105280
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Mapreduce-trunk-Commit #904 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/904/])
MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105277#comment-13105277
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Hdfs-trunk-Commit #969 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/969/])
MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105276#comment-13105276
]
Hudson commented on MAPREDUCE-3007:
---
Integrated in Hadoop-Common-trunk-Commit #892 (See
[https://builds.apache.org/job/Hadoop-Common-trunk-Commit/892/])
MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientCache.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/resources/META-INF/services/org.apache.hadoop.security.SecurityInfo
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105260#comment-13105260
]
Karam Singh commented on MAPREDUCE-3007:
Applied MAPREDUCE-3007-20110914.2.txt
Now I am not facing the problem of Jobclient not able to connect to
Historyserver
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105198#comment-13105198
]
Hadoop QA commented on MAPREDUCE-3007:
--
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12494474/MAPREDUCE-3007-20110914.2.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified
tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9)
warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/748//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/748//console
This message is automatically generated.
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105186#comment-13105186
]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3007:
bq. [..] I started getting some other error on getTaskCompletions(). I think
thats more related to the handshake for history file transfer not getting
completed becasue of immediate AppMaster shutdown.
Yes, that is MAPREDUCE-3006.
bq. In all, the patch looks good with minor changes to removing the conf
settings mentioned above.
The conf setting is used in so many other places too. I filed MAPREDUCE-3013
for removing it.
bq. The only issue with HS is that both the AM and HS implement the same
interface (MRClientProtocol) one of which is token based and the other kerberos
info based (the fact that getKerberos in MRClientSecurityInfo returns null
saves the day).
Yes. This is the reason why I think the configuration way is better, you can
set the authentication mechanism per implementation of protocol instead of
per-protocol.
bq. I tried out the patch on a cluster. Had to remove the sleep in AppMaster to
reproduce the issue. The patch worked for me [..]
Thanks Mahadev!
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105079#comment-13105079
]
Mahadev konar commented on MAPREDUCE-3007:
--
Vinod,
The conf property setting is not needed any longer:
{code}
myConf.setClass(YarnConfiguration.YARN_SECURITY_INFO,
-ClientRMSecurityInfo.class, SecurityInfo.class);
-YarnRPC rpc = YarnRPC.create(myConf);
+ClientHSSecurityInfo.class, SecurityInfo.class);
{code}
Setting the conf property is redundant since SecurityUtil picks it up via going
through the providers. The only issue with HS is that both the AM and HS
implement the same interface (MRClientProtocol) one of which is token based and
the other kerberos info based (the fact that getKerberos in
MRClientSecurityInfo returns null saves the day).
I tried out the patch on a cluster. Had to remove the sleep in AppMaster to
reproduce the issue. The patch worked for me, though I started getting some
other error on getTaskCompletions(). I think thats more related to the
handshake for history file transfer not getting completed becasue of immediate
AppMaster shutdown.
In all, the patch looks good with minor changes to removing the conf settings
mentioned above.
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.2.txt,
> MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104553#comment-13104553
]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3007:
bq. -1 tests included. The patch doesn't appear to include any new or modified
tests.
The patch fixes a bug that happens only in secure mode. We don't have the test
infrastructure to verify this fix.
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3007) JobClient cannot talk to JobHistory server in secure mode
[
https://issues.apache.org/jira/browse/MAPREDUCE-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104538#comment-13104538
]
Hadoop QA commented on MAPREDUCE-3007:
--
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12494426/MAPREDUCE-3007-20110914.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified
tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9)
warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/734//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/734//console
This message is automatically generated.
> JobClient cannot talk to JobHistory server in secure mode
> -
>
> Key: MAPREDUCE-3007
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3007
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
>Affects Versions: 0.23.0
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3007-20110914.txt
>
>
> In secure mode, Jobclient cannot connect to HistoryServer. Thanks to
> [~karams] for finding this out.
> {code}
> 11/09/14 09:57:51 INFO mapred.ClientServiceDelegate: Application state is
> completed. Redirecting to job history server
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Looking for a token
> with service :10020
> 11/09/14 09:57:51 INFO security.ApplicationTokenSelector: Token kind is
> YARN_APPLICATION_TOKEN and the token's service name is :46257
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating logout for
>
> 11/09/14 09:57:51 INFO security.UserGroupInformation: Initiating re-login for
>
> 11/09/14 09:57:55 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:57:56 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:00 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN security.UserGroupInformation: Not attempting to
> re-login since the last re-login was attempted less than 600 seconds before.
> 11/09/14 09:58:05 WARN ipc.Client: Couldn't setup connection for
> to null
> 11/09/14 09:58:05 INFO mapred.ClientServiceDelegate: Failed to contact
> AM/History for job job_1315993268700_0001 Will retry..
> {code}
> Am surprised no one working with YARN+MR ever ran into this!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
