[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609617#comment-13609617 ] Hudson commented on YARN-417: - Integrated in Hadoop-trunk-Commit #3506 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3506/]) YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks. (Sandy Ryza via bikas) (Revision 1459555) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1459555 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/AMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestAMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609649#comment-13609649 ] Sandy Ryza commented on YARN-417: - Thanks for the review and all the feedback! > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[
https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609743#comment-13609743
]
Chris Nauroth commented on YARN-417:
Hi, Sandy. I am seeing {{TestUnmanagedAMLauncher}} hang when I try to run it,
and I think I've isolated it to this YARN-417 patch.
{{TestUnmanagedAMLauncher}} uses the {{ApplicationMaster}} from distributed
shell, so perhaps it's an unexpected side effect of the changes there. Do you
have any thoughts on this? Thanks!
> Create AMRMClient wrapper that provides asynchronous callbacks
> --
>
> Key: YARN-417
> URL: https://issues.apache.org/jira/browse/YARN-417
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api, applications
>Affects Versions: 2.0.3-alpha
>Reporter: Sandy Ryza
>Assignee: Sandy Ryza
> Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java,
> YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch,
> YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch,
> YarnAppMaster.java, YarnAppMasterListener.java
>
>
> Writing AMs would be easier for some if they did not have to handle
> heartbeating to the RM on their own.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609779#comment-13609779 ] Sandy Ryza commented on YARN-417: - Hi Chris. I just tried running the test and I'm getting the hang too. I'll see if I can figure out what's causing it. > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609801#comment-13609801 ] Sandy Ryza commented on YARN-417: - I think I've figured the problem. TestUnmanagedAMLauncher runs distributed shell with 0 containers. Prior to YARN-417, ApplicationMaster would check for being done at a regular interval. Now, using the AMRMClientAsync, it only checks on container completion, which never occurs because no containers are run. Should this be fixed in a separate JIRA or here? > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13609837#comment-13609837 ] Chris Nauroth commented on YARN-417: Thanks, Sandy. The explanation makes sense. It seems like this warrants a separate jira. Is it even valid to run the distributed shell AM with no containers? I'm not sure. > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610141#comment-13610141 ] Hudson commented on YARN-417: - Integrated in Hadoop-Yarn-trunk #163 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/163/]) YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks. (Sandy Ryza via bikas) (Revision 1459555) Result = FAILURE bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1459555 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/AMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestAMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610238#comment-13610238 ] Hudson commented on YARN-417: - Integrated in Hadoop-Hdfs-trunk #1352 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1352/]) YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks. (Sandy Ryza via bikas) (Revision 1459555) Result = FAILURE bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1459555 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/AMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestAMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610299#comment-13610299 ] Hudson commented on YARN-417: - Integrated in Hadoop-Mapreduce-trunk #1380 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1380/]) YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks. (Sandy Ryza via bikas) (Revision 1459555) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1459555 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/AMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestAMRMClientAsync.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/BuilderUtils.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610938#comment-13610938 ] Bikas Saha commented on YARN-417: - I think we need to fix the Jenkins script to run tests at least in the sub-project that has the changes and not just the sub-module. I dont think its invalid for an AM to exit without launching a container. Sandy, I am re-opening this jira so that we can fix the test. > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610939#comment-13610939 ] Bikas Saha commented on YARN-417: - Actually it wasnt resolved. So its still open. > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[
https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610944#comment-13610944
]
Chris Nauroth commented on YARN-417:
We would also need to add a timeout to {{TestUnmanagedAMLauncher}} for the
proposed change in test-patch to catch this problem.
> Create AMRMClient wrapper that provides asynchronous callbacks
> --
>
> Key: YARN-417
> URL: https://issues.apache.org/jira/browse/YARN-417
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api, applications
>Affects Versions: 2.0.3-alpha
>Reporter: Sandy Ryza
>Assignee: Sandy Ryza
> Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java,
> YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch,
> YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch,
> YarnAppMaster.java, YarnAppMasterListener.java
>
>
> Writing AMs would be easier for some if they did not have to handle
> heartbeating to the RM on their own.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610954#comment-13610954 ] Sandy Ryza commented on YARN-417: - Agreed about fixing the Jenkins script. In general, I also don't think it's invalid for an AM to exit without launching a container, and AMRMClientAsync does nothing to prevent this. But in the case of distributed shell, I don't think it makes sense to run a shell command with no containers to execute it. I will attach an addendum patch that fails distributed shell early if the number of containers is 0, amend the test to use 1 container, and add a timeout. > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, YARN-417.patch, > YarnAppMaster.java, YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[
https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610987#comment-13610987
]
Hadoop QA commented on YARN-417:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12575048/YARN-417-addendum.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 tests included appear to have a timeout.{color}
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/573//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/573//console
This message is automatically generated.
> Create AMRMClient wrapper that provides asynchronous callbacks
> --
>
> Key: YARN-417
> URL: https://issues.apache.org/jira/browse/YARN-417
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api, applications
>Affects Versions: 2.0.3-alpha
>Reporter: Sandy Ryza
>Assignee: Sandy Ryza
> Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java,
> YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch,
> YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch,
> YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java,
> YarnAppMasterListener.java
>
>
> Writing AMs would be easier for some if they did not have to handle
> heartbeating to the RM on their own.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[
https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611332#comment-13611332
]
Chris Nauroth commented on YARN-417:
I am +1 for the addendum patch, assuming there is agreement that it doesn't
make sense to run distributed shell with 0 containers. I tested it locally and
verified that {{TestUnmanagedAMLauncher}} no longer hangs. Thanks, Sandy!
> Create AMRMClient wrapper that provides asynchronous callbacks
> --
>
> Key: YARN-417
> URL: https://issues.apache.org/jira/browse/YARN-417
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api, applications
>Affects Versions: 2.0.3-alpha
>Reporter: Sandy Ryza
>Assignee: Sandy Ryza
> Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java,
> YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch,
> YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch,
> YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java,
> YarnAppMasterListener.java
>
>
> Writing AMs would be easier for some if they did not have to handle
> heartbeating to the RM on their own.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611461#comment-13611461 ] Bikas Saha commented on YARN-417: - Thanks Sandy for the fix and Chris for testing. > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, > YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java, > YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611465#comment-13611465 ] Hudson commented on YARN-417: - Integrated in Hadoop-trunk-Commit #3515 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3515/]) YARN-417. Addendum patch to fix broken test (Sandy Ryza via bikas) (Revision 1460064) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1460064 Files : * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, > YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java, > YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611676#comment-13611676 ] Hudson commented on YARN-417: - Integrated in Hadoop-Yarn-trunk #164 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/164/]) YARN-417. Addendum patch to fix broken test (Sandy Ryza via bikas) (Revision 1460064) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1460064 Files : * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, > YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java, > YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611708#comment-13611708 ] Hudson commented on YARN-417: - Integrated in Hadoop-Hdfs-trunk #1353 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1353/]) YARN-417. Addendum patch to fix broken test (Sandy Ryza via bikas) (Revision 1460064) Result = FAILURE bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1460064 Files : * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, > YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java, > YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-417) Create AMRMClient wrapper that provides asynchronous callbacks
[ https://issues.apache.org/jira/browse/YARN-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611719#comment-13611719 ] Hudson commented on YARN-417: - Integrated in Hadoop-Mapreduce-trunk #1381 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1381/]) YARN-417. Addendum patch to fix broken test (Sandy Ryza via bikas) (Revision 1460064) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1460064 Files : * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java > Create AMRMClient wrapper that provides asynchronous callbacks > -- > > Key: YARN-417 > URL: https://issues.apache.org/jira/browse/YARN-417 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, applications >Affects Versions: 2.0.3-alpha >Reporter: Sandy Ryza >Assignee: Sandy Ryza > Attachments: AMRMClientAsync-1.java, AMRMClientAsync.java, > YARN-417-1.patch, YARN-417-2.patch, YARN-417-3.patch, YARN-417-4.patch, > YARN-417-4.patch, YARN-417-5.patch, YARN-417-6.patch, > YARN-417-addendum.patch, YARN-417.patch, YarnAppMaster.java, > YarnAppMasterListener.java > > > Writing AMs would be easier for some if they did not have to handle > heartbeating to the RM on their own. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
