[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164570#comment-14164570 ] Tsuyoshi OZAWA commented on YARN-2252: -- [~kkambatl] [~ywskycn] Thank you, opened YARN-2666 to address the problem. > Intermittent failure of TestFairScheduler.testContinuousScheduling > -- > > Key: YARN-2252 > URL: https://issues.apache.org/jira/browse/YARN-2252 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler >Affects Versions: trunk-win >Reporter: Ratandeep Ratti > Labels: hadoop2, scheduler, yarn > Fix For: 2.6.0 > > Attachments: YARN-2252-1.patch, yarn-2252-2.patch > > > This test-case is failing sporadically on my machine. I think I have a > plausible explanation for this. > It seems that when the Scheduler is being asked for resources, the resource > requests that are being constructed have no preference for the hosts (nodes). > The two mock hosts constructed, both have a memory of 8192 mb. > The containers(resources) being requested each require a memory of 1024mb, > hence a single node can execute both the resource requests for the > application. > In the end of the test-case it is being asserted that the containers > (resource requests) be executed on different nodes, but since we haven't > specified any preferences for nodes when requesting the resources, the > scheduler (at times) executes both the containers (requests) on the same node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163761#comment-14163761 ] Wei Yan commented on YARN-2252: --- [~ozawa], [~kasha], I'll look into this issue. > Intermittent failure of TestFairScheduler.testContinuousScheduling > -- > > Key: YARN-2252 > URL: https://issues.apache.org/jira/browse/YARN-2252 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler >Affects Versions: trunk-win >Reporter: Ratandeep Ratti > Labels: hadoop2, scheduler, yarn > Fix For: 2.6.0 > > Attachments: YARN-2252-1.patch, yarn-2252-2.patch > > > This test-case is failing sporadically on my machine. I think I have a > plausible explanation for this. > It seems that when the Scheduler is being asked for resources, the resource > requests that are being constructed have no preference for the hosts (nodes). > The two mock hosts constructed, both have a memory of 8192 mb. > The containers(resources) being requested each require a memory of 1024mb, > hence a single node can execute both the resource requests for the > application. > In the end of the test-case it is being asserted that the containers > (resource requests) be executed on different nodes, but since we haven't > specified any preferences for nodes when requesting the resources, the > scheduler (at times) executes both the containers (requests) on the same node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163470#comment-14163470 ] Karthik Kambatla commented on YARN-2252: [~ozawa] - I have also noticed the failure occasionally, poked around a little but didn't see the root cause. We could reopen this JIRA or open another one: the earlier patch is already committed to branch-2.6. > Intermittent failure of TestFairScheduler.testContinuousScheduling > -- > > Key: YARN-2252 > URL: https://issues.apache.org/jira/browse/YARN-2252 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler >Affects Versions: trunk-win >Reporter: Ratandeep Ratti > Labels: hadoop2, scheduler, yarn > Fix For: 2.6.0 > > Attachments: YARN-2252-1.patch, yarn-2252-2.patch > > > This test-case is failing sporadically on my machine. I think I have a > plausible explanation for this. > It seems that when the Scheduler is being asked for resources, the resource > requests that are being constructed have no preference for the hosts (nodes). > The two mock hosts constructed, both have a memory of 8192 mb. > The containers(resources) being requested each require a memory of 1024mb, > hence a single node can execute both the resource requests for the > application. > In the end of the test-case it is being asserted that the containers > (resource requests) be executed on different nodes, but since we haven't > specified any preferences for nodes when requesting the resources, the > scheduler (at times) executes both the containers (requests) on the same node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[
https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163118#comment-14163118
]
Tsuyoshi OZAWA commented on YARN-2252:
--
Hi, this test failure is found on trunk - you can find it
[here|https://issues.apache.org/jira/browse/YARN-2312?focusedCommentId=14161902&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14161902].
Log is as follows:
{code}
Tests run: 79, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.698 sec <<<
FAILURE! - in
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler
testContinuousScheduling(org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler)
Time elapsed: 0.582 sec <<< FAILURE!
java.lang.AssertionError: expected:<2> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler.testContinuousScheduling(TestFairScheduler.java:3372)
{code}
Can I reopen this problem?
> Intermittent failure of TestFairScheduler.testContinuousScheduling
> --
>
> Key: YARN-2252
> URL: https://issues.apache.org/jira/browse/YARN-2252
> Project: Hadoop YARN
> Issue Type: Bug
> Components: scheduler
>Affects Versions: trunk-win
>Reporter: Ratandeep Ratti
> Labels: hadoop2, scheduler, yarn
> Fix For: 2.6.0
>
> Attachments: YARN-2252-1.patch, yarn-2252-2.patch
>
>
> This test-case is failing sporadically on my machine. I think I have a
> plausible explanation for this.
> It seems that when the Scheduler is being asked for resources, the resource
> requests that are being constructed have no preference for the hosts (nodes).
> The two mock hosts constructed, both have a memory of 8192 mb.
> The containers(resources) being requested each require a memory of 1024mb,
> hence a single node can execute both the resource requests for the
> application.
> In the end of the test-case it is being asserted that the containers
> (resource requests) be executed on different nodes, but since we haven't
> specified any preferences for nodes when requesting the resources, the
> scheduler (at times) executes both the containers (requests) on the same node.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144799#comment-14144799 ] Hudson commented on YARN-2252: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1905 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1905/]) YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha) (kasha: rev f5578207d2d20aa71adf12aa9f6c37b00ee9b8dc) * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java > Intermittent failure of TestFairScheduler.testContinuousScheduling > -- > > Key: YARN-2252 > URL: https://issues.apache.org/jira/browse/YARN-2252 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler >Affects Versions: trunk-win >Reporter: Ratandeep Ratti > Labels: hadoop2, scheduler, yarn > Fix For: 2.6.0 > > Attachments: YARN-2252-1.patch, yarn-2252-2.patch > > > This test-case is failing sporadically on my machine. I think I have a > plausible explanation for this. > It seems that when the Scheduler is being asked for resources, the resource > requests that are being constructed have no preference for the hosts (nodes). > The two mock hosts constructed, both have a memory of 8192 mb. > The containers(resources) being requested each require a memory of 1024mb, > hence a single node can execute both the resource requests for the > application. > In the end of the test-case it is being asserted that the containers > (resource requests) be executed on different nodes, but since we haven't > specified any preferences for nodes when requesting the resources, the > scheduler (at times) executes both the containers (requests) on the same node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144822#comment-14144822 ] Hudson commented on YARN-2252: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1880 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1880/]) YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha) (kasha: rev f5578207d2d20aa71adf12aa9f6c37b00ee9b8dc) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java * hadoop-yarn-project/CHANGES.txt > Intermittent failure of TestFairScheduler.testContinuousScheduling > -- > > Key: YARN-2252 > URL: https://issues.apache.org/jira/browse/YARN-2252 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler >Affects Versions: trunk-win >Reporter: Ratandeep Ratti > Labels: hadoop2, scheduler, yarn > Fix For: 2.6.0 > > Attachments: YARN-2252-1.patch, yarn-2252-2.patch > > > This test-case is failing sporadically on my machine. I think I have a > plausible explanation for this. > It seems that when the Scheduler is being asked for resources, the resource > requests that are being constructed have no preference for the hosts (nodes). > The two mock hosts constructed, both have a memory of 8192 mb. > The containers(resources) being requested each require a memory of 1024mb, > hence a single node can execute both the resource requests for the > application. > In the end of the test-case it is being asserted that the containers > (resource requests) be executed on different nodes, but since we haven't > specified any preferences for nodes when requesting the resources, the > scheduler (at times) executes both the containers (requests) on the same node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2252) Intermittent failure of TestFairScheduler.testContinuousScheduling
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144667#comment-14144667 ] Hudson commented on YARN-2252: -- FAILURE: Integrated in Hadoop-Yarn-trunk #689 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/689/]) YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha) (kasha: rev f5578207d2d20aa71adf12aa9f6c37b00ee9b8dc) * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java > Intermittent failure of TestFairScheduler.testContinuousScheduling > -- > > Key: YARN-2252 > URL: https://issues.apache.org/jira/browse/YARN-2252 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler >Affects Versions: trunk-win >Reporter: Ratandeep Ratti > Labels: hadoop2, scheduler, yarn > Fix For: 2.6.0 > > Attachments: YARN-2252-1.patch, yarn-2252-2.patch > > > This test-case is failing sporadically on my machine. I think I have a > plausible explanation for this. > It seems that when the Scheduler is being asked for resources, the resource > requests that are being constructed have no preference for the hosts (nodes). > The two mock hosts constructed, both have a memory of 8192 mb. > The containers(resources) being requested each require a memory of 1024mb, > hence a single node can execute both the resource requests for the > application. > In the end of the test-case it is being asserted that the containers > (resource requests) be executed on different nodes, but since we haven't > specified any preferences for nodes when requesting the resources, the > scheduler (at times) executes both the containers (requests) on the same node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
