[jira] [Created] (YARN-4979) FSAppAttempt adds duplicate ResourceRequest to demand in updateDemand.

[zhihai xu (JIRA)]

zhihai xu created YARN-4979:
---

 Summary: FSAppAttempt adds duplicate ResourceRequest to demand in 
updateDemand.
 Key: YARN-4979
 URL: https://issues.apache.org/jira/browse/YARN-4979
 Project: Hadoop YARN
  Issue Type: Bug
  Components: fairscheduler
Affects Versions: 2.7.2, 2.8.0
Reporter: zhihai xu
Assignee: zhihai xu


FSAppAttempt adds duplicate ResourceRequest to demand in updateDemand. We 
should only count ResourceRequest for ResourceRequest.ANY when calculate demand.
Because {{hasContainerForNode}} will return false if no container request for 
ResourceRequest.ANY and both {{allocateNodeLocal}} and {{allocateRackLocal}} 
will also decrease the number of containers for ResourceRequest.ANY.
This issue may cause current memory demand overflow(integer) because duplicate 
requests can be on multiple nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Yarn-trunk - Build # 2043 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2043/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9374 lines...]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.921 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
Running 
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.506 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.584 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 244.421 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart
Running org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.664 sec - in 
org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter

Results :

Tests run: 1349, Failures: 0, Errors: 0, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.497 s]
[INFO] Apache Hadoop YARN API  SUCCESS [04:18 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [03:05 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.091 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [ 46.635 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [12:09 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 25.644 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [03:24 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:16 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:40 h
[INFO] Finished at: 2016-04-21T05:22:59+00:00
[INFO] Final Memory: 62M/491M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
All tests passed

Build failed in Jenkins: Hadoop-Yarn-trunk #2043

[Apache Jenkins Server]

See 

Changes:

[jianhe] MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip

--
[...truncated 9181 lines...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.414 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMReconnect
Running 
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.328 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
Running 
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestRMNMRPCResponseId
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.559 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestRMNMRPCResponseId
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.982 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationInputValidator
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.886 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationInputValidator
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestNoOverCommitPolicy
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.686 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestNoOverCommitPolicy
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryPlan
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.951 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryPlan
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryReservationAllocation
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.58 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryReservationAllocation
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestFairSchedulerPlanFollower
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.308 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestFairSchedulerPlanFollower
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacitySchedulerPlanFollower
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.541 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacitySchedulerPlanFollower
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestRLESparseResourceAllocation
Tests run: 12, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.55 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestRLESparseResourceAllocation
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystemUtil
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.715 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystemUtil
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystem
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.362 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystem
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestGreedyReservationAgent
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.451 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestGreedyReservationAgent
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestAlignedPlanner
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.274 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestAlignedPlanner
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestSimpleCapacityReplanner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.942 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestSimpleCapacityReplanner
Running 
org.apache.hadoop.yarn.server.resourcemanager.blacklist.TestBlacklistManager
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.19 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.blacklist.TestBlacklistManager
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMEmbeddedElector
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.301 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMEmbeddedElector
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.329 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestA

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1328

[Apache Jenkins Server]

See 

Changes:

[wangda] YARN-4890. Unit test intermittent failure:

[jianhe] MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip

--
[...truncated 6032 lines...]
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.154 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRM
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.142 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestRM
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.blacklist.TestBlacklistManager
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.167 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.blacklist.TestBlacklistManager
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestContainerResourceUsage
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.743 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestContainerResourceUsage
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.221 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestAppManager
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.13 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestAppManager
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.833 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMDispatcher
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.751 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMDispatcher
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestSchedulingUpdate
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.353 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestSchedulingUpdate
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestContinuousScheduling
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.098 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestContinuousScheduling
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.policies.TestDominantResourceFairnessPolicy
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.438 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.policies.TestDominantResourceFairnessPolicy
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.policies.TestEmptyQueues
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.435 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.policies.TestEmptyQueues
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestAppRunnability
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.976 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestAppRunnability
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler
Tests run: 83, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.284 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;

Hadoop-Yarn-trunk-Java8 - Build # 1328 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1328/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 6225 lines...]
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation
  TestRMWebServicesAppsModification.:300->getSimpleAuthInjectorFair:253 » 
Creation

Tests run: 1239, Failures: 0, Errors: 33, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.939 s]
[INFO] Apache Hadoop YARN API  SUCCESS [01:29 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [02:40 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.078 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [ 41.574 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [12:01 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 19.693 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [03:33 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:06 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:27 h
[INFO] Finished at: 2016-04-21T03:57:08+00:00
[INFO] Final Memory: 75M/1030M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: ExecutionException: 
java.lang.RuntimeException: The forked VM terminated without properly saying 
goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
 && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx2048m 
-XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire/surefirebooter3181663197695444373.jar
 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire/surefire8524577741077070343tmp
 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire/surefire_1797748695763450650981tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
#

Hadoop-Yarn-trunk - Build # 2042 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2042/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9420 lines...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.586 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger
Running org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.159 sec - in 
org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter

Results :

Failed tests: 
  TestCapacityScheduler.testHeadRoomCalculationWithDRC:3059 expected:<6144> but 
was:<16384>

Tests in error: 
  TestSchedulingPolicy.testIsApplicableTo:116 »  test timed out after 1000 
milli...

Tests run: 1349, Failures: 1, Errors: 1, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  6.706 s]
[INFO] Apache Hadoop YARN API  SUCCESS [07:08 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [05:09 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.192 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [01:23 min]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [15:37 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 45.870 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [05:11 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:30 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:05 h
[INFO] Finished at: 2016-04-21T03:18:02+00:00
[INFO] Final Memory: 64M/480M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.testHeadRoomCalculationWithDRC

Error Message:
expected:<6144> but was:<16384>

Stack Trace:
java.lang.AssertionError: expected:<6144> but was:<16384>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.testHeadRoomCalculationWithDRC(TestCapacityScheduler.java:3059)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestSchedulingPolicy.testIsApplicableTo

Error Message:
test timed out after 1000 milliseconds

Stack Trace:
java.lang.Exception: test timed out after 1000 milliseconds
at sun.misc.Unsafe.getObject(Native Method)
at 
java.util.concurrent.ConcurrentHashMap.putIfAbsent(ConcurrentHashMap.java:1147)
at java.lang.ClassLoader.getClassLoadingLock(ClassL

Build failed in Jenkins: Hadoop-Yarn-trunk #2042

[Apache Jenkins Server]

See 

Changes:

[wangda] YARN-4890. Unit test intermittent failure:

--
[...truncated 9227 lines...]
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.328 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationPriority
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestChildQueueOrder
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.108 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestChildQueueOrder
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestSchedulerApplicationAttempt
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.365 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestSchedulerApplicationAttempt
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestAppSchedulingInfo
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.38 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestAppSchedulingInfo
Running 
org.apache.hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.782 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMNodeTransitions
Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.993 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMNodeTransitions
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMHAForNodeLabels
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.346 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMHAForNodeLabels
Running org.apache.hadoop.yarn.server.resourcemanager.TestResourceTrackerService
Tests run: 27, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.076 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestResourceTrackerService
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 190.413 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart
Running org.apache.hadoop.yarn.server.resourcemanager.TestMoveApplication
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.557 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestMoveApplication
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestReservationSystemWithRMHA
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.825 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestReservationSystemWithRMHA
Running 
org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.TestProportionalCapacityPreemptionPolicy
Tests run: 27, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.726 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.TestProportionalCapacityPreemptionPolicy
Running 
org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.TestProportionalCapacityPreemptionPolicyForNodePartitions
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.292 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.TestProportionalCapacityPreemptionPolicyForNodePartitions
Running 
org.apache.hadoop.yarn.server.resourcemanager.monitor.TestSchedulingMonitor
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.577 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.monitor.TestSchedulingMonitor
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterLauncher
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.033 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterLauncher
Running org.apache.hadoop.yarn.server.resourcemanager.TestSignalContainer
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.937 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestSignalContainer
Running 
org.apache.hadoop.yarn.server.resourcemanager.nodelabels.TestRMNodeLabelsManager
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.324 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.nodelabels.TestRMNodeLabelsManager
Running 
org.apache.hadoop.yarn.server.resourcemanager.nodelabels.TestRMDelegatedNodeLabelsUpdater
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.408 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.nodelabels.TestRMDelegatedNodeLabelsUpdater
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystem
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.256 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystem
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystemUtil

Build failed in Jenkins: Hadoop-Yarn-trunk #2041

[Apache Jenkins Server]

See 

Changes:

[cnauroth] HDFS-10312. Large block reports may fail to decode at NameNode due 
to 64

--
[...truncated 9193 lines...]
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.01 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryPlan
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryReservationAllocation
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.584 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryReservationAllocation
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestFairSchedulerPlanFollower
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.352 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestFairSchedulerPlanFollower
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacitySchedulerPlanFollower
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.593 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacitySchedulerPlanFollower
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestRLESparseResourceAllocation
Tests run: 12, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.574 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestRLESparseResourceAllocation
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystemUtil
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.733 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystemUtil
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystem
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.437 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationSystem
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestGreedyReservationAgent
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.526 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestGreedyReservationAgent
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestAlignedPlanner
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.2 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestAlignedPlanner
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestSimpleCapacityReplanner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.999 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestSimpleCapacityReplanner
Running 
org.apache.hadoop.yarn.server.resourcemanager.blacklist.TestBlacklistManager
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.2 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.blacklist.TestBlacklistManager
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMEmbeddedElector
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.363 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMEmbeddedElector
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.24 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.TestFifoScheduler
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.585 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.TestFifoScheduler
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.policy.TestFifoOrderingPolicyForPendingApps
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.534 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.policy.TestFifoOrderingPolicyForPendingApps
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.policy.TestFairOrderingPolicy
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.494 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.policy.TestFairOrderingPolicy
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.policy.TestFifoOrderingPolicy
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.517 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.policy.TestFifoOrderingPolicy
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerFairShare
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.107 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerFairShare
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestAllocationFileLoaderService
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time el

Hadoop-Yarn-trunk - Build # 2041 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2041/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9386 lines...]
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.729 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 247.027 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart
Running org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.907 sec - in 
org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter

Results :

Failed tests: 
  
TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate:1459->checkQueueUsedCapacity:1240
 expected:<0.3> but was:<0.6>

Tests run: 1349, Failures: 1, Errors: 0, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.511 s]
[INFO] Apache Hadoop YARN API  SUCCESS [04:22 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [03:09 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.089 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [ 46.369 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [12:15 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 26.566 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [03:27 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:17 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:41 h
[INFO] Finished at: 2016-04-21T00:31:20+00:00
[INFO] Final Memory: 62M/507M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate

Error Message:
expected:<0.3> but was:<0.6>

Stack Trace:
java.lang.AssertionError: expected:<0.3> but was:<0.6>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:519)
at org.junit.Assert.assertEquals(Assert.java:609)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.checkQueueUsedCapacity(TestNodeLabelContainerAllocation.java:1240)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate(TestNodeLabelContainerAllocation.java:1459)

Hadoop-Yarn-trunk-Java8 - Build # 1327 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1327/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 4910 lines...]
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.287 sec - in 
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDB

Results :

Failed tests: 
  TestApplicationHistoryServer.testLaunch:102 expected:<0> but was:<-1>

Tests in error: 
  TestApplicationHistoryServer.testFilterOverrides:174 »  test timed out after 
2...

Tests run: 169, Failures: 1, Errors: 1, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.706 s]
[INFO] Apache Hadoop YARN API  SUCCESS [01:30 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [02:38 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.077 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [ 41.012 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [12:22 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 20.721 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. FAILURE [06:44 min]
[INFO] Apache Hadoop YARN ResourceManager  SKIPPED
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 24:22 min
[INFO] Finished at: 2016-04-20T22:48:18+00:00
[INFO] Final Memory: 95M/1096M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-applicationhistoryservice: ExecutionException: 
java.lang.RuntimeException: The forked VM terminated without properly saying 
goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice
 && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx2048m 
-XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/target/surefire/surefirebooter8335182619162453599.jar
 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/target/surefire/surefire6383079717168313066tmp
 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/target/surefire/surefire_165761719997197516865tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-applicationhistoryservice
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer.testFilterOverrides

Error Message:
test timed out after 24 milliseconds

Stack Trace:
java.lang.Exception: test timed out after 24 milliseconds
at 
org.mortbay.io.nio.SelectorManager$Se

Re: [VOTE] Merge YARN-3368 to trunk

[Wangda Tan]

I want to restart merge vote:

Updates: addressed comments from @aw/@chris, fixed:

*Licenses:*
- ASF licenses issues
- Licenses for dependencies (Added to top level LICENSE.txt). There’s
nothing new to add to NOTICE.txt

*Building:*
- Integrated yarn-ui building to Maven. Instead of build it by default, I
placed it under a separate profile (-Pyarn-ui), only people who have
interests for this in-development feature can build/try it.
- Dockerfile support for dependencies

*Documentations:*
- Modified BUILDING.txt includes how to build yarn-ui
- Moved tutorial doc to
site: 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md

*Other changes:*
- Removed Unnecessary dot files, including all .gitkeepers
- .gitignore is move to top dir
- Cleaned up all hard-coded fields for service addresses, such as
rm-address / ATS-address, etc. (YARN-4514)

Merge JIRA for Jenkins is:

https://issues.apache.org/jira/browse/YARN-4734

Latest Jenkins gets back with +1
https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15248772&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15248772.
(Unit tests failure are not related).

(Again :D), the vote will run for 7 days, ending Wednesday, Apr 27. Please
feel free to comment if you have any questions/doubts. I'll start with my
+1 (binding).

+ Chris/Allen

Thanks,
Wangda


On Mon, Feb 29, 2016 at 10:50 PM, Wangda Tan  wrote:

> Hi Chris,
>
> Sure, will address comments at YARN-4734 and send a separate DISCUSS
> thread before call for vote.
>
> Thanks,
> Wangda
>
> On Mon, Feb 29, 2016 at 10:40 PM, Allen Wittenauer 
> wrote:
>
>>
>> > On Feb 29, 2016, at 9:33 PM, Chris Douglas  wrote:
>> >
>> > On Thu, Feb 25, 2016 at 8:10 AM, Allen Wittenauer 
>> wrote:
>> >> -1 (non-binding)
>> >
>> > Your -1 is binding, per the bylaws. If you intend it only in protest,
>> > -0 is typical.
>>
>> I had it in my head that branch merges requires PMC +1s, not
>> committers.  It’s definitely not a protest -1.
>>
>> Thanks.
>
>
>

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1327

[Apache Jenkins Server]

See 

Changes:

[cnauroth] HDFS-10312. Large block reports may fail to decode at NameNode due 
to 64

--
[...truncated 4717 lines...]
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"IPC Server listener on 10200" daemon prio=5 tid=125 runnable
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.apache.hadoop.ipc.Server$Listener.run(Server.java:901)
"Reference Handler" daemon prio=10 tid=2 in Object.wait()
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
"pool-6-thread-1"  prio=5 tid=140 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
"IPC Server handler 2 on 10200" daemon prio=5 tid=131 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:214)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2387)
"IPC Server handler 8 on 10200" daemon prio=5 tid=137 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:214)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2387)
"134848071@qtp-1402519660-0" daemon prio=5 tid=141 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
at 
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
"IPC Server handler 3 on 10200" daemon prio=5 tid=132 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:214)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2387)
"IPC Server Responder" daemon prio=5 tid=128 runnable
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.hadoop.ipc.Server$Responder.doRunLoop(Server.java:1079)
at org.apache.hadoop.ipc.Server$Responder.run(Server.java:1062)
"246983978@qtp-1402519660-1 - Acceptor0 SelectChannelConnector@localhost:55513" 
daemon prio=5 tid=142 blocked
java.lang.Thread.State: BLOCKED
at 
org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:464)
at org.m

[jira] [Created] (YARN-4978) The number of javadocs warnings is limited to 100

[Li Lu (JIRA)]

Li Lu created YARN-4978:
---

 Summary: The number of javadocs warnings is limited to 100 
 Key: YARN-4978
 URL: https://issues.apache.org/jira/browse/YARN-4978
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Li Lu


We are generating a lot of javadoc warnings with jdk 1.8. Right now the number 
is limited to 100. Enlarge this limitation can probably reveal more problems in 
one batch for our javadoc generation process. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4977) Fix javadocs warnings in yarn-api for jdk 1.8

[Li Lu (JIRA)]

Li Lu created YARN-4977:
---

 Summary: Fix javadocs warnings in yarn-api for jdk 1.8
 Key: YARN-4977
 URL: https://issues.apache.org/jira/browse/YARN-4977
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Li Lu


I can see there are a lot of javadoc warnings for YARN codebase if ran through 
jdk 1.8. We need to fix them.

Some samples: if we ran mvn javadoc:javadoc on yarn-api, here's part of my 
sample outputs: 
{code}
100 warnings
[WARNING] Javadoc Warnings
[WARNING] Picked up JAVA_TOOL_OPTIONS: -Djava.awt.headless=true
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:97:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:98:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:129:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:130:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:169:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:170:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:202:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:203:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:237:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:238:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:274:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:275:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:296:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:297:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:311:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:312:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:326:
 warning: no description for @throws
[WARNING] * @throws YarnException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationBaseProtocol.java:327:
 warning: no description for @throws
[WARNING] * @throws IOException
[WARNING] ^
[WARNING] 
/Users/llu/hadoop-commo

Hadoop-Yarn-trunk-Java8 - Build # 1326 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1326/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 5288 lines...]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.984 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.047 sec - in 
org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter

Results :

Failed tests: 
  
TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate:1459->checkQueueUsedCapacity:1240
 expected:<0.3> but was:<0.6>

Tests run: 1349, Failures: 1, Errors: 0, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  5.289 s]
[INFO] Apache Hadoop YARN API  SUCCESS [01:48 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [03:09 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.107 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [ 49.434 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [13:06 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 23.575 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [04:48 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:26 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:50 h
[INFO] Finished at: 2016-04-20T21:44:05+00:00
[INFO] Final Memory: 64M/M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate

Error Message:
expected:<0.3> but was:<0.6>

Stack Trace:
java.lang.AssertionError: expected:<0.3> but was:<0.6>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:519)
at org.junit.Assert.assertEquals(Assert.java:609)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.checkQueueUsedCapacity(TestNodeLabelContainerAllocation.java:1240)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate(TestNodeLabelContainerAllocation.java:1459)

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1326

[Apache Jenkins Server]

See 

Changes:

[cmccabe] HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

--
[...truncated 5095 lines...]
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMDispatcher
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.058 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMDispatcher
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMProxyUsersConf
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.711 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMProxyUsersConf
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.874 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestTokenClientRMService
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.676 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestTokenClientRMService
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestLeaderElectorService
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.565 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestLeaderElectorService
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryPlan
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.098 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryPlan
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.859 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestFairSchedulerPlanFollower
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.448 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestFairSchedulerPlanFollower
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacitySchedulerPlanFollower
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.825 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestCapacitySchedulerPlanFollower
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationInputValidator
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.97 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestReservationInputValidator
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestSimpleCapacityReplanner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.077 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestSimpleCapacityReplanner
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestGreedyReservationAgent
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.571 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestGreedyReservationAgent
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestAlignedPlanner
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.188 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.TestAlignedPlanner
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.reservation.TestInMemoryReservationAllocation
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.604 sec - in 
o

Hadoop-Yarn-trunk - Build # 2040 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2040/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9538 lines...]
Results :

Failed tests: 
  
TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate:1459->checkQueueUsedCapacity:1240
 expected:<0.3> but was:<0.6>

Tests in error: 
  
TestCapacitySchedulerPreemption.testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers:450
 » NullPointer
  TestAMAuthorization.testAuthorizedAccess:178 » YarnRuntime 
java.net.BindExcept...
  TestAMAuthorization.testUnauthorizedAccess:239 » YarnRuntime 
java.net.BindExce...
  TestAMAuthorization.testAuthorizedAccess:178 » YarnRuntime 
java.net.BindExcept...
  TestAMAuthorization.testUnauthorizedAccess:239 » YarnRuntime 
java.net.BindExce...

Tests run: 1349, Failures: 1, Errors: 5, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  4.439 s]
[INFO] Apache Hadoop YARN API  SUCCESS [04:55 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [03:44 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.101 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [01:00 min]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [13:14 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 30.822 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [04:27 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:25 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:53 h
[INFO] Finished at: 2016-04-20T21:06:27+00:00
[INFO] Final Memory: 64M/541M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
6 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization.testAuthorizedAccess[0]

Error Message:
java.net.BindException: Problem binding to [0.0.0.0:8030] 
java.net.BindException: Address already in use; For more details see:  
http://wiki.apache.org/hadoop/BindException

Stack Trace:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: 
Problem binding to [0.0.0.0:8030] java.net.BindException: Address already in 
use; For more details see:  http://wiki.apache.org/hadoop/BindException
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:444)
at sun.nio.ch.Net.bind(Net.java:436)
at 
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.apache.hadoop.ipc.Server.bind(Server.java:530)
at org.apache.hadoop.ipc.Server$Listener.(Server.java:793)
at org.apache.hadoop.ipc.Server.(Server.java:2592)
at org.apache.hadoop.ipc.RPC$Ser

Build failed in Jenkins: Hadoop-Yarn-trunk #2040

[Apache Jenkins Server]

See 

Changes:

[cmccabe] HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

--
[...truncated 9345 lines...]
at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54)
at 
org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.serviceStart(ApplicationMasterService.java:142)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:675)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:1097)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:1137)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:1133)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:1133)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1173)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization.testAuthorizedAccess(TestAMAuthorization.java:178)

testUnauthorizedAccess[0](org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization)
  Time elapsed: 0.351 sec  <<< ERROR!
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: 
Problem binding to [0.0.0.0:8030] java.net.BindException: Address already in 
use; For more details see:  http://wiki.apache.org/hadoop/BindException
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:444)
at sun.nio.ch.Net.bind(Net.java:436)
at 
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.apache.hadoop.ipc.Server.bind(Server.java:530)
at org.apache.hadoop.ipc.Server$Listener.(Server.java:793)
at org.apache.hadoop.ipc.Server.(Server.java:2592)
at org.apache.hadoop.ipc.RPC$Server.(RPC.java:958)
at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
at 
org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:800)
at 
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169)
at 
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132)
at 
org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65)
at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54)
at 
org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.serviceStart(ApplicationMasterService.java:142)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:675)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:1097)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:1137)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:1133)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:1133)
at 
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1173)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization.testUnauthorizedAccess(TestAMAuthorization.java:239)

testAuthorizedAccess[1](org.apache.hadoop.yarn.serv

[jira] [Created] (YARN-4976) Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die

[Giovanni Matteo Fumarola (JIRA)]

Giovanni Matteo Fumarola created YARN-4976:
--

 Summary: Missing NullPointer check in ContainerLaunchContextPBImpl 
causes RM to die
 Key: YARN-4976
 URL: https://issues.apache.org/jira/browse/YARN-4976
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Reporter: Giovanni Matteo Fumarola
Assignee: Giovanni Matteo Fumarola






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

[Ashwin Shankar (JIRA)]

Ashwin Shankar created YARN-4975:


 Summary: Fair Scheduler: exception thrown when a parent queue 
marked 'parent' has configured child queues
 Key: YARN-4975
 URL: https://issues.apache.org/jira/browse/YARN-4975
 Project: Hadoop YARN
  Issue Type: Bug
  Components: fairscheduler
Affects Versions: 2.7.2
Reporter: Ashwin Shankar


We upgraded our clusters to 2.7.2 from 2.4.1 and saw the following exception in 
RM logs :
{code}
Caused by: 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationConfigurationException:
 Both  and type="parent" found for queue root.adhoc which is 
unsupported
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.loadQueue(AllocationFileLoaderService.java:519)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.reloadAllocations(AllocationFileLoaderService.java:352)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.initScheduler(FairScheduler.java:1440)
{code}

>From the exception, it looks like we've configured 'reservation', but we've 
>not. The issue is that AllocationFileLoaderService#loadQueue assumes that a 
>parent queue cannot be marked as 'type=parent' if it has configured child 
>queues. That can be a problem in cases where we mark a queue as 'parent' which 
>has no configured child queues to start with, but we can add child queues 
>later on.
Also the exception is kind of misleading since we haven't configured 
'reservation'. 

How to reproduce:
Run fair scheduler with following queue config:
{code}

10
300

3
 

{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Yarn-trunk-Java8 - Build # 1325 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1325/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 5302 lines...]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.466 sec - in 
org.apache.hadoop.yarn.webapp.TestRMWithCSRFFilter

Results :

Failed tests: 
  
TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate:1459->checkQueueUsedCapacity:1240
 expected:<0.3> but was:<0.6>

Tests in error: 
  TestSchedulingPolicy.testIsApplicableTo:116 »  test timed out after 1000 
milli...

Tests run: 1349, Failures: 1, Errors: 1, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [ 10.966 s]
[INFO] Apache Hadoop YARN API  SUCCESS [02:57 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [05:08 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.114 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [01:17 min]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [17:21 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 41.612 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [05:56 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:31 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:04 h
[INFO] Finished at: 2016-04-20T19:46:44+00:00
[INFO] Final Memory: 64M/1178M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestSchedulingPolicy.testIsApplicableTo

Error Message:
test timed out after 1000 milliseconds

Stack Trace:
java.lang.Exception: test timed out after 1000 milliseconds
at org.mockito.cglib.proxy.Enhancer.(Enhancer.java:86)
at 
org.mockito.internal.creation.jmock.ClassImposterizer.createProxyClass(ClassImposterizer.java:68)
at 
org.mockito.internal.creation.jmock.ClassImposterizer.imposterise(ClassImposterizer.java:50)
at org.mockito.internal.util.MockUtil.createMock(MockUtil.java:54)
at org.mockito.internal.MockitoCore.mock(MockitoCore.java:45)
at org.mockito.Mockito.mock(Mockito.java:921)
at org.mockito.Mockito.mock(Mockito.java:816)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestSchedulingPolicy.testIsApplicableTo(TestSchedulingPolicy.java:116)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation.testQueueUsedCapacitiesUpdate

Error Message:
expected:<0.3> but was:<0.6>

Stack Trace:
java.lang.Assertion

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1325

[Apache Jenkins Server]

See 

Changes:

[kasha] YARN-2883. Queuing of container requests in the NM. (Konstantinos

--
[...truncated 5109 lines...]
Running 
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.TestRMAppAttemptTransitions
Tests run: 86, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 14.379 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.TestRMAppAttemptTransitions
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.TestAMLivelinessMonitor
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.018 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.TestAMLivelinessMonitor
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestRMAppTransitions
Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.341 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestRMAppTransitions
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestNodesListManager
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.717 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestNodesListManager
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestResourceManager
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.318 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestResourceManager
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.827 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.639 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMDispatcher
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.091 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMDispatcher
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.resource.TestResources
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.047 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.resource.TestResources
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.resource.TestResourceWeights
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.156 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.resource.TestResourceWeights
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.485 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestApplicationCleanup
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.113 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationCleanup
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMAdminService
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.029 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestRMAdminService
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.847 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.yar

Build failed in Jenkins: Hadoop-Yarn-trunk #2039

[Apache Jenkins Server]

See 

Changes:

[kasha] YARN-2883. Queuing of container requests in the NM. (Konstantinos

--
[...truncated 9333 lines...]
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.329 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestLeafQueue
Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.589 sec - 
in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestLeafQueue
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerQueueACLs
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.506 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerQueueACLs
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerPreemption
Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 64.47 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerPreemption
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationLimitsByPartition
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.113 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationLimitsByPartition
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationLimits
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.368 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationLimits
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestParentQueue
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.372 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestParentQueue
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerDynamicBehavior
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.611 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerDynamicBehavior
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestReservationQueue
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.817 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestReservationQueue
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler
Tests run: 46, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 131.796 sec 
<<< FAILURE! - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler
testQueueHierarchyPendingResourceUpdate(org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler)
  Time elapsed: 12.82 sec  <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<8192>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.checkPendingResource(TestCapacityScheduler.java:2846)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.testQueueHierarchyPendingResourceUpdate(TestCapacityScheduler.java:2836)

Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestQueueParsing
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.058 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestQueueParsing
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestReservations
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.841 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestReservations
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationPriority
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.068 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationPriority
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestChildQueueOrder
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.863 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestChildQueueOrder
Running 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestSchedulerApplicationAttempt
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.406 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestSchedulerApplicationAttempt
Running org.apache.

Hadoop-Yarn-trunk - Build # 2039 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2039/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9526 lines...]
  TestNodeLabelContainerAllocation.testContainerReservationWithLabels:540 » 
NoClassDefFound
  
TestNodeLabelContainerAllocation.testContainerAllocateWithDefaultQueueLabels:463
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testPreferenceOfNeedyAppsTowardsNodePartitions:726
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testPreferenceOfNeedyPrioritiesUnderSameAppTowardsNodePartitions:789
 » NoClassDefFound
  TestNodeLabelContainerAllocation.testContainerAllocateWithLabels:387 » 
NoClassDefFound
  
TestNodeLabelContainerAllocation.testNonLabeledResourceRequestGetPreferrenceToNonLabeledNode:843
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testQueueMaxCapacitiesWillNotBeHonoredWhenNotRespectingExclusivity:1231
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testQueuesWithoutAccessUsingPartitionedNodes:1082
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testPreferenceOfQueuesTowardsNodePartitions:991
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testContainerAllocationWithSingleUserLimits:199
 » NoClassDefFound
  
TestNodeLabelContainerAllocation.testAMContainerAllocationWillAlwaysBeExclusive:1136
 » NoClassDefFound

Tests run: 1349, Failures: 2, Errors: 12, Skipped: 3

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.877 s]
[INFO] Apache Hadoop YARN API  SUCCESS [04:33 min]
[INFO] Apache Hadoop YARN Common . SUCCESS [03:17 min]
[INFO] Apache Hadoop YARN Server . SUCCESS [  0.118 s]
[INFO] Apache Hadoop YARN Server Common .. SUCCESS [ 51.555 s]
[INFO] Apache Hadoop YARN NodeManager  SUCCESS [12:36 min]
[INFO] Apache Hadoop YARN Web Proxy .. SUCCESS [ 29.034 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SUCCESS [03:34 min]
[INFO] Apache Hadoop YARN ResourceManager  FAILURE [  01:17 h]
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Timeline Plugin Storage  SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:43 h
[INFO] Finished at: 2016-04-20T18:42:11+00:00
[INFO] Final Memory: 63M/477M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-server-resourcemanager: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
14 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.testQueueHierarchyPendingResourceUpdate

Error Message:
expected:<0> but was:<8192>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<8192>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(

[jira] [Created] (YARN-4974) Random test failure:TestRMApplicationHistoryWriter#testRMWritingMassiveHistoryForCapacitySche

[Bibin A Chundatt (JIRA)]

Bibin A Chundatt created YARN-4974:
--

 Summary: Random test 
failure:TestRMApplicationHistoryWriter#testRMWritingMassiveHistoryForCapacitySche
 Key: YARN-4974
 URL: https://issues.apache.org/jira/browse/YARN-4974
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Bibin A Chundatt


https://builds.apache.org/job/PreCommit-YARN-Build/11128/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_77.txt

{noformat}
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 196.959 sec <<< 
FAILURE! - in 
org.apache.hadoop.yarn.server.resourcemanager.ahs.TestRMApplicationHistoryWriter
testRMWritingMassiveHistoryForCapacitySche(org.apache.hadoop.yarn.server.resourcemanager.ahs.TestRMApplicationHistoryWriter)
  Time elapsed: 125.174 sec  <<< FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at 
org.apache.hadoop.yarn.server.resourcemanager.ahs.TestRMApplicationHistoryWriter.testRMWritingMassiveHistory(TestRMApplicationHistoryWriter.java:441)
at 
org.apache.hadoop.yarn.server.resourcemanager.ahs.TestRMApplicationHistoryWriter.testRMWritingMassiveHistoryForCapacitySche(TestRMApplicationHistoryWriter.java:383)

{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4973) YarnWebParams next.fresh.interval should be next.refresh.interval

[Daniel Templeton (JIRA)]

Daniel Templeton created YARN-4973:
--

 Summary: YarnWebParams next.fresh.interval should be 
next.refresh.interval
 Key: YARN-4973
 URL: https://issues.apache.org/jira/browse/YARN-4973
 Project: Hadoop YARN
  Issue Type: Bug
  Components: webapp
Affects Versions: 2.8.0
Reporter: Daniel Templeton
Assignee: Daniel Templeton






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4972) Cleanup QueuingContainerManager tests to remove long sleep times

[Arun Suresh (JIRA)]

Arun Suresh created YARN-4972:
-

 Summary: Cleanup QueuingContainerManager tests to remove long 
sleep times
 Key: YARN-4972
 URL: https://issues.apache.org/jira/browse/YARN-4972
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Arun Suresh
Assignee: Arun Suresh






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4971) RM fails to re-bind to wildcard IP after failover in multi homed clusters

[Wilfred Spiegelenburg (JIRA)]

Wilfred Spiegelenburg created YARN-4971:
---

 Summary: RM fails to re-bind to wildcard IP after failover in 
multi homed clusters
 Key: YARN-4971
 URL: https://issues.apache.org/jira/browse/YARN-4971
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 3.0.0
Reporter: Wilfred Spiegelenburg
Assignee: Wilfred Spiegelenburg


If the RM has the {{yarn.resourcemanager.bind-host}} set to 0.0.0.0 the first 
time the service becomes active binding to the wildcard works as expected. If 
the service has transitioned from active to standby and then becomes active 
again after failovers the service only binds to one of the ip addresses.

There is a difference between the services inside the RM: it only seem to 
happen for the services listening on ports: 8030 and 8032



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4970) Difficult to trace "Connection Refused" in AM Proxying

[Matthew Byng-Maddick (JIRA)]

Matthew Byng-Maddick created YARN-4970:
--

 Summary: Difficult to trace "Connection Refused" in AM Proxying
 Key: YARN-4970
 URL: https://issues.apache.org/jira/browse/YARN-4970
 Project: Hadoop YARN
  Issue Type: Improvement
  Components: webapp
Affects Versions: 2.6.0
 Environment: Hadoop-2.6.0-CDH5.5.1, linux
Reporter: Matthew Byng-Maddick
Priority: Minor


In generating an HA YARN config (effectively using my own tools for 
generation), I missed out the multiple specification of 
{{yarn.resourcemanager.webapp.address}}, which produced a "Connection Refused" 
similar to that in YARN-800 (because of a misunderstanding about what the proxy 
address was) from the AM webapp.

It occurs to me, though, in tracing the code, that the behaviour of 
{{hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/RMHAUtils.java}}:
 {{getRMHAWebappAddresses(YarnConfiguration)}} should probably mirror the 
effect of the startup of the resourcemanager itself, such that if the 
id-suffixed key doesn't exist, you end up using the 
{{yarn.resourcemanager.address}} with the port number replaced by the one taken 
from {{yarn.resourcemanager.webapp.address}} (or its https equivalent). That 
is, if you had a config like:
{code}

  yarn.resourcemanager.ha.enabled
true
  yarn.resourcemanager.ha.rm-ids
hosta,hostb
  yarn.resourcemanager.webapp.address
0.0.0.0:8088
  yarn.resourcemanager.address.hosta
hosta:8032
  yarn.resourcemanager.address.hostb
hostb:8032

{code}
you would end up with ("{{hosta:8088}}", "{{hostb:8088}}") as the 
{{List}} result of the function above, rather than the current empty 
list result.

This would certainly give a better principle of least-surprise for operators of 
yarn (especially those like myself who ended up configuring it wrongly).

Thoughts? Reasons why this isn't a good idea? (I'm afraid my Java's a bit 
read-only which is why I haven't suggested a patch)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)