Failed: YARN-3814 PreCommit Build #8882

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-3814
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8882/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 301 lines...]
|  +1  |  release audit  |  0m 23s| The applied patch does not increase 
|  | || the total number of release audit
|  | || warnings.
|  +1  | checkstyle  |  0m 16s| There were no new checkstyle 
|  | || issues.
|  +1  | whitespace  |  0m 14s| The patch has no lines that end in 
|  | || whitespace.
|  +1  |install  |  1m 31s| mvn install still works. 
|  +1  |eclipse:eclipse  |  0m 42s| The patch built with 
|  | || eclipse:eclipse.
|  +1  |   findbugs  |  0m 52s| The patch does not introduce any 
|  | || new Findbugs (version 3.0.0)
|  | || warnings.
|  +1  | yarn tests  |  1m 35s| Tests passed in 
|  | || hadoop-yarn-server-timelineservice.
|  | |  40m 20s   | 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751178/YARN-3814-YARN-2928.06.patch
 |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | YARN-2928 / 9a82008 |
| hadoop-yarn-server-timelineservice test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-timelineservice.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8882/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
dd9555db4133c9a5238cd5be51d501d5c9af25dd logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 27 artifacts
Archive block size is 32768
Received 43 blocks and 8647319 bytes
Compression is 14.0%
Took 1.9 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed

Failed: YARN-2884 PreCommit Build #8880

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2884
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8880/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 438 lines...]
|  +1  | yarn tests  |  6m 14s| Tests passed in 
|  | || hadoop-yarn-server-nodemanager.
|  -1  | yarn tests  |  53m 11s   | Tests failed in 
|  | || hadoop-yarn-server-resourcemanager.
|  | |  114m 10s  | 


 Reason | Tests
 Failed unit tests  |  hadoop.yarn.util.TestRackResolver 
|  
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751175/YARN-2884-V9.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 30e342a |
| Pre-patch Findbugs warnings | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/trunkFindbugsWarningshadoop-yarn-server-common.html
 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-api.txt
 |
| hadoop-yarn-api test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-api.txt
 |
| hadoop-yarn-common test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-common.txt
 |
| hadoop-yarn-server-common test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-common.txt
 |
| hadoop-yarn-server-nodemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-nodemanager.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8880/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
b9cff8e6a16763364100e1cb1bbe754381394681 logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 86 artifacts
Archive block size is 32768
Received 31 blocks and 37287603 bytes
Compression is 2.7%
Took 7.7 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
3 tests failed.
FAILED:  org.apache.hadoop.yarn.util.TestRackResolver.testCaching

Error Message:
expected: but was:

Stack Trace:
org.junit.ComparisonFailure: expected: but was:
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.util.TestRackResolver.testCaching(TestRackResolver.java:102)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable

Error Message:
expected: but was:

Stack Trace:
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable(TestContainerAllocation.java:321)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testNormalContainerAllocationWhenDNSUnavailable

Error Message:
expected:<0> bu

Failed: YARN-2005 PreCommit Build #8881

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2005
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8881/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 244 lines...]



/home/jenkins/tools/maven/latest/bin/mvn clean test -DskipTests 
-DhadoopPatchProcess -Pnative -Ptest-patch > 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/patchJavacWarnings.txt
 2>&1

Elapsed time:   2m 25s



-1 overall

| Vote |  Subsystem |  Runtime   | Comment

|  -1  | pre-patch  |  3m 22s| trunk compilation may be broken. 
|  +1  |   @author  |  0m 0s | The patch does not contain any 
|  ||| @author tags.
|  +1  |tests included  |  0m 0s | The patch appears to include 7 new 
|  ||| or modified test files.
|  -1  | javac  |  2m 25s| The patch appears to cause the build 
|  ||| to fail.


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751130/YARN-2005.006.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 7ecbfd4 |




  Adding comment to JIRA




Comment added.
c6e644a8a1363f4546cbbce0b3e36ec8c0e0458d logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 14 artifacts
Archive block size is 32768
Received 6 blocks and 11376669 bytes
Compression is 1.7%
Took 2.3 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

Failed: YARN-4025 PreCommit Build #8879

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-4025
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8879/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 323 lines...]
|  | || the total number of release audit
|  | || warnings.
|  +1  | checkstyle  |  0m 18s| There were no new checkstyle 
|  | || issues.
|  +1  | whitespace  |  0m 5s | The patch has no lines that end in 
|  | || whitespace.
|  +1  |install  |  1m 30s| mvn install still works. 
|  +1  |eclipse:eclipse  |  0m 42s| The patch built with 
|  | || eclipse:eclipse.
|  +1  |   findbugs  |  0m 52s| The patch does not introduce any 
|  | || new Findbugs (version 3.0.0)
|  | || warnings.
|  +1  | yarn tests  |  1m 29s| Tests passed in 
|  | || hadoop-yarn-server-timelineservice.
|  | |  41m 45s   | 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751118/YARN-4025-YARN-2928.004.patch
 |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | YARN-2928 / 9a82008 |
| hadoop-yarn-server-timelineservice test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build@2/patchprocess/testrun_hadoop-yarn-server-timelineservice.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8879/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
8a27c6143ce2675cc738320300354c020fd8d184 logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 27 artifacts
Archive block size is 32768
Received 0 blocks and 9932490 bytes
Compression is 0.0%
Took 2.4 sec
[description-setter] Could not determine description.
Recording test results
Publish JUnit test result report is waiting for a checkpoint on 
PreCommit-YARN-Build #8878
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed

Failed: YARN-4059 PreCommit Build #8878

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-4059
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8878/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 312 lines...]
|  +1  |install  |  1m 29s| mvn install still works. 
|  +1  |eclipse:eclipse  |  0m 35s| The patch built with 
|  | || eclipse:eclipse.
|  +1  |   findbugs  |  1m 37s| The patch does not introduce any 
|  | || new Findbugs (version 3.0.0)
|  | || warnings.
|  -1  | yarn tests  |  53m 29s   | Tests failed in 
|  | || hadoop-yarn-server-resourcemanager.
|  | |  95m 47s   | 


 Reason | Tests
 Failed unit tests  |  
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751097/YARN-4059.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 71aedfa |
| javadoc | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffJavadocWarnings.txt
 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
 |
| whitespace | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/whitespace.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8878/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
f00a2812951ce4044209576a6362718b88489a5b logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 31 artifacts
Archive block size is 32768
Received 215 blocks and 6391985 bytes
Compression is 52.4%
Took 2.8 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable

Error Message:
expected: but was:

Stack Trace:
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable(TestContainerAllocation.java:321)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testNormalContainerAllocationWhenDNSUnavailable

Error Message:
expected:<0> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testNormalContainerAllocationWhenDNSUnavailable(TestContainerAllocation.java:206)




[jira] [Created] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-08-18 Thread Li Lu (JIRA)
Li Lu created YARN-4061:
---

 Summary: [Fault tolerance] Fault tolerant writer for timeline v2
 Key: YARN-4061
 URL: https://issues.apache.org/jira/browse/YARN-4061
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Li Lu
Assignee: Li Lu


We need to build a timeline writer that can be resistant to backend storage 
down time and timeline collector failures. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-08-18 Thread Chang Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chang Li resolved YARN-3422.

Resolution: Won't Fix

> relatedentities always return empty list when primary filter is set
> ---
>
> Key: YARN-3422
> URL: https://issues.apache.org/jira/browse/YARN-3422
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: timelineserver
>Reporter: Chang Li
>Assignee: Chang Li
> Attachments: YARN-3422.1.patch
>
>
> When you curl for ats entities with a primary filter, the relatedentities 
> fields always return empty list



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (YARN-4060) Revisit default retry config for connection with RM

2015-08-18 Thread Jian He (JIRA)
Jian He created YARN-4060:
-

 Summary: Revisit default retry config for connection with RM 
 Key: YARN-4060
 URL: https://issues.apache.org/jira/browse/YARN-4060
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Jian He
Assignee: Jian He


15 minutes timeout for AM/NM connection with RM in non-ha scenario turns out to 
be  short in production environment.  The suggestion is to increase that to 30 
min. Also, the retry-interval is set to 30 seconds which appears too long. We 
may reduce that to 10 seconds ?





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (YARN-4059) Preemption should delay assignments back to the preempted queue

2015-08-18 Thread Chang Li (JIRA)
Chang Li created YARN-4059:
--

 Summary: Preemption should delay assignments back to the preempted 
queue
 Key: YARN-4059
 URL: https://issues.apache.org/jira/browse/YARN-4059
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Chang Li
Assignee: Chang Li




When preempting containers from a queue it can take a while for the other 
queues to fully consume the resources that were freed up, due to delays waiting 
for better locality, etc. Those delays can cause the resources to be assigned 
back to the preempted queue, and then the preemption cycle continues.

We should consider adding a delay, either based on node heartbeat counts or 
time, to avoid granting containers to a queue that was recently preempted. The 
delay should be sufficient to cover the cycles of the preemption monitor, so we 
won't try to assign containers in-between preemption events for a queue.

Worst-case scenario for assigning freed resources to other queues is when all 
the other queues want no locality. No locality means only one container is 
assigned per heartbeat, so we need to wait for the entire cluster heartbeating 
in times the number of containers that could run on a single node.

So the "penalty time" for a queue should be the max of either the preemption 
monitor cycle time or the amount of time it takes to allocate the cluster with 
one container per heartbeat. Guessing this will be somewhere around 2 minutes.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Failed: YARN-3814 PreCommit Build #8877

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-3814
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8877/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 301 lines...]
|  +1  |  release audit  |  0m 29s| The applied patch does not increase 
|  | || the total number of release audit
|  | || warnings.
|  +1  | checkstyle  |  0m 16s| There were no new checkstyle 
|  | || issues.
|  +1  | whitespace  |  0m 16s| The patch has no lines that end in 
|  | || whitespace.
|  +1  |install  |  1m 47s| mvn install still works. 
|  +1  |eclipse:eclipse  |  0m 50s| The patch built with 
|  | || eclipse:eclipse.
|  +1  |   findbugs  |  1m 55s| The patch does not introduce any 
|  | || new Findbugs (version 3.0.0)
|  | || warnings.
|  +1  | yarn tests  |  2m 50s| Tests passed in 
|  | || hadoop-yarn-server-timelineservice.
|  | |  49m 45s   | 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751064/YARN-3814-YARN-2928.05.patch
 |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | YARN-2928 / 9a82008 |
| hadoop-yarn-server-timelineservice test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-timelineservice.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8877/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
17f5a72f588ba5046638a2e4375835fe8dbaed15 logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 27 artifacts
Archive block size is 32768
Received 40 blocks and 8691837 bytes
Compression is 13.1%
Took 4 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed

[jira] [Resolved] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-08-18 Thread zhihai xu (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu resolved YARN-3857.
-
Resolution: Fixed

> Memory leak in ResourceManager with SIMPLE mode
> ---
>
> Key: YARN-3857
> URL: https://issues.apache.org/jira/browse/YARN-3857
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: resourcemanager
>Affects Versions: 2.7.0
>Reporter: mujunchao
>Assignee: mujunchao
>Priority: Critical
>  Labels: patch
> Fix For: 2.7.2
>
> Attachments: YARN-3857-1.patch, YARN-3857-2.patch, YARN-3857-3.patch, 
> YARN-3857-4.patch, hadoop-yarn-server-resourcemanager.patch
>
>
>  We register the ClientTokenMasterKey to avoid client may hold an invalid 
> ClientToken after RM restarts. In SIMPLE mode, we register 
> Pair ,  But we never remove it from HashMap, as 
> unregister only runing while in Security mode, so memory leak coming. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Failed: YARN-4014 PreCommit Build #8876

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-4014
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8876/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 444 lines...]
|  +1  | yarn tests  |  7m 29s| Tests passed in hadoop-yarn-client. 
|  -1  | yarn tests  |  2m 12s| Tests failed in hadoop-yarn-common. 
|  -1  | yarn tests  |  56m 1s| Tests failed in 
|  | || hadoop-yarn-server-resourcemanager.
|  | |  218m 20s  | 


 Reason | Tests
 Failed unit tests  |  hadoop.yarn.util.TestRackResolver 
|  
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation 
   Timed out tests  |  
org.apache.hadoop.mapred.TestMRIntermediateDataEncryption 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751035/0004-YARN-4014.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / fc509f6 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-api.txt
 |
| hadoop-mapreduce-client-jobclient test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-mapreduce-client-jobclient.txt
 |
| hadoop-yarn-api test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-api.txt
 |
| hadoop-yarn-client test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-client.txt
 |
| hadoop-yarn-common test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-common.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8876/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
82754efe91b3d3de610ba9be5d46fddc53a81102 logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 86 artifacts
Archive block size is 32768
Received 43 blocks and 31019494 bytes
Compression is 4.3%
Took 10 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
3 tests failed.
FAILED:  org.apache.hadoop.yarn.util.TestRackResolver.testCaching

Error Message:
expected: but was:

Stack Trace:
org.junit.ComparisonFailure: expected: but was:
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.util.TestRackResolver.testCaching(TestRackResolver.java:102)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable

Error Message:
expected: but was:

Stack Trace:
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable(TestContainerAllocation.java:321)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testNormalContainerAllocationWhenDNSUnavailable

Error Message:
expected:<0> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:

Failed: YARN-4024 PreCommit Build #8875

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-4024
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8875/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 331 lines...]
|  | || warnings.
|  +1  | yarn tests  |  0m 24s| Tests passed in hadoop-yarn-api. 
|  -1  | yarn tests  |  1m 55s| Tests failed in hadoop-yarn-common. 
|  -1  | yarn tests  |  57m 27s   | Tests failed in 
|  | || hadoop-yarn-server-resourcemanager.
|  | |  105m 51s  | 


 Reason | Tests
  FindBugs  |  module:hadoop-yarn-server-resourcemanager 
 Failed unit tests  |  hadoop.yarn.util.TestRackResolver 
|  
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12751009/YARN-4024-draft-v3.patch
 |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 71566e2 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-api.txt
 |
| Findbugs warnings | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
 |
| hadoop-yarn-api test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-api.txt
 |
| hadoop-yarn-common test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-common.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8875/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
2d813545634dad416a606c25bb7c520402df7eca logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 58 artifacts
Archive block size is 32768
Received 41 blocks and 31381828 bytes
Compression is 4.1%
Took 6.3 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
3 tests failed.
FAILED:  org.apache.hadoop.yarn.util.TestRackResolver.testCaching

Error Message:
expected: but was:

Stack Trace:
org.junit.ComparisonFailure: expected: but was:
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.util.TestRackResolver.testCaching(TestRackResolver.java:102)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable

Error Message:
expected: but was:

Stack Trace:
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable(TestContainerAllocation.java:321)


FAILED:  
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation.testNormalContainerAllocationWhenDNSUnavailable

Error Message:
expected:<0> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals

Failed: YARN-2005 PreCommit Build #8874

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2005
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8874/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 387 lines...]
|  ||| warnings.
|  +1  |tools/hadoop tests  |  0m 52s| Tests passed in hadoop-sls. 
|  -1  |yarn tests  |  0m 22s| Tests failed in hadoop-yarn-api. 
|  -1  |yarn tests  |  57m 41s   | Tests failed in 
|  ||| 
hadoop-yarn-server-resourcemanager
|  ||| .
|  ||  104m 16s  | 


 Reason | Tests
 Failed unit tests  |  hadoop.yarn.conf.TestYarnConfigurationFields 
|  
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12750966/YARN-2005.005.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 71566e2 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-api.txt
 |
| whitespace | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/whitespace.txt
 |
| hadoop-sls test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-sls.txt
 |
| hadoop-yarn-api test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-api.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8874/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
48d5d9912b3521ec5f6a95598c7fe346fb19c2b3 logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 58 artifacts
Archive block size is 32768
Received 40 blocks and 29522728 bytes
Compression is 4.3%
Took 6 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
3 tests failed.
REGRESSION:  
org.apache.hadoop.yarn.conf.TestYarnConfigurationFields.testCompareConfigurationClassAgainstXml

Error Message:
class org.apache.hadoop.yarn.conf.YarnConfiguration has 2 variables missing in 
yarn-default.xml

Stack Trace:
java.lang.AssertionError: class org.apache.hadoop.yarn.conf.YarnConfiguration 
has 2 variables missing in yarn-default.xml
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at 
org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:429)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner.

Hadoop-Yarn-trunk-Java8 - Build # 291 - Still Failing

2015-08-18 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/291/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3937 lines...]
Tests run: 329, Failures: 1, Errors: 0, Skipped: 7

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.399 s]
[INFO] Apache Hadoop YARN API  SUCCESS [01:12 min]
[INFO] Apache Hadoop YARN Common . FAILURE [01:36 min]
[INFO] Apache Hadoop YARN Server . SKIPPED
[INFO] Apache Hadoop YARN Server Common .. SKIPPED
[INFO] Apache Hadoop YARN NodeManager  SKIPPED
[INFO] Apache Hadoop YARN Web Proxy .. SKIPPED
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SKIPPED
[INFO] Apache Hadoop YARN ResourceManager  SKIPPED
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:53 min
[INFO] Finished at: 2015-08-18T11:59:22+00:00
[INFO] Final Memory: 71M/1163M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-common: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-common
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Updating HDFS-6407
Updating HDFS-8862
Updating HDFS-8792
Updating HDFS-8845
Updating HDFS-8801
Updating HDFS-8895
Updating HDFS-8880
Updating HDFS-8713
Updating HDFS-8883
Updating HDFS-8278
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.yarn.util.TestRackResolver.testCaching

Error Message:
expected: but was:

Stack Trace:
org.junit.ComparisonFailure: expected: but was:
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.util.TestRackResolver.testCaching(TestRackResolver.java:102)




Failed: YARN-4014 PreCommit Build #8873

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-4014
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8873/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 450 lines...]

 Reason | Tests
 Failed unit tests  |  hadoop.mapreduce.lib.output.TestJobOutputCommitter 
|  hadoop.yarn.client.api.impl.TestNMClient 
|  hadoop.yarn.client.api.impl.TestYarnClient 
   Timed out tests  |  org.apache.hadoop.mapreduce.TestLargeSort 
|  org.apache.hadoop.yarn.client.api.impl.TestAHSClient 
|  org.apache.hadoop.yarn.client.api.impl.TestAMRMClient 
  Failed build  |  hadoop-yarn-common 
|  hadoop-yarn-server-resourcemanager 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12750963/0004-YARN-4014.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 71566e2 |
| javadoc | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffJavadocWarnings.txt
 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-api.txt
 |
| hadoop-mapreduce-client-jobclient test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-mapreduce-client-jobclient.txt
 |
| hadoop-yarn-api test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-api.txt
 |
| hadoop-yarn-client test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-client.txt
 |
| hadoop-yarn-common test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-common.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8873/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
f6b799756d2e6c703e93a60359795558e10bfaaf logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 87 artifacts
Archive block size is 32768
Received 45 blocks and 30962585 bytes
Compression is 4.5%
Took 8.1 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
14 tests failed.
FAILED:  
org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomCleanup

Error Message:
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/JobACLsManager

Stack Trace:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: 
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/JobACLsManager
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at 
org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.serviceInit(HistoryFileManager.java:510)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapreduce.v2.hs.JobHistory.serviceInit(JobHistory.java:95)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.service.Compos

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #291

2015-08-18 Thread Apache Jenkins Server
See 

Changes:

[xyao] HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. 
Contributed by Anu Engineer.

[wang] HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging.

[wheat9] HDFS-6407. Add sorting and pagination in the datanode tab of the NN 
Web UI. Contributed by Haohui Mai.

[wheat9] HDFS-8801. Convert BlockInfoUnderConstruction as a feature. 
Contributed by Jing Zhao.

[cmccabe] HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a 
LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe)

[cmccabe] HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li 
via Colin P. McCabe)

[arp] HDFS-8880. NameNode metrics logging. (Arpit Agarwal)

[wang] HDFS-8895. Remove deprecated BlockStorageLocation APIs.

[szetszwo] HDFS-8278. When computing max-size-to-move in Balancer, count only 
the storage with remaining >= default block size.

[yliu] HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu)

--
[...truncated 3744 lines...]
Running org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.774 sec - in 
org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestRackResolver
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.458 sec <<< 
FAILURE! - in org.apache.hadoop.yarn.util.TestRackResolver
testCaching(org.apache.hadoop.yarn.util.TestRackResolver)  Time elapsed: 0.266 
sec  <<< FAILURE!
org.junit.ComparisonFailure: expected: but was:
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.util.TestRackResolver.testCaching(TestRackResolver.java:102)

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestResourceCalculatorProcessTree
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.187 sec - in 
org.apache.hadoop.yarn.util.TestResourceCalculatorProcessTree
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestRackResolverScriptBasedMapping
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.299 sec - in 
org.apache.hadoop.yarn.util.TestRackResolverScriptBasedMapping
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestYarnVersionInfo
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.159 sec - in 
org.apache.hadoop.yarn.util.TestYarnVersionInfo
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestApps
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.238 sec - in 
org.apache.hadoop.yarn.util.TestApps
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestTimes
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.169 sec - in 
org.apache.hadoop.yarn.util.TestTimes
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestWindowsBasedProcessTree
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.182 sec - in 
org.apache.hadoop.yarn.util.TestWindowsBasedProcessTree
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.resource.TestResourceCalculator
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.339 sec - in 
org.apache.hadoop.yarn.util.resource.TestResourceCalculator
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.resource.TestResources
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.321 sec - in 
org.apache.hadoop.yarn.util.resource.TestResources
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestLog4jWarningErrorMetricsAppender
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.197 sec - in 
org.apache.hadoop.yarn.util.TestLog4jWarningErrorMetricsAppender
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.yarn.util.TestConverterUtils
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.373 sec - in 
org.apache.hadoop.yarn.util.TestConverterUtils
Java HotSpot(TM) 64-Bit Server VM warning: igno

Hadoop-Yarn-trunk - Build # 1021 - Still Failing

2015-08-18 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Yarn-trunk/1021/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 5346 lines...]
Tests run: 329, Failures: 1, Errors: 0, Skipped: 7

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop YARN  SUCCESS [  3.222 s]
[INFO] Apache Hadoop YARN API  SUCCESS [03:38 min]
[INFO] Apache Hadoop YARN Common . FAILURE [01:39 min]
[INFO] Apache Hadoop YARN Server . SKIPPED
[INFO] Apache Hadoop YARN Server Common .. SKIPPED
[INFO] Apache Hadoop YARN NodeManager  SKIPPED
[INFO] Apache Hadoop YARN Web Proxy .. SKIPPED
[INFO] Apache Hadoop YARN ApplicationHistoryService .. SKIPPED
[INFO] Apache Hadoop YARN ResourceManager  SKIPPED
[INFO] Apache Hadoop YARN Server Tests ... SKIPPED
[INFO] Apache Hadoop YARN Client . SKIPPED
[INFO] Apache Hadoop YARN SharedCacheManager . SKIPPED
[INFO] Apache Hadoop YARN Applications ... SKIPPED
[INFO] Apache Hadoop YARN DistributedShell ... SKIPPED
[INFO] Apache Hadoop YARN Unmanaged Am Launcher .. SKIPPED
[INFO] Apache Hadoop YARN Site ... SKIPPED
[INFO] Apache Hadoop YARN Registry ... SKIPPED
[INFO] Apache Hadoop YARN Project  SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 05:22 min
[INFO] Finished at: 2015-08-18T11:52:48+00:00
[INFO] Final Memory: 68M/1079M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-yarn-common: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-common
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Updating HDFS-6407
Updating HDFS-8862
Updating HDFS-8792
Updating HDFS-8845
Updating HDFS-8801
Updating HDFS-8895
Updating HDFS-8880
Updating HDFS-8713
Updating HDFS-8883
Updating HDFS-8278
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.yarn.util.TestRackResolver.testCaching

Error Message:
expected: but was:

Stack Trace:
org.junit.ComparisonFailure: expected: but was:
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.yarn.util.TestRackResolver.testCaching(TestRackResolver.java:102)




Build failed in Jenkins: Hadoop-Yarn-trunk #1021

2015-08-18 Thread Apache Jenkins Server
See 

Changes:

[xyao] HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. 
Contributed by Anu Engineer.

[wang] HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging.

[wheat9] HDFS-6407. Add sorting and pagination in the datanode tab of the NN 
Web UI. Contributed by Haohui Mai.

[wheat9] HDFS-8801. Convert BlockInfoUnderConstruction as a feature. 
Contributed by Jing Zhao.

[cmccabe] HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a 
LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe)

[cmccabe] HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li 
via Colin P. McCabe)

[arp] HDFS-8880. NameNode metrics logging. (Arpit Agarwal)

[wang] HDFS-8895. Remove deprecated BlockStorageLocation APIs.

[szetszwo] HDFS-8278. When computing max-size-to-move in Balancer, count only 
the storage with remaining >= default block size.

[yliu] HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu)

--
[...truncated 5153 lines...]
[INFO] Fork Value is true
[INFO] Done FindBugs Analysis
[INFO] 
[INFO] 
[INFO] Building Apache Hadoop YARN Common 3.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-yarn-common ---
[INFO] Deleting 

[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-yarn-common 
---
[INFO] Executing tasks

main:
[mkdir] Created dir: 

[INFO] Executed tasks
[INFO] 
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @ 
hadoop-yarn-common ---
[INFO] Wrote protoc checksums to file 

[INFO] 
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:version-info (version-info) @ 
hadoop-yarn-common ---
[WARNING] [svn, info] failed with error code 1
[INFO] SCM: GIT
[INFO] Computed MD5: 433b5ff5fb43c164c7a94f6364308a21
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
hadoop-yarn-common ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 48 resources
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ 
hadoop-yarn-common ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 331 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
hadoop-yarn-common ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
hadoop-yarn-common ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 76 source files to 

[INFO] 
[INFO] --- maven-jar-plugin:2.5:test-jar (default) @ hadoop-yarn-common ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-yarn-common 
---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Running org.apache.hadoop.yarn.TestRPC
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.316 sec - in 
org.apache.hadoop.yarn.TestRPC
Running org.apache.hadoop.yarn.event.TestAsyncDispatcher
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.751 sec - in 
org.apache.hadoop.yarn.event.TestAsyncDispatcher
Running org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.127 sec - in 
org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
Running org.apache.hadoop.yarn.util.TestRackResolver
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.621 sec <<< 
FAILURE! - in org.apache.hadoop.yarn.util.T

Failed: YARN-4024 PreCommit Build #8872

2015-08-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-4024
Build: https://builds.apache.org/job/PreCommit-YARN-Build/8872/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 319 lines...]
|  | || warnings.
|  -1  | yarn tests  |  0m 21s| Tests failed in hadoop-yarn-api. 
|  -1  | yarn tests  |  53m 34s   | Tests failed in 
|  | || hadoop-yarn-server-resourcemanager.
|  | |  97m 42s   | 


 Reason | Tests
  FindBugs  |  module:hadoop-yarn-server-resourcemanager 
 Failed unit tests  |  hadoop.yarn.conf.TestYarnConfigurationFields 
|  
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation 
|  
hadoop.yarn.server.resourcemanager.rmapp.TestNodesListManager 


|| Subsystem || Report/Notes ||

| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12750953/YARN-4024-draft-v2.patch
 |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 71566e2 |
| checkstyle |  
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/diffcheckstylehadoop-yarn-api.txt
 |
| whitespace | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/whitespace.txt
 |
| Findbugs warnings | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
 |
| hadoop-yarn-api test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-api.txt
 |
| hadoop-yarn-server-resourcemanager test log | 
/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8872/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |




  Adding comment to JIRA




Comment added.
0330766a9935b0509c5ae1e958c3001cd3f36b82 logged out




  Finished build.




Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #8867
Archived 44 artifacts
Archive block size is 32768
Received 39 blocks and 28719714 bytes
Compression is 4.3%
Took 5.9 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
4 tests failed.
REGRESSION:  
org.apache.hadoop.yarn.conf.TestYarnConfigurationFields.testCompareConfigurationClassAgainstXml

Error Message:
class org.apache.hadoop.yarn.conf.YarnConfiguration has 1 variables missing in 
yarn-default.xml

Stack Trace:
java.lang.AssertionError: class org.apache.hadoop.yarn.conf.YarnConfiguration 
has 1 variables missing in yarn-default.xml
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at 
org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:429)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(Ru