[jira] [Created] (YARN-2578) NM does not failover timely if RM node network connection fails

2014-09-21 Thread Wilfred Spiegelenburg (JIRA) 
Wilfred Spiegelenburg created YARN-2578:
---

 Summary: NM does not failover timely if RM node network connection 
fails
 Key: YARN-2578
 URL: https://issues.apache.org/jira/browse/YARN-2578
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 2.5.1
Reporter: Wilfred Spiegelenburg


The NM does not fail over correctly when the network cable of the RM is 
unplugged or the failure is simulated by a "service network stop" or a firewall 
that drops all traffic on the node. The RM fails over to the standby node when 
the failure is detected as expected. The NM should than re-register with the 
new active RM. This re-register takes a long time (15 minutes or more). Until 
then the cluster has no nodes for processing and applications are stuck.

Reproduction test case which can be used in any environment:
- create a cluster with 3 nodes
node 1: ZK, NN, JN, ZKFC, DN, RM, NM
node 2: ZK, NN, JN, ZKFC, DN, RM, NM
node 3: ZK, JN, DN, NM
- start all services make sure they are in good health
- kill the network connection of the RM that is active using one of the network 
kills from above
- observe the NN and RM failover
- the DN's fail over to the new active NN
- the NM does not recover for a long time
- the logs show a long delay and traces show no change at all

The stack traces of the NM all show the same set of threads. The main thread 
which should be used in the re-register is the "Node Status Updater" This 
thread is stuck in:
{code}
"Node Status Updater" prio=10 tid=0x7f5a6cc99800 nid=0x18d0 in 
Object.wait() [0x7f5a51fc1000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xed62f488> (a org.apache.hadoop.ipc.Client$Call)
at java.lang.Object.wait(Object.java:503)
at org.apache.hadoop.ipc.Client.call(Client.java:1395)
- locked <0xed62f488> (a org.apache.hadoop.ipc.Client$Call)
at org.apache.hadoop.ipc.Client.call(Client.java:1362)
at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at com.sun.proxy.$Proxy26.nodeHeartbeat(Unknown Source)
at 
org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.nodeHeartbeat(ResourceTrackerPBClientImpl.java:80)
{code}

The client connection which goes through the proxy can be traced back to the 
ResourceTrackerPBClientImpl. The generated proxy does not time out and we 
should be using a version which takes the RPC timeout (from the configuration) 
as a parameter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Failed: YARN-2453 PreCommit Build #5069

2014-09-21 Thread Apache Jenkins Server 
Jira: https://issues.apache.org/jira/browse/YARN-2453
Build: https://builds.apache.org/job/PreCommit-YARN-Build/5069/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3185 lines...]
-rw-r--r--  1 jenkins jenkins  1366 Sep  3 18:31 README.txt
drwxr-xr-x  2 jenkins jenkins  4096 Sep 18 20:40 dev-support
drwxr-xr-x  5 jenkins jenkins  4096 Sep 22 01:56 hadoop-assemblies
drwxr-xr-x  4 jenkins jenkins  4096 Sep 22 01:57 hadoop-client
drwxr-xr-x 10 jenkins jenkins  4096 Sep 22 01:49 hadoop-common-project
drwxr-xr-x  4 jenkins jenkins  4096 Sep 22 01:57 hadoop-dist
drwxr-xr-x  6 jenkins jenkins  4096 Sep 22 01:51 hadoop-hdfs-project
drwxr-xr-x 10 jenkins jenkins  4096 Sep 22 01:54 hadoop-mapreduce-project
drwxr-xr-x  5 jenkins jenkins  4096 Sep 22 01:56 hadoop-maven-plugins
drwxr-xr-x  4 jenkins jenkins  4096 Sep 22 01:57 hadoop-minicluster
drwxr-xr-x  4 jenkins jenkins  4096 Sep 22 01:48 hadoop-project
drwxr-xr-x  3 jenkins jenkins  4096 Sep 22 01:48 hadoop-project-dist
drwxr-xr-x 16 jenkins jenkins  4096 Sep 22 01:55 hadoop-tools
drwxr-xr-x  4 jenkins jenkins  4096 Sep 22 01:53 hadoop-yarn-project
drwxr-xr-x  2 jenkins jenkins  4096 Sep 22 01:58 patchprocess
-rw-r--r--  1 jenkins jenkins 22465 Sep  6 03:11 pom.xml
drwxr-xr-x  3 jenkins jenkins  4096 Sep 22 01:58 target
total 112
drwxr-xr-x 29 jenkins jenkins 4096 Sep  3 00:32 Apache-falcon
drwxr-xr-x 12 jenkins jenkins 4096 Sep 13 07:42 HBase-0.94
drwxr-xr-x 22 jenkins jenkins 4096 Sep 12 02:07 HBase-TRUNK
drwxr-xr-x  4 jenkins jenkins 4096 Jul  8 23:10 Hadoop-Common-0.23-Commit
drwxr-xr-x 16 jenkins jenkins 4096 Aug 29 11:32 Hadoop-Hdfs-trunk
drwxr-xr-x  4 jenkins jenkins 4096 Sep 19 06:00 Hadoop-trunk-java7
drwxr-xr-x  4 jenkins jenkins 4096 Sep 16 23:17 Pig-trunk-commit
drwxr-xr-x  3 jenkins jenkins 4096 Sep 10 16:51 PreCommit-Admin
drwxr-xr-x  4 jenkins jenkins 4096 Sep 17 18:52 PreCommit-Falcon-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 19 23:08 PreCommit-HADOOP-Build
drwxr-xr-x 23 jenkins jenkins 4096 Sep 18 11:57 PreCommit-HBASE-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 20 03:26 PreCommit-HDFS-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 23 02:54 PreCommit-HDFS-Build@2
drwxr-xr-x 17 jenkins jenkins 4096 Sep 19 21:26 PreCommit-MAPREDUCE-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 26 00:34 PreCommit-MAPREDUCE-Build@2
drwxr-xr-x 18 jenkins jenkins 4096 Sep 22 02:20 PreCommit-YARN-Build
drwxr-xr-x 17 jenkins jenkins 4096 Aug 31 01:57 PreCommit-YARN-Build@2
drwxr-xr-x  3 jenkins jenkins 4096 Sep 19 22:30 PreCommit-ZOOKEEPER-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep  2 02:01 Tajo-0.8.1-nightly
drwxr-xr-x 19 jenkins jenkins 4096 Sep 16 14:16 
Tajo-block_iteration-branch-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep 22 00:22 Tajo-master-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep  9 02:01 Tajo-master-nightly
drwxr-xr-x 17 jenkins jenkins 4096 Sep 19 07:42 Tez-Build
drwxr-xr-x 10 jenkins jenkins 4096 Sep 20 14:06 cayenne-31
drwxr-xr-x  3 jenkins jenkins 4096 Jul 21 14:17 commons-vfs-trunk
drwxr-xr-x 21 jenkins jenkins 4096 Sep  8 20:27 
oozie-trunk-find-patches-available
drwxr-xr-x 22 jenkins jenkins 4096 Sep  9 00:17 oozie-trunk-precommit-build
drwxr-xr-x 22 jenkins jenkins 4096 Aug 26 00:36 oozie-trunk-precommit-build@2
mv: cannot stat 
'/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess': 
No such file or directory
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #4749
Archived 15 artifacts
Archive block size is 32768
Received 0 blocks and 8589280 bytes
Compression is 0.0%
Took 2.8 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

Failed: YARN-2453 PreCommit Build #5068

2014-09-21 Thread Apache Jenkins Server 
Jira: https://issues.apache.org/jira/browse/YARN-2453
Build: https://builds.apache.org/job/PreCommit-YARN-Build/5068/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3189 lines...]
drwxr-xr-x 10 jenkins jenkins  4096 Sep 21 23:10 hadoop-common-project
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:17 hadoop-dist
drwxr-xr-x  6 jenkins jenkins  4096 Sep 21 23:12 hadoop-hdfs-project
drwxr-xr-x 10 jenkins jenkins  4096 Sep 21 23:15 hadoop-mapreduce-project
drwxr-xr-x  5 jenkins jenkins  4096 Sep 21 23:17 hadoop-maven-plugins
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:17 hadoop-minicluster
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:09 hadoop-project
drwxr-xr-x  3 jenkins jenkins  4096 Sep 21 23:09 hadoop-project-dist
drwxr-xr-x 16 jenkins jenkins  4096 Sep 21 23:16 hadoop-tools
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:14 hadoop-yarn-project
drwxr-xr-x  2 jenkins jenkins  4096 Sep 21 23:19 patchprocess
-rw-r--r--  1 jenkins jenkins 22465 Sep  8 15:02 pom.xml
drwxr-xr-x  3 jenkins jenkins  4096 Sep 21 23:19 target
total 128
drwxr-xr-x 31 jenkins jenkins 4096 Sep 11 00:30 Apache-falcon
drwxr-xr-x 12 jenkins jenkins 4096 Aug 25 19:32 HBase-0.94
drwxr-xr-x 12 jenkins jenkins 4096 Sep 10 02:36 HBase-0.94-JDK7
drwxr-xr-x 22 jenkins jenkins 4096 Sep 19 17:28 HBase-0.98
drwxr-xr-x 22 jenkins jenkins 4096 Sep 19 19:12 HBase-TRUNK
drwxr-xr-x  4 jenkins jenkins 4096 Aug 23 09:02 Hadoop-Common-0.23-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 23 01:33 Hadoop-Common-2-Build
drwxr-xr-x 16 jenkins jenkins 4096 Sep 13 11:31 Hadoop-Hdfs-trunk
drwxr-xr-x 16 jenkins jenkins 4096 Sep 13 10:31 Hadoop-Yarn-trunk
drwxr-xr-x  4 jenkins jenkins 4096 Aug 28 05:02 Hadoop-branch2
drwxr-xr-x  4 jenkins jenkins 4096 Sep  3 06:02 Hadoop-trunk-java7
drwxr-xr-x  4 jenkins jenkins 4096 Aug 27 01:19 Pig-trunk-commit
drwxr-xr-x  3 jenkins jenkins 4096 Aug 23 00:35 PreCommit-Admin
drwxr-xr-x  4 jenkins jenkins 4096 Sep 17 22:03 PreCommit-Falcon-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 28 14:22 PreCommit-Falcon-Build@2
drwxr-xr-x 19 jenkins jenkins 4096 Sep 18 22:33 PreCommit-HADOOP-Build
drwxr-xr-x 23 jenkins jenkins 4096 Sep 17 22:12 PreCommit-HBASE-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 20 02:19 PreCommit-HDFS-Build
drwxr-xr-x 17 jenkins jenkins 4096 Aug 29 01:29 PreCommit-HDFS-Build@2
drwxr-xr-x 18 jenkins jenkins 4096 Sep 17 23:44 PreCommit-MAPREDUCE-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 21 23:41 PreCommit-YARN-Build
drwxr-xr-x 17 jenkins jenkins 4096 Aug 29 21:58 PreCommit-YARN-Build@2
drwxr-xr-x  3 jenkins jenkins 4096 Sep 19 21:01 PreCommit-ZOOKEEPER-Build
drwxr-xr-x 17 jenkins jenkins 4096 Sep 17 23:45 Samza-0.7.0
drwxr-xr-x 18 jenkins jenkins 4096 Sep 13 02:02 Tajo-0.8.1-nightly
drwxr-xr-x 19 jenkins jenkins 4096 Sep 19 09:00 Tajo-master-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep 21 02:01 Tajo-master-nightly
drwxr-xr-x 16 jenkins jenkins 4096 Sep 21 06:50 Tez-Build
drwxr-xr-x 16 jenkins jenkins 4096 Sep 18 05:01 bookkeeper-trunk
drwxr-xr-x 21 jenkins jenkins 4096 Sep  8 19:31 
oozie-trunk-find-patches-available
drwxr-xr-x 22 jenkins jenkins 4096 Sep  8 23:13 oozie-trunk-precommit-build
drwxr-xr-x 22 jenkins jenkins 4096 Aug 26 01:35 oozie-trunk-precommit-build@2
mv: cannot stat 
'/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess': 
No such file or directory
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #4749
Archived 15 artifacts
Archive block size is 32768
Received 0 blocks and 8588351 bytes
Compression is 0.0%
Took 2.4 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

Failed: YARN-2453 PreCommit Build #5067

2014-09-21 Thread Apache Jenkins Server 
Jira: https://issues.apache.org/jira/browse/YARN-2453
Build: https://builds.apache.org/job/PreCommit-YARN-Build/5067/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3182 lines...]
-rw-r--r--  1 jenkins jenkins  1366 Sep  3 18:31 README.txt
drwxr-xr-x  2 jenkins jenkins  4096 Sep 18 20:40 dev-support
drwxr-xr-x  5 jenkins jenkins  4096 Sep 21 23:06 hadoop-assemblies
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:06 hadoop-client
drwxr-xr-x 10 jenkins jenkins  4096 Sep 21 22:59 hadoop-common-project
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:06 hadoop-dist
drwxr-xr-x  6 jenkins jenkins  4096 Sep 21 23:01 hadoop-hdfs-project
drwxr-xr-x 10 jenkins jenkins  4096 Sep 21 23:04 hadoop-mapreduce-project
drwxr-xr-x  5 jenkins jenkins  4096 Sep 21 23:06 hadoop-maven-plugins
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:06 hadoop-minicluster
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 22:58 hadoop-project
drwxr-xr-x  3 jenkins jenkins  4096 Sep 21 22:58 hadoop-project-dist
drwxr-xr-x 16 jenkins jenkins  4096 Sep 21 23:05 hadoop-tools
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 23:03 hadoop-yarn-project
drwxr-xr-x  2 jenkins jenkins  4096 Sep 21 23:08 patchprocess
-rw-r--r--  1 jenkins jenkins 22465 Sep  6 03:11 pom.xml
drwxr-xr-x  3 jenkins jenkins  4096 Sep 21 23:08 target
total 112
drwxr-xr-x 29 jenkins jenkins 4096 Sep  3 00:32 Apache-falcon
drwxr-xr-x 12 jenkins jenkins 4096 Sep 13 07:42 HBase-0.94
drwxr-xr-x 22 jenkins jenkins 4096 Sep 12 02:07 HBase-TRUNK
drwxr-xr-x  4 jenkins jenkins 4096 Jul  8 23:10 Hadoop-Common-0.23-Commit
drwxr-xr-x 16 jenkins jenkins 4096 Aug 29 11:32 Hadoop-Hdfs-trunk
drwxr-xr-x  4 jenkins jenkins 4096 Sep 19 06:00 Hadoop-trunk-java7
drwxr-xr-x  4 jenkins jenkins 4096 Sep 16 23:17 Pig-trunk-commit
drwxr-xr-x  3 jenkins jenkins 4096 Sep 10 16:51 PreCommit-Admin
drwxr-xr-x  4 jenkins jenkins 4096 Sep 17 18:52 PreCommit-Falcon-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 19 23:08 PreCommit-HADOOP-Build
drwxr-xr-x 23 jenkins jenkins 4096 Sep 18 11:57 PreCommit-HBASE-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 20 03:26 PreCommit-HDFS-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 23 02:54 PreCommit-HDFS-Build@2
drwxr-xr-x 17 jenkins jenkins 4096 Sep 19 21:26 PreCommit-MAPREDUCE-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 26 00:34 PreCommit-MAPREDUCE-Build@2
drwxr-xr-x 18 jenkins jenkins 4096 Sep 21 23:30 PreCommit-YARN-Build
drwxr-xr-x 17 jenkins jenkins 4096 Aug 31 01:57 PreCommit-YARN-Build@2
drwxr-xr-x  3 jenkins jenkins 4096 Sep 19 22:30 PreCommit-ZOOKEEPER-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep  2 02:01 Tajo-0.8.1-nightly
drwxr-xr-x 19 jenkins jenkins 4096 Sep 16 14:16 
Tajo-block_iteration-branch-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep 21 18:17 Tajo-master-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep  9 02:01 Tajo-master-nightly
drwxr-xr-x 17 jenkins jenkins 4096 Sep 19 07:42 Tez-Build
drwxr-xr-x 10 jenkins jenkins 4096 Sep 20 14:06 cayenne-31
drwxr-xr-x  3 jenkins jenkins 4096 Jul 21 14:17 commons-vfs-trunk
drwxr-xr-x 21 jenkins jenkins 4096 Sep  8 20:27 
oozie-trunk-find-patches-available
drwxr-xr-x 22 jenkins jenkins 4096 Sep  9 00:17 oozie-trunk-precommit-build
drwxr-xr-x 22 jenkins jenkins 4096 Aug 26 00:36 oozie-trunk-precommit-build@2
mv: cannot stat 
'/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess': 
No such file or directory
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #4749
Archived 15 artifacts
Archive block size is 32768
Received 0 blocks and 8588626 bytes
Compression is 0.0%
Took 3 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

Failed: YARN-2252 PreCommit Build #5066

2014-09-21 Thread Apache Jenkins Server 
Jira: https://issues.apache.org/jira/browse/YARN-2252
Build: https://builds.apache.org/job/PreCommit-YARN-Build/5066/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3185 lines...]
-rw-r--r--  1 jenkins jenkins  1366 Sep  3 18:31 README.txt
drwxr-xr-x  2 jenkins jenkins  4096 Sep 18 20:40 dev-support
drwxr-xr-x  5 jenkins jenkins  4096 Sep 21 20:56 hadoop-assemblies
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 20:57 hadoop-client
drwxr-xr-x 10 jenkins jenkins  4096 Sep 21 20:49 hadoop-common-project
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 20:57 hadoop-dist
drwxr-xr-x  6 jenkins jenkins  4096 Sep 21 20:51 hadoop-hdfs-project
drwxr-xr-x 10 jenkins jenkins  4096 Sep 21 20:54 hadoop-mapreduce-project
drwxr-xr-x  5 jenkins jenkins  4096 Sep 21 20:56 hadoop-maven-plugins
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 20:57 hadoop-minicluster
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 20:48 hadoop-project
drwxr-xr-x  3 jenkins jenkins  4096 Sep 21 20:48 hadoop-project-dist
drwxr-xr-x 16 jenkins jenkins  4096 Sep 21 20:55 hadoop-tools
drwxr-xr-x  4 jenkins jenkins  4096 Sep 21 20:53 hadoop-yarn-project
drwxr-xr-x  2 jenkins jenkins  4096 Sep 21 20:58 patchprocess
-rw-r--r--  1 jenkins jenkins 22465 Sep  6 03:11 pom.xml
drwxr-xr-x  3 jenkins jenkins  4096 Sep 21 20:58 target
total 112
drwxr-xr-x 29 jenkins jenkins 4096 Sep  3 00:32 Apache-falcon
drwxr-xr-x 12 jenkins jenkins 4096 Sep 13 07:42 HBase-0.94
drwxr-xr-x 22 jenkins jenkins 4096 Sep 12 02:07 HBase-TRUNK
drwxr-xr-x  4 jenkins jenkins 4096 Jul  8 23:10 Hadoop-Common-0.23-Commit
drwxr-xr-x 16 jenkins jenkins 4096 Aug 29 11:32 Hadoop-Hdfs-trunk
drwxr-xr-x  4 jenkins jenkins 4096 Sep 19 06:00 Hadoop-trunk-java7
drwxr-xr-x  4 jenkins jenkins 4096 Sep 16 23:17 Pig-trunk-commit
drwxr-xr-x  3 jenkins jenkins 4096 Sep 10 16:51 PreCommit-Admin
drwxr-xr-x  4 jenkins jenkins 4096 Sep 17 18:52 PreCommit-Falcon-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 19 23:08 PreCommit-HADOOP-Build
drwxr-xr-x 23 jenkins jenkins 4096 Sep 18 11:57 PreCommit-HBASE-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep 20 03:26 PreCommit-HDFS-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 23 02:54 PreCommit-HDFS-Build@2
drwxr-xr-x 17 jenkins jenkins 4096 Sep 19 21:26 PreCommit-MAPREDUCE-Build
drwxr-xr-x  4 jenkins jenkins 4096 Aug 26 00:34 PreCommit-MAPREDUCE-Build@2
drwxr-xr-x 18 jenkins jenkins 4096 Sep 21 21:20 PreCommit-YARN-Build
drwxr-xr-x 17 jenkins jenkins 4096 Aug 31 01:57 PreCommit-YARN-Build@2
drwxr-xr-x  3 jenkins jenkins 4096 Sep 19 22:30 PreCommit-ZOOKEEPER-Build
drwxr-xr-x 18 jenkins jenkins 4096 Sep  2 02:01 Tajo-0.8.1-nightly
drwxr-xr-x 19 jenkins jenkins 4096 Sep 16 14:16 
Tajo-block_iteration-branch-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep 21 18:17 Tajo-master-build
drwxr-xr-x 19 jenkins jenkins 4096 Sep  9 02:01 Tajo-master-nightly
drwxr-xr-x 17 jenkins jenkins 4096 Sep 19 07:42 Tez-Build
drwxr-xr-x 10 jenkins jenkins 4096 Sep 20 14:06 cayenne-31
drwxr-xr-x  3 jenkins jenkins 4096 Jul 21 14:17 commons-vfs-trunk
drwxr-xr-x 21 jenkins jenkins 4096 Sep  8 20:27 
oozie-trunk-find-patches-available
drwxr-xr-x 22 jenkins jenkins 4096 Sep  9 00:17 oozie-trunk-precommit-build
drwxr-xr-x 22 jenkins jenkins 4096 Aug 26 00:36 oozie-trunk-precommit-build@2
mv: cannot stat 
'/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess': 
No such file or directory
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #4749
Archived 15 artifacts
Archive block size is 32768
Received 0 blocks and 8588617 bytes
Compression is 0.0%
Took 2.7 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

Build failed in Jenkins: Hadoop-Yarn-trunk #687

2014-09-21 Thread Apache Jenkins Server 
See 

Changes:

[tucu] HADOOP-11017. KMS delegation token secret manager should be able to use 
zookeeper as store. (asuresh via tucu)

[jing] HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. 
Contributed by Jing Zhao.

[cnauroth] HDFS-7107. Avoid Findbugs warning for synchronization on 
AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris 
Nauroth.

[cnauroth] HDFS-7109. TestDataStorage does not release file locks between 
tests. Contributed by Chris Nauroth.

--
[...truncated 7326 lines...]
[INFO] Executing tasks

main:
[mkdir] Created dir: 

[INFO] Executed tasks
[INFO] 
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] 
[INFO] --- maven-resources-plugin:2.2:resources (default-resources) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] Using default encoding to copy filtered resources.
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] Compiling 258 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.2:testResources (default-testResources) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] Using default encoding to copy filtered resources.
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] Compiling 109 source files to 

[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:test-jar (default) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Running 
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.798 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl
Running org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServices
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.652 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServices
Running org.apache.hadoop.yarn.server.resourcemanager.webapp.TestNodesPage
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.702 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestNodesPage
Running org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.084 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp
Running 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppsModification
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.44 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppsModification
Running 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesCapacitySched
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.927 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesCapacitySched
Running 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokens
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.267 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokens
Running 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps
Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 172.43 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps
Running 
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.184 sec - 
in org.apache.hadoop.

Hadoop-Yarn-trunk - Build # 687 - Failure

2014-09-21 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Yarn-trunk/687/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 7519 lines...]
Running 
org.apache.hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart
Running org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.137 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger
Running org.apache.hadoop.yarn.server.resourcemanager.TestFifoScheduler
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.988 sec - 
in org.apache.hadoop.yarn.server.resourcemanager.TestFifoScheduler
Running org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.96 sec - in 
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization

Results :

Tests run: 674, Failures: 0, Errors: 0, Skipped: 1

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-yarn ... SUCCESS [  3.021 s]
[INFO] hadoop-yarn-api ... SUCCESS [02:15 min]
[INFO] hadoop-yarn-common  SUCCESS [02:08 min]
[INFO] hadoop-yarn-server  SUCCESS [  0.089 s]
[INFO] hadoop-yarn-server-common . SUCCESS [ 37.216 s]
[INFO] hadoop-yarn-server-nodemanager  SUCCESS [05:02 min]
[INFO] hadoop-yarn-server-web-proxy .. SUCCESS [ 18.748 s]
[INFO] hadoop-yarn-server-applicationhistoryservice .. SUCCESS [01:29 min]
[INFO] hadoop-yarn-server-resourcemanager  FAILURE [21:22 min]
[INFO] hadoop-yarn-server-tests .. SKIPPED
[INFO] hadoop-yarn-client  SKIPPED
[INFO] hadoop-yarn-applications .. SKIPPED
[INFO] hadoop-yarn-applications-distributedshell . SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher  SKIPPED
[INFO] hadoop-yarn-site .. SKIPPED
[INFO] hadoop-yarn-project ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 33:18 min
[INFO] Finished at: 2014-09-21T11:05:49+00:00
[INFO] Final Memory: 84M/764M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on 
project hadoop-yarn-server-resourcemanager: ExecutionException; nested 
exception is java.util.concurrent.ExecutionException: 
java.lang.RuntimeException: The forked VM terminated without saying properly 
goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
 && /home/jenkins/tools/java/jdk1.6.0_45-64/jre/bin/java -Xmx1024m 
-XX:+HeapDumpOnOutOfMemoryError -jar 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire/surefirebooter698180955102320356.jar
 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire/surefire912822362475223040tmp
 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire/surefire_1544191272579210738067tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-server-resourcemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Updating HDFS-7095
Updating HADOOP-11017
Updating HDFS-7107
Updating HDFS-7109
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.