[jira] [Created] (MAPREDUCE-6577) MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set

2015-12-16 Thread Sangjin Lee (JIRA) 
Sangjin Lee created MAPREDUCE-6577:
--

 Summary: MR AM unable to load native library without 
MR_AM_ADMIN_USER_ENV set
 Key: MAPREDUCE-6577
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6577
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Affects Versions: 2.6.0
Reporter: Sangjin Lee
Assignee: Sangjin Lee
Priority: Critical


If yarn.app.mapreduce.am.admin.user.env (or yarn.app.mapreduce.am.env) is not 
configured to set LD_LIBRARY_PATH, MR AM will fail to load the native library:

{noformat}
2015-12-15 21:29:22,473 WARN [main] org.apache.hadoop.util.NativeCodeLoader: 
Unable to load native-hadoop library for your platform... using builtin-java 
classes where applicable
{noformat}

As a result, any code that needs the hadoop native library in the MR AM will 
fail. For example, an uber-AM with lz4 compression for the mapper task will 
fail:
{noformat}
2015-12-15 21:30:17,575 WARN [uber-SubtaskRunner] 
org.apache.hadoop.mapred.LocalContainerLauncher: Exception running local 
(uberized) 'child' : java.lang.RuntimeException: native lz4 library not 
available
at 
org.apache.hadoop.io.compress.Lz4Codec.getCompressorType(Lz4Codec.java:125)
at 
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:148)
at 
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:163)
at org.apache.hadoop.mapred.IFile$Writer.(IFile.java:114)
at org.apache.hadoop.mapred.IFile$Writer.(IFile.java:97)
at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1602)
at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1482)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:457)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at 
org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:391)
at 
org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:309)
at 
org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:195)
at 
org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:238)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk - Build # 2731 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2731/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32832 lines...]
Running org.apache.hadoop.mapreduce.lib.output.TestMRMultipleOutputs
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.174 sec - in 
org.apache.hadoop.mapreduce.lib.output.TestMRMultipleOutputs
Running 
org.apache.hadoop.mapreduce.lib.output.TestMRSequenceFileAsBinaryOutputFormat
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.077 sec - in 
org.apache.hadoop.mapreduce.lib.output.TestMRSequenceFileAsBinaryOutputFormat
Running org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 249.971 sec - 
in org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
Running org.apache.hadoop.mapreduce.lib.output.TestMRCJCFileOutputCommitter
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.793 sec - in 
org.apache.hadoop.mapreduce.lib.output.TestMRCJCFileOutputCommitter
Running org.apache.hadoop.util.TestMRCJCReflectionUtils
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.735 sec - in 
org.apache.hadoop.util.TestMRCJCReflectionUtils
Running org.apache.hadoop.util.TestMRCJCRunJar
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.282 sec - in 
org.apache.hadoop.util.TestMRCJCRunJar
Running org.apache.hadoop.io.TestSequenceFileMergeProgress
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.78 sec - in 
org.apache.hadoop.io.TestSequenceFileMergeProgress

Results :

Failed tests: 
  TestNetworkedJob.testNetworkedJob:174 expected:<[[Thu Dec 17 04:14:40 + 
2015] Application is Activated, waiting for resources to be assigned for AM.  
Details : AM Partition =  ; Partition Resource = 
 ; Queue's Absolute capacity = 100.0 % ; Queue's 
Absolute used capacity = 0.0 % ; Queue's Absolute max capacity = 100.0 % ; ]> 
but was:<[]>

Tests run: 522, Failures: 1, Errors: 0, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.233 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [02:04 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 32.077 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  5.417 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [09:48 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:51 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:56 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:14 h
[INFO] Finished at: 2015-12-17T05:12:00+00:00
[INFO] Final Memory: 34M/719M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob

Error Message:
expected:<[[Thu Dec 17 04:14:40 + 2015] Application is Activated, waiting 
for resources to be assigned for AM.  Details : AM Partition = 
 ; Partition Resource =  ; Queue's 
Absolute capacity = 100.0 % ; Queue's Absolute used capacity = 0.0 % ; Queue's 
Absolute max capacity = 100.0 % ; ]> but was:<[]>

Stack Trace:
org.junit.ComparisonFai

Hadoop-Mapreduce-trunk-Java8 - Build # 794 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/794/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10097 lines...]
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.114 sec - in 
org.apache.hadoop.mapreduce.TestMapreduceConfigFields
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.904 sec - in 
org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestLocalContainerLauncher
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.632 sec - in 
org.apache.hadoop.mapred.TestLocalContainerLauncher
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.942 sec - in 
org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor

Results :

Tests in error: 
  TestMRClientService.test:82 » NoClassDefFound 
org/apache/hadoop/security/authe...
  TestMRClientService.testViewAclOnlyCannotModify:202 » Metrics Metrics source 
M...

Tests run: 340, Failures: 0, Errors: 2, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  5.714 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [03:01 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 53.564 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  8.335 s]
[INFO] Apache Hadoop MapReduce App ... FAILURE [14:21 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 18:33 min
[INFO] Finished at: 2015-12-17T05:02:37+00:00
[INFO] Final Memory: 41M/273M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  org.apache.hadoop.mapreduce.v2.app.TestMRClientService.test

Error Message:
org/apache/hadoop/security/authentication/server/AuthenticationFilter

Stack Trace:
java.lang.NoClassDefFoundError: 
org/apache/hadoop/security/authentication/server/AuthenticationFilter
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.hadoop.http.HttpServer2.constructSecretPro

Hadoop-Mapreduce-trunk-Java8 - Build # 793 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/793/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 16361 lines...]
Running org.apache.hadoop.util.TestMRCJCReflectionUtils
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.6 sec - in 
org.apache.hadoop.util.TestMRCJCReflectionUtils
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.util.TestMRCJCRunJar
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.269 sec - in 
org.apache.hadoop.util.TestMRCJCRunJar

Results :

Failed tests: 
  TestNetworkedJob.testNetworkedJob:174 expected:<[[Thu Dec 17 02:49:03 + 
2015] Application is Activated, waiting for resources to be assigned for AM.  
Details : AM Partition =  ; Partition Resource = 
 ; Queue's Absolute capacity = 100.0 % ; Queue's 
Absolute used capacity = 0.0 % ; Queue's Absolute max capacity = 100.0 % ; ]> 
but was:<[]>
  TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled:216 
expected:<1> but was:<0>

Tests in error: 
  TestMRJobsWithProfiler.testDefaultProfiler:111->testProfilerInternal:150 »  
te...
  TestMRJobsWithProfiler.testDifferentProfilers:117->testProfilerInternal:150 » 
  TestMRJobsWithProfiler.tearDown:104 » NoClassDefFound 
org/apache/hadoop/servic...

Tests run: 527, Failures: 2, Errors: 3, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  4.060 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [02:08 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 34.067 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  6.881 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [11:49 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [06:27 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:46 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:07 h
[INFO] Finished at: 2015-12-17T04:27:36+00:00
[INFO] Final Memory: 34M/181M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
5 tests failed.
FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled(TestMRTimelineEventHandling.java:216)


FAILED:  org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob

Error Message:
expected:<[[Thu Dec 17 02:49:03 + 2015] Application is Activated, waiting 
for resource

[VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-16 Thread Vinod Kumar Vavilapalli 
Hi all,

I've created a release candidate RC1 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ 


The RC tag in git is: release-2.7.2-RC1

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1026/ 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html 
for quick perusal.

As you may have noted,
 - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
 - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc

Hadoop-Mapreduce-trunk - Build # 2730 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2730/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32880 lines...]
Running org.apache.hadoop.mapreduce.TestMapCollection
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.052 sec - 
in org.apache.hadoop.mapreduce.TestMapCollection
Running org.apache.hadoop.conf.TestNoDefaultsJobConf
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.917 sec - in 
org.apache.hadoop.conf.TestNoDefaultsJobConf
Running org.apache.hadoop.util.TestMRCJCReflectionUtils
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.755 sec - in 
org.apache.hadoop.util.TestMRCJCReflectionUtils
Running org.apache.hadoop.util.TestMRCJCRunJar
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.319 sec - in 
org.apache.hadoop.util.TestMRCJCRunJar

Results :

Failed tests: 
  TestNetworkedJob.testNetworkedJob:174 expected:<[[Wed Dec 16 23:37:18 + 
2015] Scheduler has assigned a container for AM, waiting for AM container to be 
launched]> but was:<[]>

Tests in error: 
  TestJobOutputCommitter.setUp:59->HadoopTestCase.setUp:157 » YarnRuntime 
org.ap...

Tests run: 526, Failures: 1, Errors: 1, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.461 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [02:06 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 31.942 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  6.464 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [09:44 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:49 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:48 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:07 h
[INFO] Finished at: 2015-12-17T01:18:05+00:00
[INFO] Final Memory: 34M/756M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomCleanup

Error Message:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to intialize 
existing directories

Stack Trace:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: 
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to intialize 
existing directories
at 
org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:460)
at 
org.apache.hadoop.fs.DelegateToFileSystem.listStatus(DelegateToFileSystem.java:168)
at org.apache.hadoop.fs.ChecksumFs.listStatus(ChecksumFs.java:521)
at 
org.apache.hadoop.fs.AbstractFileSystem$1.(AbstractFileSystem.java:890)
at 
org.apache.hadoop.fs.AbstractFileSystem.listStatusIterator(AbstractFileSystem.java:888)
at org.apache.hadoop.fs.FileContext$22.next(FileContext.java:1492)
at org.apache.hadoop.fs.FileContext$22.next(FileContext.java:1487)
at org.apache.h

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Junping Du 
Hey Vinod,
Yes. We are voting for RC0 tag and all related build bits are related 
to RC0 only. 
Shall we do something special to RC0.1 or RC1 tag (they are just 
duplicated with RC0, pointing to the same commit as I mentioned below)? I guess 
no as we will have final tag for this release after vote ends. Isn't it?

Thanks,

Junping

From: Vinod Kumar Vavilapalli 
Sent: Wednesday, December 16, 2015 7:32 PM
To: common-...@hadoop.apache.org
Cc: yarn-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; 
hdfs-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.

Are we still doing that? What are the RC0.1 and RC1 tags doing then?

+Vinod

> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
>
> Thanks Akira for notice this. I don't think we can remove these tags as they 
> should be immutable as branches. I created these duplicated tags as after I 
> cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I 
> could still push to original tag by forcefully. The best thing I can do then 
> is to make them point to the same commit as now it is.
>
> Thanks,
>
> Junping
> 
> From: Akira AJISAKA 
> Sent: Wednesday, December 16, 2015 6:41 AM
> To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
> mapreduce-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>
> Thanks Junping for starting release process.
> I noticed there are duplicated tags:
>
> * release-2.6.3-RC0
> * release-2.6.3-RC0.1
> * release-2.6.3-RC1
>
> Could you remove RC0.1 and RC1?
>
> Regards,
> Akira
>
> On 12/16/15 10:17, yliu wrote:
>> Thanks Junping, +1.
>> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
>> basic functionalities.
>>
>> Regards,
>> Yi Liu
>>
>> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>>
>>> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
>>> built locally. Ran some MR jobs successfully.
>>>
>>> Best,
>>> Chang
>>>
>>> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
>>>
 Thanks Junping,

 +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
 both successfully finished.

 Regards,
 Wangda


 On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
 naganarasimha...@gmail.com> wrote:

> Hi Junping,
>
> +0 (non binding)
>
> Though everything else is working  fine (downloaded the tar ball and
> installed single node cluster setup and  verified  few MR jobs),
> submission of Unmanaged AM is getting the RM down. YARN-4452 has
> already been raised and i am working on it. Will provide the patch for
> the trunk and the 2.6.3 version asap
>
> Regards,
>
> + Naga
>
> 
>
> Thanks for the work Junping! Downloaded the src tarball. Built locally
> and successfully ran
> in single node mode with a few map reduce jobs. LGTM.
>
> Li Lu
>
> On Dec 14, 2015, at 04:23, Junping Du
> mailto:j...@hortonworks.com>>
> wrote:
>
> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
> issue and download
> should work now. Please try to download it again. Thanks!
>
>
> Thanks,
>
>
> Junping
>
>
> 
> From: sarjeet singh mailto:sarje...@usc.edu>>
> Sent: Sunday, December 13, 2015 6:44 PM
> To: common-...@hadoop.apache.org
> Cc: mapreduce-dev@hadoop.apache.org>>> mapreduce-dev@hadoop.apache.org
>> ;
> hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org;
> junping...@apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>
> I am also getting the same error when downloading tar.gz:
>
> "You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server."
>
> - Sarjeet Singh
>
> On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
> mailto:oz...@apache.org>>
> wrote:
> Hi Junping,
>
> Thank you for starting the voting.
> I cannot access the tar.gz file because of permission error. Could you
> check the permission to access the files?
>
> Forbidden
> You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server.
>
> Thanks,
> - Tsuyoshi
>
> On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
> mailto:j...@hortonworks.com> j...@hortonworks.com>>
> wrote:
>
> Hi all developers in hadoop community,
>   I've created

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Xuan Gong 
+1 (binding),

Build and deploy the cluster from source code.
Ran a few example jobs and passed successfully. 

Xuan Gong

> On Dec 16, 2015, at 4:07 PM, Arpit Agarwal  wrote:
> 
> +1 (binding)
> 
> - Verified signatures for source and binary distributions
> - Built jars from source with java 1.7.0_79
> - Deployed single-node pseudo-cluster
> - Ran example map reduce jobs
> - Ran hdfs admin commands, verified NN web UI shows expected usages
> 
> 
> 
> On 12/11/15, 4:16 PM, "Junping Du"  wrote:
> 
>> 
>> Hi all developers in hadoop community,
>>  I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
>> maintenance release to follow up 2.6.2.) according to email thread of 
>> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several 
>> blocker issues were getting committed until yesterday. Below is the details:
>> 
>> The RC is available for validation at:
>> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
>> *
>> 
>> The RC tag in git is: release-2.6.3-RC0
>> 
>> The maven artifacts are staged via repository.apache.org at:
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
>> *
>> 
>> You can find my public key at:
>> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> 
>> Please try the release and vote. The vote will run for the usual 5 days.
>> 
>> Thanks and happy weekend!
>> 
>> 
>> Cheers,
>> 
>> Junping
>> 
>> 
>> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Arpit Agarwal 
+1 (binding)

- Verified signatures for source and binary distributions
- Built jars from source with java 1.7.0_79
- Deployed single-node pseudo-cluster
- Ran example map reduce jobs
- Ran hdfs admin commands, verified NN web UI shows expected usages



On 12/11/15, 4:16 PM, "Junping Du"  wrote:

>
>Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
>
>The RC is available for validation at:
>*http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
>*
>
>The RC tag in git is: release-2.6.3-RC0
>
>The maven artifacts are staged via repository.apache.org at:
>*https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
>*
>
>You can find my public key at:
>http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
>Please try the release and vote. The vote will run for the usual 5 days.
>
>Thanks and happy weekend!
>
>
>Cheers,
>
>Junping
>
>
>[1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>

Hadoop-Mapreduce-trunk-Java8 - Build # 792 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/792/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9714 lines...]
Running org.apache.hadoop.mapreduce.lib.db.TestSplitters
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.754 sec - in 
org.apache.hadoop.mapreduce.lib.db.TestSplitters
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.lib.db.TestDbClasses
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.91 sec - in 
org.apache.hadoop.mapreduce.lib.db.TestDbClasses
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.lib.jobcontrol.TestJobControl
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.804 sec - in 
org.apache.hadoop.mapreduce.lib.jobcontrol.TestJobControl
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.TestShufflePlugin
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.956 sec - in 
org.apache.hadoop.mapreduce.TestShufflePlugin

Results :

Failed tests: 
  TestCLI.testGetJob:175 null

Tests run: 220, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  2.278 s]
[INFO] Apache Hadoop MapReduce Core .. FAILURE [01:37 min]
[INFO] Apache Hadoop MapReduce Common  SKIPPED
[INFO] Apache Hadoop MapReduce Shuffle ... SKIPPED
[INFO] Apache Hadoop MapReduce App ... SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:40 min
[INFO] Finished at: 2015-12-16T23:56:01+00:00
[INFO] Final Memory: 35M/255M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-core: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-core
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapreduce.tools.TestCLI.testGetJob

Error Message:
null

Stack Trace:
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at 
org.apache.hadoop.mapreduce.tools.TestCLI.testGetJob(TestCLI.java:175)

[jira] [Resolved] (MAPREDUCE-6566) Add retry support to mapreduce CLI tool

2015-12-16 Thread Xuan Gong (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuan Gong resolved MAPREDUCE-6566.
--
   Resolution: Fixed
Fix Version/s: 2.8.0

> Add retry support to mapreduce CLI tool
> ---
>
> Key: MAPREDUCE-6566
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6566
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Affects Versions: 2.7.1
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Fix For: 2.8.0
>
> Attachments: MAPREDUCE-6566.001.patch, MAPREDUCE-6566.002.patch
>
>
> MAPREDUCE-6251 added support for retries to JobClient. However the MR CLI 
> class doesn't use the JobClient. It would be useful to add support for 
> retries to the CLI class as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Jason Lowe 
+1 (binding)
- Verified signatures and digests- Successfully built from source with native 
code support- Deployed to a single-node cluster and ran some test jobs
Jason

  From: Junping Du 
 To: Hadoop Common ; "hdfs-...@hadoop.apache.org" 
; "mapreduce-dev@hadoop.apache.org" 
; "yarn-...@hadoop.apache.org" 
 
Cc: "junping...@apache.org" 
 Sent: Friday, December 11, 2015 6:16 PM
 Subject: [VOTE] Release Apache Hadoop 2.6.3 RC0
   

Hi all developers in hadoop community,
  I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
maintenance release to follow up 2.6.2.) according to email thread of release 
plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
were getting committed until yesterday. Below is the details:

The RC is available for validation at:
*http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
*

The RC tag in git is: release-2.6.3-RC0

The maven artifacts are staged via repository.apache.org at:
*https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
*

You can find my public key at:
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS

Please try the release and vote. The vote will run for the usual 5 days.

Thanks and happy weekend!


Cheers,

Junping


[1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y

[jira] [Reopened] (MAPREDUCE-6566) Add retry support to mapreduce CLI tool

2015-12-16 Thread Vinod Kumar Vavilapalli (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli reopened MAPREDUCE-6566:


[~xgong], there are many major issues with how this patch got committed.
 - This is an improvement. It should never have been in 2.7.2. Why did you put 
it in 2.7.2?
 - Even if I give you that, it actually doesn't exist in 2.7.2 branch.
 - Neither does it exist in 2.8.0 branch.
 - What exactly happened with that trunk commit? You made too many CHANGES.txt 
modifications there.

I'm reverting both the commits and reopening this JIRA to get this fixed 
correctly.

> Add retry support to mapreduce CLI tool
> ---
>
> Key: MAPREDUCE-6566
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6566
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Affects Versions: 2.7.1
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: MAPREDUCE-6566.001.patch, MAPREDUCE-6566.002.patch
>
>
> MAPREDUCE-6251 added support for retries to JobClient. However the MR CLI 
> class doesn't use the JobClient. It would be useful to add support for 
> retries to the CLI class as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk-Java8 - Build # 791 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/791/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10063 lines...]
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.816 sec - 
in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.743 sec - 
in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempt
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.716 sec - in 
org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempt
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.TestMapreduceConfigFields
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.177 sec - in 
org.apache.hadoop.mapreduce.TestMapreduceConfigFields

Results :

Failed tests: 
  TestKill.testKillJob:84 Task state not correct expected: but was:

Tests run: 340, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [ 10.841 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [04:13 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [01:10 min]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 13.235 s]
[INFO] Apache Hadoop MapReduce App ... FAILURE [18:07 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 23:59 min
[INFO] Finished at: 2015-12-16T23:08:43+00:00
[INFO] Final Memory: 41M/266M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapreduce.v2.app.TestKill.testKillJob

Error Message:
Task state not correct expected: but was:

Stack Trace:
java.lang.AssertionError: Task state not correct expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at 
org.apache.hadoop.mapreduce.v2.app.TestKill.testKillJob(TestKill.java:84)

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

2015-12-16 Thread Vinod Kumar Vavilapalli 
The last of the blockers went in late last week.

Re-spinning the RC now.

Thanks
+Vinod

> On Nov 13, 2015, at 10:26 AM, Vinod Kumar Vavilapalli  
> wrote:
> 
> Thanks for reporting this Jason!
> 
> Everyone, I am canceling this RC given the feedback, we will go again after 
> addressing the open issues.
> 
> Thanks
> +Vinod
> 
>> On Nov 13, 2015, at 7:57 AM, Jason Lowe > > wrote:
>> 
>> -1 (binding)
>> 
>> Ran into public localization issues and filed YARN-4354 
>> . We need that resolved 
>> before the release is ready.  We will either need a timely fix or may have 
>> to revert YARN-2902 to unblock the release if my root-cause analysis is 
>> correct.  I'll dig into this more today.
>> 
>> Jason
>> 
>> From: Vinod Kumar Vavilapalli > >
>> To: common-...@hadoop.apache.org ; 
>> hdfs-...@hadoop.apache.org ; 
>> yarn-...@hadoop.apache.org ; 
>> mapreduce-dev@hadoop.apache.org  
>> Cc: vino...@apache.org  
>> Sent: Wednesday, November 11, 2015 10:31 PM
>> Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0
>> 
>> Hi all,
>> 
>> 
>> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>> 
>> 
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>> 
>> 
>> The RC is available for validation at:
>> 
>> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/ 
>> 
>> 
>> > >*
>> 
>> 
>> The RC tag in git is: release-2.7.2-RC0
>> 
>> 
>> The maven artifacts are available via repository.apache.org 
>>  at
>> 
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/ 
>> 
>> 
>> > >*
>> 
>> 
>> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
>> by quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>> 
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> 
>> Thanks,
>> 
>> Vinod
>> 
>> 
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 
>> 
>> 
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk 
>> 
>> 
>> 
>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

2015-12-16 Thread Vinod Kumar Vavilapalli 
Seeing as this came up very late, I am leaning towards dropping this off from 
2.7.2.

That said, I don’t see any reason why this shouldn’t be in 2.8.0 and 2.7.3. Set 
the target-versions accordingly on JIRA. If you agree, appreciate backport help 
to those branches.

Thanks
+Vinod

> On Dec 15, 2015, at 12:59 AM, Konstantin Shvachko  
> wrote:
> 
> Sorry for bringing this up late.
> I think we should pick up HDFS-9516 for this release.
> Rather critical bug fix, but up to you, Vinod.
> 
> Thanks,
> --Konst
> 
> On Wed, Nov 11, 2015 at 8:31 PM, Vinod Kumar Vavilapalli > wrote:
> 
>> Hi all,
>> 
>> 
>> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>> 
>> 
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>> 
>> 
>> The RC is available for validation at:
>> 
>> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/
>> 
>> *
>> 
>> 
>> The RC tag in git is: release-2.7.2-RC0
>> 
>> 
>> The maven artifacts are available via repository.apache.org at
>> 
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/
>> 
>> >> *
>> 
>> 
>> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
>> by quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>> 
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> 
>> Thanks,
>> 
>> Vinod
>> 
>> 
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes
>> 
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk
>>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Jian He 
+1,

Build and deploy the cluster from source code.
Ran a few example jobs and passed successfully. 

Jian

> On Dec 16, 2015, at 2:19 PM, Vinod Kumar Vavilapalli  
> wrote:
> 
> +1 (binding) for the RC except for my question below about the tag.
> 
> I checked 2.6.3-RC0, based on my check-list:
> 
> - Signatures and message digests all are good in general.
> - The top level full LICENSE, NOTICE and README for the source artifacts are 
> good - CHANGES.txt for common, hdfs and mapped are correctly located.
> - Able to build the tars out of the source tar ball using JDK 7. (Don’t have 
> a JDK 6 at hand)
> 
> Testing: All testing on single node, unsecured, default mode.
> 
> - Started HDFS daemons successfully , created directories.
> - Successfully started YARN daemons - ResourceManager, NodeManager and 
> Timeline Service
> - Successfully started MapReduce history server.
> - Ran DistributedShell as a native YARN app.
> - Ran wordcount, pi, random writer, sort, grep and they all pass just fine.
> - Navigated through the RM, NM and Timeline UIs to make sure the views are 
> working well.
> - Navigated through the MapReduce UI to make sure the views are working well.
> 
> Thanks,
> +Vinod
> 
> 
>> On Dec 16, 2015, at 11:32 AM, Vinod Kumar Vavilapalli  
>> wrote:
>> 
>> So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.
>> 
>> Are we still doing that? What are the RC0.1 and RC1 tags doing then?
>> 
>> +Vinod
>> 
>>> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
>>> 
>>> Thanks Akira for notice this. I don't think we can remove these tags as 
>>> they should be immutable as branches. I created these duplicated tags as 
>>> after I cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't 
>>> realize I could still push to original tag by forcefully. The best thing I 
>>> can do then is to make them point to the same commit as now it is.
>>> 
>>> Thanks,
>>> 
>>> Junping
>>> 
>>> From: Akira AJISAKA 
>>> Sent: Wednesday, December 16, 2015 6:41 AM
>>> To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
>>> mapreduce-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>>> 
>>> Thanks Junping for starting release process.
>>> I noticed there are duplicated tags:
>>> 
>>> * release-2.6.3-RC0
>>> * release-2.6.3-RC0.1
>>> * release-2.6.3-RC1
>>> 
>>> Could you remove RC0.1 and RC1?
>>> 
>>> Regards,
>>> Akira
>>> 
>>> On 12/16/15 10:17, yliu wrote:
 Thanks Junping, +1.
 Download the tarball and deploy a small HDFS/YARN cluster, and verify few
 basic functionalities.
 
 Regards,
 Yi Liu
 
 On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
 
> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
> built locally. Ran some MR jobs successfully.
> 
> Best,
> Chang
> 
> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
> 
>> Thanks Junping,
>> 
>> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
>> both successfully finished.
>> 
>> Regards,
>> Wangda
>> 
>> 
>> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
>> naganarasimha...@gmail.com> wrote:
>> 
>>> Hi Junping,
>>> 
>>> +0 (non binding)
>>> 
>>> Though everything else is working  fine (downloaded the tar ball and
>>> installed single node cluster setup and  verified  few MR jobs),
>>> submission of Unmanaged AM is getting the RM down. YARN-4452 has
>>> already been raised and i am working on it. Will provide the patch for
>>> the trunk and the 2.6.3 version asap
>>> 
>>> Regards,
>>> 
>>> + Naga
>>> 
>>> 
>>> 
>>> Thanks for the work Junping! Downloaded the src tarball. Built locally
>>> and successfully ran
>>> in single node mode with a few map reduce jobs. LGTM.
>>> 
>>> Li Lu
>>> 
>>> On Dec 14, 2015, at 04:23, Junping Du
>>> mailto:j...@hortonworks.com>>
>>> wrote:
>>> 
>>> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
>>> issue and download
>>> should work now. Please try to download it again. Thanks!
>>> 
>>> 
>>> Thanks,
>>> 
>>> 
>>> Junping
>>> 
>>> 
>>> 
>>> From: sarjeet singh mailto:sarje...@usc.edu>>
>>> Sent: Sunday, December 13, 2015 6:44 PM
>>> To: common-...@hadoop.apache.org
>>> Cc: mapreduce-dev@hadoop.apache.org> mapreduce-dev@hadoop.apache.org
 ;
>>> hdfs-...@hadoop.apache.org;
>>> yarn-...@hadoop.apache.org;
>>> junping...@apache.org
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>>> 
>>> I am also getting

Hadoop-Mapreduce-trunk - Build # 2729 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2729/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32834 lines...]
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.369 sec - in 
org.apache.hadoop.mapred.TestJavaSerialization
Running org.apache.hadoop.mapred.TestAuditLogger
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.32 sec - in 
org.apache.hadoop.mapred.TestAuditLogger
Running org.apache.hadoop.mapred.pipes.TestPipesNonJavaInputFormat
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.362 sec - in 
org.apache.hadoop.mapred.pipes.TestPipesNonJavaInputFormat
Running org.apache.hadoop.mapred.pipes.TestPipeApplication
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.473 sec - in 
org.apache.hadoop.mapred.pipes.TestPipeApplication
Running org.apache.hadoop.mapred.pipes.TestPipes
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.046 sec - in 
org.apache.hadoop.mapred.pipes.TestPipes
Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.463 sec - in 
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Running org.apache.hadoop.mapred.TestReporter
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.542 sec - in 
org.apache.hadoop.mapred.TestReporter

Results :

Failed tests: 
  TestNetworkedJob.testNetworkedJob:174 expected:<[[Wed Dec 16 21:33:52 + 
2015] Scheduler has assigned a container for AM, waiting for AM container to be 
launched]> but was:<[]>
  TestTextInputFormat.testSplitableCodecs:223 Key in multiple partitions.

Tests run: 523, Failures: 2, Errors: 0, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.088 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:55 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 29.495 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  5.068 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [09:24 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:38 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:58 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:16 h
[INFO] Finished at: 2015-12-16T22:29:32+00:00
[INFO] Final Memory: 41M/981M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  org.apache.hadoop.mapred.TestTextInputFormat.testSplitableCodecs

Error Message:
Key in multiple partitions.

Stack Trace:
java.lang.AssertionError: Key in multiple partitions.
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertFalse(Assert.java:64)
at 
org.apache.hadoop.mapred.TestTextInputFormat.testSplitableCodecs(TestTextInputFormat.java:223)


FAILED:  org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob

Error Message:
expected:<[[Wed Dec 16 21:33:52 + 2015] Scheduler has assigned a container 
for AM, waiting for AM container to be launched]> but was:<[]>

Stack Trace:
org.junit.ComparisonFail

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Vinod Kumar Vavilapalli 
+1 (binding) for the RC except for my question below about the tag.

I checked 2.6.3-RC0, based on my check-list:

- Signatures and message digests all are good in general.
- The top level full LICENSE, NOTICE and README for the source artifacts are 
good - CHANGES.txt for common, hdfs and mapped are correctly located.
- Able to build the tars out of the source tar ball using JDK 7. (Don’t have a 
JDK 6 at hand)

Testing: All testing on single node, unsecured, default mode.

- Started HDFS daemons successfully , created directories.
- Successfully started YARN daemons - ResourceManager, NodeManager and Timeline 
Service
- Successfully started MapReduce history server.
- Ran DistributedShell as a native YARN app.
- Ran wordcount, pi, random writer, sort, grep and they all pass just fine.
- Navigated through the RM, NM and Timeline UIs to make sure the views are 
working well.
- Navigated through the MapReduce UI to make sure the views are working well.

Thanks,
+Vinod


> On Dec 16, 2015, at 11:32 AM, Vinod Kumar Vavilapalli  
> wrote:
> 
> So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.
> 
> Are we still doing that? What are the RC0.1 and RC1 tags doing then?
> 
> +Vinod
> 
>> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
>> 
>> Thanks Akira for notice this. I don't think we can remove these tags as they 
>> should be immutable as branches. I created these duplicated tags as after I 
>> cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize 
>> I could still push to original tag by forcefully. The best thing I can do 
>> then is to make them point to the same commit as now it is.
>> 
>> Thanks,
>> 
>> Junping
>> 
>> From: Akira AJISAKA 
>> Sent: Wednesday, December 16, 2015 6:41 AM
>> To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
>> mapreduce-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>> 
>> Thanks Junping for starting release process.
>> I noticed there are duplicated tags:
>> 
>> * release-2.6.3-RC0
>> * release-2.6.3-RC0.1
>> * release-2.6.3-RC1
>> 
>> Could you remove RC0.1 and RC1?
>> 
>> Regards,
>> Akira
>> 
>> On 12/16/15 10:17, yliu wrote:
>>> Thanks Junping, +1.
>>> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
>>> basic functionalities.
>>> 
>>> Regards,
>>> Yi Liu
>>> 
>>> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>>> 
 Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
 built locally. Ran some MR jobs successfully.
 
 Best,
 Chang
 
 On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
 
> Thanks Junping,
> 
> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
> both successfully finished.
> 
> Regards,
> Wangda
> 
> 
> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
> naganarasimha...@gmail.com> wrote:
> 
>> Hi Junping,
>> 
>> +0 (non binding)
>> 
>> Though everything else is working  fine (downloaded the tar ball and
>> installed single node cluster setup and  verified  few MR jobs),
>> submission of Unmanaged AM is getting the RM down. YARN-4452 has
>> already been raised and i am working on it. Will provide the patch for
>> the trunk and the 2.6.3 version asap
>> 
>> Regards,
>> 
>> + Naga
>> 
>> 
>> 
>> Thanks for the work Junping! Downloaded the src tarball. Built locally
>> and successfully ran
>> in single node mode with a few map reduce jobs. LGTM.
>> 
>> Li Lu
>> 
>> On Dec 14, 2015, at 04:23, Junping Du
>> mailto:j...@hortonworks.com>>
>> wrote:
>> 
>> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
>> issue and download
>> should work now. Please try to download it again. Thanks!
>> 
>> 
>> Thanks,
>> 
>> 
>> Junping
>> 
>> 
>> 
>> From: sarjeet singh mailto:sarje...@usc.edu>>
>> Sent: Sunday, December 13, 2015 6:44 PM
>> To: common-...@hadoop.apache.org
>> Cc: mapreduce-dev@hadoop.apache.org mapreduce-dev@hadoop.apache.org
>>> ;
>> hdfs-...@hadoop.apache.org;
>> yarn-...@hadoop.apache.org;
>> junping...@apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>> 
>> I am also getting the same error when downloading tar.gz:
>> 
>> "You don't have permission to access
>> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
>> on this server."
>> 
>> - Sarjeet Singh
>> 
>> On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
>> mailto:oz...@apache.org>>
>> wrote:

request to subscribe to list william hunt

2015-12-16 Thread William Hunt 
request to suscribe to list william hunt

[jira] [Resolved] (MAPREDUCE-6576) AM java.io.tmpdir should be set to $PWD/tmp

2015-12-16 Thread Rohini Palaniswamy (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rohini Palaniswamy resolved MAPREDUCE-6576.
---
Resolution: Duplicate

My bad. I thought I did not report this. But found that [~jlowe] had already 
reported this in MAPREDUCE-6472 and it is fixed in 2.7.2

> AM java.io.tmpdir should be set to $PWD/tmp
> ---
>
> Key: MAPREDUCE-6576
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6576
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Reporter: Rohini Palaniswamy
>  Labels: newbie
>
> For tasks it is already done by MapReduceChildJVM 
> {code}
> Path childTmpDir = new Path(Environment.PWD.$(),
> YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR);
> vargs.add("-Djava.io.tmpdir=" + childTmpDir);
> So it is only needed to be set for AM in launcher because of uber mode.
> {code}
> Need to do this in AM as well, so that running in uber mode does not go to 
> default java.io.tmpdir of /tmp and fill up task nodes and not be cleanedup. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk-Java8 - Build # 790 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/790/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10063 lines...]
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.901 sec - in 
org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.jobhistory.TestJobSummary
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.384 sec - in 
org.apache.hadoop.mapreduce.jobhistory.TestJobSummary
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.701 sec - 
in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.691 sec - in 
org.apache.hadoop.mapreduce.jobhistory.TestEvents

Results :

Failed tests: 
  TestJobImpl.testUnusableNodeTransition:629->assertJobState:1012 
expected: but was:

Tests run: 340, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  2.785 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:52 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 28.974 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  4.559 s]
[INFO] Apache Hadoop MapReduce App ... FAILURE [11:38 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14:08 min
[INFO] Finished at: 2015-12-16T20:49:39+00:00
[INFO] Final Memory: 40M/263M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testUnusableNodeTransition

Error Message:
expected: but was:

Stack Trace:
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at 
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:1012)
at 
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testUnusableNodeTransition(TestJobImpl.java:629)

[jira] [Created] (MAPREDUCE-6576) AM java.io.tmpdir should be set to $PWD/tmp

2015-12-16 Thread Rohini Palaniswamy (JIRA) 
Rohini Palaniswamy created MAPREDUCE-6576:
-

 Summary: AM java.io.tmpdir should be set to $PWD/tmp
 Key: MAPREDUCE-6576
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6576
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
Reporter: Rohini Palaniswamy


For tasks it is already done by MapReduceChildJVM 

{code}
Path childTmpDir = new Path(Environment.PWD.$(),
YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR);
vargs.add("-Djava.io.tmpdir=" + childTmpDir);
So it is only needed to be set for AM in launcher because of uber mode.
{code}

Need to do this in AM as well, so that running in uber mode does not go to 
default java.io.tmpdir of /tmp and fill up task nodes and not be cleanedup. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (MAPREDUCE-6575) TestMRJobs.setup() should use YarnConfiguration properties instead of bare strings

2015-12-16 Thread Daniel Templeton (JIRA) 
Daniel Templeton created MAPREDUCE-6575:
---

 Summary: TestMRJobs.setup() should use YarnConfiguration 
properties instead of bare strings
 Key: MAPREDUCE-6575
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6575
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
Reporter: Daniel Templeton
Assignee: Daniel Templeton


YARN-5870 introduced the following line:

{code}
  conf.setInt("yarn.cluster.max-application-priority", 10);
{code}

It should instead be:

{code}
  conf.setInt(YarnConfiguration.MAX_CLUSTER_LEVEL_APPLICATION_PRIORITY, 10);
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk-Java8 - Build # 789 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/789/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10069 lines...]
Running org.apache.hadoop.mapreduce.TestMapreduceConfigFields
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.17 sec - in 
org.apache.hadoop.mapreduce.TestMapreduceConfigFields
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.769 sec - in 
org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestLocalContainerLauncher
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.617 sec - in 
org.apache.hadoop.mapred.TestLocalContainerLauncher
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.025 sec - in 
org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor

Results :

Failed tests: 
  TestMRApp.testUpdatedNodes:262 Expecting 2 more completion events for killed 
expected:<4> but was:<2>

Tests run: 340, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  4.383 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [02:59 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 51.795 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  7.627 s]
[INFO] Apache Hadoop MapReduce App ... FAILURE [14:39 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 18:44 min
[INFO] Finished at: 2015-12-16T19:52:19+00:00
[INFO] Final Memory: 41M/287M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapreduce.v2.app.TestMRApp.testUpdatedNodes

Error Message:
Expecting 2 more completion events for killed expected:<4> but was:<2>

Stack Trace:
java.lang.AssertionError: Expecting 2 more completion events for killed 
expected:<4> but was:<2>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at 
org.apache.hadoop.mapreduce.v2.app.TestMRApp.testUpdatedNodes(TestMRApp.java:262)

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Vinod Kumar Vavilapalli 
So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.

Are we still doing that? What are the RC0.1 and RC1 tags doing then?

+Vinod

> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
> 
> Thanks Akira for notice this. I don't think we can remove these tags as they 
> should be immutable as branches. I created these duplicated tags as after I 
> cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I 
> could still push to original tag by forcefully. The best thing I can do then 
> is to make them point to the same commit as now it is.
> 
> Thanks,
> 
> Junping
> 
> From: Akira AJISAKA 
> Sent: Wednesday, December 16, 2015 6:41 AM
> To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
> mapreduce-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> 
> Thanks Junping for starting release process.
> I noticed there are duplicated tags:
> 
> * release-2.6.3-RC0
> * release-2.6.3-RC0.1
> * release-2.6.3-RC1
> 
> Could you remove RC0.1 and RC1?
> 
> Regards,
> Akira
> 
> On 12/16/15 10:17, yliu wrote:
>> Thanks Junping, +1.
>> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
>> basic functionalities.
>> 
>> Regards,
>> Yi Liu
>> 
>> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>> 
>>> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
>>> built locally. Ran some MR jobs successfully.
>>> 
>>> Best,
>>> Chang
>>> 
>>> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
>>> 
 Thanks Junping,
 
 +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
 both successfully finished.
 
 Regards,
 Wangda
 
 
 On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
 naganarasimha...@gmail.com> wrote:
 
> Hi Junping,
> 
> +0 (non binding)
> 
> Though everything else is working  fine (downloaded the tar ball and
> installed single node cluster setup and  verified  few MR jobs),
> submission of Unmanaged AM is getting the RM down. YARN-4452 has
> already been raised and i am working on it. Will provide the patch for
> the trunk and the 2.6.3 version asap
> 
> Regards,
> 
> + Naga
> 
> 
> 
> Thanks for the work Junping! Downloaded the src tarball. Built locally
> and successfully ran
> in single node mode with a few map reduce jobs. LGTM.
> 
> Li Lu
> 
> On Dec 14, 2015, at 04:23, Junping Du
> mailto:j...@hortonworks.com>>
> wrote:
> 
> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
> issue and download
> should work now. Please try to download it again. Thanks!
> 
> 
> Thanks,
> 
> 
> Junping
> 
> 
> 
> From: sarjeet singh mailto:sarje...@usc.edu>>
> Sent: Sunday, December 13, 2015 6:44 PM
> To: common-...@hadoop.apache.org
> Cc: mapreduce-dev@hadoop.apache.org>>> mapreduce-dev@hadoop.apache.org
>> ;
> hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org;
> junping...@apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> 
> I am also getting the same error when downloading tar.gz:
> 
> "You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server."
> 
> - Sarjeet Singh
> 
> On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
> mailto:oz...@apache.org>>
> wrote:
> Hi Junping,
> 
> Thank you for starting the voting.
> I cannot access the tar.gz file because of permission error. Could you
> check the permission to access the files?
> 
> Forbidden
> You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server.
> 
> Thanks,
> - Tsuyoshi
> 
> On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
> mailto:j...@hortonworks.com> j...@hortonworks.com>>
> wrote:
> 
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
> next maintenance release
> to follow up 2.6.2.) according to email thread of release plan 2.6.3
> [1]. Sorry for this RC
> coming a bit late as several blocker issues were getting committed
> until yesterday. Below
> is the details:
> 
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> *
> 
> The RC tag in git is: release-2.6.3-RC0
> 
> The maven artifacts are staged via
> repo

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Varun Saxena 
+1 (non-binding)

- Downloaded the source and built locally.
- Set up a 2 node cluster.
- Ran a few mapreduce jobs successfully.

Regards,
Varun Saxena.

On Thu, Dec 17, 2015 at 12:06 AM, Tsuyoshi Ozawa  wrote:

> +1 (binding)
>
> - verified checksums
> - built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran
> tests and all of them passed.
>
> Thanks,
> - Tsuyoshi
>
> On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee  wrote:
> > +1 (non-binding)
> >
> > - downloaded source and binary and verified the signatures (although I
> > didn't connect with Junping via web of trust)
> > - started a pseudo-distributed cluster and ran test jobs
> > - browsed the RM and NN UI
> > - looked through the daemon logs
> >
> > Thanks Junping.
> >
> > Sangjin
> >
> > On Wed, Dec 16, 2015 at 5:11 AM, Brahma Reddy Battula <
> > brahmareddy.batt...@huawei.com> wrote:
> >
> >> +1 (non-binding)
> >>
> >> -- Downloaded both source and binary tarballs successfully.
> >> --Set up a pseudo-distributed cluster and Distributed HA Cluster
> >> --Ran Several jobs Slive,Terasort and pi.
> >> --All are working fine.
> >>
> >>
> >> Thanks & Regards
> >>  Brahma Reddy Battula
> >> 
> >> From: Steve Loughran [ste...@hortonworks.com]
> >> Sent: Wednesday, December 16, 2015 5:58 PM
> >> To: mapreduce-dev@hadoop.apache.org
> >> Cc: Hadoop Common; hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org;
> >> junping...@apache.org
> >> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> >>
> >> +1, binding
> >>
> >>
> >> Did a build and test with slider with the build set to
> >> -Dhadoop.version=2.6.3
> >>
> >> this does a D/L and test from the staging repo. All artifacts were
> >> located, and the tests completed
> >>
> >> > On 12 Dec 2015, at 00:16, Junping Du  wrote:
> >> >
> >> >
> >> > Hi all developers in hadoop community,
> >> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
> next
> >> maintenance release to follow up 2.6.2.) according to email thread of
> >> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several
> >> blocker issues were getting committed until yesterday. Below is the
> details:
> >> >
> >> > The RC is available for validation at:
> >> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> >> > *
> >> >
> >> > The RC tag in git is: release-2.6.3-RC0
> >> >
> >> > The maven artifacts are staged via repository.apache.org at:
> >> > *
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> >> > <
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/>*
> >> >
> >> > You can find my public key at:
> >> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >> >
> >> > Please try the release and vote. The vote will run for the usual 5
> days.
> >> >
> >> > Thanks and happy weekend!
> >> >
> >> >
> >> > Cheers,
> >> >
> >> > Junping
> >> >
> >> >
> >> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> >> >
> >>
> >>
>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Tsuyoshi Ozawa 
+1 (binding)

- verified checksums
- built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran
tests and all of them passed.

Thanks,
- Tsuyoshi

On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee  wrote:
> +1 (non-binding)
>
> - downloaded source and binary and verified the signatures (although I
> didn't connect with Junping via web of trust)
> - started a pseudo-distributed cluster and ran test jobs
> - browsed the RM and NN UI
> - looked through the daemon logs
>
> Thanks Junping.
>
> Sangjin
>
> On Wed, Dec 16, 2015 at 5:11 AM, Brahma Reddy Battula <
> brahmareddy.batt...@huawei.com> wrote:
>
>> +1 (non-binding)
>>
>> -- Downloaded both source and binary tarballs successfully.
>> --Set up a pseudo-distributed cluster and Distributed HA Cluster
>> --Ran Several jobs Slive,Terasort and pi.
>> --All are working fine.
>>
>>
>> Thanks & Regards
>>  Brahma Reddy Battula
>> 
>> From: Steve Loughran [ste...@hortonworks.com]
>> Sent: Wednesday, December 16, 2015 5:58 PM
>> To: mapreduce-dev@hadoop.apache.org
>> Cc: Hadoop Common; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
>> junping...@apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>>
>> +1, binding
>>
>>
>> Did a build and test with slider with the build set to
>> -Dhadoop.version=2.6.3
>>
>> this does a D/L and test from the staging repo. All artifacts were
>> located, and the tests completed
>>
>> > On 12 Dec 2015, at 00:16, Junping Du  wrote:
>> >
>> >
>> > Hi all developers in hadoop community,
>> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next
>> maintenance release to follow up 2.6.2.) according to email thread of
>> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several
>> blocker issues were getting committed until yesterday. Below is the details:
>> >
>> > The RC is available for validation at:
>> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
>> > *
>> >
>> > The RC tag in git is: release-2.6.3-RC0
>> >
>> > The maven artifacts are staged via repository.apache.org at:
>> > *
>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
>> > <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/>*
>> >
>> > You can find my public key at:
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> > Please try the release and vote. The vote will run for the usual 5 days.
>> >
>> > Thanks and happy weekend!
>> >
>> >
>> > Cheers,
>> >
>> > Junping
>> >
>> >
>> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>> >
>>
>>

[jira] [Created] (MAPREDUCE-6574) MR AM should print host of failed tasks.

2015-12-16 Thread Wangda Tan (JIRA) 
Wangda Tan created MAPREDUCE-6574:
-

 Summary: MR AM should print host of failed tasks.
 Key: MAPREDUCE-6574
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6574
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Wangda Tan


Something tasks failed because of issues on NMs. For example, bad disk/network 
could cause reducer fetching failure and mappers need to be re-scheduled.

It will be very helpful to identify such issues if we could print host of 
failed tasks, which we can simply grep MR AM's log to see what happened.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk - Build # 2728 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2728/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32826 lines...]
Running org.apache.hadoop.mapred.TestJavaSerialization
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.355 sec - in 
org.apache.hadoop.mapred.TestJavaSerialization
Running org.apache.hadoop.mapred.TestAuditLogger
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.243 sec - in 
org.apache.hadoop.mapred.TestAuditLogger
Running org.apache.hadoop.mapred.pipes.TestPipesNonJavaInputFormat
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.364 sec - in 
org.apache.hadoop.mapred.pipes.TestPipesNonJavaInputFormat
Running org.apache.hadoop.mapred.pipes.TestPipeApplication
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.411 sec - in 
org.apache.hadoop.mapred.pipes.TestPipeApplication
Running org.apache.hadoop.mapred.pipes.TestPipes
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.047 sec - in 
org.apache.hadoop.mapred.pipes.TestPipes
Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.333 sec - in 
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Running org.apache.hadoop.mapred.TestReporter
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.606 sec - in 
org.apache.hadoop.mapred.TestReporter

Results :

Failed tests: 
  TestNetworkedJob.testNetworkedJob:174 expected:<[[Wed Dec 16 16:18:25 + 
2015] Application is Activated, waiting for resources to be assigned for AM.  
Details : AM Partition =  ; Partition Resource = 
 ; Queue's Absolute capacity = 100.0 % ; Queue's 
Absolute used capacity = 0.0 % ; Queue's Absolute max capacity = 100.0 % ; ]> 
but was:<[]>

Tests run: 522, Failures: 1, Errors: 0, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.676 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:55 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 29.076 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  4.952 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [09:14 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:34 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:50 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:08 h
[INFO] Finished at: 2015-12-16T17:06:47+00:00
[INFO] Final Memory: 39M/607M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob

Error Message:
expected:<[[Wed Dec 16 16:18:25 + 2015] Application is Activated, waiting 
for resources to be assigned for AM.  Details : AM Partition = 
 ; Partition Resource =  ; Queue's 
Absolute capacity = 100.0 % ; Queue's Absolute used capacity = 0.0 % ; Queue's 
Absolute max capacity = 100.0 % ; ]> but was:<[]>

Stack Trace:
org.junit.ComparisonFailure: expected:<[[Wed Dec 16 16:18:25 + 2015] 
Application is Activated, waiting for resources to be assigned for AM.  Details 
: AM Parti

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Sangjin Lee 
+1 (non-binding)

- downloaded source and binary and verified the signatures (although I
didn't connect with Junping via web of trust)
- started a pseudo-distributed cluster and ran test jobs
- browsed the RM and NN UI
- looked through the daemon logs

Thanks Junping.

Sangjin

On Wed, Dec 16, 2015 at 5:11 AM, Brahma Reddy Battula <
brahmareddy.batt...@huawei.com> wrote:

> +1 (non-binding)
>
> -- Downloaded both source and binary tarballs successfully.
> --Set up a pseudo-distributed cluster and Distributed HA Cluster
> --Ran Several jobs Slive,Terasort and pi.
> --All are working fine.
>
>
> Thanks & Regards
>  Brahma Reddy Battula
> 
> From: Steve Loughran [ste...@hortonworks.com]
> Sent: Wednesday, December 16, 2015 5:58 PM
> To: mapreduce-dev@hadoop.apache.org
> Cc: Hadoop Common; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
> junping...@apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>
> +1, binding
>
>
> Did a build and test with slider with the build set to
> -Dhadoop.version=2.6.3
>
> this does a D/L and test from the staging repo. All artifacts were
> located, and the tests completed
>
> > On 12 Dec 2015, at 00:16, Junping Du  wrote:
> >
> >
> > Hi all developers in hadoop community,
> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next
> maintenance release to follow up 2.6.2.) according to email thread of
> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several
> blocker issues were getting committed until yesterday. Below is the details:
> >
> > The RC is available for validation at:
> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> > *
> >
> > The RC tag in git is: release-2.6.3-RC0
> >
> > The maven artifacts are staged via repository.apache.org at:
> > *
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> > <
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/>*
> >
> > You can find my public key at:
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > Please try the release and vote. The vote will run for the usual 5 days.
> >
> > Thanks and happy weekend!
> >
> >
> > Cheers,
> >
> > Junping
> >
> >
> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> >
>
>

Hadoop-Mapreduce-trunk-Java8 - Build # 788 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/788/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9711 lines...]
Running org.apache.hadoop.mapred.TestJobEndNotifier
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.119 sec - in 
org.apache.hadoop.mapred.TestJobEndNotifier
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestOldMethodsJobID
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.262 sec - in 
org.apache.hadoop.mapred.TestOldMethodsJobID
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestJobQueueClient
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 sec - in 
org.apache.hadoop.mapred.TestJobQueueClient
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestJobConf
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.294 sec - in 
org.apache.hadoop.mapred.TestJobConf

Results :

Failed tests: 
  TestCLI.testGetJob:175 null

Tests run: 220, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  2.163 s]
[INFO] Apache Hadoop MapReduce Core .. FAILURE [01:39 min]
[INFO] Apache Hadoop MapReduce Common  SKIPPED
[INFO] Apache Hadoop MapReduce Shuffle ... SKIPPED
[INFO] Apache Hadoop MapReduce App ... SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:42 min
[INFO] Finished at: 2015-12-16T15:32:47+00:00
[INFO] Final Memory: 35M/254M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-core: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-core
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapreduce.tools.TestCLI.testGetJob

Error Message:
null

Stack Trace:
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at 
org.apache.hadoop.mapreduce.tools.TestCLI.testGetJob(TestCLI.java:175)

RE: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Brahma Reddy Battula 
+1 (non-binding)

-- Downloaded both source and binary tarballs successfully.
--Set up a pseudo-distributed cluster and Distributed HA Cluster
--Ran Several jobs Slive,Terasort and pi.
--All are working fine.


Thanks & Regards
 Brahma Reddy Battula

From: Steve Loughran [ste...@hortonworks.com]
Sent: Wednesday, December 16, 2015 5:58 PM
To: mapreduce-dev@hadoop.apache.org
Cc: Hadoop Common; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
junping...@apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, binding


Did a build and test with slider with the build set to -Dhadoop.version=2.6.3

this does a D/L and test from the staging repo. All artifacts were located, and 
the tests completed

> On 12 Dec 2015, at 00:16, Junping Du  wrote:
>
>
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
>
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> *
>
> The RC tag in git is: release-2.6.3-RC0
>
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> *
>
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> Please try the release and vote. The vote will run for the usual 5 days.
>
> Thanks and happy weekend!
>
>
> Cheers,
>
> Junping
>
>
> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Steve Loughran 

+1, binding


Did a build and test with slider with the build set to -Dhadoop.version=2.6.3

this does a D/L and test from the staging repo. All artifacts were located, and 
the tests completed

> On 12 Dec 2015, at 00:16, Junping Du  wrote:
> 
> 
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
> 
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> *
> 
> The RC tag in git is: release-2.6.3-RC0
> 
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> *
> 
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> 
> Please try the release and vote. The vote will run for the usual 5 days.
> 
> Thanks and happy weekend!
> 
> 
> Cheers,
> 
> Junping
> 
> 
> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Steve Loughran 

> On 16 Dec 2015, at 06:41, Akira AJISAKA  wrote:
> 
> Thanks Junping for starting release process.
> I noticed there are duplicated tags:
> 
> * release-2.6.3-RC0
> * release-2.6.3-RC0.1
> * release-2.6.3-RC1
> 
> Could you remove RC0.1 and RC1?
> 
> Regards,
> Akira


the ASF has locked down tag & branch movement for now, so that you are 
guaranteed that the tag included in a vote is the tag you get when you download 
things.

The numbering suggestion was mine, I'm afraid

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Junping Du 
Thanks Akira for notice this. I don't think we can remove these tags as they 
should be immutable as branches. I created these duplicated tags as after I cut 
off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I could 
still push to original tag by forcefully. The best thing I can do then is to 
make them point to the same commit as now it is.

Thanks,

Junping

From: Akira AJISAKA 
Sent: Wednesday, December 16, 2015 6:41 AM
To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
mapreduce-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Thanks Junping for starting release process.
I noticed there are duplicated tags:

* release-2.6.3-RC0
* release-2.6.3-RC0.1
* release-2.6.3-RC1

Could you remove RC0.1 and RC1?

Regards,
Akira

On 12/16/15 10:17, yliu wrote:
> Thanks Junping, +1.
> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
> basic functionalities.
>
> Regards,
> Yi Liu
>
> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>
>> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
>> built locally. Ran some MR jobs successfully.
>>
>> Best,
>> Chang
>>
>> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
>>
>>> Thanks Junping,
>>>
>>> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
>>> both successfully finished.
>>>
>>> Regards,
>>> Wangda
>>>
>>>
>>> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
>>> naganarasimha...@gmail.com> wrote:
>>>
 Hi Junping,

 +0 (non binding)

 Though everything else is working  fine (downloaded the tar ball and
 installed single node cluster setup and  verified  few MR jobs),
 submission of Unmanaged AM is getting the RM down. YARN-4452 has
 already been raised and i am working on it. Will provide the patch for
 the trunk and the 2.6.3 version asap

 Regards,

 + Naga

 

 Thanks for the work Junping! Downloaded the src tarball. Built locally
 and successfully ran
 in single node mode with a few map reduce jobs. LGTM.

 Li Lu

 On Dec 14, 2015, at 04:23, Junping Du
 mailto:j...@hortonworks.com>>
 wrote:

 ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
 issue and download
 should work now. Please try to download it again. Thanks!


 Thanks,


 Junping


 
 From: sarjeet singh mailto:sarje...@usc.edu>>
 Sent: Sunday, December 13, 2015 6:44 PM
 To: common-...@hadoop.apache.org
 Cc: mapreduce-dev@hadoop.apache.org>> mapreduce-dev@hadoop.apache.org
> ;
 hdfs-...@hadoop.apache.org;
 yarn-...@hadoop.apache.org;
 junping...@apache.org
 Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

 I am also getting the same error when downloading tar.gz:

 "You don't have permission to access
 /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
 on this server."

 - Sarjeet Singh

 On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
 mailto:oz...@apache.org>>
 wrote:
 Hi Junping,

 Thank you for starting the voting.
 I cannot access the tar.gz file because of permission error. Could you
 check the permission to access the files?

 Forbidden
 You don't have permission to access
 /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
 on this server.

 Thanks,
 - Tsuyoshi

 On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
 mailto:j...@hortonworks.com j...@hortonworks.com>>
 wrote:

 Hi all developers in hadoop community,
I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
 next maintenance release
 to follow up 2.6.2.) according to email thread of release plan 2.6.3
 [1]. Sorry for this RC
 coming a bit late as several blocker issues were getting committed
 until yesterday. Below
 is the details:

 The RC is available for validation at:
 *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
 *

 The RC tag in git is: release-2.6.3-RC0

 The maven artifacts are staged via
 repository.apache.org<
 http://repository.apache.org>
 at:
 *
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/
>> ?
 <
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/
> *

 You can find my public key
 at:http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS

 Please try the release and vote. The vote wil

Hadoop-Mapreduce-trunk - Build # 2727 - Still Failing

2015-12-16 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2727/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 35607 lines...]
Running org.apache.hadoop.mapred.pipes.TestPipeApplication
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.49 sec - in 
org.apache.hadoop.mapred.pipes.TestPipeApplication
Running org.apache.hadoop.mapred.TestJavaSerialization
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.052 sec - in 
org.apache.hadoop.mapred.TestJavaSerialization
Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.419 sec - in 
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Running org.apache.hadoop.ipc.TestMRCJCSocketFactory
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.818 sec - in 
org.apache.hadoop.ipc.TestMRCJCSocketFactory

Results :

Failed tests: 
  TestNetworkedJob.testNetworkedJob:174 expected:<[[Wed Dec 16 08:49:10 + 
2015] Application is Activated, waiting for resources to be assigned for AM.  
Details : AM Partition =  ; Partition Resource = 
 ; Queue's Absolute capacity = 100.0 % ; Queue's 
Absolute used capacity = 0.0 % ; Queue's Absolute max capacity = 100.0 % ; ]> 
but was:<[]>

Tests in error: 
  TestMRJobsWithProfiler.testDifferentProfilers:117->testProfilerInternal:155 » 

Tests run: 526, Failures: 1, Errors: 1, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.899 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [02:54 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 42.925 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  8.194 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [12:07 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [07:11 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  02:04 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:27 h
[INFO] Finished at: 2015-12-16T09:40:56+00:00
[INFO] Final Memory: 38M/1094M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testDifferentProfilers

Error Message:
test timed out after 15 milliseconds

Stack Trace:
java.lang.Exception: test timed out after 15 milliseconds
at java.lang.Thread.sleep(Native Method)
at 
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfilerInternal(TestMRJobsWithProfiler.java:155)
at 
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testDifferentProfilers(TestMRJobsWithProfiler.java:117)


FAILED:  org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob

Error Message:
expected:<[[Wed Dec 16 08:49:10 + 2015] Application is Activated, waiting 
for resources to be assigned for AM.  Details : AM Partition = 
 ; Partition Resource =  ; Queue's 
Absolute