[jira] [Created] (MAPREDUCE-6355) 2.5 client cannot communicate with 2.5 job on 2.6 cluster

2015-05-04 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-6355:
-

 Summary: 2.5 client cannot communicate with 2.5 job on 2.6 cluster
 Key: MAPREDUCE-6355
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6355
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Affects Versions: 2.6.0
Reporter: Jason Lowe


Trying to run a job on a Hadoop 2.6 cluster from a Hadoop 2.5 client submitting 
a job that uses Hadoop 2.5 jars results in a job that succeeds but the client 
cannot communicate with the AM while the job is running.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (MAPREDUCE-6354) shuffle handler should log connection info

2015-05-04 Thread Chang Li (JIRA)
Chang Li created MAPREDUCE-6354:
---

 Summary: shuffle handler should log connection info
 Key: MAPREDUCE-6354
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6354
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Chang Li
Assignee: Chang Li


currently, shuffle handler only log connection info in debug mode, we want to 
log that info in a more concise way



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Hadoop-Mapreduce-trunk - Build # 2133 - Failure

2015-05-04 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2133/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 31969 lines...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.839 sec - in 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat

Results :

Tests in error: 
  TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled:153 ยป IO 
Jo...

Tests run: 520, Failures: 0, Errors: 1, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ... SUCCESS [  2.718 s]
[INFO] hadoop-mapreduce-client-core .. SUCCESS [01:21 min]
[INFO] hadoop-mapreduce-client-common  SUCCESS [ 27.590 s]
[INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [  4.739 s]
[INFO] hadoop-mapreduce-client-app ... SUCCESS [08:28 min]
[INFO] hadoop-mapreduce-client-hs  SUCCESS [05:26 min]
[INFO] hadoop-mapreduce-client-jobclient . FAILURE [  01:46 h]
[INFO] hadoop-mapreduce-client-hs-plugins  SKIPPED
[INFO] hadoop-mapreduce-client-nativetask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] hadoop-mapreduce .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:02 h
[INFO] Finished at: 2015-05-04T15:28:54+00:00
[INFO] Final Memory: 40M/1017M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Sending artifact delta relative to Hadoop-Mapreduce-trunk #2132
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 20334854 bytes
Compression is 0.0%
Took 5.4 sec
Recording test results
Updating MAPREDUCE-6349
Updating HADOOP-11328
Updating MAPREDUCE-5905
Updating HADOOP-9658
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
1 tests failed.
REGRESSION:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled(TestMRTimelineEventHandling.java:153)




Hadoop-Mapreduce-trunk-Java8 - Build # 184 - Still Failing

2015-05-04 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/184/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10914 lines...]
Running org.apache.hadoop.util.TestMRCJCRunJar
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.22 sec - in 
org.apache.hadoop.util.TestMRCJCRunJar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestSequenceFileMergeProgress
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.382 sec - in 
org.apache.hadoop.io.TestSequenceFileMergeProgress

Results :

Failed tests: 
  TestCombineFileInputFormat.testSplitPlacementForCompressedFiles:918 
expected:<2> but was:<1>
  TestCombineFileInputFormat.testSplitPlacement:372 expected:<2> but was:<1>

Tests run: 520, Failures: 2, Errors: 0, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ... SUCCESS [  2.190 s]
[INFO] hadoop-mapreduce-client-core .. SUCCESS [01:09 min]
[INFO] hadoop-mapreduce-client-common  SUCCESS [ 25.713 s]
[INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [  4.016 s]
[INFO] hadoop-mapreduce-client-app ... SUCCESS [10:18 min]
[INFO] hadoop-mapreduce-client-hs  SUCCESS [05:55 min]
[INFO] hadoop-mapreduce-client-jobclient . FAILURE [  01:40 h]
[INFO] hadoop-mapreduce-client-hs-plugins  SKIPPED
[INFO] hadoop-mapreduce-client-nativetask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] hadoop-mapreduce .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:58 h
[INFO] Finished at: 2015-05-04T15:05:56+00:00
[INFO] Final Memory: 34M/233M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
No artifacts from Hadoop-Mapreduce-trunk-Java8 #28 to compare, so performing 
full copy of artifacts
Recording test results
Updating MAPREDUCE-6349
Updating HADOOP-11328
Updating MAPREDUCE-5905
Updating HADOOP-9658
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacementForCompressedFiles

Error Message:
expected:<2> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<2> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacementForCompressedFiles(TestCombineFileInputFormat.java:918)


FAILED:  
org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacement

Error Message:
expected:<2> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<2> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.ma

[jira] [Resolved] (MAPREDUCE-6348) JobHistoryEventHandler could not flush every 30 secondes

2015-05-04 Thread Devaraj K (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Devaraj K resolved MAPREDUCE-6348.
--
Resolution: Duplicate

> JobHistoryEventHandler could not flush every 30 secondes
> 
>
> Key: MAPREDUCE-6348
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6348
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: jobhistoryserver
>Reporter: qus-jiawei
>Priority: Minor
>
> JobHistoryEventHandler could not flush the event every 30 seconds.
> cause the var isTimerActive is never set to true.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (MAPREDUCE-6348) JobHistoryEventHandler could not flush every 30 secondes

2015-05-04 Thread Devaraj K (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Devaraj K reopened MAPREDUCE-6348:
--

> JobHistoryEventHandler could not flush every 30 secondes
> 
>
> Key: MAPREDUCE-6348
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6348
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: jobhistoryserver
>Reporter: qus-jiawei
>Priority: Minor
>
> JobHistoryEventHandler could not flush the event every 30 seconds.
> cause the var isTimerActive is never set to true.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)