Hadoop-Mapreduce-trunk-Commit - Build # 964 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/964/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14027 lines...]
[junit] Running org.apache.hadoop.mapred.TestMapRed
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.339 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.525 sec
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.583 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.506 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 31.493 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.608 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.752 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.025 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.225 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 47.245 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.036 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.899 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.728 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 102.808 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.179 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 47.134 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.344 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.625 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.338 sec
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.946 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.585 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 7 minutes 1 second
Build step 'Execute shell' marked build as failure
Recording test results
Updating HDFS-2356
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed


[jira] [Created] (MAPREDUCE-3085) Fix / remove failing tests from MrV1

2011-09-23 Thread Siddharth Seth (JIRA)
Fix / remove failing tests from MrV1


 Key: MAPREDUCE-3085
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3085
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Siddharth Seth


30 failures. Most related to 
{code}
Error Message

Invalid "mapreduce.jobtracker.address" configuration value for JobTracker: 
"local"

Stacktrace

java.io.IOException: Invalid "mapreduce.jobtracker.address" configuration value 
for JobTracker: "local"
at 
org.apache.hadoop.mapred.JobTrackerClientProtocolProvider.create(JobTrackerClientProtocolProvider.java:47)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:74)
at org.apache.hadoop.mapred.JobClient.init(JobClient.java:459)
at org.apache.hadoop.mapred.JobClient.(JobClient.java:438)
at 
org.apache.hadoop.mapred.TestComparators.configure(TestComparators.java:332)
at 
org.apache.hadoop.mapred.TestComparators.testDefaultMRComparator(TestComparators.java:341)
{code}
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-trunk-Commit/963/#showFailuresLink

Tests like TestTaskTrackerBlackListing, which aren't relevant can probably be 
removed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-3084) race when KILL_CONTAINER is received for a LOCALIZED container

2011-09-23 Thread Siddharth Seth (JIRA)
race when KILL_CONTAINER is received for a LOCALIZED container
--

 Key: MAPREDUCE-3084
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3084
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth


Depending on when ContainersLaunch starts a container, {{KILL_CONTAINER}} when 
container state is {{LOCALIZED}} ({{LAUNCH_CONTAINER}} event already sent) can 
end up generating a {{CONTAINER_LAUNCHED}} event - which isn't handled by 
ContainerState: {{KILLING}}. Also, the launched container won't be killed since 
{{CLEANUP_CONTAINER}} would have already been processed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-3083) Distributed Cache Handling of public directories with private files

2011-09-23 Thread Siddharth Seth (JIRA)
Distributed Cache Handling of public directories with private files
---

 Key: MAPREDUCE-3083
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3083
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: distributed-cache, mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Minor


0.23 distributed cache fails to localize with public directory containing 
private files. 0.20 handles this a private directory. (seems to handles all 
directories as private)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-3082) archive command take wrong path for input file with current directory

2011-09-23 Thread Rajit (JIRA)
archive command take wrong path for input file with current directory
-

 Key: MAPREDUCE-3082
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3082
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Affects Versions: 0.20.204.1
Reporter: Rajit


$hadoop dfs -copyFromLocal /etc/passwd .
$hadoop dfs -lsr .
-rw---   3 hadoopqa hdfs   6883 2011-09-23 22:37 /user/hadoopqa/passwd
$hadoop archive -archiveName test1.har -p .  passwd .
11/09/23 22:39:22 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 4 
for hadoopqa
11/09/23 22:39:22 INFO security.TokenCache: Got dt for
hdfs:///user/hadoopqa/.staging/job_201109232234_0004;uri=:8020;t.service=:8020
11/09/23 22:39:22 INFO mapred.JobClient: Running job: job_201109232234_0004
11/09/23 22:39:23 INFO mapred.JobClient:  map 0% reduce 0%
11/09/23 22:39:34 INFO mapred.JobClient: Task Id : 
attempt_201109232234_0004_m_00_0, Status : FAILED
java.io.FileNotFoundException: File does not exist: hdfs:///user/hadoopqa/hadoopqa/passwd
at 
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:525)
at 
org.apache.hadoop.tools.HadoopArchives$HArchivesMapper.map(HadoopArchives.java:697)
at 
org.apache.hadoop.tools.HadoopArchives$HArchivesMapper.map(HadoopArchives.java:587)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:255)

So Archiving is failing as it was finding input file at 
/user/hadoopqa/hadoopqa/passwd , whereas it should look for 
/user/hadoopqa/passwd

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-3081) Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh

2011-09-23 Thread vitthal (Suhas) Gogate (JIRA)
Change the name format for hadoop core and vaidya jar to be 
hadoop-{core/vaidya}-{version}.jar in vaidya.sh
---

 Key: MAPREDUCE-3081
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3081
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: contrib/vaidya
Affects Versions: 0.20.1
Reporter: vitthal (Suhas) Gogate
 Fix For: 0.20.205.0


Vaidya script is broken due to change in the naming convention for hadoop core 
jar and vaidya jar. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-3080) dfs calls from streaming fails with ExceptionInInitializerError

2011-09-23 Thread Ramya Sunil (JIRA)
dfs calls from streaming fails with ExceptionInInitializerError
---

 Key: MAPREDUCE-3080
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3080
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: contrib/streaming
Affects Versions: 0.20.205.0
Reporter: Ramya Sunil
 Fix For: 0.20.205.0


Dfs calls from streaming seem to fail with the following error:

{noformat}
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)
Caused by: org.apache.commons.logging.LogConfigurationException: User-specified 
log class 'org.apache.commons.logging.impl.Log4JLogger' cannot be found or is 
not useable.
at 
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:874)
at 
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604)
at 
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336)
at 
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:310)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.conf.Configuration.(Configuration.java:142)
... 3 more
{noformat}

commons-logging-1.1.1.jar is in the classpath. An easy way to reproduce this 
is, on a secure deploy, "hadoop --config $HADOOP_CONF_DIR jar 
hadoop-streaming.jar -input  -output Out -mapper "hadoop --config 
$HADOOP_CONF_DIR dfs -help" -reducer NONE"


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Re: Jobs not running after MAPREDUCE-2880

2011-09-23 Thread Ravi Prakash
Hi Arun,

Unsecure single node.

I'm attaching the classpath I grepped | sort | uniq from the two task.sh
files I got (one from the working version and the other from the notworking
version). Looks like the classpath which worked had some other jars not
present in the new classpath.

I'm guessing as part of the simplification for CLASSPATH maybe we missed
something that was being included earlier?

Thanks
Ravi


On Fri, Sep 23, 2011 at 12:18 PM, Arun Murthy  wrote:

> This is secure mode or unsecured? Cluster or single node? Tx
>
> Sent from my iPhone
>
> On Sep 23, 2011, at 8:37 AM, Ravi Prakash  wrote:
>
> > Hi Arun/Vinod,
> >
> > After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
> > Date:   Wed Sep 21 18:52:27 2011 +
> > MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
> > git-svn-id:
> >
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
> >
> > My mapreduce jobs are failing
> > 2011-09-23 10:27:08,534 INFO  ipc.HadoopYarnRPC
> > (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc
> proxy
> > for protocol interface
> org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
> > 2011-09-23 10:27:08,634 INFO  mapreduce.Job
> > (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002
> > 2011-09-23 10:27:09,653 INFO  mapreduce.Job
> > (Job.java:monitorAndPrintJob(1229)) -  map 0% reduce 0%
> > 2011-09-23 10:27:16,739 INFO  mapreduce.Job
> > (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed
> with
> > state FAILED
> > 2011-09-23 10:27:16,786 INFO  mapreduce.Job
> > (Job.java:monitorAndPrintJob(1246)) - Counters: 0
> >
> > Digging into the stderr logs: I see this single line
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/mapreduce/v2/app/MRAppMaster
> >
> > What do I need to add to my environment / config so that the magic
> happens
> > again?
> >
> > Thanks
> > Ravi.
>


Re: Jobs not running after MAPREDUCE-2880

2011-09-23 Thread Arun Murthy
This is secure mode or unsecured? Cluster or single node? Tx

Sent from my iPhone

On Sep 23, 2011, at 8:37 AM, Ravi Prakash  wrote:

> Hi Arun/Vinod,
>
> After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
> Date:   Wed Sep 21 18:52:27 2011 +
> MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
> git-svn-id:
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
>
> My mapreduce jobs are failing
> 2011-09-23 10:27:08,534 INFO  ipc.HadoopYarnRPC
> (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy
> for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
> 2011-09-23 10:27:08,634 INFO  mapreduce.Job
> (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002
> 2011-09-23 10:27:09,653 INFO  mapreduce.Job
> (Job.java:monitorAndPrintJob(1229)) -  map 0% reduce 0%
> 2011-09-23 10:27:16,739 INFO  mapreduce.Job
> (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with
> state FAILED
> 2011-09-23 10:27:16,786 INFO  mapreduce.Job
> (Job.java:monitorAndPrintJob(1246)) - Counters: 0
>
> Digging into the stderr logs: I see this single line
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapreduce/v2/app/MRAppMaster
>
> What do I need to add to my environment / config so that the magic happens
> again?
>
> Thanks
> Ravi.


[jira] [Created] (MAPREDUCE-3079) usercache//appcache/ directory not removed when using DefaultContainerExecutor

2011-09-23 Thread Thomas Graves (JIRA)
usercache//appcache/ directory not removed when using 
DefaultContainerExecutor
---

 Key: MAPREDUCE-3079
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3079
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Thomas Graves
Priority: Critical
 Fix For: 0.23.0


Running with the DefaultContainerExecutor it appears that the 
usercache//appcache/ directory itself is not removed when the app 
finishes.  All the directories under it are properly removed though.

The nodemanager log file indicates that it tries to delete it:
11/09/23 15:17:56 INFO nodemanager.DefaultContainerExecutor: Deleting absolute 
path : 
/home/hadoop/mapred/tmp/mapred-local/usercache/tgraves/appcache/application_1316722920862_0003

This doesn't appear to happen with the LinuxContainerExecutor.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 963 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/963/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14028 lines...]
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.37 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 62.449 sec
[junit] Test org.apache.hadoop.mapred.TestMiniMRDFSCaching FAILED
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.587 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.485 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.054 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.614 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.751 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.022 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.935 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 42.848 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 3.975 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.891 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.693 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 56.695 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.18 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 43.825 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.351 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.613 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 48.002 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.946 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.58 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 8 minutes 2 seconds
Build step 'Execute shell' marked build as failure
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed


Jobs not running after MAPREDUCE-2880

2011-09-23 Thread Ravi Prakash
Hi Arun/Vinod,

After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
Date:   Wed Sep 21 18:52:27 2011 +
MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68

My mapreduce jobs are failing
2011-09-23 10:27:08,534 INFO  ipc.HadoopYarnRPC
(HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy
for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
2011-09-23 10:27:08,634 INFO  mapreduce.Job
(Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002
2011-09-23 10:27:09,653 INFO  mapreduce.Job
(Job.java:monitorAndPrintJob(1229)) -  map 0% reduce 0%
2011-09-23 10:27:16,739 INFO  mapreduce.Job
(Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with
state FAILED
2011-09-23 10:27:16,786 INFO  mapreduce.Job
(Job.java:monitorAndPrintJob(1246)) - Counters: 0

Digging into the stderr logs: I see this single line
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/v2/app/MRAppMaster

What do I need to add to my environment / config so that the magic happens
again?

Thanks
Ravi.


Hadoop-Mapreduce-trunk-Commit - Build # 962 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/962/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14026 lines...]
[junit] Running org.apache.hadoop.mapred.TestMapRed
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.327 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.926 sec
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.585 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.522 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 51.384 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.611 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.756 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.938 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.584 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 42.862 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.204 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.884 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.74 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 67.453 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.182 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 41.537 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.347 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.62 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.358 sec
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.95 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.588 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 6 minutes 20 seconds
Build step 'Execute shell' marked build as failure
Recording test results
Updating MAPREDUCE-3055
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed


Hadoop-Mapreduce-trunk-Commit - Build # 961 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/961/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14024 lines...]
[junit] Running org.apache.hadoop.mapred.TestMapRed
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.326 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.712 sec
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.583 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.47 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 31.85 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.615 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.756 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.018 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.902 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 47.493 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.014 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.909 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.704 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 53.655 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.179 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 41.564 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.345 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.618 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.335 sec
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.942 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.579 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 5 minutes 50 seconds
Build step 'Execute shell' marked build as failure
Recording test results
Updating HADOOP-7542
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed


Hadoop-Mapreduce-trunk-Commit - Build # 960 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/960/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14024 lines...]
[junit] Running org.apache.hadoop.mapred.TestMapRed
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.338 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 29.508 sec
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.582 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.494 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 37.613 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.615 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.754 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.989 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.908 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 47.46 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.142 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.888 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.688 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 85.01 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.179 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 47.106 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.345 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.615 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.317 sec
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.935 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.576 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 6 minutes 29 seconds
Build step 'Execute shell' marked build as failure
Recording test results
Updating HADOOP-7669
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed


Hadoop-Mapreduce-trunk-Commit - Build # 959 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/959/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14024 lines...]
[junit] Running org.apache.hadoop.mapred.TestMapRed
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.323 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 33.997 sec
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.586 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.484 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 88.7 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.611 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.762 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.942 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.367 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 47.261 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 3.964 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.904 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.687 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 103.91 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.181 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 47.089 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.345 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.633 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.322 sec
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.945 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.58 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 7 minutes 44 seconds
Build step 'Execute shell' marked build as failure
Recording test results
Updating HADOOP-7542
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed


[jira] [Resolved] (MAPREDUCE-2982) App/Tasks progress is showing as 0% in UI even if successfully completed

2011-09-23 Thread Vinod Kumar Vavilapalli (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli resolved MAPREDUCE-2982.


Resolution: Duplicate

Closing this as duplicate in favour of MAPREDUCE-3078 and MAPREDUCE-2676 which 
are fixing the issues separately.

> App/Tasks progress is showing as 0% in UI even if successfully completed
> 
>
> Key: MAPREDUCE-2982
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2982
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: jobhistoryserver, resourcemanager
>Affects Versions: 0.24.0
>Reporter: Devaraj K
>Assignee: Devaraj K
> Attachments: App Progress.jpg, Tasks Progress.jpg
>
>
> Application/Tasks progress is showing as 0% in UI even if successfully 
> completed as shown in the attached screen shots.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-3078) Application's progress isn't updated from AM to RM.

2011-09-23 Thread Vinod Kumar Vavilapalli (JIRA)
Application's progress isn't updated from AM to RM.
---

 Key: MAPREDUCE-3078
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3078
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Vinod Kumar Vavilapalli
 Fix For: 0.23.0


It helps to be able to monitor the application-progress from the RM UI itself.

Bits of it is already there, even the AM-RM API (in AllocateRequest). We just 
need to make sure the progress is produced and consumed properly.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 958 - Still Failing

2011-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/958/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14024 lines...]
[junit] Running org.apache.hadoop.mapred.TestMapRed
[junit] Tests run: 5, Failures: 2, Errors: 3, Time elapsed: 1.322 sec
[junit] Test org.apache.hadoop.mapred.TestMapRed FAILED
[junit] Running org.apache.hadoop.mapred.TestMiniMRDFSCaching
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 29.786 sec
[junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.588 sec
[junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.482 sec
[junit] Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 31.692 sec
[junit] Running org.apache.hadoop.mapred.TestReduceTask
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.616 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.753 sec
[junit] Running 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.069 sec
[junit] Running org.apache.hadoop.mapred.TestSequenceFileInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.546 sec
[junit] Running org.apache.hadoop.mapred.TestSeveral
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 46.923 sec
[junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 3.957 sec
[junit] Running org.apache.hadoop.mapred.TestTaskLimits
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.915 sec
[junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.69 sec
[junit] Running org.apache.hadoop.mapred.TestTextInputFormat
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 61.437 sec
[junit] Running org.apache.hadoop.mapred.TestTextOutputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.18 sec
[junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 47.052 sec
[junit] Running org.apache.hadoop.mapreduce.TestCounters
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.347 sec
[junit] Running org.apache.hadoop.mapreduce.TestMapCollection
[junit] Tests run: 11, Failures: 0, Errors: 11, Time elapsed: 0.616 sec
[junit] Test org.apache.hadoop.mapreduce.TestMapCollection FAILED
[junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.332 sec
[junit] Running org.apache.hadoop.mapreduce.lib.input.TestFileInputFormat
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.947 sec
[junit] Running 
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.588 sec

checkfailure:
[touch] Creating 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:792:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:755:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:816:
 Tests failed!

Total time: 6 minutes 0 seconds
Build step 'Execute shell' marked build as failure
Recording test results
Updating HADOOP-7542
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed