[jira] [Created] (MAPREDUCE-2910) Allow empty MapOutputFile segments

2011-08-29 Thread Binglin Chang (JIRA)
Allow empty MapOutputFile segments -- Key: MAPREDUCE-2910 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2910 Project: Hadoop Map/Reduce Issue Type: Improvement Components: task, tasktracker

[jira] [Created] (MAPREDUCE-2909) Docs for remaining records in yarn-api

2011-08-29 Thread Arun C Murthy (JIRA)
Docs for remaining records in yarn-api -- Key: MAPREDUCE-2909 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2909 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: documentation,

[jira] [Created] (MAPREDUCE-2908) Fix findbugs warnings in Map Reduce.

2011-08-29 Thread Mahadev konar (JIRA)
Fix findbugs warnings in Map Reduce. Key: MAPREDUCE-2908 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2908 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Version

RE: Hadoop-Mapreduce-22-branch - Build # 65 - Still Failing

2011-08-29 Thread Rottinghuis, Joep
Looks like a problem with the Hudson slave setup, and/or the job. If somebody from infra can confirm that ant is installed in the expected location (/homes/hudson/tools/ant/latest/bin/ant), or else an explicit ant version should be selected in the job setup: + /homes/hudson/tools/ant/latest/bin/

Hadoop-Mapreduce-22-branch - Build # 65 - Still Failing

2011-08-29 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/65/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2276 lines...] A src/examples/org/apache/h

[jira] [Created] (MAPREDUCE-2907) ResourceManager logs filled with [INFO] debug messages from org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue

2011-08-29 Thread Ravi Prakash (JIRA)
ResourceManager logs filled with [INFO] debug messages from org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue Key: M

[jira] [Resolved] (MAPREDUCE-2906) FindBugs OutOfMemoryError

2011-08-29 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis resolved MAPREDUCE-2906. - Resolution: Not A Problem Even though same entry does not exist in hadoop-com

[jira] [Created] (MAPREDUCE-2906) FindBugs OutOfMemoryError

2011-08-29 Thread Joep Rottinghuis (JIRA)
FindBugs OutOfMemoryError - Key: MAPREDUCE-2906 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2906 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.22.0 Environment: FindBugs 1.3.9, a

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-08-29 Thread Allen Wittenauer
I have a feeling this discussion should get moved to common-dev or even to general. My #1 question is if tools is basically contrib reborn. If not, what makes it different? On Aug 29, 2011, at 1:43 AM, Amareshwari Sri Ramadasu wrote: > Some questions on making hadoop-tools top level under tr

Re: Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Robert Evans
DONE I filed HADOOP-7589 and uploaded my patch to it. Alejandro, could you take a quick look at the patch because you appear to be the maven expert. Thanks, Bobby Evans On 8/29/11 12:39 PM, "Mahadev Konar" wrote: Bobby, You are right. The test-patch uses mvn compile. Please file a jira. It

RE: which Eclipse plugin to use for Maven?

2011-08-29 Thread Jim Falgout
Ahh, thanks. I was thinking back to pre-merge when you had to run "ant eclipsefiles" since the source directories were spread everywhere. -Original Message- From: Robert Evans [mailto:ev...@yahoo-inc.com] Sent: Monday, August 29, 2011 12:38 PM To: mapreduce-dev@hadoop.apache.org Subject:

Re: Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Mahadev Konar
Bobby, You are right. The test-patch uses mvn compile. Please file a jira. It should be a minor change: thanks mahadev On Mon, Aug 29, 2011 at 10:34 AM, Robert Evans wrote: > Thanks Alejandro, > > That really clears things up. Is the a JIRA you know of to change test-patch > to do mvn test -Ds

Re: which Eclipse plugin to use for Maven?

2011-08-29 Thread Robert Evans
Jim, The m2 plugin replaces the normal eclipse build system with maven. If you want to use M2 then you don't need to run mvn eclipse:eclipse at all. What mvn eclipse:eclipse does is it generates source code, and produces a .project and .classpath so that eclipse can use it's normal build syst

Re: Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Robert Evans
Thanks Alejandro, That really clears things up. Is the a JIRA you know of to change test-patch to do mvn test -DskipTests instead of mvn compile? If not I can file one and do the work. Test-patch failed for me because of this. --Bobby On 8/29/11 12:21 PM, "Alejandro Abdelnur" wrote: The re

Re: Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Alejandro Abdelnur
The reason for this failure is because of how Maven reactor/dependency resolution works (IMO a bug). Maven reactor/dependency resolution is smart enough to create the classpath using the classes from all modules being built. However, this smartness falls short just a bit. The dependencies are res

[jira] [Created] (MAPREDUCE-2905) Allow mapred.fairscheduler.assignmultple to be set per job

2011-08-29 Thread Jeff Bean (JIRA)
Allow mapred.fairscheduler.assignmultple to be set per job -- Key: MAPREDUCE-2905 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2905 Project: Hadoop Map/Reduce Issue Type: Improv

Re: Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Ravi Prakash
Yeah I've seen this before. Sometimes I had to descend into child directories to mvn install them, before I could maven install parents. I'm hoping/guessing that issue is fixed now On Mon, Aug 29, 2011 at 11:39 AM, Robert Evans wrote: > Wow this is odd install works just fine, but compile fails

which Eclipse plugin to use for Maven?

2011-08-29 Thread Jim Falgout
Using the latest trunk code, used the "mvn eclipse:eclipse" target to build the Eclipse project files. I've got the M2E plugin for Maven installed. After some trouble with lifecycle errors ("Plugin execution not covered by lifecycle configuration" error messages) I noticed this comment in the .p

Re: Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Robert Evans
Wow this is odd install works just fine, but compile fails unless I do an install first (I found this trying to run test-patch). $mvn --version Apache Maven 3.0.3 (r1075438; 2011-02-28 11:31:09-0600) Maven home: /home/evans/bin/maven Java version: 1.6.0_22, vendor: Sun Microsystems Inc. Java home

Trunk and 0.23 build failing with clean .m2 directory

2011-08-29 Thread Robert Evans
I am getting the following errors when I try to build either trunk or 0.23 with a clean maven cache. I don't get any errors if I use my old cache. [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ hadoop-yarn-common --- [INFO] Compiling 2 source files to /home/evans/src/hadoop-gi

Hadoop-Mapreduce-trunk - Build # 800 - Still Failing

2011-08-29 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/800/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 18277 lines...] [junit] Running org.apache.hadoo

[jira] [Created] (MAPREDUCE-2904) HDFS jars added incorrectly to yarn classpath

2011-08-29 Thread Sharad Agarwal (JIRA)
HDFS jars added incorrectly to yarn classpath - Key: MAPREDUCE-2904 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2904 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Sharad

[jira] [Created] (MAPREDUCE-2903) Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps

2011-08-29 Thread Devaraj K (JIRA)
Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps Key: MAPREDUCE-2903 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2903 Project: Hadoop Map

Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-08-29 Thread Amareshwari Sri Ramadasu
Some questions on making hadoop-tools top level under trunk, 1. Should the patches for tools be created against Hadoop Common? 2. What will happen to the tools test automation? Will it run as part of Hadoop Common tests? 3. Will it introduce a dependency from MapReduce to Common? Or is this

Re: Building MR2

2011-08-29 Thread Arun C Murthy
Thanks Vinod! On Aug 29, 2011, at 12:30 AM, Vinod Kumar Vavilapalli wrote: > Updated http://wiki.apache.org/hadoop/DevelopingOnTrunkAfter279Merge > and filed MAPREDUCE-2901. > > +Vinod > > On Fri, Aug 19, 2011 at 12:22 AM, Alejandro Abdelnur wrote: > >> protoc is invoked from an antrun plugin

[jira] [Created] (MAPREDUCE-2902) Merge DevelopingOnTrunkAfter279Merge wiki page into HowToContribute

2011-08-29 Thread Vinod Kumar Vavilapalli (JIRA)
Merge DevelopingOnTrunkAfter279Merge wiki page into HowToContribute --- Key: MAPREDUCE-2902 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2902 Project: Hadoop Map/Reduce

Re: Building MR2

2011-08-29 Thread Vinod Kumar Vavilapalli
Updated http://wiki.apache.org/hadoop/DevelopingOnTrunkAfter279Merge and filed MAPREDUCE-2901. +Vinod On Fri, Aug 19, 2011 at 12:22 AM, Alejandro Abdelnur wrote: > protoc is invoked from an antrun plugin configuration. > > we could check using ant tasks that protoc is avail, and fail with a > me

[jira] [Created] (MAPREDUCE-2901) Build should fail sanely if protoc isn't on PATH

2011-08-29 Thread Vinod Kumar Vavilapalli (JIRA)
Build should fail sanely if protoc isn't on PATH Key: MAPREDUCE-2901 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2901 Project: Hadoop Map/Reduce Issue Type: Bug Components: