Re: Problem with MRv2 Build

It turns out "ant veryclean jar -Dresolvers=internal" can compile well. The error came from jar-test. Best, Haoyuan On Tue, Aug 9, 2011 at 11:12 PM, Haoyuan Li wrote: > Thank you Praveen and Arun. > > Both approaches work! > > However, I still got problem in the last step... ant veryclean jar

Re: Adaptive resource assignment is possible in MRv2?

Thank you for helpful reply :) Cheers, -- Hyunsik Choi On Wed, Aug 10, 2011 at 2:23 PM, Arun C Murthy wrote: > > On Aug 9, 2011, at 9:28 PM, Hyunsik Choi wrote: > > > Hi guys, > > > > MRv2 looks very promising for various applications. We have considered > > an application based on Yarn, but t

Re: Problem with MRv2 Build

Thank you Praveen and Arun. Both approaches work! However, I still got problem in the last step... ant veryclean jar jar-test -Dresolvers=internal Any thoughts? Thanks, Haoyuan ivy-resolve-test: [ivy:resolve] downloading /home/haoyuan/.m2/repository/org/apache/hadoop/yarn-common/1.0-SNAPSHOT

Re: Problem with MRv2 Build

Haoyuan, I am using Ubuntu 11.04, which doesn't come with autoconf/autoreconf. So, I had to install autoconf (installed autoconf and autoreconf) to get rid of the above error. Thanks, Praveen On Wed, Aug 10, 2011 at 10:58 AM, Arun C Murthy wrote: > Looks like you don't have autotool chain requ

Re: Problem with MRv2 Build

Looks like you don't have autotool chain required to build the native code for launching containers. It isn't critical - you can run with the java based DefaultContainerExecutor. Just pass -P-cbuild to maven to skip building the native code. Arun On Aug 9, 2011, at 10:24 PM, Haoyuan Li wrote:

Re: MRv2 Configuration in Eclipse

Praveen, I'm not aware of any devs using eclipse to run MRv2, I haven't tried it myself. OTOH, if you do get to we are happy to follow your lead, please feel free to provide us instructions and we can update the README... thanks. Arun On Aug 9, 2011, at 7:39 PM, Praveen Sripati wrote: > Hi,

Re: Problem with MRv2 Build

Hi Praveen, Thank you for the info. It did help. Everything before "mvn clean install assembly:assembly -DskipTests" worked well, and I got the following errors. Do you have any clue? Best, Haoyuan main: [echo] project.build.directory: /home/haoyuan/hadoop/trunk/mapreduce/yarn/yarn-server/

Re: Adaptive resource assignment is possible in MRv2?

On Aug 9, 2011, at 9:28 PM, Hyunsik Choi wrote: > Hi guys, > > MRv2 looks very promising for various applications. We have considered > an application based on Yarn, but this app is required the adaptive > resource assignment. In other words, this app may need additional > resources while this a

Re: Adaptive resource assignment is possible in MRv2?

I'm sorry for my poor English. I correct some English errors, and I post as follows: MRv2 looks very promising for various applications. We have considered an application based on Yarn, but this app requires the adaptive resource assignment. In other words, this app may need additional resour

Adaptive resource assignment is possible in MRv2?

Hi guys, MRv2 looks very promising for various applications. We have considered an application based on Yarn, but this app is required the adaptive resource assignment. In other words, this app may need additional resources while this app is running. Is it possible? After I look at some code, esp

Re: Problem with MRv2 Build

Haoyuan, The instructions at the mentioned URL are not updated. 1. Get the code from trunk. 2. Remove the mapreduce folder. 3. Get the mapreduce code from MR-279 branch. 4. Run the build scripts. echo "Common build ." mvn clean install package -Pbintar -DskipTests echo "HDFS build ." cd

Re: Problem with MRv2 Build

Hi Tom, I also have trouble in building the current MR-279. How to compile common by using mvn? And do you mean that http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL doesn't work anymore? Thank you. Best, Haoyuan On Thu, Aug 4, 2011 at 8:19 AM, Thomas Graves w

MRv2 Configuration in Eclipse

Hi, Are there any instructions to start the ResourceManager, NodeManager, HistoryServer from Eclipse? I got the code from SVN, compiled it and ran the sample program. The projects have also been exported in Eclipse. I want to run the RM, NM and HS from Eclipse, so as to see the flow and fix any pr

Hadoop-Mapreduce-22-branch - Build # 62 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/62/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2281 lines...] A src/examples/org/apache/h

Hadoop-Mapreduce-trunk - Build # 751 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/751/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2396 lines...] A build-utils.xml A bu

Hadoop-Mapreduce-trunk-Commit - Build # 760 - Failure

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/760/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2421 lines...] A test-patch/test-patch

[jira] [Created] (MAPREDUCE-2796) [MR-279] Start time for all the apps is set to 0

[MR-279] Start time for all the apps is set to 0 Key: MAPREDUCE-2796 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2796 Project: Hadoop Map/Reduce Issue Type: Bug Components:

[jira] [Created] (MAPREDUCE-2795) [MR-279] AppsKilled is never incremented

[MR-279] AppsKilled is never incremented Key: MAPREDUCE-2795 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2795 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects

[jira] [Created] (MAPREDUCE-2794) [MR-279] Incorrect metrics value for AvailableGB per queue per user

[MR-279] Incorrect metrics value for AvailableGB per queue per user --- Key: MAPREDUCE-2794 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2794 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

[MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs -- Key: MAPREDUCE-2793 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2792) [MR-279] Replace IP addresses with hostnames

[MR-279] Replace IP addresses with hostnames Key: MAPREDUCE-2792 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2792 Project: Hadoop Map/Reduce Issue Type: Improvement Components:

[jira] [Created] (MAPREDUCE-2791) [MR-279] Missing/incorrect info on job -status CLI

[MR-279] Missing/incorrect info on job -status CLI --- Key: MAPREDUCE-2791 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2791 Project: Hadoop Map/Reduce Issue Type: Bug Compon

[jira] [Created] (MAPREDUCE-2790) [MR-279] Add additional field for storing the AM/job history info on CLI

[MR-279] Add additional field for storing the AM/job history info on CLI Key: MAPREDUCE-2790 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2790 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2789) [MR:279] Update the scheduling info on CLI

[MR:279] Update the scheduling info on CLI -- Key: MAPREDUCE-2789 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2789 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Aff

Re: Not able to execute MRv2

Hi Praveen, This is an issue because of incompatible versions of avro. This occurs if you have avro 1.3.2 in your cp. We use avro 1.4. For the time being you can remove any occurence of avro 1.3.2. jar in your classpath and that should get you out of the error below. For fixing it in the righ

Re: Not able to execute MRv2

Hi, For some reason none of the .log files are getting generated, so I had to put some println and figure out the problems. I just see the .out files for the RM, NM and the HistoryServer. 1) I get the below error while starting the ResourceManager. In the hadoop-mapreduce-1.0-SNAPSHOT/lib folder