Another "mvn test" caused the build to fail slightly further down the road. As my Jira issue is documentation-only, I've submitted the patch anyway.
Is this multiple-failure scenario typical for trying to build hadoop from the trunk? It's sure putting me off submitting code in future. Is there any way the build process could be reconsidered such that there's only one source of instruction for how to successfully build the project? Tony -----Original Message----- From: Tony Burton [mailto:tbur...@sportingindex.com] Sent: 11 September 2012 12:15 To: user@hadoop.apache.org Subject: RE: hadoop trunk build failure - yarn, surefire related? Good suggestions Harsh and Hemanth. When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version. Tony -----Original Message----- From: Harsh J [mailto:ha...@cloudera.com] Sent: 11 September 2012 11:59 To: user@hadoop.apache.org Subject: Re: hadoop trunk build failure - yarn, surefire related? I guess we'll need to clean that guide and divide it in two - For branch-1 maintenance contributors, and for trunk contributors. I had another page that serves a slightly different purpose, but may help you just the same: http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <tbur...@sportingindex.com> wrote: > That's good to know - is there a more up to date guide than > http://wiki.apache.org/hadoop/HowToContribute which still makes many > references to ant builds? > > > > > -----Original Message----- > From: Harsh J [mailto:ha...@cloudera.com] > Sent: 11 September 2012 11:36 > To: user@hadoop.apache.org > Subject: Re: hadoop trunk build failure - yarn, surefire related? > > Ah there is no longer a need to run ant anymore on trunk. Ignore the > leftover files in the base MR project directory - those should be > cleaned up soon. All of the functional pieces of the build right now > definitely use Maven. > > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <tbur...@sportingindex.com> > wrote: >> Ok - thanks Harsh. >> >> Following Steve's earlier advice I tried the mvn install, which worked fine, >> then ant test in hadoop-mapreduce-project which failed. I was mid-email to >> mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and >> report back. >> >> Tony >> >> >> -----Original Message----- >> From: Harsh J [mailto:ha...@cloudera.com] >> Sent: 11 September 2012 11:25 >> To: user@hadoop.apache.org >> Subject: Re: hadoop trunk build failure - yarn, surefire related? >> >> Tony, >> >> What I do is: >> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test >> >> This seems to work in running without any missing dependencies at least. >> >> The user lists are all merged, but the developer lists remain separate >> as that works better. >> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <tbur...@sportingindex.com> >> wrote: >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can >>> see came from repository.apache.org though. >>> >>> >>> >>> How do I run the MR tests only? >>> >>> >>> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists >>> had merged into one though - did I get the wrong end of the stick? >>> >>> >>> >>> Tony >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> From: Steve Loughran [mailto:ste...@hortonworks.com] >>> Sent: 11 September 2012 10:45 >>> >>> >>> To: user@hadoop.apache.org >>> Subject: Re: hadoop trunk build failure - yarn, surefire related? >>> >>> >>> >>> It's probably some maven thing -in particular Maven's habit of grabbing the >>> online nightly snapshots off apache rather than local, >>> >>> >>> >>> try mvn clean install -DskipTests -offline >>> >>> to force in all the artifacts, then run the MR tests >>> >>> >>> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to >>> discuss build and test process. >>> >>> On 11 September 2012 09:58, Tony Burton <tbur...@sportingindex.com> wrote: >>> >>> Hi, >>> >>> >>> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the >>> codebase as part of following the "How To Contribute" guide at >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently >>> failing in hadoop-mapreduce-client-jobclient, the failure message is below - >>> something to do with org.hadoop.yarn.client and/or the maven surefire >>> plugin. Can anyone suggest how to proceed? Thanks! >>> >>> >>> >>> >>> >>> >>> >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Reactor Summary: >>> [INFO] [snipped SKIPPED test groups] >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s] >>> [INFO] >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] BUILD FAILURE >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Total time: 17.229s >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012 >>> [INFO] Final Memory: 21M/163M >>> [INFO] >>> ------------------------------------------------------------------------ >>> [ERROR] Failed to execute goal >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on >>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: >>> java.lang.reflect.InvocationTargetException; nested exception is >>> java.lang.reflect.InvocationTargetException: null: >>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl >>> -> [Help 1] >>> [ERROR] >>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e >>> switch. >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, please >>> read the following articles: >>> [ERROR] [Help 1] >>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException >>> >>> P Think of the environment: please don't print this email unless you really >>> need to. >>> >>> Outbound Email has been scanned for viruses and SPAM >>> >>> This email and any attachments are confidential, protected by copyright and >>> may be legally privileged. If you are not the intended recipient, then the >>> dissemination or copying of this email is prohibited. If you have received >>> this in error, please notify the sender by replying by email and then delete >>> the email completely from your system. Neither Sporting Index nor the sender >>> accepts responsibility for any virus, or any other defect which might affect >>> any computer or IT system into which the email is received and/or opened. It >>> is the responsibility of the recipient to scan the email and no >>> responsibility is accepted for any loss or damage arising in any way from >>> receipt or use of this email. Sporting Index Ltd is a company registered in >>> England and Wales with company number 2636842, whose registered office is at >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is >>> authorised and regulated by the UK Financial Services Authority (reg. no. >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >>> financial promotion contained herein has been issued and approved by >>> Sporting Index Ltd. >>> >>> >>> >>> Inbound Email has been scanned for viruses and SPAM >>> >>> P Think of the environment: please don't print this email unless you really >>> need to. >>> >>> Outbound Email has been scanned for viruses and SPAM >>> >>> This email and any attachments are confidential, protected by copyright and >>> may be legally privileged. If you are not the intended recipient, then the >>> dissemination or copying of this email is prohibited. If you have received >>> this in error, please notify the sender by replying by email and then delete >>> the email completely from your system. Neither Sporting Index nor the sender >>> accepts responsibility for any virus, or any other defect which might affect >>> any computer or IT system into which the email is received and/or opened. It >>> is the responsibility of the recipient to scan the email and no >>> responsibility is accepted for any loss or damage arising in any way from >>> receipt or use of this email. Sporting Index Ltd is a company registered in >>> England and Wales with company number 2636842, whose registered office is at >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is >>> authorised and regulated by the UK Financial Services Authority (reg. no. >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >>> financial promotion contained herein has been issued and approved by >>> Sporting Index Ltd. >> >> >> >> -- >> Harsh J >> www.sportingindex.com >> Inbound Email has been scanned for viruses and SPAM >> ********************************************************************** >> This email and any attachments are confidential, protected by copyright and >> may be legally privileged. If you are not the intended recipient, then the >> dissemination or copying of this email is prohibited. If you have received >> this in error, please notify the sender by replying by email and then delete >> the email completely from your system. Neither Sporting Index nor the >> sender accepts responsibility for any virus, or any other defect which might >> affect any computer or IT system into which the email is received and/or >> opened. It is the responsibility of the recipient to scan the email and no >> responsibility is accepted for any loss or damage arising in any way from >> receipt or use of this email. Sporting Index Ltd is a company registered in >> England and Wales with company number 2636842, whose registered office is at >> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is >> authorised and regulated by the UK Financial Services Authority (reg. no. >> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >> financial promotion contained herein has been issued >> and approved by Sporting Index Ltd. >> >> Outbound email has been scanned for viruses and SPAM > > > > -- > Harsh J > www.sportingindex.com > Inbound Email has been scanned for viruses and SPAM > ********************************************************************** > This email and any attachments are confidential, protected by copyright and > may be legally privileged. If you are not the intended recipient, then the > dissemination or copying of this email is prohibited. If you have received > this in error, please notify the sender by replying by email and then delete > the email completely from your system. Neither Sporting Index nor the sender > accepts responsibility for any virus, or any other defect which might affect > any computer or IT system into which the email is received and/or opened. It > is the responsibility of the recipient to scan the email and no > responsibility is accepted for any loss or damage arising in any way from > receipt or use of this email. Sporting Index Ltd is a company registered in > England and Wales with company number 2636842, whose registered office is at > Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is > authorised and regulated by the UK Financial Services Authority (reg. no. > 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any > financial promotion contained herein has been issued > and approved by Sporting Index Ltd. > > Outbound email has been scanned for viruses and SPAM -- Harsh J www.sportingindex.com Inbound Email has been scanned for viruses and SPAM ********************************************************************** This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd. Outbound email has been scanned for viruses and SPAM www.sportingindex.com Inbound Email has been scanned for viruses and SPAM ********************************************************************** This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd. Outbound email has been scanned for viruses and SPAM
