Trying to run the PI MapReduce example using RC0 the job is failing,
looking at the NM logs I'm getting the following.
I believe it may be something in my setup as many already test MR jobs with
this RC successfully, but couldn't figure out yet. Running on OSX 10.9.1
using JDK7.
Thanks.
------
2014-02-13 13:12:06,092 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Initializing user tucu
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying
from
/tmp/hadoop-tucu/nm-local-dir/nmPrivate/container_1392325918406_0001_01_000001.tokens
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/container_1392325918406_0001_01_000001.tokens
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
=
file:/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
2014-02-13 13:12:06,957 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
DEBUG: FAILED {
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar,
1392325925016, PATTERN, (?:classes/|lib/).* }, rename destination
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/filecache/10
already exists.
2014-02-13 13:12:06,959 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar
transitioned from DOWNLOADING to FAILED
------
On Thu, Feb 13, 2014 at 1:06 PM, Sandy Ryza <sandy.r...@cloudera.com> wrote:
> +1 (non-binding)
>
> Built from source and ran jobs on a pseudo-distributed cluster with the
> Fair Scheduler
>
>
> On Wed, Feb 12, 2014 at 7:56 PM, Xuan Gong <xg...@hortonworks.com> wrote:
>
> > +1 (non-binding)
> >
> > downloaded the source tar ball, built, ran a number of MR jobs on a
> > single-node cluster and checked the job history from job history server.
> >
> >
> > On Wed, Feb 12, 2014 at 7:53 PM, Gera Shegalov <g...@shegalov.com>
> wrote:
> >
> > > +1 non-binding
> > >
> > > - checked out the rc tag and built from source
> > > - deployed a pseudo-distributed cluster with
> > > yarn.resourcemanager.recovery.enabled=true
> > > - ran a sleep job with multiple map waves and a long reducer
> > > -- SIGKILL'd AM at various points and verified AM restart
> > > -- SIGKILL'd RM at various points and verified RM restart
> > > - checked some ui issues we had fixed.
> > > - verified the new restful plain text container log NM-WS
> > >
> > > Thanks,
> > >
> > > Gera
> > >
> > >
> > > On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy <a...@hortonworks.com>
> > > wrote:
> > >
> > > > Folks,
> > > >
> > > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would
> > like
> > > > to get released.
> > > >
> > > > The RC is available at:
> > > > http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0
> > > > The RC tag in svn is here:
> > > >
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0
> > > >
> > > > The maven artifacts are available via repository.apache.org.
> > > >
> > > > Please try the release and vote; the vote will run for the usual 7
> > days.
> > > >
> > > > thanks,
> > > > Arun
> > > >
> > > > PS: Thanks to Andrew, Vinod & Alejandro for all their help in various
> > > > release activities.
> > > > --
> > > > CONFIDENTIALITY NOTICE
> > > > NOTICE: This message is intended for the use of the individual or
> > entity
> > > to
> > > > which it is addressed and may contain information that is
> confidential,
> > > > privileged and exempt from disclosure under applicable law. If the
> > reader
> > > > of this message is not the intended recipient, you are hereby
> notified
> > > that
> > > > any printing, copying, dissemination, distribution, disclosure or
> > > > forwarding of this communication is strictly prohibited. If you have
> > > > received this communication in error, please contact the sender
> > > immediately
> > > > and delete it from your system. Thank You.
> > > >
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
--
Alejandro
