execution is turned
> on.
>
> -- Ken
>
>
> > From: Dmitriy Lyubimov
> > Sent: October 9, 2014 11:31:42am PDT
> > To: user@mahout.apache.org
> > Subject: Re: SSVD: lease conflict due to 2 attempts using the same dir
> >
> > wow. good to know. however, it wo
true,
conf);
closeables.addFirst(qhatInput);
It wouldn't surprise me if this fails when speculative execution is turned on.
-- Ken
> From: Dmitriy Lyubimov
> Sent: October 9, 2014 11:31:42am PDT
> To: user@mahout.apache.org
> Subject: Re: SSVD:
wow. good to know. however, it would seem to me like a bug in
MultipleOutputs? either way, it doesn't seem anything to do with the Mahout
code itself.
On Thu, Oct 9, 2014 at 10:32 AM, Yang wrote:
> yes, that's what I'm saying, I disabled speculative, it works for now (kind
> of is a hack)
>
>
>
yes, that's what I'm saying, I disabled speculative, it works for now (kind
of is a hack)
also yes, this is hadoop 2.0 with YARN
this has nothing to do with overwrite mode. the 2 attempts are run
simultaneously because they are speculative runs
On Wed, Oct 8, 2014 at 12:07 AM, Serega Sheypak
w
owned by DFSClient_attempt_1412632629877_7081_*m_00_1_**196610264_1
*but is
accessed by DFSClient_attempt_1412632629877_7081_*m_00_0_**1051299648_1*
at
Looks like two clients try to write to the same dir and they are trying to
write to the same file.
2014-10-08 6:24 GMT+04:00 Dmitriy
Usually map reduce output format would issue a much clearer message.this on
the other hand looks like a name node operation conflict.
Sent from my phone.
On Oct 7, 2014 3:23 PM, "Suneel Marthi" wrote:
> Have u tried running with -ow (overwrite) option, that should clear all
> tmpdir between succ
Have u tried running with -ow (overwrite) option, that should clear all
tmpdir between successive runs ??
The SSVD code does clear the tmpdir when -ow is specified.
On Tue, Oct 7, 2014 at 5:55 PM, Yang wrote:
> we are running mahout ssvd, with a --tempDir parameter,
> but we are constantly gett
Looks like pecularities of a newer hadoop stack.. never saw this before.
On Oct 7, 2014 2:55 PM, "Yang" wrote:
> we are running mahout ssvd, with a --tempDir parameter,
> but we are constantly getting this error below.
>
> the following seems to suggest that the 2 attempts in mapper are trying t
we are running mahout ssvd, with a --tempDir parameter,
but we are constantly getting this error below.
the following seems to suggest that the 2 attempts in mapper are trying to
access the same tmp dir on hdfs.
if this is the cause, then ssvd has a bug in that different attempts should
use diffe
