Removing the file programatically is doing the trick for me. thank you all
for your answers and help :-)
On Tue, Mar 31, 2009 at 12:25 AM, some speed wrote:
> Hello everyone,
>
> Is it necessary to redirect the ouput of reduce to a file? When I am trying
> to run the same M-R job mo
Hello everyone,
Is it necessary to redirect the ouput of reduce to a file? When I am trying
to run the same M-R job more than once, it throws an error that the output
file already exists. I dont want to use command line args so I hard coded
the file name into the program.
So, Is there a way , I c
f B*F(t-1) is inherently sequential.
> So all we can do is parallelize the a*w(t)*w(t) part.
>
> -Sagar
>
>
> some speed wrote:
>
>> Hello all,
>>
>> I am trying to implement a Map Reduce Chain to solve a particular
>> statistic
>> problem. I
Hello all,
I am trying to implement a Map Reduce Chain to solve a particular statistic
problem. I have come to a point where I have to solve the following type of
equation in Hadoop:
F(t)= A*w(t)*w(t) + B*F(t-1); Given: F(0)=0, A and B are Alpha and Beta
and their values are known.
Now, W is
On Thu, Feb 5, 2009 at 2:22 PM, Rasit OZDAS wrote:
> > Sharath,
> >
> > You're using reporter.incrCounter(enumVal, intVal); to increment
> counter,
> > I think method to get should also be similar.
> >
> > Try to use findCounter(enumVal).getCounter() or getCounter
In fact I put the enum in my Reduce method as the following link (from
Yahoo) says so:
http://public.yahoo.com/gogate/hadoop-tutorial/html/module5.html#metrics
--->Look at the section under Reporting Custom Metrics.
2009/2/5 some speed
> Thanks Rasit.
>
> I did as you said.
&g
d be out of Reduce class.
> > Hadoop probably tries to find it elsewhere with "MyCounter", but it's
> > actually "Reduce.MyCounter" in your example.
> >
> > Hope this helps,
> > Rasit
> >
> > 2009/2/5 some speed :
> >> I
.Task$Counter", 0,
"*MyCounter*").getCounter();
//even tried MyCounter.Key1
Does anyone know whay that is happening?
Thanks,
Sharath
On Thu, Feb 5, 2009 at 5:59 AM, some speed wrote:
> Hi Tom,
>
> I get the error :
>
> Cannot find Symbol* "**MyCounter.ct_ke
?
>
> Tom
>
> On Thu, Feb 5, 2009 at 10:09 AM, some speed wrote:
> > Hi,
> >
> > Can someone help me with the usage of counters please? I am incrementing
> a
> > counter in Reduce method but I am unable to collect the counter value
> after
> > the job
Hi,
Can someone help me with the usage of counters please? I am incrementing a
counter in Reduce method but I am unable to collect the counter value after
the job is completed.
Its something like this:
public static class Reduce extends MapReduceBase implements Reducer
{
static enum
Hi,
I am implementing a chain M-R job in java. If I am using multiple reducers,
then the output seems to be dispersed among several files on the dfs.
How can I now read these files into the Map method of the next job?
Another doubt I have is ...Is it possible to keep appending to the same
outpu
Hi all,
Is it possible to pass an integer value from one M-R job to another? My 2nd
MR job reads the output of the 1st job but also i would like it to read
another integer value too.
I tried doing so with configure(JobConf conf) method. But how/where in the
reduce method should I use the conf.set
oceed.
Thanks.
On Sun, Nov 16, 2008 at 1:49 AM, some speed <[EMAIL PROTECTED]> wrote:
> Thank you all!!
> What Milind has said will do the trick for me as a I need accurate values
> for the deviation.
> Passing variables between jobs by means of the Configure method and
> getInt
;wrote:
> Since you need to pass only one number (average) to all mappers, you can
> pass it through jobconf with a config variable defined by you, say
> "my.average"..
>
> - milind
>
>
> On 11/11/08 8:25 PM, "some speed" <[EMAIL PROTECTED]> wrote:
n Mon, Nov 10, 2008 at 4:22 AM, Amar Kamat <[EMAIL PROTECTED]> wrote:
> Amar Kamat wrote:
>
>> some speed wrote:
>>
>>> I was wondering if it was possible to read the input for a map function
>>> from
>>> 2 different files:
>>> 1st fi
I was wondering if it was possible to read the input for a map function from
2 different files:
1st file ---> user-input file from a particular location(path)
2nd file=---> A resultant file (has just one pair) from a
previous MapReduce job. (I am implementing a chain MapReduce function)
Now, for
16 matches
Mail list logo
