-Marc Spaggiari [jean-m...@spaggiari.org]
Sent: Thursday, December 20, 2012 6:09 AM
To: user@hbase.apache.org
Subject: Re: MR missing lines
Hi Anoop,
Thanks for the hint! Even if it's not fixing my issue, at least my
tests are going to be faster.
I will take a look at the documentation to under
___
> From: Jean-Marc Spaggiari [jean-m...@spaggiari.org]
> Sent: Tuesday, December 18, 2012 7:07 PM
> To: user@hbase.apache.org
> Subject: Re: MR missing lines
>
> I faced the issue again today...
>
> RowCounter gave me 104313 lines
> Here is t
__
From: Jean-Marc Spaggiari [jean-m...@spaggiari.org]
Sent: Tuesday, December 18, 2012 7:07 PM
To: user@hbase.apache.org
Subject: Re: MR missing lines
I faced the issue again today...
RowCounter gave me 104313 lines
Here is the output of the job counters:
12/12/17 22:32:52 INFO mapred.JobClient
I faced the issue again today...
RowCounter gave me 104313 lines
Here is the output of the job counters:
12/12/17 22:32:52 INFO mapred.JobClient: ENTRY_ADDED=81594
12/12/17 22:32:52 INFO mapred.JobClient: ENTRY_SIMILAR=434
12/12/17 22:32:52 INFO mapred.JobClient: ENTRY_NO_CHANGES=14250
The job run the morning, and of course, this time, all the rows got processed ;)
So I will give it few other tries and will keep you posted if I'm able
to reproduce that again.
Thanks,
JM
2012/12/16, Jean-Marc Spaggiari :
> Thanks for the suggestions.
>
> I already have logs to display all the
Thanks for the suggestions.
I already have logs to display all the exepctions and there is
nothing. I can't display the work done, there is to much :(
I have counters "counting" the rows processed and they match what is
done, minus what is not processed. I have just added few other
counters. One
Did you check the returned array of the delete method to make sure all
records sent for delete have been deleted?
Sent from my iPhone
On 16 בדצמ 2012, at 14:52, Jean-Marc Spaggiari wrote:
> Hi,
>
> I have a table where I'm running MR each time is exceding 100 000 rows.
>
> When the target is re
You can use MR counters to count your overall Deletes, to see if they
match your table count. Also, does your job input record count match
the expected count of the table you intended to clear?
On Sun, Dec 16, 2012 at 6:22 PM, Jean-Marc Spaggiari
wrote:
> Hi,
>
> I have a table where I'm running
Probably best to create some client side logging in the MR job to track
this down.
On Dec 16, 2012 7:52 AM, "Jean-Marc Spaggiari"
wrote:
> Hi,
>
> I have a table where I'm running MR each time is exceding 100 000 rows.
>
> When the target is reached, all the feeding process are stopped.
>
> Yeste
Hi,
I have a table where I'm running MR each time is exceding 100 000 rows.
When the target is reached, all the feeding process are stopped.
Yesterday it reached 123608 rows. So I stopped the feeding process,
and ran the MR.
For each line, the MR is creating a delete. The delete is placed on a
10 matches
Mail list logo