RE: MR missing lines

2012-12-19 Thread Anoop Sam John
-Marc Spaggiari [jean-m...@spaggiari.org] Sent: Thursday, December 20, 2012 6:09 AM To: user@hbase.apache.org Subject: Re: MR missing lines Hi Anoop, Thanks for the hint! Even if it's not fixing my issue, at least my tests are going to be faster. I will take a look at the documentation to under

Re: MR missing lines

2012-12-19 Thread Jean-Marc Spaggiari
___ > From: Jean-Marc Spaggiari [jean-m...@spaggiari.org] > Sent: Tuesday, December 18, 2012 7:07 PM > To: user@hbase.apache.org > Subject: Re: MR missing lines > > I faced the issue again today... > > RowCounter gave me 104313 lines > Here is t

RE: MR missing lines

2012-12-18 Thread Anoop Sam John
__ From: Jean-Marc Spaggiari [jean-m...@spaggiari.org] Sent: Tuesday, December 18, 2012 7:07 PM To: user@hbase.apache.org Subject: Re: MR missing lines I faced the issue again today... RowCounter gave me 104313 lines Here is the output of the job counters: 12/12/17 22:32:52 INFO mapred.JobClient

Re: MR missing lines

2012-12-18 Thread Jean-Marc Spaggiari
I faced the issue again today... RowCounter gave me 104313 lines Here is the output of the job counters: 12/12/17 22:32:52 INFO mapred.JobClient: ENTRY_ADDED=81594 12/12/17 22:32:52 INFO mapred.JobClient: ENTRY_SIMILAR=434 12/12/17 22:32:52 INFO mapred.JobClient: ENTRY_NO_CHANGES=14250

Re: MR missing lines

2012-12-17 Thread Jean-Marc Spaggiari
The job run the morning, and of course, this time, all the rows got processed ;) So I will give it few other tries and will keep you posted if I'm able to reproduce that again. Thanks, JM 2012/12/16, Jean-Marc Spaggiari : > Thanks for the suggestions. > > I already have logs to display all the

Re: MR missing lines

2012-12-16 Thread Jean-Marc Spaggiari
Thanks for the suggestions. I already have logs to display all the exepctions and there is nothing. I can't display the work done, there is to much :( I have counters "counting" the rows processed and they match what is done, minus what is not processed. I have just added few other counters. One

Re: MR missing lines

2012-12-16 Thread Asaf Mesika
Did you check the returned array of the delete method to make sure all records sent for delete have been deleted? Sent from my iPhone On 16 בדצמ 2012, at 14:52, Jean-Marc Spaggiari wrote: > Hi, > > I have a table where I'm running MR each time is exceding 100 000 rows. > > When the target is re

Re: MR missing lines

2012-12-16 Thread Harsh J
You can use MR counters to count your overall Deletes, to see if they match your table count. Also, does your job input record count match the expected count of the table you intended to clear? On Sun, Dec 16, 2012 at 6:22 PM, Jean-Marc Spaggiari wrote: > Hi, > > I have a table where I'm running

Re: MR missing lines

2012-12-16 Thread Kevin O'dell
Probably best to create some client side logging in the MR job to track this down. On Dec 16, 2012 7:52 AM, "Jean-Marc Spaggiari" wrote: > Hi, > > I have a table where I'm running MR each time is exceding 100 000 rows. > > When the target is reached, all the feeding process are stopped. > > Yeste

MR missing lines

2012-12-16 Thread Jean-Marc Spaggiari
Hi, I have a table where I'm running MR each time is exceding 100 000 rows. When the target is reached, all the feeding process are stopped. Yesterday it reached 123608 rows. So I stopped the feeding process, and ran the MR. For each line, the MR is creating a delete. The delete is placed on a