RE: Where is code in hbase that physically delete a record?

2012-10-17 Thread Anoop Sam John
You can see the code in ScanQueryMatcher Basically in major compact a scan will be happening scanning all the files... As per the delete markers, the deleted KVs wont come out of the scanner and thus gets eliminated. Also in case of major compact the delete markers itself will get deleted ( Sti

RE: Where is code in hbase that physically delete a record?

2012-10-17 Thread Ramkrishna.S.Vasudevan
Hi Yun Logically deleting a KeyValue data in hbase is performed > by > marking tombmarker (by Delete() per records) or setting TTL/max_version > (per Store). After these actions, however, the physical data are still > there, somewhere in the system. Physically deleting a record in hbase > is > real

RE: Where is code in hbase that physically delete a record?

2012-10-17 Thread Ramkrishna.S.Vasudevan
Also to see the code how the delete happens pls refer to StoreScanner.java and how the ScanQueryMatcher.match() works. That is where we decide if any kv has to be avoided due to already deleted tombstone marker. Forgot to tell you about this. Regards Ram > -Original Message- > From: y

Re: Where is code in hbase that physically delete a record?

2012-10-17 Thread yun peng
Hi, Ram and Anoop, Thanks for the nice reference on the java file, which I will check through. It is interesting to know about the recent feature on preCompactScannerOpen() hook. Ram, it would be nice if I can know how to specify conditions like c1 = 'a'. I have also checked the example code in h

RE: Where is code in hbase that physically delete a record?

2012-10-17 Thread Anoop Sam John
PM To: user@hbase.apache.org Subject: Re: Where is code in hbase that physically delete a record? Hi, Ram and Anoop, Thanks for the nice reference on the java file, which I will check through. It is interesting to know about the recent feature on preCompactScannerOpen() hook. Ram, it would be nice if I

RE: Where is code in hbase that physically delete a record?

2012-10-17 Thread Ramkrishna.S.Vasudevan
} Regards Ram > -Original Message- > From: Anoop Sam John [mailto:anoo...@huawei.com] > Sent: Thursday, October 18, 2012 9:02 AM > To: user@hbase.apache.org > Subject: RE: Where is code in hbase that physically delete a record? > > Hi Yun, > We have

Re: Where is code in hbase that physically delete a record?

2012-10-19 Thread PG
iginal Message- >> From: Anoop Sam John [mailto:anoo...@huawei.com] >> Sent: Thursday, October 18, 2012 9:02 AM >> To: user@hbase.apache.org >> Subject: RE: Where is code in hbase that physically delete a record? >> >> Hi Yun, >> We have preCompactScannerOp

Re: Where is code in hbase that physically delete a record?

2012-10-19 Thread Anoop John
delegate.next(kv); > >foreach(kv){ > >//Do necessary filtering here. > > } > > > > } > > } > > > > Regards > > Ram > > > >> -Original Message- > >> From: Anoop Sam John [mailto:anoo...@huawei.com]

Re: Where is code in hbase that physically delete a record?

2012-10-19 Thread ramkrishna vasudevan
<- > >> Do the real scan from HFiles > >> See List KVs and remove > >> those u dont want > >> <- > >> Only the passe