Re: Custom Filter on hbase Column

2014-09-15 Thread Ted Yu
Take a look at StoreScanner#next(): ScanQueryMatcher.MatchCode qcode = matcher.match(kv); switch(qcode) { case INCLUDE: case INCLUDE_AND_SEEK_NEXT_ROW: case INCLUDE_AND_SEEK_NEXT_COL: Filter f = matcher.getFilter(); if (f != null) {

Re: Custom Filter on hbase Column

2014-09-15 Thread Nishanth S
Thanks Anoop.I did that but the only method that was getting called in my filter was public byte[] toByteArray() ,even though I over ride transformcell. Thanks, Nishanth On Thu, Sep 11, 2014 at 10:51 PM, Anoop John wrote: > And u have to implement > transformCell(*final* Cell v) > in your c

Re: Custom Filter on hbase Column

2014-09-11 Thread Anoop John
And u have to implement transformCell(*final* Cell v) in your custom Filter. JFYI -Anoop- On Fri, Sep 12, 2014 at 4:36 AM, Nishanth S wrote: > Sure Sean.This is much needed. > > -Nishan > > On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey wrote: > > > I filed HBASE-11950 to get some details adde

Re: Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Sure Sean.This is much needed. -Nishan On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey wrote: > I filed HBASE-11950 to get some details added to the book on this topic[1]. > > Nishanth, could you follow that ticket and give feedback on whatever update > ends up proposed? > > [1]: https://issues.a

Re: Custom Filter on hbase Column

2014-09-11 Thread Sean Busbey
I filed HBASE-11950 to get some details added to the book on this topic[1]. Nishanth, could you follow that ticket and give feedback on whatever update ends up proposed? [1]: https://issues.apache.org/jira/browse/HBASE-11950 On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu wrote: > See http://search-ha

Re: Custom Filter on hbase Column

2014-09-11 Thread Ted Yu
See http://search-hadoop.com/m/DHED4xWh622 On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S wrote: > Hey All, > > I am sorry if this is a naive question.Do we need to generate a proto file > using proto buffer compiler when implementing a filter.I did not see that > any where in the documentation.Can

Re: Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Hey All, I am sorry if this is a naive question.Do we need to generate a proto file using proto buffer compiler when implementing a filter.I did not see that any where in the documentation.Can some one help please? On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S wrote: > Thanks Dima and Ted.Yes I

Re: Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Thanks Dima and Ted.Yes I need to return the first the 1000 characters.There is no matching involved. -Nishan On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu wrote: > In Nishanth's case, the 5K message is stored in one KeyValue, right ? > > If only the first 1000 Characters of this message are to be

Re: Custom Filter on hbase Column

2014-09-11 Thread Ted Yu
In Nishanth's case, the 5K message is stored in one KeyValue, right ? If only the first 1000 Characters of this message are to be returned, a new KeyValue needs to be composed and returned. Cheers On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak wrote: > Hi Nishanth, > > Take a look at http://hba

Re: Custom Filter on hbase Column

2014-09-11 Thread Dima Spivak
Hi Nishanth, Take a look at http://hbase.apache.org/book/client.filter.html . If I understand your use case correctly, you might want to look at RegexStringComparator to match the first 1000 characters of your column qualifier. -Dima On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S wrote: > Hi All

Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Hi All, I have an hbase table with multiple cfs (say c1,c2,c3).Each of this column family has a column 'message' which is about 5K.What I need to do is to grab only the first 1000 Characters of this message when I do a get on the table using row Key.I was thinking of using filters to do this on