Re: Scan vs Parallel scan.

2014-09-11 Thread Guillermo Ortiz
I'm working with HBase 0.94 for this case,, I'll try with 0.98, although there is not difference. I disabled the table and disabled the blockcache for that family and I put scan.setBlockcache(false) as well for both cases. I think that it's not possible that I executing an complete scan for each

Re: need help understand log output

2014-09-11 Thread Brian Jeltema
the RS log is huge. What do you want to see other than what was posted earlier? On Sep 11, 2014, at 6:10 AM, Qiang Tian tian...@gmail.com wrote: that is strange. we hit it in 0.94 as well: https://issues.apache.org/jira/browse/HBASE-11695 what Nicolas raised makes sense to me, but

Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Hi All, I have an hbase table with multiple cfs (say c1,c2,c3).Each of this column family has a column 'message' which is about 5K.What I need to do is to grab only the first 1000 Characters of this message when I do a get on the table using row Key.I was thinking of using filters to do this

Re: Custom Filter on hbase Column

2014-09-11 Thread Dima Spivak
Hi Nishanth, Take a look at http://hbase.apache.org/book/client.filter.html . If I understand your use case correctly, you might want to look at RegexStringComparator to match the first 1000 characters of your column qualifier. -Dima On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S

Re: Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Thanks Dima and Ted.Yes I need to return the first the 1000 characters.There is no matching involved. -Nishan On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu yuzhih...@gmail.com wrote: In Nishanth's case, the 5K message is stored in one KeyValue, right ? If only the first 1000 Characters of this

Re: Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Hey All, I am sorry if this is a naive question.Do we need to generate a proto file using proto buffer compiler when implementing a filter.I did not see that any where in the documentation.Can some one help please? On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S nishanth.2...@gmail.com wrote:

Re: Custom Filter on hbase Column

2014-09-11 Thread Ted Yu
See http://search-hadoop.com/m/DHED4xWh622 On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S nishanth.2...@gmail.com wrote: Hey All, I am sorry if this is a naive question.Do we need to generate a proto file using proto buffer compiler when implementing a filter.I did not see that any where in

Re: Custom Filter on hbase Column

2014-09-11 Thread Sean Busbey
I filed HBASE-11950 to get some details added to the book on this topic[1]. Nishanth, could you follow that ticket and give feedback on whatever update ends up proposed? [1]: https://issues.apache.org/jira/browse/HBASE-11950 On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu yuzhih...@gmail.com wrote:

Re: Custom Filter on hbase Column

2014-09-11 Thread Nishanth S
Sure Sean.This is much needed. -Nishan On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey bus...@cloudera.com wrote: I filed HBASE-11950 to get some details added to the book on this topic[1]. Nishanth, could you follow that ticket and give feedback on whatever update ends up proposed? [1]:

Re: need help understand log output

2014-09-11 Thread Qiang Tian
Thanks Brian, is there any clue in logs spanning 2014-09-08 06:25 +/- 30 minutes? 在 2014-9-11，19:08，Brian Jeltema brian.jelt...@digitalenvoy.net 写道： the RS log is huge. What do you want to see other than what was posted earlier? On Sep 11, 2014, at 6:10 AM, Qiang Tian tian...@gmail.com wrote:

Re: Custom Filter on hbase Column

2014-09-11 Thread Anoop John
And u have to implement transformCell(*final* Cell v) in your custom Filter. JFYI -Anoop- On Fri, Sep 12, 2014 at 4:36 AM, Nishanth S nishanth.2...@gmail.com wrote: Sure Sean.This is much needed. -Nishan On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey bus...@cloudera.com wrote: I filed