Re: Region server slowdown

2014-03-17 Thread Salabhanjika S
My bad. > - I strongly feel this issue has something to do with HBase version. I > verified the code paths of the stack I posted. Read this as "I DON'T feel this issue has something to do with HBase version." On Tue, Mar 18, 2014 at 10:12 AM, Salabhanjika S wrote: > Thanks Rodinov & Enis for res

[jira] [Created] (HBASE-10781) Remove hadoop-one-compat module and all references to hadoop1

2014-03-17 Thread stack (JIRA)
stack created HBASE-10781: - Summary: Remove hadoop-one-compat module and all references to hadoop1 Key: HBASE-10781 URL: https://issues.apache.org/jira/browse/HBASE-10781 Project: HBase Issue Type:

[jira] [Created] (HBASE-10780) HFilePrettyPrinter#processFile should return immediately if file does not exists.

2014-03-17 Thread Ashish Singhi (JIRA)
Ashish Singhi created HBASE-10780: - Summary: HFilePrettyPrinter#processFile should return immediately if file does not exists. Key: HBASE-10780 URL: https://issues.apache.org/jira/browse/HBASE-10780 P

[jira] [Created] (HBASE-10779) Doc hadoop1 deprecated in 0.98 and NOT supported in hbase 1.0

2014-03-17 Thread stack (JIRA)
stack created HBASE-10779: - Summary: Doc hadoop1 deprecated in 0.98 and NOT supported in hbase 1.0 Key: HBASE-10779 URL: https://issues.apache.org/jira/browse/HBASE-10779 Project: HBase Issue Type:

Re: Region server slowdown

2014-03-17 Thread Salabhanjika S
Thanks Rodinov & Enis for responding. I agree with you that we need to upgrade. As I mentioned in my first mail, we are in process of upgrade. >> >>> We are using hbase version 0.90.6 (please don't complain of old >> >>> version. we are in process of upgrading) - Suboptimal (as per me) code snipp

Introducing libhbase (C APIs for Apache HBase)

2014-03-17 Thread Aditya
Hi, Pursuant to the JIRAs HBASE-10168, HBASE-9977 and HBASE-9835I am happy to announce that the first draft of a JNI based implementation of C API

[jira] [Resolved] (HBASE-10735) [WINDOWS] Set -XX:MaxPermSize for unit tests

2014-03-17 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-10735. --- Resolution: Fixed > [WINDOWS] Set -XX:MaxPermSize for unit tests > -

[jira] [Resolved] (HBASE-10778) Unique keys accounting in MultiThreadedReader is incorrect

2014-03-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-10778. Resolution: Fixed > Unique keys accounting in MultiThreadedReader is incorrect > -

[VOTE] The 1st HBase 0.98.1 release candidate (RC0) is available

2014-03-17 Thread Andrew Purtell
Adding VOTE tag to subject and a clarification (pardon the typo): This vote will run for 14 days given that a few RCs have stacked up this month. Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00 -0800 GMT) on March 31 on whether or not we should release this as 0.98.1.

Re: The 1st HBase 0.98.1 release candidate (RC0) is available

2014-03-17 Thread Ted Yu
Will give RC a spin. bq. on February 31 possibly a typo: February -> March. Cheers On Mon, Mar 17, 2014 at 4:42 PM, Andrew Purtell wrote: > The 1st HBase 0.98.1 release candidate (RC0) is available for download at > http://people.apache.org/~apurtell/0.98.1RC0/ and Maven artifacts are also >

The 1st HBase 0.98.1 release candidate (RC0) is available

2014-03-17 Thread Andrew Purtell
The 1st HBase 0.98.1 release candidate (RC0) is available for download at http://people.apache.org/~apurtell/0.98.1RC0/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1007. Signed with my code signing key D5365CC

RE: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Vladimir Rodionov
Sure. Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Ted Yu [yuzhih...@gmail.com] Sent: Monday, March 17, 2014 1:34 PM To: dev@hbase.apache.org Subject: Re: 答复: setMaxResultSi

[jira] [Created] (HBASE-10778) Unique keys accounting in MultiThreadedReader is incorrect

2014-03-17 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10778: -- Summary: Unique keys accounting in MultiThreadedReader is incorrect Key: HBASE-10778 URL: https://issues.apache.org/jira/browse/HBASE-10778 Project: HBase Issue Type: Su

[jira] [Created] (HBASE-10777) Restart Embedded Thrift Server in case of failures

2014-03-17 Thread Rishit Shroff (JIRA)
Rishit Shroff created HBASE-10777: - Summary: Restart Embedded Thrift Server in case of failures Key: HBASE-10777 URL: https://issues.apache.org/jira/browse/HBASE-10777 Project: HBase Issue Ty

[jira] [Created] (HBASE-10776) Separate HConnectionManager into several parts

2014-03-17 Thread Yi Deng (JIRA)
Yi Deng created HBASE-10776: --- Summary: Separate HConnectionManager into several parts Key: HBASE-10776 URL: https://issues.apache.org/jira/browse/HBASE-10776 Project: HBase Issue Type: Bug

Re: Region server slowdown

2014-03-17 Thread Enis Söztutar
Hi Agreed with Vladimir. I doubt anybody will spend the time to debug the issue. It would be easier if you can upgrade your HBase cluster. Also you will have to upgrade your Hadoop cluster as well. You should go with 0.96.x/0.98.x and either Hadoop-2.2 or Hadoop2.3. Check out the Hbase book for th

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Ted Yu
bq. Scan.setRowCaching() I think you meant Scan.setCaching() On Mon, Mar 17, 2014 at 1:28 PM, Vladimir Rodionov wrote: > > HBase RegionServer does scanning in batches, client requests next batch > from server > and server reads and merge the data from cache/disk. You can control batch > data si

RE: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Vladimir Rodionov
HBase RegionServer does scanning in batches, client requests next batch from server and server reads and merge the data from cache/disk. You can control batch data size by setting both: Scan.setRowCaching(number of rows to send in one RPC request) Technically speaking, this allows you to contr

[jira] [Created] (HBASE-10775) Revisit the HBASE-4012 byte comprare optimization

2014-03-17 Thread stack (JIRA)
stack created HBASE-10775: - Summary: Revisit the HBASE-4012 byte comprare optimization Key: HBASE-10775 URL: https://issues.apache.org/jira/browse/HBASE-10775 Project: HBase Issue Type: Task

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Weiping Qu
Hi James, Thank you for reminding me of that. Cheers, Weiping > Hi Weiping, > Take a look at Apache Phoenix (http://phoenix.incubator.apache.org/). It's > a SQL layer on top of HBase and has support for LIMIT and a query planner > and optimizer. > Thanks, > James > > > On Mon, Mar 17, 2014 at 12:1

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread James Taylor
Hi Weiping, Take a look at Apache Phoenix (http://phoenix.incubator.apache.org/). It's a SQL layer on top of HBase and has support for LIMIT and a query planner and optimizer. Thanks, James On Mon, Mar 17, 2014 at 12:19 PM, Weiping Qu wrote: > I am doing a mult-thread(100) scan test over hbase.

[jira] [Resolved] (HBASE-10027) CompoundRowPrefixFilter

2014-03-17 Thread Manukranth Kolloju (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10027. Resolution: Fixed > CompoundRowPrefixFilter > --- > >

[jira] [Resolved] (HBASE-10437) Integrating CompoundRowPrefixFilter with RowPrefixBloomFilter

2014-03-17 Thread Manukranth Kolloju (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10437. Resolution: Fixed > Integrating CompoundRowPrefixFilter with RowPrefixBloomFilter

[jira] [Resolved] (HBASE-9828) Fix the reflection call in SequenceFileLogReader

2014-03-17 Thread Manukranth Kolloju (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-9828. --- Resolution: Fixed > Fix the reflection call in SequenceFileLogReader > --

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Weiping Qu
I am doing a mult-thread(100) scan test over hbase. If one request with given key-range matches a large number of correspoding rows in hbase, my request is waiting for this scan to complete. The throughput is really slow. For test purpose, I'd like to use LIMIT to reduce the time on scanning and tr

RE: Region server slowdown

2014-03-17 Thread Vladimir Rodionov
I think, 0.90.6 has reached EOL a couple years ago. The best you can do right now is start planning upgrading to the latest stable 0.94 or 0.96. Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com _

RE: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Vladimir Rodionov
Limit clause in SQL Select statement makes sense because it allows query optimizer to plan accordingly. It does not make sense in HBase as since there is no query planner and or optimization involved during scanning HBase table. You can easily mimic this functionality on a client side (I mean -

RE: setMaxResultSize method in Scan

2014-03-17 Thread Vladimir Rodionov
Its in 0.96 + You can use setBatch(limit) to limit numbers of key-values transmitted in one RPC call Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Weiping Qu [q...@informat

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Weiping Qu
Thank you for the reply. I will check that. Cheers > This method was introduced by HBASE-2214 which is in 0.96+ > > Can you upgrade to 0.96 or 0.98 ? > > Cheers > > > On Mon, Mar 17, 2014 at 4:48 AM, Weiping Qu wrote: > >> Thanks. >> >> I'd like to assume that setMaxResultSize is equivalent to th

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Ted Yu
This method was introduced by HBASE-2214 which is in 0.96+ Can you upgrade to 0.96 or 0.98 ? Cheers On Mon, Mar 17, 2014 at 4:48 AM, Weiping Qu wrote: > Thanks. > > I'd like to assume that setMaxResultSize is equivalent to the SQL Limit > clause as expected which is specified each time a SQL

Problem with TScan.StartRow

2014-03-17 Thread Umesh Chaudhary
Hi, Here I am facing a strange Problem with TScan.StartRow property with C# Thrift API My problem is when I try to give the value as: scanFilter.StartRow = Encoding.ASCII.GetBytes("25|China|South|China South Branch|Times Square|668|2013|07|21|PM"); scanFilter.EndRow = Encoding.ASCII.GetBytes("25

[jira] [Created] (HBASE-10774) Restore TestMultiTableInputFormat

2014-03-17 Thread Liu Shaohui (JIRA)
Liu Shaohui created HBASE-10774: --- Summary: Restore TestMultiTableInputFormat Key: HBASE-10774 URL: https://issues.apache.org/jira/browse/HBASE-10774 Project: HBase Issue Type: Test

[jira] [Created] (HBASE-10773) Make use of ByteRanges in HFileBlock instead of ByteBuffers

2014-03-17 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-10773: -- Summary: Make use of ByteRanges in HFileBlock instead of ByteBuffers Key: HBASE-10773 URL: https://issues.apache.org/jira/browse/HBASE-10773 Proje

[jira] [Created] (HBASE-10772) Use ByteRanges instead of ByteBuffers in BlockCache

2014-03-17 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-10772: -- Summary: Use ByteRanges instead of ByteBuffers in BlockCache Key: HBASE-10772 URL: https://issues.apache.org/jira/browse/HBASE-10772 Project: HBase

Re: 答复: setMaxResultSize method in Scan

2014-03-17 Thread Weiping Qu
Thanks. I'd like to assume that setMaxResultSize is equivalent to the SQL Limit clause as expected which is specified each time a SQL statement is executed . Now through "hbase.client.scanner.max.result.size" can the limitation of number of row returned only apply to all the scanner instances. I a

答复: setMaxResultSize method in Scan

2014-03-17 Thread 冯宏华
No such method for Scan in 0.94.x. If you want to set the max result size for a scan, you can achieve this by setting the "hbase.client.scanner.max.result.size" configuration, the default for which is Long.MAX_VALUE (no limited) 发件人: Weiping Qu [q...@info

setMaxResultSize method in Scan

2014-03-17 Thread Weiping Qu
Hello, I could not find the method setMaxResultSize(long m) (http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/Scan.html) in my Scanclass (0.94.13 version). Can anyone help me? Thanks Weiping

Re: Region server slowdown

2014-03-17 Thread Salabhanjika S
@Devs, please respond if you can provide me some hints on this problem. Did some more analysis. While going through the code in stack track I noticed something sub-optimal. This may not be a root cause of our slowdown but I felt it may be some thing worthy to optimize/fix. HBase is making a call

[jira] [Created] (HBASE-10771) Primitive type put/get APIs in ByteRange

2014-03-17 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-10771: -- Summary: Primitive type put/get APIs in ByteRange Key: HBASE-10771 URL: https://issues.apache.org/jira/browse/HBASE-10771 Project: HBase Issue Type: Imp

[jira] [Created] (HBASE-10770) Don't exit from the Canary daemon mode if no regions are present

2014-03-17 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-10770: --- Summary: Don't exit from the Canary daemon mode if no regions are present Key: HBASE-10770 URL: https://issues.apache.org/jira/browse/HBASE-10770 Project: HBase