Re: How to improve HBase read performance.

2018-06-07 Thread Kang Minwoo
ive sql vs hbase scan from same > > origin data. > > (origin data -> put hbase, convert orc file -> test hive sql vs hbase > scan) > > > > > > Best regards, > > Minwoo Kang > > > > > > 보낸 사람: Stack 대신 saint@gma

Re: How to improve HBase read performance.

2018-06-07 Thread Juan Jose Escobar
ive sql vs hbase scan from same > > origin data. > > (origin data -> put hbase, convert orc file -> test hive sql vs hbase > scan) > > > > > > Best regards, > > Minwoo Kang > > > > > > 보낸 사람: Stack 대신 saint@gma

Re: How to improve HBase read performance.

2018-06-06 Thread Kang Minwoo
: Re: How to improve HBase read performance. HBASE performance highly dependant on query & row key format. Can you share few rowkeys, query format? also what is encoding you are using? On Thu, May 24, 2018 at 8:38 PM, Kang Minwoo wrote: > 5B logs a day? > => Yes, 5B/day > >

Re: How to improve HBase read performance.

2018-05-26 Thread sudhir patil
> 보낸 사람: Stack 대신 saint@gmail.com < > saint@gmail.com> > 보낸 날짜: 2018년 5월 24일 목요일 01:33 > 받는 사람: Hbase-User > 제목: Re: How to improve HBase read performance. > > On Wed, May 16, 2018 at 7:30 PM, Kang Minwoo > wrote: > >

Re: How to improve HBase read performance.

2018-05-24 Thread Kang Minwoo
gards, Minwoo Kang 보낸 사람: Stack 대신 saint@gmail.com 보낸 날짜: 2018년 5월 24일 목요일 01:33 받는 사람: Hbase-User 제목: Re: How to improve HBase read performance. On Wed, May 16, 2018 at 7:30 PM, Kang Minwoo wrote: > Here is information. > > store about 5 billion a day. >

Re: How to improve HBase read performance.

2018-05-23 Thread Stack
; 보낸 날짜: 2018년 5월 17일 목요일 00:01 > 받는 사람: user@hbase.apache.org > 제목: Re: How to improve HBase read performance. > > bq. store a lot of logs in HBase > > Kang: > Can you tell us a bit more about how you store (and access) the log(s) - > size of each log, whether log is encoded in

Re: How to improve HBase read performance.

2018-05-16 Thread Kang Minwoo
Here is information. store about 5 billion a day. size of each log is about 4k. compression by snappy. Best regards, Minwoo Kang 보낸 사람: Ted Yu 보낸 날짜: 2018년 5월 17일 목요일 00:01 받는 사람: user@hbase.apache.org 제목: Re: How to improve HBase read performance. bq

Re: How to improve HBase read performance.

2018-05-16 Thread Ted Yu
bq. store a lot of logs in HBase Kang: Can you tell us a bit more about how you store (and access) the log(s) - size of each log, whether log is encoded in hbase ? ORC is columnar format while hbase uses different format. Thanks On Wed, May 16, 2018 at 6:41 AM, Marcell Ortutay wrote: > This t

Re: How to improve HBase read performance.

2018-05-16 Thread Marcell Ortutay
This ticket: https://issues.apache.org/jira/browse/HBASE-20459 was fixed in the latest version of HBase, upgrading to latest may help with performance On Wed, May 16, 2018 at 3:55 AM, Kang Minwoo wrote: > Hi, Users. > > I store a lot of logs in HBase. > However, the reading speed of the log is t

How to improve HBase read performance.

2018-05-16 Thread Kang Minwoo
Hi, Users. I store a lot of logs in HBase. However, the reading speed of the log is too slow compared to the Hive ORC file. I know that HBase is slow compared to the Hive ORC file. The problem is that it is too slow. HBase is about 6 times slower. Is there a good way to speed up HBase's reading s