: user
Sent: Thursday, August 29, 2013 11:11 PM
Subject: Re: experiencing high latency for few reads in HBase
Are your GC logs enabled? Can you see any long pause in it?
On Fri, Aug 30, 2013 at 4:45 AM, Kiru Pakkirisamy wrote:
> I just moved from 0.94.10 to 0.94.11. Tremendous improvement
rg
> Sent: Thursday, August 29, 2013 5:37 AM
> Subject: Re: experiencing high latency for few reads in HBase
>
>
> In 0.94.11 Release, has been included an optimization for MultiGets:
> https://issues.apache.org/jira/browse/HBASE-9087
>
> What version have you deployed?
>
at is probably affecting us.
Regards,
- kiru
From: Federico Gaule
To: user@hbase.apache.org
Sent: Thursday, August 29, 2013 5:37 AM
Subject: Re: experiencing high latency for few reads in HBase
In 0.94.11 Release, has been included an optimization for MultiGets:
s is low)
>> (?)
>>>
>>> Regards,
>>> - kiru
>>>
>>>
>>> Kiru Pakkirisamy | webcloudtech.wordpress.com
>>>
>>>
>>>
>>> From: Vladimir Rodionov
>>> To: "user@h
unning the test after a few runs to make sure they are
> already in IN_MEMORY (ie blockCacheHit is high or blockCacheMiss is low)
> (?)
> >
> > Regards,
> > - kiru
> >
> >
> > Kiru Pakkirisamy | webcloudtech.wordpress.com
> >
> >
> > _______
ot;
Sent: Thursday, August 29, 2013 12:09 PM
Subject: Re: experiencing high latency for few reads in HBase
Thanks Kiru.
We have 10TB of data on disk. It would not fit in memory. Also for the first
time, hbase need to read from the disk. And it has to go through the network to
read the blo
gards,
> - kiru
>
>
> Kiru Pakkirisamy | webcloudtech.wordpress.com
>
>
>
> From: Vladimir Rodionov
> To: "user@hbase.apache.org"
> Sent: Thursday, August 29, 2013 11:11 AM
> Subject: RE: experiencing high latency for few
From: Vladimir Rodionov
To: "user@hbase.apache.org"
Sent: Thursday, August 29, 2013 11:11 AM
Subject: RE: experiencing high latency for few reads in HBase
Usually, either cluster restart or major compaction helps improving locality
index.
There is an issue
..@yahoo.com]
Sent: Thursday, August 29, 2013 10:52 AM
To: user@hbase.apache.org
Cc: user@hbase.apache.org
Subject: Re: experiencing high latency for few reads in HBase
Thanks Vlad.
Quick question. I notice hdfsBlocksLocalityIndex is around 50 in all region
servers.
Does that could be a problem? If i
orm Engineer
> > Carrier IQ, www.carrieriq.com
> > e-mail: vrodio...@carrieriq.com
> >
> >
> > From: Saurabh Yahoo [saurabh...@yahoo.com]
> > Sent: Thursday, August 29, 2013 2:49 AM
> > To: user@hbase.apache.org
> > Cc:
Yahoo [saurabh...@yahoo.com]
> Sent: Thursday, August 29, 2013 2:49 AM
> To: user@hbase.apache.org
> Cc: user@hbase.apache.org
> Subject: Re: experiencing high latency for few reads in HBase
>
> Hi Vlad,
>
> We do have strict latency requirement as it is financial data requir
__
> From: Saurabh Yahoo
> To: "user@hbase.apache.org"
> Cc: "user@hbase.apache.org"
> Sent: Thursday, August 29, 2013 2:49 AM
> Subject: Re: experiencing high latency for few reads in HBase
>
>
> Hi Vlad,
>
> We do have strict latency requir
t;> To: "user@hbase.apache.org"
>> Cc: "user@hbase.apache.org"
>> Sent: Wednesday, August 28, 2013 3:17 PM
>> Subject: Re: experiencing high latency for few reads in HBase
>>
>> Hi Vlad,
>>
>> Thanks for your response.
>>
013 2:49 AM
To: user@hbase.apache.org
Cc: user@hbase.apache.org
Subject: Re: experiencing high latency for few reads in HBase
Hi Vlad,
We do have strict latency requirement as it is financial data requiring direct
access from clients.
Are you saying that it is not possible to achieve sub second la
sts to the regions.
Regards,
- kiru
From: Saurabh Yahoo
To: "user@hbase.apache.org"
Cc: "user@hbase.apache.org"
Sent: Thursday, August 29, 2013 2:49 AM
Subject: Re: experiencing high latency for few reads in HBase
Hi Vlad,
We do have st
Yahoo
To: "user@hbase.apache.org"
Cc: "user@hbase.apache.org"
Sent: Wednesday, August 28, 2013 3:17 PM
Subject: Re: experiencing high latency for few reads in HBase
Hi Vlad,
Thanks for your response.
1. Our SLA is less than one sec. we cannot afford latency more than 1 sec.
__
> From: Saurabh Yahoo [saurabh...@yahoo.com]
> Sent: Wednesday, August 28, 2013 4:18 PM
> To: user@hbase.apache.org
> Subject: Re: experiencing high latency for few reads in HBase
>
> Thanks Kiru,
>
> Scan is not an option for our use cases. Our read is pretty ra
times of 200ms, but I have not verified that.
-- Lars
- Original Message -
From: Saurabh Yahoo
To: "user@hbase.apache.org"
Cc: "user@hbase.apache.org"
Sent: Wednesday, August 28, 2013 3:17 PM
Subject: Re: experiencing high latency for few reads in HBase
Hi Vl
M
To: user@hbase.apache.org
Subject: Re: experiencing high latency for few reads in HBase
Thanks Kiru,
Scan is not an option for our use cases. Our read is pretty random.
Any other suggestion to bring down the latency.
Thanks,
Saurabh.
On Aug 28, 2013, at 7:01 PM, Kiru Pakkirisamy wrote:
> Sa
_
> From: Saurabh Yahoo
> To: "user@hbase.apache.org"
> Cc: "user@hbase.apache.org"
> Sent: Wednesday, August 28, 2013 3:20 PM
> Subject: Re: experiencing high latency for few reads in HBase
>
>
> Thanks Kitu. We need le
From: Saurabh Yahoo
To: "user@hbase.apache.org"
Cc: "user@hbase.apache.org"
Sent: Wednesday, August 28, 2013 3:20 PM
Subject: Re: experiencing high latency for few reads in HBase
Thanks Kitu. We need less than 1 sec latency.
We are us
ser@hbase.apache.org"
> Sent: Wednesday, August 28, 2013 12:15 PM
> Subject: RE: experiencing high latency for few reads in HBase
>
>
> 1. 4 sec max latency is not that bad taking into account 12GB heap. It can
> be much larger. What is your SLA?
> 2. Block eviction
Hi Vlad,
Thanks for your response.
1. Our SLA is less than one sec. we cannot afford latency more than 1 sec.
We can increase heap size if that help, we have enough memory on server. What
would be the optimal heap size?
2. Cache hit ratio is 95%. One thing I don't understand that we have al
ot;
Sent: Wednesday, August 28, 2013 12:15 PM
Subject: RE: experiencing high latency for few reads in HBase
1. 4 sec max latency is not that bad taking into account 12GB heap. It can be
much larger. What is your SLA?
2. Block evictions is the result of a poor cache hit rate and the root c
ay, August 28, 2013 12:15 PM
To: user@hbase.apache.org
Subject: RE: experiencing high latency for few reads in HBase
1. 4 sec max latency is not that bad taking into account 12GB heap. It can be
much larger. What is your SLA?
2. Block evictions is the result of a poor cache hit rate and the root c
1. 4 sec max latency is not that bad taking into account 12GB heap. It can be
much larger. What is your SLA?
2. Block evictions is the result of a poor cache hit rate and the root cause of
a periodic stop-the-world GC pauses (max latencies
latencies you have been observing in the test)
3. Bl
26 matches
Mail list logo
