Re: Column families

2017-06-23 Thread Alexander Ilyin
de to > achieve transaction > where needed. > Since the multiple tables tend to have same row key design as you > mentioned, region servers carry more regions, increasing load on assignment > manager / balancer, etc. > > Cheers > > On Thu, Jun 22, 2017 at 5:44 AM, Alexander

Column families

2017-06-22 Thread Alexander Ilyin
Hi, A general question regarding column families. It is said in the doc that HBase doesn't do well with more than 2-3 column families because flushing and compactions are done on a per region basis which should be addressed in the future: http://hbase.apache.org/book.html#number.of.cfs Is it stil

Re: Compaction monitoring

2017-05-05 Thread Alexander Ilyin
egion size is becoming too large? <-- > This is 100% depends, it depends on your environment, I/O usage, SLAs etc, > I am not sure if anyone has done documented compaction times based on > Region sizes. You may have to do some trial and error here. > > I hope this helps! > > &g

Compaction monitoring

2017-05-05 Thread Alexander Ilyin
Hi, Tuning HBase performance I've found a lot of settings which affect compaction process (off-peak hours, time between compactions, compaction ratio, region sizes, etc.). They all seem to be useful and there are recommendations in the doc saying which values to set. But I found no way to assess h

Re: Spikes in HBase response time

2016-10-26 Thread Alexander Ilyin
ase.rpc.timeout * hbase.client.operation.timeout * something else I missed? On Tue, Oct 25, 2016 at 1:21 PM, Alexander Ilyin wrote: > Hi Ted, Stack, > > thanks for the answers. > > We're not using Phoenix but the server process was running on some > datanodes. We stopped i

Re: Spikes in HBase response time

2016-10-25 Thread Alexander Ilyin
r the 800ms penalty? > Thanks, > St.Ack > > On Mon, Oct 24, 2016 at 5:44 AM, Alexander Ilyin > wrote: > > > Hi, > > > > I'm experiencing some spikes in HBase response time. The problem appeared > > in one moment: before all the requests used to take 4-3

Spikes in HBase response time

2016-10-24 Thread Alexander Ilyin
Hi, I'm experiencing some spikes in HBase response time. The problem appeared in one moment: before all the requests used to take 4-30ms to complete and now some of them (several percent) take as long as 800ms decreasing significantly an average processing time. This happens with the requests to

Re: HBase restart without region reassigning

2016-10-17 Thread Alexander Ilyin
ster reboot) > > On Mon, Oct 17, 2016 at 8:26 AM Alexander Ilyin > wrote: > > > Hi, > > > > We have a 7-node HBase cluster (version 1.1.2) and we change some of its > > settings from time to time which requires a restart. The problem is that > > every time

Re: HBase restart without region reassigning

2016-10-17 Thread Alexander Ilyin
thing be amiss in your network settings? Seeing phantom datanodes > could be tripping things up. Are these physical machines or instances in > the cloud? > > On Monday, October 17, 2016, Alexander Ilyin > wrote: > > > Hi, > > > > We have a 7-node HBase

HBase restart without region reassigning

2016-10-17 Thread Alexander Ilyin
Hi, We have a 7-node HBase cluster (version 1.1.2) and we change some of its settings from time to time which requires a restart. The problem is that every time after the restart load balancer reassigns the regions making data locality low. To address this issue we tried the settings described he