Re: How to healthcheck a regionserver

2017-03-30 Thread jeff saremi
I couldn't find the relationship between Slider and Regionservers. Do you have a specific link? What I'm looking for is something like this: using the java native client: - get a list of regions - for each region, get the name of the region server - somehow find a record belonging to that regio

Re: How to healthcheck a regionserver

2017-03-30 Thread Ted Yu
Health check can be as simple as pinging - see https://issues.apache.org/jira/browse/HBASE-17453 To get list of regions, see this post: http://search-hadoop.com/m/HBase/YGbb7vLCS1bp1Ed1?subj=Re+How+to+get+the+Region+s+of+a+Table+on+a+Region+server On Thu, Mar 30, 2017 at 9:21 AM, jeff saremi wr

Is this expected HBase replication behavior or am I doing something wrong?

2017-03-30 Thread James Johansville
Hello, I attempted HBase replication for the first time and am trying to understand how it works. I have three HBase clusters each with their own ZK ensemble, A, B, C. I wanted to have complete acyclical replication between all 3 clusters, so I added B as a peer of A, C as a peer of B, A as a pee

HBase as a file repository

2017-03-30 Thread Daniel Jeliński
Hello, I'm evaluating HBase as a cheaper replacement for NAS as a file storage medium. To that end I have a cluster of 5 machines, 36TB HDD each; I'm planning to initially store ~240 million files of size 1KB-100MB, total size 30TB. Currently I'm storing each file under an individual column, and I

Re: HBase as a file repository

2017-03-30 Thread Ted Yu
Have you read: http://hbase.apache.org/book.html#hbase_mob In particular: When using MOBs, ideally your objects will be between 100KB and 10MB Cheers On Thu, Mar 30, 2017 at 1:01 PM, Daniel Jeliński wrote: > Hello, > I'm evaluating HBase as a cheaper replacement for NAS as a file storage > me

Re: HBase as a file repository

2017-03-30 Thread Daniel Jeliński
Thank you Ted for your response. I have read that part of HBase book. It never explained why objects over 10MB are no good, and did not suggest an alternative storage medium for these. I have also read this: http://hbase.apache.org/book.html#regionserver_sizing_rules_of_thumb And yet I'm trying t

Re: Is this expected HBase replication behavior or am I doing something wrong?

2017-03-30 Thread Ashish Singhi
Hello, Did you check the RegionServer logs, was there any exception ? Regards, Ashish On Thu, Mar 30, 2017 at 10:14 PM, James Johansville < james.johansvi...@gmail.com> wrote: > Hello, > > I attempted HBase replication for the first time and am trying to > understand how it works. > > I have th

Re: HBase as a file repository

2017-03-30 Thread Jingcheng Du
Hi Daniel, I think it is because the memory burden in both clients and servers. If we have a row with large size, we have to have a hfile block with a large size which will heavy the burden of the block cache if the data block would be cached. And in scanning, both region servers and clients will