Re: RegionServer 60030 Show All RPC Handler Task is empty

2015-07-02 Thread Stack
On Wed, Jul 1, 2015 at 9:18 PM, Louis Hust louis.h...@gmail.com wrote: Hi, all I restart a regionserver and do a balanceswitch manually, the task seems ok You are seeing handler tasks now? On apache branch-1, I see the tasks all WAITING. Let me check a CDH... St.Ack 2015-06-30 15:38

Re: Corrupted META?

2015-07-02 Thread Esteban Gutierrez
Hi Mike, Have you had a chance to look into what Chien suggested? what exception do you see in the RS that is trying to open META? is it just complaining about TableInfoMissingException: No table descriptor file under hdfs://gs1/hbase/data/hbase/meta ? if thats the case have you tried to fix it

Re: HBase Start Error: java.io.IOException: com.google.protobuf.ServiceException: java.lang.NoSuchMethodError:

2015-07-02 Thread Esteban Gutierrez
Hello Arthur, Our apologies for the delay here. Why you cannot use protobuf 2.5? I don't see anything special in that version would cause an issue with ppc64le. Worst case, assuming you are using Linux on that architecture, there is a protobuf compiler for ppc64el in rpmfind:

Re: HBase monitoring

2015-07-02 Thread Esteban Gutierrez
Hi Wojciech, From the memory metrics and the up time of the RS reported by top seems that JVM has been running for a while, so a good part of the memory pages available for the JVM process have been touched and now are considered as used by to OS. Same thing can happen if -Xms is present and its

Why hbase can quickly position columns for certain key?

2015-07-02 Thread James Teng
Hi all,i am wondering whether someone could explain this to me, although i have read some materials for hbase, but still have some puzzles on this. Hbase store files are stored on hdfs, which lacks random access writes, although hbase has some mechanisms to filter data on store files level, but

Backup/Restore (HBASE-7192) design doc

2015-07-02 Thread Vladimir Rodionov
Hi, folks Kindly soliciting feedback on a latest design doc: https://issues.apache.org/jira/browse/HBASE-7912 -Vlad

[Discuss]A issue of scan timeout after delete a number of rows

2015-07-02 Thread Song Geng
Hi everyone, I am a complete novice in hbase and the community. And this is my first email. Please forgive me if I make some trouble. Here is the issue: We use hbase store the file information and using compose userid and rowkey as the file path. For example: A user’s id is 1000, and

Re: [Discuss]A issue of scan timeout after delete a number of rows

2015-07-02 Thread Ted Yu
You may have read http://hbase.apache.org/book.html#version.delete Please see 'Scan Improvements in HBase 1.1.0' under https://blogs.apache.org/hbase/ Cheers On Thu, Jul 2, 2015 at 6:54 PM, Song Geng soul.gr...@me.com wrote: Hi everyone, I am a complete novice in hbase and the community.

scan with ColumnPrefixFilter, but return all columns that match

2015-07-02 Thread aloharich
i'm still designing and coming up to speed with hbase, trying to use a columnprefix filter to find rows/keys that have a certain family:column key, and then get all the data for that key. so the goal would be, assuming there was a table like this (example) create 'cars' , 'interior',

Re: Corrupted META?

2015-07-02 Thread MiMills
We got it back up and running late last night with no loss of data. We did a few things and I'll try and list them here for others. Some items may have not helped, but we did them as we were trying to resolve the issue and they caused no harm. * From Samir's list: 1. Shutdown your cluster

Re: Why hbase can quickly position columns for certain key?

2015-07-02 Thread Demai Ni
think the storage of HBase as a INDEX, according to the KEY. So if the query has a condition of the key(for example, key = '1234'). It is a quick search tree (with meta data in memory), and locate the HFile. Then it is one I/O to retrieve the HFile. 'Quick' is a relative term. A relational

Hot (consistent) incremental backup

2015-07-02 Thread Nicola Ferraro
HBase has many options for performing the backup of data stored in a table. The export tool is described by O'Reilly (HBase, the definitive guide), but also here [ http://blog.cloudera.com/blog/2013/11/approaches-to-backup-and-disaster-recovery-in-hbase/comment-page-1/#comment-63294] as a way to

Re: Hot (consistent) incremental backup

2015-07-02 Thread Vladimir Rodionov
Hi, Nicola I recommend you to read HBASE-7912 design doc (it has been updated today). https://issues.apache.org/jira/browse/HBASE-7912 -Vlad On Thu, Jul 2, 2015 at 11:46 AM, Nicola Ferraro nibbi...@gmail.com wrote: HBase has many options for performing the backup of data stored in a table.

Re: Hot (consistent) incremental backup

2015-07-02 Thread Nicola Ferraro
Thank you Vlad, I looked at the design document and found the approach really interesting. I have also checked some of the linked jiras and found out that there is still much work ahead for developing and testing the solution, though you are doing a great job. I was wondering whether you knew any

Re: Hot (consistent) incremental backup

2015-07-02 Thread Vladimir Rodionov
No, I am not aware about any other than (HBASE-7912) solution for incremental backup. You can try patch from HBASE-11085. It compiles and runs on master (2.0) and should compile with, probably, minimal changes on 1.0-1.1 - not 0.98. This should give you basic feature of full/incr backup and