Re: Level of permissions required for creating tables in HBase.

2016-02-16 Thread Junegunn Choi
"CREATE" permission should suffice. See: http://hbase.apache.org/book.html#_understanding_access_levels - junegunn

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Pedro Gandola
Hi Enis, At the time that the problem happened, the active NN log does not have any error or exceptions however the standby node has the following: 2016-02-16 14:21:51,039 INFO ha.EditLogTailer > (EditLogTailer.java:doTailEdits(238)) - Loaded 80 edits starting from txid > 4916546 > 2016-02-16

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Pedro Gandola
Hi St.Ack I attached the log in my previous response. Thanks Cheers On Tue, Feb 16, 2016 at 11:51 PM, Stack wrote: > On Tue, Feb 16, 2016 at 1:32 AM, Pedro Gandola > wrote: > > > Just missed one of your questions. > > > > Were you trying to restart

Re: disable major compaction per table

2016-02-16 Thread Ted Yu
bq. hbase.hregion.majorcompaction = 0 per table/column family I searched code base but didn't find relevant test case for the above. Mind giving me some pointer ? Thanks On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov wrote: > 1.does major compaction in hbase runs

Re: disable major compaction per table

2016-02-16 Thread Vladimir Rodionov
1.does major compaction in hbase runs per table basis. Per Region 2.By default every 24 hours? In older versions - yes. Current (1.x+) - 7 days 3.Can I disable automatic major compaction for few tables while keep it enable for rest of tables? yes, you can. You can set

Re: disable major compaction per table

2016-02-16 Thread Ted Yu
For #2, see http://hbase.apache.org/book.html#managed.compactions For #3, I don't think so. On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora wrote: > Hi > > 1.does major compaction in hbase runs per table basis. > 2.By default every 24 hours? > 3.Can I disable

disable major compaction per table

2016-02-16 Thread Shushant Arora
Hi 1.does major compaction in hbase runs per table basis. 2.By default every 24 hours? 3.Can I disable automatic major compaction for few tables while keep it enable for rest of tables? 4.Does hbase put ,get and delete are blocked while major compaction and are working in minor compaction?

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Stack
On Tue, Feb 16, 2016 at 1:32 AM, Pedro Gandola wrote: > Just missed one of your questions. > > Were you trying to restart it and it wouldn't come up? It kept doing the > > NPE on each restart? > > Or it happened once and killed the regionserver? > > > I received an alarm

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Enis Söztutar
> Operation category WRITE is not supported in state standby This looks to be coming from a NN that is in Standby state (or safe mode?). Did you check whether underlying HDFS is healthy. Is this HA configuration and hbase-site.xml contains the correct NN configuration? Enis On Tue, Feb 16, 2016

Re: Getting Htable first key and last key

2016-02-16 Thread Ted Yu
Please see the following in HConstants: public static final byte [] EMPTY_START_ROW = EMPTY_BYTE_ARRAY; To get the first key in a region, you can specify the start key obtained below in a Scan and utilize the following: * To limit the maximum number of values returned for each call to

Re: Disable table command hangs in hbase shell in HBase 1.1.2

2016-02-16 Thread Stack
On Tue, Feb 16, 2016 at 8:30 AM, Anthony Nguyen wrote: > Hi all, > > I'm running into an issue in HBase 1.1.2 where after a cluster is running > for some time, disabling a table in the shell has no effect, hanging until > the timeout limit is reached. Looking at the

Re: Level of permissions required for creating tables in HBase.

2016-02-16 Thread Harinder Singh
ok, thanks On Tue, Feb 16, 2016 at 10:04 PM, sudhakara st wrote: > Yes, admin privilege required. > > On Tue, Feb 16, 2016 at 10:00 PM, Harinder Singh < > harindersingh...@gmail.com > > wrote: > > > Hi, > > > > What is the level of permission required for creating a

Getting Htable first key and last key

2016-02-16 Thread beeshma r
Hi , I wanna get Regions first key and last key for Htable.i did code like this. please suggest am i doing right way // people is table name //con is Hbase configration HTable ht=new HTable(con,"people"); NavigableMap np=ht.getRegionLocations();

Re: Level of permissions required for creating tables in HBase.

2016-02-16 Thread sudhakara st
Yes, admin privilege required. On Tue, Feb 16, 2016 at 10:00 PM, Harinder Singh wrote: > Hi, > > What is the level of permission required for creating a table in HBase if I > am making a client request using RPC. Should the user have ADMIN privileges > for that? > >

Level of permissions required for creating tables in HBase.

2016-02-16 Thread Harinder Singh
Hi, What is the level of permission required for creating a table in HBase if I am making a client request using RPC. Should the user have ADMIN privileges for that? Thanks Harinder

Disable table command hangs in hbase shell in HBase 1.1.2

2016-02-16 Thread Anthony Nguyen
Hi all, I'm running into an issue in HBase 1.1.2 where after a cluster is running for some time, disabling a table in the shell has no effect, hanging until the timeout limit is reached. Looking at the master logs there is only one message that has anything to do with it: 2016-02-12 13:16:23,237

Re: Rename tables or swap alias

2016-02-16 Thread Ted Yu
Please see http://hbase.apache.org/book.html#ops.snapshots for background on snapshots. In Anil's description, table_old is the result of cloning the snapshot which is taken in step #1. See http://hbase.apache.org/book.html#ops.snapshots.clone Cheers On Tue, Feb 16, 2016 at 6:35 AM, Pat Ferrel

Re: Inserting different versions for a KeyValue through 2 HFiles while bulkloading

2016-02-16 Thread Jean-Marc Spaggiari
Hi Mehdi, HBase wil sort the KeyValues based on the timestamp. So if you keep just one version only the last one will be returned. If you keep more than one and ask them all of them, then you will get both, ordered by timestamp. HTH JMS 2016-02-16 5:19 GMT-05:00 Mehdi Ben Haj Abbes

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Pedro Gandola
Just lost another RegionServer... The cluster was very stable until yesterday, 2 region servers in less than 24 hours something might be wrong in my configuration. Any insights? Thank you Pedro *(rs log)* > 2016-02-16 14:22:37,749 WARN [ResponseProcessor for block >

Re: Rename tables or swap alias

2016-02-16 Thread Pat Ferrel
I think I can work out the algorithm if I knew precisely what a “snapshot" does. From my reading it seems to be a lightweight fast alias (for lack of a better word) since it creates something that refers to the same physical data.So if I create a new table with cleaned data, call it table_new.

Re: Stuck while pulling data from Hbase table

2016-02-16 Thread Ted Yu
The stack trace is similar to the one shown in HBASE-14812 HBASE-14812 is fixed in the soon to be released 1.2.0 FYI On Tue, Feb 16, 2016 at 5:56 AM, Arul wrote: > Hi, > > I am trying to pull data from hbase table and it works for some time and > gets stuck in

Stuck while pulling data from Hbase table

2016-02-16 Thread Arul
Hi, I am trying to pull data from hbase table and it works for some time and gets stuck in hbase after that. Please find the stack trace for it. Not sure its related to HBASE-15140. Can you please let me know how to fix this issue. "kafkaProducer hbase - Thread" prio=10 tid=0x7f6ffdc11000

Re: Exceptions in Thrift

2016-02-16 Thread Rajeshkumar J
Hi Ted, Is the difference in the thrift version is the root cause of this problem? As I am using this in web service when multiple (more than 10 requests per sec) requests (clients) are given for this service only it throws error otherwise it works fine. Thanks On Tue, Feb 16, 2016 at

Re: Exceptions in Thrift

2016-02-16 Thread Ted Yu
0.98 uses thrift 0.9.0 0.9.0 Can you pastebin the complete stack trace ? Were all the client connections encountering this problem ? Thanks On Tue, Feb 16, 2016 at 12:47 AM, Rajeshkumar J wrote: > Hi, > > Please ignore my previous mail. > > My C# code

Inserting different versions for a KeyValue through 2 HFiles while bulkloading

2016-02-16 Thread Mehdi Ben Haj Abbes
Hi folks, I'm doing bulk loading. Let's imagine that I wrote a first version for a given KeyValue in HFile that I loaded in my table. Then for a further integration I will write another HFile that will contain a new version of the "same" KeyValue I wrote before. Will the second bulk load succeed.

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Pedro Gandola
Just missed one of your questions. Were you trying to restart it and it wouldn't come up? It kept doing the > NPE on each restart? > Or it happened once and killed the regionserver? I received an alarm for the RS and I went there I saw the cluster not processing data and I tried to restart the

Re: NPE on ProtobufLogWriter.sync()

2016-02-16 Thread Pedro Gandola
Hi St.Ack, Thank you for your help. I have attached ~5 min worth of data before the crash. I restarted the cluster to update some configurations after that I moved some regions around to balance the cluster and just to ensure the data locality I ran a major compaction. After that I connected my

Re: Exceptions in Thrift

2016-02-16 Thread Rajeshkumar J
Hi, Please ignore my previous mail. My C# code was compiled against thrift 0.92 and I am trying to connect to hbase 0.98.17 Thanks On Tue, Feb 16, 2016 at 2:02 PM, Rajeshkumar J wrote: > Hi, > > For both I have used hbase 0.98.17 only > > Thnaks > > On Tue,

Re: Exceptions in Thrift

2016-02-16 Thread Rajeshkumar J
Hi, For both I have used hbase 0.98.17 only Thnaks On Tue, Feb 16, 2016 at 1:14 PM, Ted Yu wrote: > What version of thrift was your C# code compiled against ? > > Which release of hbase do you try to connect to ? > > Cheers > > On Mon, Feb 15, 2016 at 11:04 PM,