RE: Can't enable, nor disable, nor truncate nor drop

2012-12-12 Thread Rajeshbabu Chintaguntla
Hi Alexander, This problem comes when some failures in enable/disable of a table. You can refer this jira https://issues.apache.org/jira/browse/HBASE-6469 for more information(FYI) Thanks and Regards, Rajesh -Original Message- From: Alexander Gallego [mailto:gallego.al...@gmail.com] Se

Re: How to design a data warehouse in HBase?

2012-12-12 Thread lars hofhansl
For OLAP type queries you will generally be better off with a truly column oriented database. You can probably shoehorn HBase into this, but it wasn't really designed with raw scan performance along single columns in mind. From: bigdata To: "user@hbase.apache

Re: access hbae with 'username and passwd"

2012-12-12 Thread Harsh J
HBase provides an authentication layer via kerberos. You can read more on that here: http://hbase.apache.org/book.html#security and some info on its design at http://blog.cloudera.com/blog/2012/09/understanding-user-authentication-and-authorization-in-apache-hbase/. On Thu, Dec 13, 2012 at 10:54 A

Re: Region server instability with large number of deletes

2012-12-12 Thread lars hofhansl
That is fixed in 0.94 (can't find the exact issue now, though) Before the fix in 0.94 the region server would skip deleted columns one by one in order to advance to the next row. Now it seeks ahead, instead. In 0.92 I think your only option is to follow your batch delete with a major compaction

Re: How to pick which region(s) to major compact?

2012-12-12 Thread Bryan Beaudreault
I've looked into this in the past, and I haven't implemented anything yet. But I have a couple notes: 1) From what I can tell hbase doesn't currently provide you with an API you could use to figure this out smartly. (I was looking at 0.90.x, it could have changed in later versions). 2) What seem

Re: Checking if a coprocessor was loaded successfully from client

2012-12-12 Thread Andrew Purtell
HBaseAdmin#getClusterStatus -> ClusterStatus#getMasterCoprocessors() -> for (ServerName sn: ClusterStatus#getServers) { ClusterStatus#getLoad(sn).getCoprocessors() } ? On Wed, Dec 12, 2012 at 11:44 AM, Ted Yu wrote: > Can you log a JIRA so that Coprocessor.State is exposed in Java API

Re: H-Rider / HTable UI

2012-12-12 Thread Otis Gospodnetic
If this were to become a part of Apache HBase, HBase devs would have to maintain it. And I have a feeling nobody really wants to maintain this here :) Otis -- HBASE Performance Monitoring - http://sematext.com/spm/index.html Search Analytics - http://sematext.com/search-analytics/index.html

Re: How to know it's time for a major compaction?

2012-12-12 Thread Kevin O'dell
Ted, That is awesome. Thank you! On Wed, Dec 12, 2012 at 3:36 PM, Ted Yu wrote: > Thanks confirmation, Kevin. > > I logged HBASE-7340 so that user doesn't have to script for compaction. > > On Wed, Dec 12, 2012 at 12:30 PM, Kevin O'dell >wrote: > > > Ted, > > > > Yes, it is all done throu

Re: How to know it's time for a major compaction?

2012-12-12 Thread Ted Yu
Thanks confirmation, Kevin. I logged HBASE-7340 so that user doesn't have to script for compaction. On Wed, Dec 12, 2012 at 12:30 PM, Kevin O'dell wrote: > Ted, > > Yes, it is all done through scripting. > > On Wed, Dec 12, 2012 at 3:22 PM, Ted Yu wrote: > > > bq. they will major compact any

Re: How to know it's time for a major compaction?

2012-12-12 Thread Kevin O'dell
Ted, Yes, it is all done through scripting. On Wed, Dec 12, 2012 at 3:22 PM, Ted Yu wrote: > bq. they will major compact any region the balancer has moved. > > Interesting. Do they achieve this through scripting ? > > I think HBase can perform some follow-on action after region movement. > >

Re: dfs.replication

2012-12-12 Thread Bryan Keller
Thanks, it is in the classpath after all. I was looking at the "ps" output which was truncated, "hbase classpath" revealed the full classpath. On Dec 12, 2012, at 11:47 AM, Jean-Daniel Cryans wrote: > dfs.replication is an HDFS client-side setting, so it has to be coming > from somewhere. Doubl

Re: How to know it's time for a major compaction?

2012-12-12 Thread Ted Yu
bq. they will major compact any region the balancer has moved. Interesting. Do they achieve this through scripting ? I think HBase can perform some follow-on action after region movement. Cheers On Wed, Dec 12, 2012 at 12:19 PM, Kevin O'dell wrote: > Otis, > > I think it depends on your use ca

Re: How to know it's time for a major compaction?

2012-12-12 Thread Kevin O'dell
Otis, I think it depends on your use case. Some use cases are extremely dependent on locality and latency, so they will major compact any region the balancer has moved. Some people follow the HFile count and will trigger a major when there are x amount of files. Others will just follow best pra

Re: dfs.replication

2012-12-12 Thread Jean-Daniel Cryans
dfs.replication is an HDFS client-side setting, so it has to be coming from somewhere. Double check that classpath of yours with bin/hbase classpath J-D On Wed, Dec 12, 2012 at 11:32 AM, Bryan Keller wrote: > I noticed in some of the documentation that it states to add the Hadoop > config direc

Re: Checking if a coprocessor was loaded successfully from client

2012-12-12 Thread Ted Yu
Can you log a JIRA so that Coprocessor.State is exposed in Java API ? Cheers On Tue, Dec 11, 2012 at 11:08 PM, Asaf Mesika wrote: > I'm talking about doing this programmatically since my class is an > Installer for a Region Observer I wrote. > > On 11 בדצמ 2012, at 08:47, Ted Yu wrote: > > > F

dfs.replication

2012-12-12 Thread Bryan Keller
I noticed in some of the documentation that it states to add the Hadoop config directory to the HBase classpath if you want HBase to use any DFS client settings, like dfs.replication. Is this still true? It seems like HBase is using the dfs.replication setting. I have it set to 2 in the Hadoop c

Region server instability with large number of deletes

2012-12-12 Thread Mark Greene
Hi All, I'm running HBase 0.92.1-cdh4.1.2. I'm seeing a region server get into a state where they constantly emit LeaseExceptions and ClosedChannelException from the IPC handler under load that is several standard deviations above what we normally see. One thing that's different about this clust