Re: Scanner Exception

2010-06-03 Thread Raghava Mutharaju
Nope, it doesn't. After recompiling, I just changed the $HBASE_HOME to the newly created build folder. I think that is the only change required? Regards, Raghava. On Fri, Jun 4, 2010 at 1:46 AM, Stack wrote: > Does your filter start working if you add it in here w/ a code of its > own and reco

Re: Scanner Exception

2010-06-03 Thread Raghava Mutharaju
I check that out and get back to you :) Raghava. On Fri, Jun 4, 2010 at 1:46 AM, Stack wrote: > Does your filter start working if you add it in here w/ a code of its > own and recompile and relaunch? > St.Ack > > On Thu, Jun 3, 2010 at 10:40 PM, Raghava Mutharaju > wrote: > > I found the codes

Re: Scanner Exception

2010-06-03 Thread Stack
Does your filter start working if you add it in here w/ a code of its own and recompile and relaunch? St.Ack On Thu, Jun 3, 2010 at 10:40 PM, Raghava Mutharaju wrote: > I found the codes in HBaseObjectWritable file and saw the jira too :). > This change only effects the performance isn't it (part

Re: Scanner Exception

2010-06-03 Thread Raghava Mutharaju
I found the codes in HBaseObjectWritable file and saw the jira too :). This change only effects the performance isn't it (particularly for small cell data), not the actual functionality. Regards, Raghava. On Fri, Jun 4, 2010 at 1:18 AM, Stack wrote: > Look in that java file and see how all exta

Re: Scanner Exception

2010-06-03 Thread Stack
Look in that java file and see how all extant filters are mentioned and assigned a code. You need to add yours too. St.Ack On Thu, Jun 3, 2010 at 10:14 PM, Raghava Mutharaju wrote: > Thank you Angus and Guilherme :). I added the filter jar to $HBase/lib and > the exceptions went away. Although,

Re: Scanner Exception

2010-06-03 Thread Raghava Mutharaju
Thank you Angus and Guilherme :). I added the filter jar to $HBase/lib and the exceptions went away. Although, there now the filter doesn't return any rows - I have to check this out. Stack: About HBaseObjectWritable, I have used it in serializing(write() method) and deserializing(readFields()

Re: Scanner Exception

2010-06-03 Thread Stack
You have to add it to HBaseObjectWritable too, IIRC. See how other filters are mentioned in there (The need to do this has to go away. I filed HBASE-2666). St.Ack On Thu, Jun 3, 2010 at 9:01 PM, Angus He wrote: > Even if HBase is running in standalone mode,  the scan operation is > still runnin

Re: Scanner Exception

2010-06-03 Thread Angus He
Even if HBase is running in standalone mode, the scan operation is still running in another jvm, to be specific, in HMaster process. So you still have to either put the custom filter jar in $HBASE/lib or set up the $HBASE/conf/hbase-env.sh properly. On Fri, Jun 4, 2010 at 4:37 AM, Raghava Muthar

Re: Regarding IntSet implementation

2010-06-03 Thread Lekhnath
Hi Yoram, Thanks for your reply. We have structural data and have to search and sort against each attribute. So, simply IHBase or THBase did not help. We are studying on some custom implementation that is in between IHBase and THBase. For that case we may need Coprocessors implemented in HBase.

Re: Adding a tiny HBase cluster to existing Hadoop environment

2010-06-03 Thread Todd Lipcon
Hi Tatsuya, On Thu, Jun 3, 2010 at 5:06 PM, Tatsuya Kawano wrote: > Hello, > > I remember Jon was talking other day that he was trying a single HBase > server with existing HDFS cluster to serve map reduce (MR) results. I wonder > if this went well or not. > > A couple of friends in Tokyo are con

Adding a tiny HBase cluster to existing Hadoop environment

2010-06-03 Thread Tatsuya Kawano
Hello, I remember Jon was talking other day that he was trying a single HBase server with existing HDFS cluster to serve map reduce (MR) results. I wonder if this went well or not. A couple of friends in Tokyo are considering HBase to do a similar thing. They want to serve MR results insi

RE: Trying to get the region servers working....

2010-06-03 Thread Buttler, David
The problem with your scenario is that if you get partitioned then both sides will go down because ZK needs a quorum (half plus one). As for Hadoop, by default it does not support multiple name nodes. The master file lists secondary name nodes (they just log what happens on the NN). There is

RE: Trying to get the region servers working....

2010-06-03 Thread Anthony Ikeda
David, we are currently prototyping an Active-Active site scenario so for now we will be using 2 ZooKeeper servers (one on site a the other on site b). >From what I understand, Hadoop also supports multiple Masters? I'm only going on the pretence that the config file is labelled ${HADOOP_HOME}/con

Re: elastic search or other Lucene for HBase?

2010-06-03 Thread Steven Noels
On Thu, Jun 3, 2010 at 4:58 PM, Otis Gospodnetic wrote: Wow, Steven, you really did your homework well! Major A+ in my book. :) > I have a real talent for copy/paste, but credits for the write-up need to go to my colleague Bruno Dumon! Steven. -- Steven Noelshttp:

Re: Scanner Exception

2010-06-03 Thread Raghava Mutharaju
The custom filter doesn't need any additional jars. Another point I forgot to mention is that, I am running this on a single node (laptop) to test my filter. Regards, Raghava. On Thu, Jun 3, 2010 at 4:23 PM, Guilherme Germoglio wrote: > please check if the jars needed for your custom filter impl

Re: Scanner Exception

2010-06-03 Thread Guilherme Germoglio
please check if the jars needed for your custom filter implementation are in hbase's classpath On Thu, Jun 3, 2010 at 5:16 PM, Raghava Mutharaju wrote: > Hi all, > > I wrote a custom filter and used it with scan. I am getting the > following exceptions. If I use any built-in filters, it wor

Scanner Exception

2010-06-03 Thread Raghava Mutharaju
Hi all, I wrote a custom filter and used it with scan. I am getting the following exceptions. If I use any built-in filters, it works fine. I searched around and one of the suggestions was to increase the lease timeout. Since it works fine for built-in filters, I am assuming that this is not

RE: Trying to get the region servers working....

2010-06-03 Thread Buttler, David
Just to be clear, you are not actually running exactly 2 ZK nodes are you? I think one ZK node on your master is sufficient for this size of cluster. If that node goes down you entire cluster is gone in any case. And remember, you need to have an odd number of ZK nodes. And 3 nodes probably

Re: elastic search or other Lucene for HBase?

2010-06-03 Thread Otis Gospodnetic
Wow, Steven, you really did your homework well! Major A+ in my book. :) Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Steven Noels > To: hbase-user > Sent: Thu, June 3, 2010 3:33:0

Re: Using HBase for logging

2010-06-03 Thread Alex Baranov
Hi, If you're not going access this logged data as is from HBase and will use it to produce some statistics, etc. (perhaps via MR jobs), then I wouldn't recommend using neither date/time nor timestamp as a row key. This will make HBase write logs into particular RegionServer at one time and thus a

Re: elastic search or other Lucene for HBase?

2010-06-03 Thread Steven Noels
On Sat, Mar 27, 2010 at 8:46 PM, Tim Robertson wrote: > Hi all, > > Is anyone using elastic search as an indexing layer to HBase content? > It looks to have a really nice API, and was thinking of setting up an > EC2 test where I maintain an ES index storing only the Key to HBase > rows. So ES pro

Re: elastic search or other Lucene for HBase?

2010-06-03 Thread Tim Robertson
Hi Otis, Other some basic tests on EC2, I'm afraid not. I was initially pondering using ElasticSearch as the front end REST and hooking in the CRUD to HBase underneath, but since HBase is not my primary store (in truth it is something I only get time to fire up and play with occasionally at the m