Re: TableRecordReaderImpl is not able to get the rows

2012-06-14 Thread Sonal Goyal
Are you doing something specific with the RecordReader? Maybe you can post more of your code as it is difficult to tell anything right now. Best Regards, Sonal Crux: Reporting for HBase Nube Technologies

Re: TableRecordReaderImpl is not able to get the rows

2012-06-14 Thread Subroto
Hi Sonal, Thanks for your suggestion… I checked my code and found out that I was doing something like this: for (String column : columns) { scan.addColumn(Bytes.toBytes(column), Bytes.toBytes("")) } The same scan object was being set in the configuration. After removing this piece of c

RE: TableRecordReaderImpl is not able to get the rows

2012-06-14 Thread Anoop Sam John
Hi Subroto Scan.addColumn you can use when u want only specific columns to be retrieved in the sacn . U can read the javadoc in addColumn() and addFamily() methods and then it will be clear. scan.addColumn(Bytes.toBytes(column), Bytes.toBytes("")) As you do this empty qualifier name is

Re: IllegalArgumentException: Not a host:port

2012-06-14 Thread pdv
Lifesaver! Thanks a lot!

Re: Timestamp as a key good practice?

2012-06-14 Thread Jean-Marc Spaggiari
Wow! This is exactly what I was looking for. So I will read all of that now. Need to read here at the bottom: https://github.com/sematext/HBaseWD and here: http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/ Thanks, JM 2012/6

Re: Timestamp as a key good practice?

2012-06-14 Thread Michael Segel
Actually I think you should revisit your key design Look at your access path to the data for each of the types of queries you are going to run. From your post: "I have a table with a uniq key, a file path and a "last update" field. >>> I can easily find back the file with the ID and find wh

Re: Timestamp as a key good practice?

2012-06-14 Thread Jean-Marc Spaggiari
Hi Michael, Thanks for your feedback. Here are more details to describe what I'm trying to achieve. My goal is to store information about files into the database. I need to check the oldest files in the database to refresh the information. The key is an 8 bytes ID of the server name in the netwo

RE: HBaseAdmin.enableTable not responding

2012-06-14 Thread Ramkrishna.S.Vasudevan
Hi Benjamin Can you post some logs. Can you see if you get any msg in logs of master saying regions are in transition or something. Regards Ram > -Original Message- > From: Ben Kim [mailto:benkimkim...@gmail.com] > Sent: Thursday, June 14, 2012 6:00 PM > To: user@hbase.apache.org > Subj

Re: TableRecordReaderImpl is not able to get the rows

2012-06-14 Thread Subroto
Hi Anoop, Thanks a lot for the explanation. Need to go through the documentation properly…. ;-) Cheers, Subroto Sanyal On Jun 14, 2012, at 10:15 AM, Anoop Sam John wrote: > Hi Subroto > Scan.addColumn you can use when u want only specific columns to be > retrieved in the sacn . U can

Re: RS unresponsive after series of deletes

2012-06-14 Thread Stack
On Wed, Jun 13, 2012 at 12:09 PM, Ted Tuttle wrote: > My client code has a set of deletes to carry out.  After successfully issuing > 19 such deletes the client begins logging HBase errors while trying to > complete the deletes.  It logs ERRORs every 60s for 10 times and then gives > up. > Wha

Re: Controlling Region Server Heap usage

2012-06-14 Thread Stack
On Wed, Jun 13, 2012 at 8:40 AM, Amit Sela wrote: > HBase configurations are: > hbase.regionserver.handler.count 18 > hbase.regionserver.global.memstore.upperLimit 0.5 > hbase.regionserver.global.memstore.lowerLimit 0.45 > hbase.server.thread.wakefrequency 500 > hbase.hregion.memstore.flush.size 2

Re: Clear Block Cache

2012-06-14 Thread Li Pi
Take a look at setCacheBlocks. "Set whether blocks should be cached for this Scan. This is true by default. When true, default settings of the table and family are used (this will never override caching blocks if the block cache is disabled for that family or entirely)" http://hbase.apache.org/

Re: NotServingRegionException; Region is not online: .META.,,1

2012-06-14 Thread Stack
On Wed, Jun 13, 2012 at 2:51 AM, Anty wrote: >     i have a little cluster composed of 1master+7regionserver, hbase version > is 0.90.5, one of my region server constantly print debug info like this all > the time, even there is no request issued against the region server. > Please upgrade your h

Re: Clear Block Cache

2012-06-14 Thread Kevin O'dell
Kevin, One way to do it would be to use a configuration parameter and just set it to zero for those scans. From the HBase book: Disabling Blockcache Do not turn off block cache (You'd do it by setting hbase.block.cache.size to zero). Currently we do not do well if you do this because the reg

Re: Timestamp as a key good practice?

2012-06-14 Thread Michael Segel
Jean-Marc, You do realize that this really isn't a good use case for HBase, assuming that what you are describing is a stand alone system. It would be easier and better if you just used a simple relational database. Then you would have your table w an ID, and a secondary index on the timestamp.

Re: Timestamp as a key good practice?

2012-06-14 Thread Jean-Marc Spaggiari
Hi Michael, For now this is more a proof of concept than a production application. And if it's working, it should be growing a lot and database at the end will easily be over 1B rows. each individual server will have to send it's own information to one centralized server which will insert that int

RE: RS unresponsive after series of deletes

2012-06-14 Thread Ted Tuttle
> What kind of a delete are you doing? A mixture of row and cell deletes. Interestingly, the first 19 (successful) deletes were row deletes. The client got hung up while submitting its first batch of cell deletes. However, I think the cell/row distinction is a red herring as we've experienced

Re: Timestamp as a key good practice?

2012-06-14 Thread Michael Segel
Ok... Makes sense. You don't need to worry about Coprocessors in your initial PoC. It just makes it easier instead of relying on the application managing all of the database updates. A billion rows shouldn't be a problem for an RDBMS but that's a different issue. To start with, you update

Re: Timestamp as a key good practice?

2012-06-14 Thread Doug Meil
Will do! On 6/14/12 2:06 AM, "Otis Gospodnetic" wrote: >JM, have a look at https://github.com/sematext/HBaseWD (this comes up >often Doug, maybe you could add it to the Ref Guide?) > >Otis > >Performance Monitoring for Solr / ElasticSearch / HBase - >http://sematext.com/spm > > > >

Re: why responseTooSlow ?

2012-06-14 Thread Jiajun Chen
running: Compacting store data (since 59sec ago) Flushing data: creating writer (since 1mins, 34sec ago) Compaction complete (since 59sec ago) On 12 May 2012 12:48, Stack wrote: > On Fri, May 11, 2012 at 5:17 AM, Jiajun Chen wrote: > > 2012-05-11 16:07:19,988 WARN org.apache.hadoop.ipc.HBase

Data locality in HBase

2012-06-14 Thread Ben Kim
Hi, I've been posting questions in the mailing-list quiet often lately, and here goes another one about data locality I read the excellent blog post about data locality that Lars George wrote at http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html I understand data locality in hbase

Re: why responseTooSlow ?

2012-06-14 Thread Jiajun Chen
$ iostat 3 5 avg-cpu: %user %nice %system %iowait %steal %idle 27.930.006.554.440.00 61.08 Device:tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 39.58 1987.97 1360.10 2261558140 1547281856 sdb 40.86 19