Reading Performance

Hi, There are 500 concurrent clients request which trying to fetch data from HBASE through our 10 application servers. These requests will be equally dispatched to 10 application servers. In my application server, I am using HBASE java API to fetch hbase data by scan key and secindary ind

HBQL connection

Hi, Does anyone use HBQL? I found ZooKeeper client connection info every time while executing stmt.executeQuery. HResultSet results = stmt.executeQuery(query); I think once the connection setups up that can be used repeatedly. Any suggestion would be appreciated? Thank you very much. Fleming C

Re: HTablePool for Reading Performance

Hi, I've loaded 30 oracle tables into HBase successfully. All these columns are in a single columnFamily. My java program is trying to random read a few data from the first table to the last. Like Bill of Material, my user will pass one or a few products to my application which will return each p

HTablePool for Reading Performance

Hi, I am trying to start multiple threads in a client to read data from Hbase. These threads seem to share only one connection, which resulted in increasing latency. HTablePool can create multiple connections, right? I am using two ways to scan HBASE data. One is scanning by Key value, the other

Re: HBase reading performance

Hi, Thanks for your help. Our machines are Dell 1U server with 4 cores and 12G Memory. Most of our request is scanning table or secondary index table (Transactional componet). Yes, it is the default compaction interval. Sometimes there are some bulkload map/reduce jobs running while some client

HBase reading performance

Hi there, HBase read performance works fine in most of the time, but it took a very long time (over 500 seconds) yesterday while scan a few records(it takes 2 seconds while HBase is normal) I don't know how to do at that time; it lasted about 1 hour long, HBase return to normal status. So, my que

Re: Bulk load + Secondary index

Hi, I am trying to speed up the data initial into HBase. By spooling oracle data to csv file -> importtsv (Map/Reduce to HFile) -> completebulkload -> build secondary index Spool oracle data, one table with 7 millions records, taken time: 4 hours importtsv in 5 machines cluster, taken time: 20

Bulk load + Secondary index

Hi, I am trying to dump my oracle data to hbase by bulk load. After that, build my index by hbase-transactional-tableindexed. I don't know why the index table is empty after creating index. Therefore, I wonder they are not the good combination. Any ideas? Thank you very much. Fleming Chiu(邱宏明)

Re: secondary index

Hi, It seems that it is not compatible with 0.90.1-cdh3u0. There are compile errors in openHRegion and replayRecoveredEditsIfAny. Any ideas? Thank you public class TransactionalRegion extends HRegion { @Override protected HRegion openHRegion(final Progressable reporter) throws IOExcep

secondary index

Hi, I am trying to build secondary index by hbase-transactional-tableindexed. My HBase version is hbase-0.90.1-cdh3u0.jar. Where can I download the hbase-transactional-tableindexed jar ? and how can I deploy that jar (to each region server?) or is there any best secondary index components? Thank

completebulkload Exception

Hi, There was a exception found when I use completebulkload. Is there anything wrong with my format in zoo.cfg? Any suggestions would be appreciated! hadoop jar /usr/lib/hbase/hbase-0.90.1-cdh3u0.jar completebulkload /tmp/output myTable my zoo.cfg in /hadoop/conf clientPort=2181 server.0=10.4

bulk load map/reduce sample code

Hi, I am planning to use bulk load to import my csv file into HBase0.90. Is there any bulk load map/reduce sample code? Thank you very much. Fleming Chiu(邱宏明) Ext: 707-2260 Be Veg, Go Green, Save the Planet! ---

Fw: SingleColumnValueFilter

Cool! Thanks you very much. I forgot to use regex | (or) new RegexStringComparator("^AA|^BB|^CC")) ; Fleming Chiu(邱宏明) Ext: 707-2260 Be Veg, Go Green, Save the Planet! - Forwarded by HMCHIUD（Fleming Chiu 邱宏明）/TWN on 2011/05/2

SingleColumnValueFilter

Hi there, Can I set multiple SingleColumnValueFilter for a qualifier like following sample codes? The scan result is nothing, so I think whether the filters can combine these filter with "OR" instead of " AND". Any ideas? //==

Re: Oracle schema to HBase

I didn't do anything about compression in HBase configure. So you mean I can keep oracle schema in hbase with a compression method, right? Fleming Chiu(邱宏明) Ext: 707-2260 Be Veg, Go Green, Save the Planet!

Oracle schema to HBase

Hi, I want to put a table of data from RDBM to HBase. Key is the same both in RDBMS and HBase, but I wonder how to put these columns data. All put in a cell with json format or keep it like RDBMS table's columns? Put in Json format, it will impact the ETL when a column's data changed, It needs to k

StarGate HTTP ERROR: 404

Hi there, Anything wrrong with my stargate server? Thanks HBase 20.2 Starting restServer 2010-10-11 14:05:22.365::INFO: Logging to STDERR via org.mortbay.log.StdErrLog 2010-10-11 14:05:22.430::INFO: jetty-6.1.14 2010-10-11 14:05:22.892::INFO: Started socketconnec...@0.0.0.0:60050 [d...@f12p4