Re: a short introduction of simplehbase(hbase ORM)

2014-01-06 Thread Rural Hunter
+1 于 2014/1/6 12:24, Ted Yu 写道: I think you should point to Apache release - if there is no special feature from adh3u2.2 that your project depends on.

how to delete all input characters in hbase shell?

2014-01-06 Thread Li Li
hi all, In bash shell, we can use ctrl+c to cancel current command. But in hbase shell, ctrl+c will terminate the hbase shell.

Fine tunning

2014-01-06 Thread Ranjini Rathinam
Hi, I have a input File of 16 fields in it. Using Mapreduce code need to load the hbase tables. The first eight has to go into one table in hbase and last eight has to got to another hbase table. The data is being loaded into hbase table in 0.11 sec , but if any lookup is being added in the map

Re: Hbase Performance Issue

2014-01-06 Thread Nicolas Liochon
It's very strange that you don't see a perf improvement when you increase the number of nodes. Nothing in what you've done change the performances at the end? You may want to check: - the number of regions for this table. Are all the region server busy? Do you have some split on the table? - How

Re: hbase-orm

2014-01-06 Thread John Hancock
Zhang_xzhi, In case you did not know, there is also at least one ORM for HBase project already in existence that you may be interested in. https://code.google.com/p/kundera/ https://github.com/impetus-opensource/Kundera/wiki/HBase-Specific-Features If you have questions about Kundera please d

Re:Re: a short introduction of simplehbase(hbase ORM)

2014-01-06 Thread zhang_xzhi
Sorry for that, I forgot change it. Now pom is modified. xinzhi.zhang 在 2014-01-06 16:13:56,"Rural Hunter [via Apache HBase]" 写道: +1 于 2014/1/6 12:24, Ted Yu 写道: > I think you should point to Apache release - if there is no special feature > from adh3u2.2 that your project depends on. > I

Re: how to delete all input characters in hbase shell?

2014-01-06 Thread Jean-Marc Spaggiari
Hi Li Li, Ctrl-C in shell doesn't clear the line, it kills the current command. Like in HBase shell. In bash if you want to clear the last word you will use Ctrl-w. If you want to clear the line you will use Ctrl-u. With HBase Shell, it's exactly the same thing. HTH. JM 2014/1/6 Li Li > hi

Re: how to delete all input characters in hbase shell?

2014-01-06 Thread Li Li
thanks On Mon, Jan 6, 2014 at 8:45 PM, Jean-Marc Spaggiari wrote: > Hi Li Li, > > Ctrl-C in shell doesn't clear the line, it kills the current command. Like > in HBase shell. > > In bash if you want to clear the last word you will use Ctrl-w. If you want > to clear the line you will use Ctrl-u. W

Custom filter comparator

2014-01-06 Thread Kristopher Kane
I have two qualifiers that contain latitude and longitude longs. I wish to write a filter comparator that will look at these two qualifiers and determine if they exist within a supplied bounding box. - This will compare four longs passed in as min/max values against what is found in the qualifiers

Re: Custom filter comparator

2014-01-06 Thread Haosong Huang
I think a more efficient way is to use geohash as rowkey. And scan the hbase with start row and end row. May be this examplecould give you some idea. On Tue, Jan 7, 2014 at 12:12 AM, Kristopher Kane wrote: > I have two qualifiers that contain latitude and lo

Re: Custom filter comparator

2014-01-06 Thread Ted Yu
Kris: You're looking at HBase 0.96, right ? What described is the standard way of serializing comparator using protobuf. This is to facilitate your expanding what may be included in the comparison in the future. Cheers On Mon, Jan 6, 2014 at 8:12 AM, Kristopher Kane wrote: > I have two qualifi

Re: Custom filter comparator

2014-01-06 Thread Kristopher Kane
> examplecould give you some idea. > > This is it. I didn't realize all that Nick had done on the GIS side. Thanks, -Kris

Re: Fine tunning

2014-01-06 Thread lars hofhansl
Hi Ranjini, can you tell more about the lookup? A lookup to another HBase table? For 13k records you would not need the complexity of HBase. -- Lars From: Ranjini Rathinam To: user@hbase.apache.org Sent: Monday, January 6, 2014 1:23 AM Subject: Fine tunning

Re: Hbase Performance Issue

2014-01-06 Thread Doug Meil
In addition to what everybody else said, look what *where* the regions are for the target table. There may be 5 regions (for example), but look to see if they are all on the same RS. On 1/6/14 5:45 AM, "Nicolas Liochon" wrote: >It's very strange that you don't see a perf improvement when y

Re: Hbase Performance Issue

2014-01-06 Thread Mike Axiak
I suggest you look at hannibal [1] to look at the distribution of the data on your cluster: 1: https://github.com/sentric/hannibal On Mon, Jan 6, 2014 at 2:14 PM, Doug Meil wrote: > > In addition to what everybody else said, look what *where* the regions are > for the target table. There may b

hbase 0.94.x and hadoop 2.2

2014-01-06 Thread Kim Chew
Hello all, Does hbase 0.94.x support hadoop 2.2? Because I got this exception when trying to connect to a table, Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.net.NetUtils.getInputStream(Ljava/net/Socket;)Ljava/io/InputStream; at org.apache.hadoop.hbase.ipc.HBaseC

Re: hbase 0.94.x and hadoop 2.2

2014-01-06 Thread Ted Yu
By default, 2.0.0-alpha is in effect for hadoop 2.0 profile in 0.94 I used the following command and it builds : mvn -Dhadoop.profile=2.0 clean package -DskipTests Here is the diff I used to compile against hadoop 2.2 : Index: pom.xml

Re: how to delete all input characters in hbase shell?

2014-01-06 Thread Tao Xiao
Besides, if you want to modify a part of what you have entered, you can go back using left arrow key on the keyboard and delete whatever characters using the forward delete key. After deleting these characters you can input whatever characters you want. 2014/1/6 Li Li > thanks > > On Mon, Jan 6

[HbaseInAction]twitbase-async build fail

2014-01-06 Thread Li Li
hi all, I am trying to build twitbase-async(https://github.com/hbaseinaction/twitbase-async) but failed. it's the source code of the book "HBase in Action". I can't find the authors' emails, so I post it here. the error message is : [ERROR] Failed to execute goal on project twitbase-async:

Facing problem while using MultiTableOutputFormat

2014-01-06 Thread AnilKumar B
Hi, In my MR job, I need to write output into multiple tables, So I am using MultiTableOutputFormat as below. But I am getting TableNotFoundException. I am attaching code snippet below, Is this the correct way to use MultiTableOutputFormat ? Job class: public int run(String[] args) throws

Re: Facing problem while using MultiTableOutputFormat

2014-01-06 Thread Ted Yu
System.out.println( " Running with on tables "+args[1]+ " and "+args[2]+" with zk "+args[3]); What was the output from the above ? I would expect a call similar to the following in your run() method - this comes from TestTableMapReduce.java: TableMapReduceUtil.initTableReducerJob(

Re: Facing problem while using MultiTableOutputFormat

2014-01-06 Thread AnilKumar B
Hi Ted, System.out.println( " Running with on tables "+args[1]+ " and "+args[2]+" with zk "+args[3]); What was the output from the above ? >> Running with on tables ci_history and ci_lookup with zk 10.9.208.71 Tables are exist on hbase: hbase(main):001:0> list TABLE ci_history ci_lookup

Re: Facing problem while using MultiTableOutputFormat

2014-01-06 Thread AnilKumar B
Hi Ted, It seems some issue in my code itself, will retry and update you. Thanks, B Anil Kumar. Thanks & Regards, B Anil Kumar. On Tue, Jan 7, 2014 at 9:35 AM, AnilKumar B wrote: > Hi Ted, > > System.out.println( " Running with on tables "+args[1]+ " and "+args[2]+" > with zk "+args[3]); >

Re: Facing problem while using MultiTableOutputFormat

2014-01-06 Thread AnilKumar B
Hi Ted, I modified the Job class as below. Then it's working. Job class: public int run(String[] args) throws Exception { System.out.println( " Running with on tables "+args[1]+ " and "+args[2]+" with zk "+args[3]); Configuration hbaseConf = HBaseConfiguration.create(getConf()); // hbaseCo

Stargate - feeding numerics as byte arrays

2014-01-06 Thread Prashanth Gedde
I know that Stargate expects the values to be inserted into a HBase table to be base64 encoded. How do I base64 encode numerical values like integer and floats before forming the JSON payload for HTTP PUT? I expect the numerics to be written as byte arrays. Thanks Prashanth

Re: Stargate - feeding numerics as byte arrays

2014-01-06 Thread Bharath Vissapragada
Not sure if I got you right. Is this [1] what you are looking for? or this [2] ? [1] http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/util/Bytes.html#toBytes(int) [2] http://commons.apache.org/proper/commons-codec/apidocs/org/apache/commons/codec/binary/Base64.html#encodeBase64(byte[]) O

hbase read performance tuning failed

2014-01-06 Thread LEI Xiaofeng
Hi, I am running hbase-0.94.6-cdh4.5.0 and set up a cluster of 5 nodes. The random read performance is ok, but the scan performance is poor. I tried to increase "hbase.client.scanner.caching" to 100 to promote the scan performance but it made no difference. And when I tried to make smaller block

Re: [HbaseInAction]twitbase-async build fail

2014-01-06 Thread Nick Dimiduk
Hi Li, Could be some of the maven dependencies have suffered bit-rot. I'll have a look and make updates as appropriate. Thanks for your interest, Nick On Monday, January 6, 2014, Li Li wrote: > hi all, >I am trying to build > twitbase-async(https://github.com/hbaseinaction/twitbase-async) b

Re: [HbaseInAction]twitbase-async build fail

2014-01-06 Thread Li Li
I modify the pom.xml and use org.hbase asynchbase 1.3.2 it works. On Tue, Jan 7, 2014 at 3:39 PM, Nick Dimiduk wrote: > Hi Li, > > Could be some of the maven dependencies have suffered bit-rot. I'll have a > look and make updates as appropriate. > > Thanks for your in