Hello!

2014-11-02 Thread jackie
Hello!

how to design hbase schema?

2014-11-02 Thread jackie
Hi! I have data warehouse application(base on oracle database), i want to transfer it to hbase database ,how to design hbase tables especially 1:n or n:m relationship in oracle database ! Thank U very much! jackie

Re: how to design hbase schema?

2014-11-02 Thread Krishna Kalyan
Some Resources http://hbase.apache.org/book/schema.casestudies.html http://www.slideshare.net/cloudera/5-h-base-schemahbasecon2012 http://www.evanconkle.com/2011/11/hbase-tutorial-creating-table/ http://www.slideshare.net/hmisty/20090713-hbase-schema-design-case-studies On Sun, Nov 2, 2014 at

Re: how to design hbase schema?

2014-11-02 Thread Ted Yu
Please also consider phoenix.apache.org Cheers On Nov 2, 2014, at 5:43 AM, Krishna Kalyan krishnakaly...@gmail.com wrote: Some Resources http://hbase.apache.org/book/schema.casestudies.html http://www.slideshare.net/cloudera/5-h-base-schemahbasecon2012

Re:Re: how to design hbase schema?

2014-11-02 Thread jackie
Thank u very much! At 2014-11-02 21:49:49, Ted Yu yuzhih...@gmail.com wrote: Please also consider phoenix.apache.org Cheers On Nov 2, 2014, at 5:43 AM, Krishna Kalyan krishnakaly...@gmail.com wrote: Some Resources http://hbase.apache.org/book/schema.casestudies.html

Re: Hello!

2014-11-02 Thread Chandrashekhar Kotekar
Hello jackie.. looks like u have joined mailing list just now :D Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Sun, Nov 2, 2014 at 6:52 PM, jackie jackiehbaseu...@126.com wrote: Hello!

error in starting hbase

2014-11-02 Thread beeshma r
HI When i start hbase fallowing error is occurred .How to solve this? i haven't add any zokeeper path anywhere? Please suggest this. 2014-11-01 20:01:51,196 INFO [main] server.ZooKeeperServer: Server environment:java.io.tmpdir=/tmp 2014-11-01 20:01:51,196 INFO [main] server.ZooKeeperServer:

Re:error in starting hbase

2014-11-02 Thread jackie
please check the hbase conf and zookeeper! At 2014-11-02 22:41:02, beeshma r beeshm...@gmail.com wrote: HI When i start hbase fallowing error is occurred .How to solve this? i haven't add any zokeeper path anywhere? Please suggest this. 2014-11-01 20:01:51,196 INFO [main]

Re: Hello!

2014-11-02 Thread Ravindranath Akila
More like spam judging by the mail id. On Sunday, November 2, 2014, Chandrashekhar Kotekar shekhar.kote...@gmail.com wrote: Hello jackie.. looks like u have joined mailing list just now :D Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Sun, Nov 2, 2014 at 6:52 PM, jackie

Re: error in starting hbase

2014-11-02 Thread Ted Yu
Are you running hbase in standalone mode ? See http://hbase.apache.org/book.html#zookeeper bq. To toggle HBase management of ZooKeeper, use the HBASE_MANAGES_ZK variable in conf/hbase-env.sh. Cheers On Sun, Nov 2, 2014 at 6:41 AM, beeshma r beeshm...@gmail.com wrote: HI When i start hbase

Re: error in starting hbase

2014-11-02 Thread beeshma r
Hi Ted, Thanks for your reply. Yes i am running standalone mode After changing my zookeeper property its resolved .And now i have another two issues . 2014-11-02 07:06:32,948 DEBUG [main] master.HMaster: master/ubuntu.ubuntu-domain/127.0.1.1:0 HConnection server-to-server retries=350 2014-11-02

It is possible to indicate a specific key range into a specific node?

2014-11-02 Thread yonghu
Dear All, Suppose that I have a key range from 1 to 100 and want to store 1-50 in the first node and 51-100 in the second node. How can I do this in Hbase? regards! Yong

Re: It is possible to indicate a specific key range into a specific node?

2014-11-02 Thread Dima Spivak
Hi Yong, Check out http://hbase.apache.org/book/perf.writing.html to learn about pre-splitting regions at table creation time. Beyond this, HBase internally handles which RegionServers serve any particular region. All the best, Dima On Sun, Nov 2, 2014 at 11:32 AM, yonghu

Re: It is possible to indicate a specific key range into a specific node?

2014-11-02 Thread Dima Spivak
Oops, accidentally cut out my last sentence: If you do want to move a region manually, the simplest way to do this is by invoking move in the HBase shell. -Dima On Sun, Nov 2, 2014 at 11:51 AM, Dima Spivak dspi...@cloudera.com wrote: Hi Yong, Check out

No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
Hi, I'm migrating from CDH4 to CDH5 (hbase 0.98.6-cdh5.2.0) I had a unit test for mapper used to create HFile and bulk load later. I've bumped maven deps from cdh4 to cdh5 0.98.6-cdh5.2.0 Now I've started to get exception java.lang.IllegalStateException: No applicable class implementing

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Ted Yu
bq. PutFactory.createPut( Can you reveal how PutFactory creates the Put ? Thanks On Sun, Nov 2, 2014 at 1:02 PM, Serega Sheypak serega.shey...@gmail.com wrote: Hi, I'm migrating from CDH4 to CDH5 (hbase 0.98.6-cdh5.2.0) I had a unit test for mapper used to create HFile and bulk load later.

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
public static Put createPut(DynamicObjectSerDeItemRecommendation serde, ItemRecommendation item, String columnFamily){ Put put = new Put(Bytes.toBytes(Long.valueOf(item.getId(; put.add(Bytes.toBytes(columnFamily), Bytes.toBytes(item.getRank()), serde.serialize(item));

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
In the 0.94.x API, Put implemented Writable[1]. This meant that MR code, like yours, could use it as a Key or Value between Mapper and Reducer. In 0.96 and later APIs, Put no longer directly implements Writable[2]. Instead, HBase now includes a Hadoop Seriazliation implementation. Normally, this

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Ted Yu
Since your code uses mrunit which hbase 0.98 is not dependent on, have you considered asking this question on: mrunit-u...@incubator.apache.org Cheers On Sun, Nov 2, 2014 at 1:22 PM, Serega Sheypak serega.shey...@gmail.com wrote: public static Put

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
I use it to prepare HFile using my custom mapper emitting Put and HFileOutputFormat.configureIncrementalLoad(job, createHTable()) //connection to target table and then bulk load data to table using LoadIncrementalHFiles P.S. HFileOutputFormat is also deprecated... so many changes... (((

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
If you're calling HFileOutputFormat.configureIncrementalLoad, that should be setting up the Serialization for you. Can you look at the job configuration and see what's present for the key io.serializations? -Sean On Sun, Nov 2, 2014 at 3:53 PM, Serega Sheypak serega.shey...@gmail.com wrote: I

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 3:53 PM, Serega Sheypak serega.shey...@gmail.com wrote: P.S. HFileOutputFormat is also deprecated... so many changes... ((( Incidentally, you should consider switching to HFileOutputFormat2, since you rely on the version that has a Mapper outputting Put values instead

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
Sean, I've started to catch that serialization problem on unit-test level while using mrunit. I don't see any possibility to call HFileOutputFormat.configureIncrementalLoad before mrunit mocking stuff. I was workngi w/o any problem in 0.94 :) 2014-11-03 1:08 GMT+03:00 Sean Busbey

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
Cool, is it this stuff? http://hbase.apache.org/book/hfilev2.html 2014-11-03 1:10 GMT+03:00 Sean Busbey bus...@cloudera.com: On Sun, Nov 2, 2014 at 3:53 PM, Serega Sheypak serega.shey...@gmail.com wrote: P.S. HFileOutputFormat is also deprecated... so many changes... (((

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 4:11 PM, Serega Sheypak serega.shey...@gmail.com wrote: Sean, I've started to catch that serialization problem on unit-test level while using mrunit. I don't see any possibility to call HFileOutputFormat.configureIncrementalLoad before mrunit mocking stuff. I was

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 4:14 PM, Serega Sheypak serega.shey...@gmail.com wrote: Cool, is it this stuff? http://hbase.apache.org/book/hfilev2.html No, that's all details on the update to the backing HFile format that started in HBase 0.92. The change in output format is detailed here:

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Ted Yu
bq. context.write(hbaseKey, put); //Exception here I am not mrunit expert. But as long as you call the following method prior to the above method invocation, you should be able to proceed: conf.setStrings(io.serializations, conf.get(io.serializations),

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 5:09 PM, Ted Yu yuzhih...@gmail.com wrote: bq. context.write(hbaseKey, put); //Exception here I am not mrunit expert. But as long as you call the following method prior to the above method invocation, you should be able to proceed:

Re: Increasing write throughput..

2014-11-02 Thread Anoop John
You have ~280 regions per RS. And ur memstore size % is 40% and heap size 48GB This mean the heap size for memstore is 48 * 0.4 = 19.2GB ( I am just considering the upper water mark alone) If u have to consider all 280 regions each with 512 MB heap you need much more size of heap. And your

is there a HBase 0.98 hdfs directory structure introduction?

2014-11-02 Thread Liu, Ming (HPIT-GADSC)
Hi, all, I have a program to calculate the disk usage of hbase per table in hbase 0.94. I used to use the hadoop fs -du command against directory $roodir/table as the size a table uses, as described in HBase's ref guide: http://hbase.apache.org/book/trouble.namenode.html . However, when we

Re: is there a HBase 0.98 hdfs directory structure introduction?

2014-11-02 Thread Ted Yu
In 0.98, you would find your table under the following directory: $roodir/{namespace}/table If you don't specify namespace at table creation time, 'default' namespace would be used. Cheers On Sun, Nov 2, 2014 at 7:16 PM, Liu, Ming (HPIT-GADSC) ming.l...@hp.com wrote: Hi, all, I have a

Authenticate from SQL

2014-11-02 Thread Margusja
Hi I am looking solutions where users before using HBase rest will be authenticate from SQL (in example from Oracle). Is there any best practices or ready solutions for HBase? -- Best regards, Margus Roo skype: margusja phone: +372 51 48 780 web: http://margus.roo.ee