Upgrade from Hbase 0.94.6 to 0.96 (From CDH45. - CDH 5.0)

2014-06-02 Thread yanivG
Hi, I am trying to upgrade from CDH4.5 (which contains Hbase 0.94.6) to CDH5.0 (which contains hbase 0.96). From Cloudera documentation I found that: Rolling upgrades from CDH 4 to CDH 5 are not possible because existing CDH 4 HBase clients cannot make requests to CDH 5 servers and CDH 5 HBase

Re: Upgrade from Hbase 0.94.6 to 0.96 (From CDH45. - CDH 5.0)

2014-06-02 Thread Pradeep Gollakota
Hortonworks has written a bridge tool to help with this. As far as I know, this will only work for replicating from a 0.94 cluster to a 0.96 cluster. Check out https://github.com/hortonworks/HBaseReplicationBridgeServer On Mon, Jun 2, 2014 at 7:35 AM, yanivG yaniv.yancov...@gmail.com wrote:

Re: [VOTE] The 3nd HBase 0.98.3 release candidate (RC2) is available, vote closing 6/7/2014

2014-06-02 Thread Stack
+1 Trying to follow new release policy sketch [1]: Downloaded src bundle. Hash is good. Checking signature I got this: unknown-10-87-5-x:hbase-0.98.3-hadoop2 stack$ gpg --verify hbase-0.98.3-src.tar.gz.asc hbase-0.98.3-src.tar.gz gpg: Signature made Sat May 31 23:05:47 2014 PDT using RSA key

hbase block-cache scan.setCaching(false) not being respected

2014-06-02 Thread Matt K
Hi all, We are running a number of Map/Reduce jobs on top of HBase. We are not using HBase for any of its realtime capabilities, only for batch-processing. So we aren't doing lookups, just scans. Each one of our jobs has *scan.setCaching(false)* to turn off block-caching, since each block will

Re: hbase block-cache scan.setCaching(false) not being respected

2014-06-02 Thread Bryan Beaudreault
The Block Cache is used for more than just the scanner caching. Additionally, *hfile.block.cache.size *is a server-side config, while scan.setCaching(false) is on an RPC-level. So regardless of your setCaching value the RegionServers will continue to allocate memory to the block cache. Check

Re: hbase block-cache scan.setCaching(false) not being respected

2014-06-02 Thread Ted Yu
Have you added the following when passing Scan to your job ? scan.setCacheBlocks(false); BTW image didn't go through. Consider putting image on third-party site. On Mon, Jun 2, 2014 at 12:55 PM, Matt K matvey1...@gmail.com wrote: Hi all, We are running a number of Map/Reduce jobs on top of

Re: [VOTE] The 3nd HBase 0.98.3 release candidate (RC2) is available, vote closing 6/7/2014

2014-06-02 Thread Andrew Purtell
Yes, some of our code signing keys need a keysigning party. On Mon, Jun 2, 2014 at 12:15 PM, Stack st...@duboce.net wrote: +1 Trying to follow new release policy sketch [1]: Downloaded src bundle. Hash is good. Checking signature I got this: unknown-10-87-5-x:hbase-0.98.3-hadoop2

HBase REST using ssl

2014-06-02 Thread Demai Ni
hi, folks, I am wondering how to use ssl with HBase REST, and look at http://wiki.apache.org/hadoop/Hbase/Stargate, and google a bit. but couldn't find examples or instructions. Can someone give me a couple pointers? thanks Demai

Re: HBase REST using ssl

2014-06-02 Thread Jimmy Xiang
Hi Demai, You need to set these configurations for your REST server: hbase.rest.ssl.enabled hbase.rest.ssl.keystore.store hbase.rest.ssl.keystore.password hbase.rest.ssl.keystore.keypassword Thanks, Jimmy On Mon, Jun 2, 2014 at 3:23 PM, Demai Ni nid...@gmail.com wrote: hi, folks, I am

Re: HBase REST using ssl

2014-06-02 Thread Demai Ni
Jimmy, Many thanks for the quick response. Any setting needed on client side? Demai on the run On Jun 2, 2014, at 3:40 PM, Jimmy Xiang jxi...@cloudera.com wrote: Hi Demai, You need to set these configurations for your REST server: hbase.rest.ssl.enabled hbase.rest.ssl.keystore.store

Re: hbase block-cache scan.setCaching(false) not being respected

2014-06-02 Thread Matt K
Hi, thanks for responses. Ted - when I said scan.setCaching, I meant scan.setCacheBlocks(false). That's what I get for not copying/pasting directly from code :) I added a link to the graphs here: https://drive.google.com/file/d/0B3ZQ0nMNMFxCOHZNZVFsWEhCOUU/edit?usp=sharing Bryan - I believe

Re: Re: CDH5 hbase client outofmemory

2014-06-02 Thread jingych
Hi, Anoop Nicolas! Sorry for reply you so late! I'm a newbie in the hadoop community. Where can i post the bug list? And now I found that the HTable#flushCommit method is the sync operation. So my solution is counting the rows, if the rows cached by client beyond the threadhold, i flush the

Re: Re: CDH5 hbase client outofmemory

2014-06-02 Thread Ted Yu
bq. Where can i post the bug list? You can find HBase JIRAs here: https://issues.apache.org/jira/browse/HBASE/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel

Re: IllegalArgumentException: Not a host:port

2014-06-02 Thread Amitabh Ranjan
Listas Discussões listas@... writes: you were right. it was a classpath issue. the hbase jar version on my client was not the same from my hbase instance. in the end I just had to put in my classpath hbase/lib dir and everything worked fine :) tks for your advise Arian Can you

Re: IllegalArgumentException: Not a host:port

2014-06-02 Thread Stack
On Mon, Jun 2, 2014 at 3:58 AM, Amitabh Ranjan ranamit...@gmail.com wrote: Listas Discussões listas@... writes: you were right. it was a classpath issue. the hbase jar version on my client was not the same from my hbase instance. in the end I just had to put in my classpath

HBase meetup at Hadoop Summit

2014-06-02 Thread Subash DSouza
If you are attending Hadoop Summit, Please drop by to check us out. It's this Thursday at 3:30 PM at the San Jose Convention Center, Room 230C http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/179081342/ We have a great selection of talks 3:35-3:55: Jonathan Hsieh Ryan Blue

Re: HBase 0.98 rpm

2014-06-02 Thread oc tsdb
Hi, To build rpm, we downloaded HBase 0.98.2 src from apache download link( http://mirror.sdunix.com/apache/hbase/hbase-0.98.2/hbase-0.98.2-src.tar.gz) and other files (including specs) from bigtop ( https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hbase ) But while