Re: Upgrading a coprocessor

2014-10-29 Thread Hayden Marchant
Thanks all for confirming what I thought was happening. I am considering implementing a pattern similar to Iain's in that I version that path of the cp, and disable/enable the table while upgrading the cp metadata. However, what are the operational considerations of disabling a table for a

Region split during mapreduce

2014-10-29 Thread Flavio Pompermaier
Hi to all, I was reading http://www.abcn.net/2014/07/spark-hbase-result-keyvalue-bytearray.html?m=1 and they say still using org.apache.hadoop.hbase.mapreduce.TableInputFormat is a big problem, your job will fail when one of HBase Region for target HBase table is splitting ! because the original

Rewrite Hbase Thrift2

2014-10-29 Thread Charlot W
Hi to all， (my hbase is of hdp2.1 from: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1-latest/bk_installing_manually_book/content/rpm-chap1.html ) i planed to rewrite the thrift2 of hbase, so i download the src from: http://mirrors.advancedhosters.com/apache/hbase/hbase-0.99.1/ i used mvn

Reducing the logging info on Eclipse console

2014-10-29 Thread Sznajder ForMailingList
Hi, When running Hbase client from my eclipse IDE, I get a very large amount of log info on the console. For example: [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT [main] INFO org.apache.zookeeper.ZooKeeper - Client

Re: Hbase unstable, master and regionservers crashes every night at ~ 00:07 UTC

2014-10-29 Thread Ron van der Vegt
Thanks all! We found the issue. Every night our server will create a snapshot backup. This was causing the problems. Thanks again :) On wo, okt 29, 2014 at 6:25 , lars hofhansl la...@apache.org wrote: We had an issue similar to this for a while. Every Sunday between 1am and 6am we'd

Re: Reducing the logging info on Eclipse console

2014-10-29 Thread Dima Spivak
Benjamin, You can reduce the log level with the log4j properties file under hbase-server/src/main/resources. All the best, Dima On Wednesday, October 29, 2014, Sznajder ForMailingList bs4mailingl...@gmail.com wrote: Hi, When running Hbase client from my eclipse IDE, I get a very large

Re: Hbase unstable, master and regionservers crashes every night at ~ 00:07 UTC

2014-10-29 Thread Ted Yu
Is this hbase snapshot or some other snapshot ? Thanks On Oct 29, 2014, at 5:05 AM, Ron van der Vegt ron.van.der.v...@openindex.io wrote: Thanks all! We found the issue. Every night our server will create a snapshot backup. This was causing the problems. Thanks again :) On wo, okt 29,

Re: Hbase unstable, master and regionservers crashes every night at ~ 00:07 UTC

2014-10-29 Thread Ron van der Vegt
System backup snapshot :) On wo, okt 29, 2014 at 1:38 , Ted Yu yuzhih...@gmail.com wrote: Is this hbase snapshot or some other snapshot ? Thanks On Oct 29, 2014, at 5:05 AM, Ron van der Vegt ron.van.der.v...@openindex.io wrote: Thanks all! We found the issue. Every night our server will

Re: Reducing the logging info on Eclipse console

2014-10-29 Thread Ted Yu
There is also hbase-server/src/test/resources/log4j.properties using which you can control the logging level of test utility classes. Cheers On Wed, Oct 29, 2014 at 5:30 AM, Dima Spivak dspi...@cloudera.com wrote: Benjamin, You can reduce the log level with the log4j properties file under

Re: Upgrading a coprocessor

2014-10-29 Thread Ted Yu
Rolling restart of servers may have bigger impact on operations - server hosting hbase:meta would be involved which has more impact compared to disabling / enabling user table. You should give ample timeout to your client. The following is an incomplete list of configs (you can find their

Re: Snapshot failure

2014-10-29 Thread Ian Brooks
Hi, I applied the suggested timeout changes and it lasted longer before it started failing, but its now just throwing the same errors on procedure.Subprocedure: Subprocedure pool is full! Looking through the logs, it looks like the nodes may not correctly updating they completion state after

Re: Upgrading a coprocessor

2014-10-29 Thread Michael Segel
Well you could redesign your cp. There is a way to work around the issue by creating a cp that's really a framework and then manage the cps in a different jvm(s) using messaging between the two. So if you want to reload or restart your cp, you can do it outside of the RS. Its a bit more

Re: Upgrading a coprocessor

2014-10-29 Thread Pradeep Gollakota
At Lithium, we power Klout using HBase. We load Klout scores for about 500 million users into HBase every night. When a load is happening, we noticed that the performance of klout.com was severely degraded. We also see severely degraded performance when performing operations like compactions. In

which tool can i choose to bulid the Hbase table ?like the use the powerdesign tool build the oracle database tables!

2014-10-29 Thread jackie
Hi I'm using the Hbase 0.96.2(base on hadoop 2.2.0), which tool can i choose to build the Hbase table,like the use the powerdesign tool build the oracle database tables! Thank u very much! jackie!

Re: which tool can i choose to bulid the Hbase table ?like the use the powerdesign tool build the oracle database tables!

2014-10-29 Thread Ted Yu
Were you referring to PowerDesigner ? If so, there is no such tool for HBase as fas as I know. Cheers On Wed, Oct 29, 2014 at 7:07 PM, jackie jackiehbaseu...@126.com wrote: Hi I'm using the Hbase 0.96.2(base on hadoop 2.2.0), which tool can i choose to build the Hbase table,like the

Re:Re: which tool can i choose to bulid the Hbase table ?like the use the powerdesign tool build the oracle database tables!

2014-10-29 Thread jackie
Thank u very much ! can i use the hue tool build the hbase tables? At 2014-10-30 10:19:12, Ted Yu yuzhih...@gmail.com wrote: Were you referring to PowerDesigner ? If so, there is no such tool for HBase as fas as I know. Cheers On Wed, Oct 29, 2014 at 7:07 PM, jackie