Re: move meta table to ZK

replication does not involve meta data. On Fri, Mar 18, 2011 at 12:32 PM, Ryan Rawson wrote: > Is it possible to search a list of z nodes? That is what we do now with > meta > in hbase. > > I used to be a fan, but I think self hosting all important meta data is the > best approach. It makes lots

Re: move meta table to ZK

When does ZK plan to adopt this extension? In general, I agree with Ryan that ZK is a good coordination layer, but the data (and associated meta-data should be self-hosted to simplify the consistency problem). On Thu, Mar 17, 2011 at 9:54 PM, jiangwen w wrote: > yes , it is possible, only enhan

Re: move meta table to ZK

yes , it is possible, only enhance zookeeper a little, and i have already implement it. On Fri, Mar 18, 2011 at 12:32 PM, Ryan Rawson wrote: > Is it possible to search a list of z nodes? That is what we do now with > meta > in hbase. > > I used to be a fan, but I think self hosting all important

Re: move meta table to ZK

Is it possible to search a list of z nodes? That is what we do now with meta in hbase. I used to be a fan, but I think self hosting all important meta data is the best approach. It makes lots of things easier, like replication, snapshots, etc. On Mar 17, 2011 9:27 PM, "jiangwen w" wrote: > how do

move meta table to ZK

how do you think about moving meta table to ZK, so no meta table are needed. if we do so, we need enhance ZK in the following way: 1. let children of ZNode in order. if we do so, we can benifit: 1. no need to treat meta table as a special way. this will simplify the code a lot 2. ZK is highly ava

Re: stargate doc

Yes. Thats is my understanding. Stargate became our REST offering. St.Ack On Thu, Mar 17, 2011 at 4:35 PM, Ted Yu wrote: > It becomes > http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/rest/package-summary.html? > > On Thu, Mar 17, 2011 at 4:34 PM, Ted Yu wrote: > >> Hi, >> What

Jenkins build is back to normal : HBase-TRUNK #1794

See

Build failed in Jenkins: hbase-0.90 #121

See Changes: [stack] HBASE-3595 get_counter broken in shell [nspiegelberg] HBASE-3665 tighten assertions for testBloomFilterSize -- [...truncated 2809 lines...] Tests run: 1, Failures: 0, Error

Re: stargate doc

It becomes http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/rest/package-summary.html? On Thu, Mar 17, 2011 at 4:34 PM, Ted Yu wrote: > Hi, > What's the equivalent for the following in hbase 0.90.x and beyond ? > > http://hbase.apache.org/docs/r0.20.5/api/org/apache/hadoop/hbase/

stargate doc

Hi, What's the equivalent for the following in hbase 0.90.x and beyond ? http://hbase.apache.org/docs/r0.20.5/api/org/apache/hadoop/hbase/stargate/package-summary.html I don't find the module in http://hbase.apache.org/docs/current/api/ Thanks

Re: Avro Util and ServerLoad

Yeah, it looks unused. I'd guess that it an incomplete attempt at revealing cluster load over avro; haven't dug in though... St.Ack On Thu, Mar 17, 2011 at 2:21 PM, Ted Yu wrote: > Hi, > I didn't find any reference to the following method in trunk: >  static public ARegionLoad hrlToARL(HServerLo

Build failed in Jenkins: HBase-TRUNK #1793

See Changes: [nspiegelberg] add HBASE-3665 to CHANGES.txt [nspiegelberg] HBASE-3665 tighten assertions for testBloomFilterSize [nspiegelberg] HBASE-3653 : Parallelize Server Requests on HBase Client ---

Re: trimming RegionLoad fields

I agree that it is useful information. Can we retrieve it from HRegion which is in HRegionServer.onlineRegions ? protected final Map onlineRegions = new HashMap(); Thanks On Thu, Mar 17, 2011 at 2:47 PM, Andrew Purtell wrote: > memstoreSizeMB is part of the output printed by the shell wh

Re: trimming RegionLoad fields

Without solid evidence of "we'll be saving X megabytes" I don't see a compelling reason to hacking that stuff out yet. We sort of need a better out-of-the-box monitoring system. One idea I had was to embed OpenTSDB inside the HMaster. This way OpenTSDB would store info about a HBase cluster back i

Re: trimming RegionLoad fields

memstoreSizeMB is part of the output printed by the shell when you do status 'detailed'. I use that. Isn't that information useful to others? - Andy --- On Thu, 3/17/11, Ryan Rawson wrote: > From: Ryan Rawson > Subject: Re: trimming RegionLoad fields > To: dev@hbase.apache.org > Cc: "Ted

Re: trimming RegionLoad fields

How much memory does profiling indicating these objects use? How much are you expecting to save? Saving 4-8 bytes even on a 10k region cluster is still only 80k of ram, not really significant. On Thu, Mar 17, 2011 at 2:32 PM, Ted Yu wrote: > Hi, > See email thread 'One of the regionserver abor

trimming RegionLoad fields

Hi, See email thread 'One of the regionserver aborted, then the master shut down itself' for background. I am evaluating various ways of trimming the memory footprint of RegionLoad because there would be so many regions in production cluster. Looking at field memstoreSizeMB of RegionLoad, I only f

Avro Util and ServerLoad

Hi, I didn't find any reference to the following method in trunk: static public ARegionLoad hrlToARL(HServerLoad.RegionLoad rl) throws IOException { Out of curiosity, can someone tell me who/how the above is used ? Thanks

Build failed in Jenkins: hbase-0.90 #120

See Changes: [todd] Some cleanup to CHANGES.txt -- [...truncated 2808 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.048 sec Running org.apache.hadoop.hbase.client.T

Jenkins build is back to normal : HBase-TRUNK #1792

See

Build failed in Jenkins: hbase-0.90 #119

See Changes: [todd] Fix 0.90.2 release date to Unreleased in CHANGES.txt [todd] HBASE-3659 Fix TestHLog to pass on newer versions of Hadoop -- [...truncated 2688 lines...] [INFO] -