Re: Contrib section (nee Re: A modest proposal for simplifying zookeeper :)

2009-02-26 Thread Anthony Urso
So does this mean no contrib section? On Thu, Feb 26, 2009 at 10:00 PM, Patrick Hunt wrote: > So far we've stayed with the process used by core as this minimizes the > amount of work we need to do re process/build/release, etc... we just copy > the process/build/release etc... used in core, we ge

Adding a server to a running ensemble?

2009-02-26 Thread Chad Harrington
We are investigating Ensemble and a key question came up: How does one add a server to a running ensemble of Zookeeper servers in a 24/7 environment? If I have a 3-server ensemble and traffic grows to the point where I need another 2 servers, how do I add them without shutting everything down and

Re: Contrib section (nee Re: A modest proposal for simplifying zookeeper :)

2009-02-26 Thread Patrick Hunt
So far we've stayed with the process used by core as this minimizes the amount of work we need to do re process/build/release, etc... we just copy the process/build/release etc... used in core, we get all that for free. I'm hesitant to diverge as this will increase the amount of work we need to

Contrib section (nee Re: A modest proposal for simplifying zookeeper :)

2009-02-26 Thread Anthony Urso
Speaking of the contrib section, what is the status of ZOOKEEPER-103? Is it ready to be reevaluated now that 3.0 is out? Cheers, Anthony On Fri, Jan 9, 2009 at 11:58 AM, Mahadev Konar wrote: > Hi Kevin, >  It would be great to have such high level interfaces. It could be > something that you cou

Re: Recommended session timeout

2009-02-26 Thread Joey Echeverria
I doubt we're swapping, The machine we used to test has 12 GB of RAM and little else active at the time. I think the main problem is the heap being too small, so the GC has to run for longer trying to track down objects to collect. On Thu, Feb 26, 2009 at 10:28 PM, Benjamin Reed wrote: > just a q

RE: Recommended session timeout

2009-02-26 Thread Benjamin Reed
just a quick sanity check. are you sure your memory is not overcommitted? in other words you aren't swapping. since the gc does a bunch of random memory accesses if you swap at all things will go very slow. ben From: Joey Echeverria [joe...@gmail.com] Sen

Re: Recommended session timeout

2009-02-26 Thread Patrick Hunt
That's very interesting results, a good job sleuthing. You might try the concurrent collector? http://java.sun.com/javase/technologies/hotspot/gc/gc_tuning_6.html#available_collectors.selecting specifically item 4 "-XX:+UseConcMarkSweepGC" I've never used this before myself but it's supposed t

Re: Recommended session timeout

2009-02-26 Thread Joey Echeverria
I've answered the questions you asked previously below, but I thought I would open with the actual culprit now that we found it. When I said loading data before, what I was talking about was sending data via Thrift to the machine that was getting disconnected from zookeeper. This turned out to be t

Re: Anyone using Zookeeper in AWS (Amazon Cloud)?

2009-02-26 Thread Mahadev Konar
Hi Greg, As for cross datacenters, we have tested zookeeper cross data centers and it works fine. The only thing is that you might have to tweak synclimit and tickTime to a little higher values for Zookeeper. http://hadoop.apache.org/zookeeper/docs/r3.1.0/zookeeperAdmin.html#sc_config uration pr

Anyone using Zookeeper in AWS (Amazon Cloud)?

2009-02-26 Thread bebble zap
We're thinking about using Zookeeper as our coordination service and also for doing group membership in the Amazon Cloud. Currently our applications are deployed in Amazon Cloud on multiple availability zones (i.e. data centers), so this means that ZK nodes will be talking across datacenters. I'm