Re: Parent nodes & multi-step transactions

2010-08-24 Thread Gustavo Niemeyer
> Every functionality added to ZK will make it harder to maintain. The use case Definitely, but it's hard to debate about features at that level. If we delete the whole code base, we have nothing to maintain, so given this r. > recursiveDelete, recursiveCreate: If you want to create /A/C/D-1 jus

Closing a client fails

2010-08-24 Thread Maarten Koopmans
Hi, I am using the Zookeeper Java client class from Scala for some synchronous communication (no watches, no async). Fairly simple. Every now and then my application needs to use ZK and then creates a client, does its thing, and closes the client. What happens though is that I keep having two

Re: Non Hadoop scheduling frameworks

2010-08-24 Thread Thomas Koch
Todd Nine: > [...] > UC1: Synchronized Jobs > 1. A job is fired across all nodes > 2. The nodes wait until the barrier is entered by all participants > 3. The nodes process the data and leave > 4. On all nodes leaving the barrier, the Leader node marks the job as > complete. > > UC2: Multiple Jobs

Re: Parent nodes & multi-step transactions

2010-08-24 Thread Thomas Koch
Gustavo Niemeyer: > Hi Thomas, > > > I have a very strong feeling against more complex operations in the ZK > > server. > > Can you please describe a little better what that feeling is about? Every functionality added to ZK will make it harder to maintain. The use case you're asking for is IMHO

Re: Parent nodes & multi-step transactions

2010-08-24 Thread Gustavo Niemeyer
Hi Thomas, > I have a very strong feeling against more complex operations in the ZK server. Can you please describe a little better what that feeling is about? > These are things that should be provided by a ZK client helper library. The Which things should be provided by client helper librarie

Re: Parent nodes & multi-step transactions

2010-08-24 Thread Gustavo Niemeyer
> My own opinion is that lots of these structure sorts of problems are solved > by putting the structure into a single znode.  Atomic creation and update > come for free at that point and we can even make the node ephemeral which we > can't really do if there are children. Sure, it makes sense tha

Re: Parent nodes & multi-step transactions

2010-08-24 Thread Thomas Koch
Hi Gustavo, I have a very strong feeling against more complex operations in the ZK server. These are things that should be provided by a ZK client helper library. The zkclient library from 101tec for example gives you exactly that. If you're planning to write another layer on top of the ZK API p