[jira] Commented: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12930983#action_12930983
 ] 

Andrei Savu commented on ZOOKEEPER-780:
---

I will create a new test class for testing {{ZooKeeperMain}}. There are no 
previous tests for this class. 

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch, 
> ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (ZOOKEEPER-815) fill in "TBD"s in overview doc

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu reassigned ZOOKEEPER-815:
-

Assignee: (was: Andrei Savu)

> fill in "TBD"s in overview doc
> --
>
> Key: ZOOKEEPER-815
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-815
> Project: Zookeeper
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.3.1
>Reporter: Patrick Hunt
>Priority: Minor
> Fix For: 3.3.2, 3.4.0
>
>
> Funny: "Ephemeral nodes are useful when you want to implement [tbd]." there 
> are a few others in that doc that are should really be fixed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-740) zkpython leading to segfault on zookeeper

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923008#action_12923008
 ] 

Andrei Savu commented on ZOOKEEPER-740:
---

It seems like this issue is fixed on the trunk by patch ZOOKEEPER-888 but 
unfortunately the 3.3 branch still gives a segfault. I've tested using the code 
sample provided by Mike Solomon. 

> zkpython leading to segfault on zookeeper
> -
>
> Key: ZOOKEEPER-740
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-740
> Project: Zookeeper
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Federico
>Assignee: Henry Robinson
>Priority: Critical
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-740.patch
>
>
> The program that we are implementing uses the python binding for zookeeper 
> but sometimes it crash with segfault; here is the bt from gdb:
> Program received signal SIGSEGV, Segmentation fault.
> [Switching to Thread 0xad244b70 (LWP 28216)]
> 0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
> at ../Objects/abstract.c:2488
> 2488../Objects/abstract.c: No such file or directory.
> in ../Objects/abstract.c
> (gdb) bt
> #0  0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
> at ../Objects/abstract.c:2488
> #1  0x080d6ef2 in PyEval_CallObjectWithKeywords (func=0x862fab0,
> arg=0x8837194, kw=0x0) at ../Python/ceval.c:3575
> #2  0x080612a0 in PyObject_CallObject (o=0x862fab0, a=0x8837194)
> at ../Objects/abstract.c:2480
> #3  0x0047af42 in watcher_dispatch (zzh=0x86174e0, type=-1, state=1,
> path=0x86337c8 "", context=0x8588660) at src/c/zookeeper.c:314
> #4  0x00496559 in do_foreach_watcher (zh=0x86174e0, type=-1, state=1,
> path=0x86337c8 "", list=0xa5354140) at src/zk_hashtable.c:275
> #5  deliverWatchers (zh=0x86174e0, type=-1, state=1, path=0x86337c8 "",
> list=0xa5354140) at src/zk_hashtable.c:317
> #6  0x0048ae3c in process_completions (zh=0x86174e0) at src/zookeeper.c:1766
> #7  0x0049706b in do_completion (v=0x86174e0) at src/mt_adaptor.c:333
> #8  0x0013380e in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
> #9  0x002578de in clone () from /lib/tls/i686/cmov/libc.so.6

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-670) zkpython leading to segfault on zookeeper server restart

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923002#action_12923002
 ] 

Andrei Savu commented on ZOOKEEPER-670:
---

It seems like this is no longer an issue on the trunk (fixed by ZOOKEEPER-888). 
I've run {{zk.py}} against the latest version and I see no segfault but 
unfortunately on the 3.3 branch it still crashes. 

> zkpython leading to segfault on zookeeper server restart
> 
>
> Key: ZOOKEEPER-670
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-670
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib-bindings
>Affects Versions: 3.2.1, 3.2.2
> Environment: CentOS w/ Python 2.4
>Reporter: Lei Zhang
>Assignee: Henry Robinson
>Priority: Critical
> Fix For: 3.4.0
>
> Attachments: voyager.patch, zk.py
>
>
> Zookeeper client using zkpython segfaults on zookeeper server restart. It is 
> reliably reproducible using the attached script zk.py.
> I'm able to stop segfault using the attached patch voyager.patch, but 
> zkpython seems to have deeper issue on its use of watcher_dispatch - on 
> zookeeper server restart, I see up to 6 invocation of watcher_dispatch while 
> my script is simply sleeping in the main thread. This can't be right.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (ZOOKEEPER-815) fill in "TBD"s in overview doc

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu reassigned ZOOKEEPER-815:
-

Assignee: Andrei Savu

> fill in "TBD"s in overview doc
> --
>
> Key: ZOOKEEPER-815
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-815
> Project: Zookeeper
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.3.1
>Reporter: Patrick Hunt
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.3.2, 3.4.0
>
>
> Funny: "Ephemeral nodes are useful when you want to implement [tbd]." there 
> are a few others in that doc that are should really be fixed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-883) Idle cluster increasingly consumes CPU resources

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916588#action_12916588
 ] 

Andrei Savu commented on ZOOKEEPER-883:
---

The trunk contains a monitoring script (src/contrib/monitoring) useful for 
Nagios, Ganglia and  Cacti. For best results you need a version of ZooKeeper 
that has the 'mntr' 4letter word (see ZOOKEEPER-744) but it also works with 
3.3.x.

> Idle cluster increasingly consumes CPU resources
> 
>
> Key: ZOOKEEPER-883
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-883
> Project: Zookeeper
>  Issue Type: Bug
>  Components: server
>Affects Versions: 3.3.1
>Reporter: Lars George
> Attachments: Archive.zip
>
>
> Monitoring the ZooKeeper nodes by polling the various ports using Nagios' 
> open port checks seems to cause a substantial raise of CPU being used by the 
> ZooKeeper daemons. Over the course of a week an idle cluster grew from a 
> baseline 2% to >10% CPU usage. Attached is a stack dump and logs showing the 
> occupied threads. At the end the daemon starts failing on "too many open 
> files" errors as all handles are used up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: [jira] Commented: (ZOOKEEPER-883) Idle cluster increasingly consumes CPU resources

[Andrei Savu]

The trunk contains some monitoring scripts (src/contrib/monitoring)
useful for Nagios, Ganglia and  Cacti.

For best results you need a version of ZooKeeper that contains a new
monitoring 4letter word (see ZOOKEEPER-744) but it also works with
3.3.x.

Let me know if the install instructions are confusing.

On Thu, Sep 30, 2010 at 8:09 PM, Lars George (JIRA)  wrote:
>
>    [ 
> https://issues.apache.org/jira/browse/ZOOKEEPER-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916561#action_12916561
>  ]
>
> Lars George commented on ZOOKEEPER-883:
> ---
>
> Yes, did request that and will update here as I get details.
>
>> Idle cluster increasingly consumes CPU resources
>> 
>>
>>                 Key: ZOOKEEPER-883
>>                 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-883
>>             Project: Zookeeper
>>          Issue Type: Bug
>>          Components: server
>>    Affects Versions: 3.3.1
>>            Reporter: Lars George
>>         Attachments: Archive.zip
>>
>>
>> Monitoring the ZooKeeper nodes by polling the various ports using Nagios' 
>> open port checks seems to cause a substantial raise of CPU being used by the 
>> ZooKeeper daemons. Over the course of a week an idle cluster grew from a 
>> baseline 2% to >10% CPU usage. Attached is a stack dump and logs showing the 
>> occupied threads. At the end the daemon starts failing on "too many open 
>> files" errors as all handles are used up.
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>



-- 
Andrei Savu -- http://www.andreisavu.ro/

[jira] Updated: (ZOOKEEPER-740) zkpython leading to segfault on zookeeper

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-740:
--

Status: Patch Available  (was: Reopened)

> zkpython leading to segfault on zookeeper
> -
>
> Key: ZOOKEEPER-740
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-740
> Project: Zookeeper
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Federico
>Assignee: Henry Robinson
>Priority: Critical
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-740.patch
>
>
> The program that we are implementing uses the python binding for zookeeper 
> but sometimes it crash with segfault; here is the bt from gdb:
> Program received signal SIGSEGV, Segmentation fault.
> [Switching to Thread 0xad244b70 (LWP 28216)]
> 0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
> at ../Objects/abstract.c:2488
> 2488../Objects/abstract.c: No such file or directory.
> in ../Objects/abstract.c
> (gdb) bt
> #0  0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
> at ../Objects/abstract.c:2488
> #1  0x080d6ef2 in PyEval_CallObjectWithKeywords (func=0x862fab0,
> arg=0x8837194, kw=0x0) at ../Python/ceval.c:3575
> #2  0x080612a0 in PyObject_CallObject (o=0x862fab0, a=0x8837194)
> at ../Objects/abstract.c:2480
> #3  0x0047af42 in watcher_dispatch (zzh=0x86174e0, type=-1, state=1,
> path=0x86337c8 "", context=0x8588660) at src/c/zookeeper.c:314
> #4  0x00496559 in do_foreach_watcher (zh=0x86174e0, type=-1, state=1,
> path=0x86337c8 "", list=0xa5354140) at src/zk_hashtable.c:275
> #5  deliverWatchers (zh=0x86174e0, type=-1, state=1, path=0x86337c8 "",
> list=0xa5354140) at src/zk_hashtable.c:317
> #6  0x0048ae3c in process_completions (zh=0x86174e0) at src/zookeeper.c:1766
> #7  0x0049706b in do_completion (v=0x86174e0) at src/mt_adaptor.c:333
> #8  0x0013380e in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
> #9  0x002578de in clone () from /lib/tls/i686/cmov/libc.so.6

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-740) zkpython leading to segfault on zookeeper

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-740:
--

Attachment: ZOOKEEPER-740.patch

I've created a patch as Mike suggested. I've been able to reproduce the issue 
and the change seems to fix it.  I don't know if it prevent watchers from 
eventually being correctly freed. I've also run all the tests and everything 
seems to work fine. 

> zkpython leading to segfault on zookeeper
> -
>
> Key: ZOOKEEPER-740
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-740
> Project: Zookeeper
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Federico
>Assignee: Henry Robinson
>Priority: Critical
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-740.patch
>
>
> The program that we are implementing uses the python binding for zookeeper 
> but sometimes it crash with segfault; here is the bt from gdb:
> Program received signal SIGSEGV, Segmentation fault.
> [Switching to Thread 0xad244b70 (LWP 28216)]
> 0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
> at ../Objects/abstract.c:2488
> 2488../Objects/abstract.c: No such file or directory.
> in ../Objects/abstract.c
> (gdb) bt
> #0  0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
> at ../Objects/abstract.c:2488
> #1  0x080d6ef2 in PyEval_CallObjectWithKeywords (func=0x862fab0,
> arg=0x8837194, kw=0x0) at ../Python/ceval.c:3575
> #2  0x080612a0 in PyObject_CallObject (o=0x862fab0, a=0x8837194)
> at ../Objects/abstract.c:2480
> #3  0x0047af42 in watcher_dispatch (zzh=0x86174e0, type=-1, state=1,
> path=0x86337c8 "", context=0x8588660) at src/c/zookeeper.c:314
> #4  0x00496559 in do_foreach_watcher (zh=0x86174e0, type=-1, state=1,
> path=0x86337c8 "", list=0xa5354140) at src/zk_hashtable.c:275
> #5  deliverWatchers (zh=0x86174e0, type=-1, state=1, path=0x86337c8 "",
> list=0xa5354140) at src/zk_hashtable.c:317
> #6  0x0048ae3c in process_completions (zh=0x86174e0) at src/zookeeper.c:1766
> #7  0x0049706b in do_completion (v=0x86174e0) at src/mt_adaptor.c:333
> #8  0x0013380e in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
> #9  0x002578de in clone () from /lib/tls/i686/cmov/libc.so.6

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (ZOOKEEPER-546) add "diskless" ensemble support

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu resolved ZOOKEEPER-546.
---

Resolution: Duplicate

Closing as a duplicate of ZOOKEEPER-866 (already has a patch attached). 

> add "diskless" ensemble support
> ---
>
> Key: ZOOKEEPER-546
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-546
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: server
>Reporter: Patrick Hunt
> Fix For: 3.4.0
>
>
> In some cases there is no need to have the ZK data persisted to disk. For 
> example if all you are doing is group membership and leadership
> election the data is totally ephemeral, storing on disk is unnecessary. We've 
> also seen cases where any non-ephemeral data can be
> easily recovered (say configuration data that's generated/read and loaded 
> into zk) and there is less need to worry about recovery of the
> data in the case of catastrophic failure (meaning _all_ replicas are lost, 
> remember, recovery is automatic if 2n+1 servers and <= n servers
> fail, even if > n fail manual recovery is still possible as long as at least 
> 1 replica, or replica backup can be recovered)
> In these cases it makes sense to have a "diskless" zookeeper ensemble. The 
> result should be improved write performance
> an less moving parts (no disk to fail!), simplifiying ops in cases where this 
> can be applied.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-858) Zookeeper appears as QuorumPeerMain in jps output, which is not very user-friendly

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904587#action_12904587
 ] 

Andrei Savu commented on ZOOKEEPER-858:
---

{{jps -l}} looks user-friendly enough for me: 
\\ \\
{noformat}
9355 org.apache.zookeeper.server.quorum.QuorumPeerMain
9472 sun.tools.jps.Jps
9354 org.apache.zookeeper.server.quorum.QuorumPeerMain
9358 org.apache.zookeeper.server.quorum.QuorumPeerMain
9357 org.apache.zookeeper.server.quorum.QuorumPeerMain
9356 org.apache.zookeeper.server.quorum.QuorumPeerMain
{noformat}

Renaming {{QuorumPeerMain}} to something like {{ZooKeeperQuorumPeerMain}} 
sounds like too much. 



> Zookeeper appears as QuorumPeerMain in jps output, which is not very 
> user-friendly
> --
>
> Key: ZOOKEEPER-858
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-858
> Project: Zookeeper
>  Issue Type: Improvement
>Reporter: Jeff Hammerbacher
>
> As noted by Jordan Sissel on Twitter: 
> http://twitter.com/jordansissel/status/22570450969

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904571#action_12904571
 ] 

Andrei Savu commented on ZOOKEEPER-853:
---

Thanks Henry. 

> Make zookeeper.is_unrecoverable return True or False and not an integer
> ---
>
> Key: ZOOKEEPER-853
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-853.patch, ZOOKEEPER-853.patch
>
>
> This is a patch that fixes a TODO from the python zookeeper extension, it 
> makes {{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an 
> integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-853:
--

Attachment: ZOOKEEPER-853.patch

Fixed patch to do proper reference counting when returning boolean values. 

> Make zookeeper.is_unrecoverable return True or False and not an integer
> ---
>
> Key: ZOOKEEPER-853
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-853.patch, ZOOKEEPER-853.patch
>
>
> This is a patch that fixes a TODO from the python zookeeper extension, it 
> makes {{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an 
> integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-853:
--

Status: Patch Available  (was: Open)

> Make zookeeper.is_unrecoverable return True or False and not an integer
> ---
>
> Key: ZOOKEEPER-853
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-853.patch, ZOOKEEPER-853.patch
>
>
> This is a patch that fixes a TODO from the python zookeeper extension, it 
> makes {{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an 
> integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-853:
--

Status: Open  (was: Patch Available)

> Make zookeeper.is_unrecoverable return True or False and not an integer
> ---
>
> Key: ZOOKEEPER-853
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-853.patch
>
>
> This is a patch that fixes a TODO from the python zookeeper extension, it 
> makes {{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an 
> integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-853:
--

Status: Patch Available  (was: Open)

> Make zookeeper.is_unrecoverable return True or False and not an integer
> ---
>
> Key: ZOOKEEPER-853
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-853.patch
>
>
> This is a patch that fixes a TODO from the python zookeeper extension, it 
> makes {{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an 
> integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-853:
--

Attachment: ZOOKEEPER-853.patch

> Make zookeeper.is_unrecoverable return True or False and not an integer
> ---
>
> Key: ZOOKEEPER-853
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-853.patch
>
>
> This is a patch that fixes a TODO from the python zookeeper extension, it 
> makes {{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an 
> integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (ZOOKEEPER-853) Make zookeeper.is_unrecoverable return True or False and not an integer

[Andrei Savu (JIRA)]

Make zookeeper.is_unrecoverable return True or False and not an integer
---

 Key: ZOOKEEPER-853
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-853
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib-bindings
Reporter: Andrei Savu
Assignee: Andrei Savu
Priority: Minor
 Fix For: 3.4.0


This is a patch that fixes a TODO from the python zookeeper extension, it makes 
{{zookeeper.is_unrecoverable}} return {{True}} or {{False}} and not an integer. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (ZOOKEEPER-701) GSoC 2010: Monitoring Recipes and Web-based Administrative Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu resolved ZOOKEEPER-701.
---

Resolution: Fixed

> GSoC 2010: Monitoring Recipes and Web-based Administrative Interface
> 
>
> Key: ZOOKEEPER-701
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-701
> Project: Zookeeper
>  Issue Type: Wish
>Reporter: Henry Robinson
>    Assignee: Andrei Savu
> Attachments: milestones.txt
>
>
> Monitoring Recipes And Web-based Administrative Interface
> Mentor: Patrick Hunt (ph...@apache.org)
> Requirements:
> Modern web platform - e.g. Django. Some design or UI skills would help. Java 
> for adding methods to ZooKeeper.
> Description:
> ZooKeeper is a complex distributed system. Understanding how well it is 
> running is tremendously important. Patrick Hunt has created a Django-based 
> dashboard (see http://github.com/phunt/zookeeper_dashboard) that allows some 
> insight into how ZooKeeper is running. This is a great foundation on which to 
> build; however there are improvements that could be made! This project would 
> capture much more information from ZooKeeper, adding hooks to retrieve it 
> where necessary and visualise it in a appealing and useful way. Integration 
> with Ganglia would be a definite plus.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-701) GSoC 2010: Monitoring Recipes and Web-based Administrative Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899759#action_12899759
 ] 

Andrei Savu commented on ZOOKEEPER-701:
---

I just wanted to say that I had a great learning experience while working on 
ZooKeeper as a GSoC Student Developer. Thank you all for feedback. Thanks 
Patrick for mentoring.

I'm not going to leave :) I will keep on submitting patches. Some of the things 
I'm planning to work on in the near future are:
* awesome REST gateway that implements all the ZooKeeper API features 
* allow ephemerals to have children nodes: ZOOKEEPER-834
* lightweight Pythonic wrapper around zkpython that also implements basic 
synchronization primitives and provides more recipes
* production ready job queue also implemented in Python
* a tool for easy configuration publishing

I will do one thing at a time, do it well, and move on. I hope to be able to 
finish in a reasonable time frame. 

Thanks again for giving me this opportunity. I will keep in touch. 

> GSoC 2010: Monitoring Recipes and Web-based Administrative Interface
> 
>
> Key: ZOOKEEPER-701
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-701
> Project: Zookeeper
>  Issue Type: Wish
>Reporter: Henry Robinson
>Assignee: Andrei Savu
> Attachments: milestones.txt
>
>
> Monitoring Recipes And Web-based Administrative Interface
> Mentor: Patrick Hunt (ph...@apache.org)
> Requirements:
> Modern web platform - e.g. Django. Some design or UI skills would help. Java 
> for adding methods to ZooKeeper.
> Description:
> ZooKeeper is a complex distributed system. Understanding how well it is 
> running is tremendously important. Patrick Hunt has created a Django-based 
> dashboard (see http://github.com/phunt/zookeeper_dashboard) that allows some 
> insight into how ZooKeeper is running. This is a great foundation on which to 
> build; however there are improvements that could be made! This project would 
> capture much more information from ZooKeeper, adding hooks to retrieve it 
> where necessary and visualise it in a appealing and useful way. Integration 
> with Ganglia would be a definite plus.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899746#action_12899746
 ] 

Andrei Savu commented on ZOOKEEPER-808:
---

Thanks a lot Patrick for all your help. 

> Web-based Administrative Interface
> --
>
> Key: ZOOKEEPER-808
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Fix For: 3.4.0
>
> Attachments: huebrowser.tar.gz
>
>
> Implement a web-based administrative interface that should allow the user to 
> perform all the tasks that can be done using the interactive shell (zkCli.sh) 
> from a browser. It should also display cluster and individual server info 
> extracted using the 4letter word commands. 
> I'm going to build starting from the 
> http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: ZOOKEEPER-809.patch

* fixed {{text/Base.java}} broken by refactoring {{ZooKeeperService}}
* all junit tests are now passing
* all python tests are now passing

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Fix For: 3.4.0
>
> Attachments: keys.tar.gz, SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch, ZOOKEEPER-809.patch, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch, ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-808:
--

Attachment: huebrowser.tar.gz

* Packaged the ZooKeeper Browser Hue application to be added to the trunk as a 
contrib. 
* Added README with install & config instructions. 



> Web-based Administrative Interface
> --
>
> Key: ZOOKEEPER-808
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: huebrowser.tar.gz
>
>
> Implement a web-based administrative interface that should allow the user to 
> perform all the tasks that can be done using the interactive shell (zkCli.sh) 
> from a browser. It should also display cluster and individual server info 
> extracted using the 4letter word commands. 
> I'm going to build starting from the 
> http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899286#action_12899286
 ] 

Andrei Savu commented on ZOOKEEPER-808:
---

Yes. That's exactly what I'm doing now :) I will upload the patch / archive in 
a few minutes. 

> Web-based Administrative Interface
> --
>
> Key: ZOOKEEPER-808
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Reporter: Andrei Savu
>Assignee: Andrei Savu
>
> Implement a web-based administrative interface that should allow the user to 
> perform all the tasks that can be done using the interactive shell (zkCli.sh) 
> from a browser. It should also display cluster and individual server info 
> extracted using the 4letter word commands. 
> I'm going to build starting from the 
> http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: ZOOKEEPER-809.patch
keys.tar.gz

I've added the license header to {{HTTPBasicAuth.java}}, removed all the tabs 
and added dummy self-signed keys to {{keys.tar.gz}} ( should be extracted to 
{{conf/keys}} folder ). 

Thanks Patrick for reviewing. 

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Fix For: 3.4.0
>
> Attachments: keys.tar.gz, SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch, ZOOKEEPER-809.patch, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (ZOOKEEPER-834) Allow ephemeral znodes to have children created only by the owner session.

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu reassigned ZOOKEEPER-834:
-

Assignee: Andrei Savu

> Allow ephemeral znodes to have children created only by the owner session. 
> ---
>
> Key: ZOOKEEPER-834
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-834
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: c client, java client, server
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Fix For: 3.4.0
>
>
> Ephemeral znodes are automatically removed when the client session is closed 
> or expires and this behavior makes them very useful when you want to publish 
> status information from active / connected clients. 
> But there is a catch. Right now ephemerals can't have children znodes and 
> because of that clients need to serialize status information as byte strings. 
> This serialization renders that information almost invisible to generic 
> zookeeper clients and hard / inefficient to update. 
> Most of the time the status information can be expressed as a bunch of (key, 
> value) pairs and we could easily store that using child znodes. Any ZooKeeper 
> client can read that info without the need to reverse the serialization 
> process and we can also easily update it. 
> I suggest that the server should allow the ephemeral znodes to have children 
> znodes. Each child should also be an ephemeral znode owned by the same 
> session - parent ephemeralOwner session.
> Mail Archive: 
> http://www.mail-archive.com/zookeeper-dev@hadoop.apache.org/msg09819.html
> Another discussion about the same topic:
> http://www.mail-archive.com/zookeeper-dev@hadoop.apache.org/msg08165.html

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-785) Zookeeper 3.3.1 shouldn't infinite loop if someone creates a server.0 line

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-785:
--

Status: Patch Available  (was: Open)

>  Zookeeper 3.3.1 shouldn't infinite loop if someone creates a server.0 line
> ---
>
> Key: ZOOKEEPER-785
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-785
> Project: Zookeeper
>  Issue Type: Bug
>  Components: server
>Affects Versions: 3.3.1
> Environment: Tested in linux with a new jvm
>Reporter: Alex Newman
>Assignee: Patrick Hunt
> Fix For: 3.3.2, 3.4.0
>
> Attachments: ZOOKEEPER-785.patch, ZOOKEEPER-785.patch
>
>
> The following config causes an infinite loop
> [zoo.cfg]
> tickTime=2000
> dataDir=/var/zookeeper/
> clientPort=2181
> initLimit=10
> syncLimit=5
> server.0=localhost:2888:3888
> Output:
> 2010-06-01 16:20:32,471 - INFO [main:quorumpeerm...@119] - Starting quorum 
> peer
> 2010-06-01 16:20:32,489 - INFO [main:nioservercnxn$fact...@143] - binding to 
> port 0.0.0.0/0.0.0.0:2181
> 2010-06-01 16:20:32,504 - INFO [main:quorump...@818] - tickTime set to 2000
> 2010-06-01 16:20:32,504 - INFO [main:quorump...@829] - minSessionTimeout set 
> to -1
> 2010-06-01 16:20:32,505 - INFO [main:quorump...@840] - maxSessionTimeout set 
> to -1
> 2010-06-01 16:20:32,505 - INFO [main:quorump...@855] - initLimit set to 10
> 2010-06-01 16:20:32,526 - INFO [main:files...@82] - Reading snapshot 
> /var/zookeeper/version-2/snapshot.c
> 2010-06-01 16:20:32,547 - INFO [Thread-1:quorumcnxmanager$liste...@436] - My 
> election bind port: 3888
> 2010-06-01 16:20:32,554 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@620] - LOOKING
> 2010-06-01 16:20:32,556 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@649] - New election. My 
> id = 0, Proposed zxid = 12
> 2010-06-01 16:20:32,558 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@689] - Notification: 0, 
> 12, 1, 0, LOOKING, LOOKING, 0
> 2010-06-01 16:20:32,560 - WARN 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@623] - Unexpected exception
> java.lang.NullPointerException
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.totalOrderPredicate(FastLeaderElection.java:496)
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:709)
> at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:621)
> 2010-06-01 16:20:32,560 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@620] - LOOKING
> 2010-06-01 16:20:32,560 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@649] - New election. My 
> id = 0, Proposed zxid = 12
> 2010-06-01 16:20:32,561 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@689] - Notification: 0, 
> 12, 2, 0, LOOKING, LOOKING, 0
> 2010-06-01 16:20:32,561 - WARN 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@623] - Unexpected exception
> java.lang.NullPointerException
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.totalOrderPredicate(FastLeaderElection.java:496)
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:709)
> at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:621)
> 2010-06-01 16:20:32,561 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@620] - LOOKING
> 2010-06-01 16:20:32,562 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@649] - New election. My 
> id = 0, Proposed zxid = 12
> 2010-06-01 16:20:32,562 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@689] - Notification: 0, 
> 12, 3, 0, LOOKING, LOOKING, 0
> 2010-06-01 16:20:32,562 - WARN 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@623] - Unexpected exception
> java.lang.NullPointerException
> Things like HBase require that the zookeeper servers be listed in the 
> zoo.cfg. This is a bug on their part, but zookeeper shouldn't null pointer in 
> a loop though.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-785) Zookeeper 3.3.1 shouldn't infinite loop if someone creates a server.0 line

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-785:
--

Attachment: ZOOKEEPER-785.patch

I've added the warning message as Benjamin suggested. The patch also applies 
cleanly on the 3.3 branch. 

>  Zookeeper 3.3.1 shouldn't infinite loop if someone creates a server.0 line
> ---
>
> Key: ZOOKEEPER-785
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-785
> Project: Zookeeper
>  Issue Type: Bug
>  Components: server
>Affects Versions: 3.3.1
> Environment: Tested in linux with a new jvm
>Reporter: Alex Newman
>Assignee: Patrick Hunt
> Fix For: 3.3.2, 3.4.0
>
> Attachments: ZOOKEEPER-785.patch, ZOOKEEPER-785.patch
>
>
> The following config causes an infinite loop
> [zoo.cfg]
> tickTime=2000
> dataDir=/var/zookeeper/
> clientPort=2181
> initLimit=10
> syncLimit=5
> server.0=localhost:2888:3888
> Output:
> 2010-06-01 16:20:32,471 - INFO [main:quorumpeerm...@119] - Starting quorum 
> peer
> 2010-06-01 16:20:32,489 - INFO [main:nioservercnxn$fact...@143] - binding to 
> port 0.0.0.0/0.0.0.0:2181
> 2010-06-01 16:20:32,504 - INFO [main:quorump...@818] - tickTime set to 2000
> 2010-06-01 16:20:32,504 - INFO [main:quorump...@829] - minSessionTimeout set 
> to -1
> 2010-06-01 16:20:32,505 - INFO [main:quorump...@840] - maxSessionTimeout set 
> to -1
> 2010-06-01 16:20:32,505 - INFO [main:quorump...@855] - initLimit set to 10
> 2010-06-01 16:20:32,526 - INFO [main:files...@82] - Reading snapshot 
> /var/zookeeper/version-2/snapshot.c
> 2010-06-01 16:20:32,547 - INFO [Thread-1:quorumcnxmanager$liste...@436] - My 
> election bind port: 3888
> 2010-06-01 16:20:32,554 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@620] - LOOKING
> 2010-06-01 16:20:32,556 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@649] - New election. My 
> id = 0, Proposed zxid = 12
> 2010-06-01 16:20:32,558 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@689] - Notification: 0, 
> 12, 1, 0, LOOKING, LOOKING, 0
> 2010-06-01 16:20:32,560 - WARN 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@623] - Unexpected exception
> java.lang.NullPointerException
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.totalOrderPredicate(FastLeaderElection.java:496)
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:709)
> at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:621)
> 2010-06-01 16:20:32,560 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@620] - LOOKING
> 2010-06-01 16:20:32,560 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@649] - New election. My 
> id = 0, Proposed zxid = 12
> 2010-06-01 16:20:32,561 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@689] - Notification: 0, 
> 12, 2, 0, LOOKING, LOOKING, 0
> 2010-06-01 16:20:32,561 - WARN 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@623] - Unexpected exception
> java.lang.NullPointerException
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.totalOrderPredicate(FastLeaderElection.java:496)
> at 
> org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:709)
> at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:621)
> 2010-06-01 16:20:32,561 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@620] - LOOKING
> 2010-06-01 16:20:32,562 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@649] - New election. My 
> id = 0, Proposed zxid = 12
> 2010-06-01 16:20:32,562 - INFO 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:fastleaderelect...@689] - Notification: 0, 
> 12, 3, 0, LOOKING, LOOKING, 0
> 2010-06-01 16:20:32,562 - WARN 
> [QuorumPeer:/0:0:0:0:0:0:0:0:2181:quorump...@623] - Unexpected exception
> java.lang.NullPointerException
> Things like HBase require that the zookeeper servers be listed in the 
> zoo.cfg. This is a bug on their part, but zookeeper shouldn't null pointer in 
> a loop though.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898790#action_12898790
 ] 

Andrei Savu commented on ZOOKEEPER-808:
---

No. The application is pretty much self-contained. You only need to deploy the 
new REST gateway (ZOOKEEPER-809) and configure the application by editing 
{{apps/zkui/src/zkui/settings.py}}. 

> Web-based Administrative Interface
> --
>
> Key: ZOOKEEPER-808
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
>
> Implement a web-based administrative interface that should allow the user to 
> perform all the tasks that can be done using the interactive shell (zkCli.sh) 
> from a browser. It should also display cluster and individual server info 
> extracted using the 4letter word commands. 
> I'm going to build starting from the 
> http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898257#action_12898257
 ] 

Andrei Savu commented on ZOOKEEPER-808:
---

The web-based administrative interface is available on Github as a Hue app.

Repository: http://github.com/andreisavu/hue/tree/zookeeper-browser/
Branch: zookeeper-browser App: zkui 

It requires the lates Hue release (1.0). 

> Web-based Administrative Interface
> --
>
> Key: ZOOKEEPER-808
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
>
> Implement a web-based administrative interface that should allow the user to 
> perform all the tasks that can be done using the interactive shell (zkCli.sh) 
> from a browser. It should also display cluster and individual server info 
> extracted using the 4letter word commands. 
> I'm going to build starting from the 
> http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: ZOOKEEPER-809.patch

In this patch I've added:
* a bunch of classes for parsing the configuration file
* per context HTTP Digest authentication settings 
* per context ZooKeeper digest authentication settings
* support for chroot when parsing the hostPort string

By using these features you can easily create secure channels from your 
application to ZooKeeper ( HTTPS + Digest Authentication + ZK Auth + chroot). 
It doesn't support the whole API but it should be really useful for 
configuration management. 

Working on:
* support for ACLs: read and update
* per session ZooKeeper authentication 

Sample config for a channel:

rest.port = 9998

rest.endpoint.1 = /channel;localhost:2181,localhost:2182,localhost:2183/app
rest.endpoint.1.http.auth = user:pass,user2:pass2
rest.endpoint.1.zk.digest = appuser:pass

.. you should also enable SSL because the browser sends the password as plain 
text

rest.ssl = true
rest.ssl.jks = keys/rest.jks
rest.ssl.jks.pass = 123456

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch, ZOOKEEPER-809.patch, ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-732) Improper translation of error into Python exception

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-732:
--

Attachment: ZOOKEEPER-732.patch

I've fixed the patch to also include {{ZCLOSING}} and {{ZNOTHING}}. It seems 
like all the error codes listed in {{zookeeper.h}} {{ZOO_ERRORS}} enum are now 
handled by {{err_to_exception}}. 

> Improper translation of error into Python exception
> ---
>
> Key: ZOOKEEPER-732
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-732
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib-bindings
>Affects Versions: 3.2.2
>Reporter: Gustavo Niemeyer
>Assignee: Lei Zhang
>Priority: Minor
> Attachments: ZOOKEEPER-732.patch, ZOOKEEPER-732.patch
>
>
> Apparently errors returned by the C library are not being correctly converted 
> into a Python exception in some cases: 
> >>> zookeeper.get_children(0, "/", None)
> Traceback (most recent call last):
>   File "", line 1, in 
> SystemError: error return without exception set

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: Compiling c client

[Andrei Savu]

I believe the code for the 3.3.2 release should be on the 3.3 branch
but I'm not completely sure.

The trunk contains many unreleased changes. They should all be part of
the upcoming 3.4.0 release.

On Sat, Aug 7, 2010 at 9:41 PM, Michi Mutsuzaki  wrote:
> Thanks for the response, Andrei.
>
> branch-3.3 didn't work for me, but trunk worked. I'll try what you suggested
> in branch-3.3.
>
> By the way, how can I find out which zookeeper version is in the trunk? I
> need to fix a bug in 3.3.2, but I wasn't sure which branch I'm supposed to
> work on.
>
> Thanks!
> --Michi
>
> On 8/6/10 11:48 PM, "Andrei Savu"  wrote:
>
>> It should work. On which ZooKeeper release / version are you doing
>> this? Latest release (3.3.1)?
>>
>> I've done the same steps on the 3.3.1 release, 3.3 branch and trunk
>> and everything seems to work fine. I'm running Ubuntu 10.04 and java
>> 1.6.0_18 (OpenJDK).
>>
>> Try running: $ ant clean compile_jute
>>
>> You should get some output similar to this:
>>
>> Buildfile: build.xml
>>
>> [ ... clean ... ]
>>
>> init:
>>     [mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/build/classes
>>     [mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/build/lib
>>     [mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/build/test/lib
>>
>> jute:
>>     [javac] Compiling 38 source files to
>> /home/andrei/current/zk/src/zookeeper/build/classes
>>     [javac] Note: Some input files use unchecked or unsafe operations.
>>     [javac] Note: Recompile with -Xlint:unchecked for details.
>>
>> compile_jute_uptodate:
>>
>> compile_jute:
>>     [mkdir] Created dir:
>> /home/andrei/current/zk/src/zookeeper/src/java/generated
>>     [mkdir] Created dir: 
>> /home/andrei/current/zk/src/zookeeper/src/c/generated
>>      [java] ../../zookeeper.jute Parsed Successfully
>>      [java] ../../zookeeper.jute Parsed Successfully
>>     [touch] Creating
>> /home/andrei/current/zk/src/zookeeper/src/java/generated/.generated
>>
>> BUILD SUCCESSFUL
>> Total time: 4 seconds
>>
>>
>>
>> On Sat, Aug 7, 2010 at 12:54 AM, Michi Mutsuzaki  
>> wrote:
>>> Hi,
>>>
>>> I'm trying to compile c client, and I'm getting error saying that jute files
>>> are missing. I've run "ant compile_jute", but it didn't generate any files.
>>> Am I missing any steps?
>>>
>>> $ ant compile_jute
>>> Buildfile: build.xml
>>>
>>> init:
>>>
>>> jute:
>>>
>>> compile_jute_uptodate:
>>>
>>> compile_jute:
>>>
>>> BUILD SUCCESSFUL
>>> Total time: 0 seconds
>>>
>>> $ cd src/c
>>> $ autoreconf -if
>>> $ ./configure
>>> ...
>>> configure: error: jute files are missing! Please run "ant compile_jute"
>>> while in the zookeeper top level directory.
>>>
>>> Thanks!
>>> --Michi
>>>
>>>
>>
>>
>>
>> --
>> Indekspot -- http://www.indekspot.com -- Managed Hosting for Apache Solr
>>
>
>



-- 
Indekspot -- http://www.indekspot.com -- Managed Hosting for Apache Solr

Re: Compiling c client

[Andrei Savu]

It should work. On which ZooKeeper release / version are you doing
this? Latest release (3.3.1)?

I've done the same steps on the 3.3.1 release, 3.3 branch and trunk
and everything seems to work fine. I'm running Ubuntu 10.04 and java
1.6.0_18 (OpenJDK).

Try running: $ ant clean compile_jute

You should get some output similar to this:

Buildfile: build.xml

[ ... clean ... ]

init:
[mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/build/classes
[mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/build/lib
[mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/build/test/lib

jute:
[javac] Compiling 38 source files to
/home/andrei/current/zk/src/zookeeper/build/classes
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

compile_jute_uptodate:

compile_jute:
[mkdir] Created dir:
/home/andrei/current/zk/src/zookeeper/src/java/generated
[mkdir] Created dir: /home/andrei/current/zk/src/zookeeper/src/c/generated
 [java] ../../zookeeper.jute Parsed Successfully
 [java] ../../zookeeper.jute Parsed Successfully
[touch] Creating
/home/andrei/current/zk/src/zookeeper/src/java/generated/.generated

BUILD SUCCESSFUL
Total time: 4 seconds



On Sat, Aug 7, 2010 at 12:54 AM, Michi Mutsuzaki  wrote:
> Hi,
>
> I'm trying to compile c client, and I'm getting error saying that jute files
> are missing. I've run "ant compile_jute", but it didn't generate any files.
> Am I missing any steps?
>
> $ ant compile_jute
> Buildfile: build.xml
>
> init:
>
> jute:
>
> compile_jute_uptodate:
>
> compile_jute:
>
> BUILD SUCCESSFUL
> Total time: 0 seconds
>
> $ cd src/c
> $ autoreconf -if
> $ ./configure
> ...
> configure: error: jute files are missing! Please run "ant compile_jute"
> while in the zookeeper top level directory.
>
> Thanks!
> --Michi
>
>



-- 
Indekspot -- http://www.indekspot.com -- Managed Hosting for Apache Solr

Re: Feature: Allow ephemeral nodes to have children

[Andrei Savu]

I've added a link to the email thread to ZOOKEEPER-723 [1].

I've also created a new JIRA for the approach I've suggested
ZOOKEEPER-834 [2] I will try to provide a patch after I finish my GSoC
assignment.

For me it seems like a good idea to allow a session to create / own an
ephemeral tree and not just leafs under persistent znodes.

[1] https://issues.apache.org/jira/browse/ZOOKEEPER-723
[2] https://issues.apache.org/jira/browse/ZOOKEEPER-834


On Fri, Aug 6, 2010 at 7:21 PM, Patrick Hunt  wrote:
> Take a look at the following. Would be a great feature to add. (search the
> mail archives for a full discussion, we should rehash that on the jira, or
> at least link the jira to that thread - would appreciate if someone could
> add a comment to the jira with that.)
>
> https://issues.apache.org/jira/browse/ZOOKEEPER-723
>
> On 08/06/2010 06:39 AM, Gustavo Niemeyer wrote:
>>
>> Hey Andrei,
>>
>>> I was just re-reading part of the ZooKeeper documentation and I was
>>> trying to understand why ephemeral znodes should not have children
>>> znodes. Adding this feature, while maintaining an important
>>> restriction, could be really useful.
>>
>> Indeed.  There was some discussion about this idea in this mailing
>> list a few months ago, and the conclusion IIRC is that it is indeed an
>> interesting feature, and there's an approach which is apparently
>> feasible too without too much trouble, but no one is taking care of
>> the idea right now.   It'd be good to find someone that is interested
>> in trying it out (hint hint).
>>
>



-- 
Indekspot -- http://www.indekspot.com -- Managed Hosting for Apache Solr

[jira] Created: (ZOOKEEPER-834) Allow ephemeral znodes to have children created only by the owner session.

[Andrei Savu (JIRA)]

Allow ephemeral znodes to have children created only by the owner session. 
---

 Key: ZOOKEEPER-834
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-834
 Project: Zookeeper
  Issue Type: New Feature
  Components: c client, java client, server
Reporter: Andrei Savu
 Fix For: 3.4.0


Ephemeral znodes are automatically removed when the client session is closed or 
expires and this behavior makes them very useful when you want to publish 
status information from active / connected clients. 

But there is a catch. Right now ephemerals can't have children znodes and 
because of that clients need to serialize status information as byte strings. 
This serialization renders that information almost invisible to generic 
zookeeper clients and hard / inefficient to update. 

Most of the time the status information can be expressed as a bunch of (key, 
value) pairs and we could easily store that using child znodes. Any ZooKeeper 
client can read that info without the need to reverse the serialization process 
and we can also easily update it. 

I suggest that the server should allow the ephemeral znodes to have children 
znodes. Each child should also be an ephemeral znode owned by the same session 
- parent ephemeralOwner session.

Mail Archive: 
http://www.mail-archive.com/zookeeper-dev@hadoop.apache.org/msg09819.html

Another discussion about the same topic:
http://www.mail-archive.com/zookeeper-dev@hadoop.apache.org/msg08165.html


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-723) ephemeral parent znodes

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896128#action_12896128
 ] 

Andrei Savu commented on ZOOKEEPER-723:
---

You can find the whole discussion that generated this JIRA at the following URL:

http://www.mail-archive.com/zookeeper-dev@hadoop.apache.org/msg08165.html



> ephemeral parent znodes
> ---
>
> Key: ZOOKEEPER-723
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-723
> Project: Zookeeper
>  Issue Type: New Feature
>Reporter: Benjamin Reed
>
> ephemeral znodes have the nice property of automatically cleaning up after 
> themselves when the creator goes away, but since they can't have children it 
> is hard to build subtrees that will cleanup after the clients that are using 
> them are gone.
> rather than changing the semantics of ephemeral nodes, i propose ephemeral 
> parents: znodes that disappear when they have no more children. this cleanup 
> would happen automatically when the last child is removed. an ephemeral 
> parent is not tied to any particular session, so even if the creator goes 
> away, the ephemeral parent will remain as long as there are children.
> the when an ephemeral parent is created it will have an initial child, so 
> that it doesn't get immediately removed. i think this child should be an 
> ephemeral znode with a predefined name, "firstChild".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896118#action_12896118
 ] 

Andrei Savu commented on ZOOKEEPER-780:
---

I will take  a look tomorrow. Maybe the test failure is somehow related to my 
change even if I don't understand how. 

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch, 
> ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: ZOOKEEPER-809.patch

In this patch:
* ant task for packaging: just run {{ant tar}} and it will generate 
{{zookeeper-dev-rest.tar.gz}} in {{build/contrib/rest/}}
* basic script for starting and stopping the REST gateway - 
{{bin/restServer.sh}}

Remaining: 
* ACLs & ZooKeeper Authentication - after GSoC "soft" deadline 

All tests are passing, including the ones from the new python client test suite.



> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch, ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Feature: Allow ephemeral nodes to have children

[Andrei Savu]

Hello,

I was just re-reading part of the ZooKeeper documentation and I was
trying to understand why ephemeral znodes should not have children
znodes. Adding this feature, while maintaining an important
restriction, could be really useful.

Let's suppose that we have a multi-agent system and we are using
ZooKeeper to store status for each agent. Most of the time the agent
status can be expressed as a bunch of (key, value) pairs and, because
we can't create children for ephemeral znodes, we need to serialize
this data structure as a byte string. By doing this we make the status
information hard to retrieve and also a bit difficult (and
inefficient) to update.

I believe that it's a good idea to allow the ephemeralOwner session to
create children znodes. By doing this we eliminate the need to
serialize status information.

We should end-up having a tree structure looking like this:

/agent-000234
/active -- is active now
/memory  -- memory usage for this agent
/ip   -- the IP address of the system where the agent is running
/port-- the port where the agent is listening for commands
... etc.

This is somehow similar to /proc on Unix systems. It shouldn't be that
difficult to cleanup this if the session expires or is closed.

In the near future I would like to use this feature at
http://indekspot.com to publish Apache Solr status information in
order to be able to easily monitor and manage the running servers.

What do you think? Do you find this feature useful?

Thanks

-- 
Andrei Savu -- http://andreisavu.ro

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: ZOOKEEPER-809.patch

Changes in this patch:
* {{ZooKeeperService}} now uses the servlet context path and not full URI as a 
key for retrieving ZooKeeper connections
* added a configuration file: conf/rest.properties
* added support for multiple endpoints: /cluster1, /cluster2 - useful if you 
have multiple ZooKeeper clusters 
* HTTPS support 
* HTTP Basic Authentication 
* shutdownHook for cleanup

I'm still working on: packaging, ACLs & ZooKeeper Authentication 

I will finish the packaging ant task tomorrow and next week (after the GSoC 
"soft" deadline) I will also add support for ACLs and Authentication.

Let me know what you think. Thanks. 

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch, 
> ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895574#action_12895574
 ] 

Andrei Savu commented on ZOOKEEPER-809:
---

Thanks Patrick for reviewing the patch. I will fix those issues ASAP. 

Sorry about reformatting existing code, I've used the Eclipse Format tool and 
only latter I've realized that it changes the whole file. 

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: ZOOKEEPER-809.patch
SPEC.txt


This patch contains:

* basic support for sessions ( create: POST 
/sessions/v1?op=create&expire=SECONDS, delete: DELETE /sessions/v1/, 
heartbeat: PUT /sessions/v1/ )
* support for ephemeral nodes: create: POST 
/znodes/v1/a/b?op=create&name=c&ephemeral=true&session=ID
* experimental (almost complete) python REST client
* demos: demo_master_election.py & demo_queue.py 
* updated specs

I'm not going to implement watches now because they are not useful if the 
client pulls the server for changes.  

Working on: 
* configuration, ACLs and basic authentication 
* packaging - I want to be able to run the REST gateway as a task managed by 
the Hue [1] supervisor. 

I would really like to get more feedback from you regarding this patch. Thanks. 

[1] http://github.com/cloudera/hue 



> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: SPEC.txt, SPEC.txt, ZOOKEEPER-809.patch
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895223#action_12895223
 ] 

Andrei Savu commented on ZOOKEEPER-780:
---

The failing test is not related to this patch: 

 [exec]  [exec] 
/grid/0/hudson/hudson-slave/workspace/Zookeeper-Patch-h7.grid.sp2.yahoo.net/trunk/src/c/tests/TestClient.cc:879:
 Assertion: assertion failed [Expression: ctx.waitForConnected(zk)]
 [exec]  [exec] Failures !!!



> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch, 
> ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-780:
--

Attachment: ZOOKEEPER-780.patch

Fixed typo failes -> failed. 

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch, 
> ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-780:
--

Status: Patch Available  (was: Open)

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch, 
> ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-780:
--

Status: Open  (was: Patch Available)

found a typo. will resubmit patch

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-780:
--

Attachment: ZOOKEEPER-780.patch

Added a generic exception handler for all kinds of unexpected errors. 

Output:

[zk: (CLOSED) 1] connect localhost2181
2010-07-29 15:13:32,364 [myid:] - INFO  [main:zookee...@375] - Initiating 
client connection, connectString=localhost2181 sessionTimeout=3 
watcher=org.apache.zookeeper.zookeepermain$mywatc...@209f4e
Command failes: java.net.UnknownHostException: localhost2181

This should make the CLI interface much more robust. 

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-780:
--

Status: Patch Available  (was: Open)

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch, ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-814) monitoring scripts are missing apache license headers

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892680#action_12892680
 ] 

Andrei Savu commented on ZOOKEEPER-814:
---

thanks Mahadev! 

> monitoring scripts are missing apache license headers
> -
>
> Key: ZOOKEEPER-814
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-814
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib
>Reporter: Patrick Hunt
>Assignee: Andrei Savu
>Priority: Blocker
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-814.patch
>
>
> Andrei, I just realized that src/contrib/monitoring files are missing apache 
> license headers.  Please add them (in particular any script files like 
> python, see similar files in svn for examples - in some cases like README 
> it's not strictly necessary.) 
> You can run the RAT tool to verify (see build.xml or 
> http://incubator.apache.org/rat/)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-809:
--

Attachment: SPEC.txt

I've attached the first draft of the SPECs for an improved REST gateway. 

I'm proposing the following new operations:

1. create a new session -- POST /sessions/v1?op=create HTTP/1.1

2. keep the session alive -- PUT /sessions/v1/ HTTP/1.1

3. close the session -- DELETE /sessions/v1/ HTTP/1.1

4. create an ephemeral node -- POST 
/znodes/v1/a/b?op=create&name=c&ephemeral=true&session= HTTP/1.1

5. create a new watch -- POST /znodes/v1/a/b?op=watch&view=data OR 
children&session= HTTP/1.1

6. query watch status -- GET /sessions/v1//watches/ 
HTTP/1.1
This operation could support long-polling in the future. 

7. delete a triggered watch -- DELETE 
/sessions/v1//watches/ HTTP/1.1

Let me know what you think about this. Am I breaking the REST principles? 

This is what I want to do in the first iteration. In the second iteration I 
would like to add support for ACLs and authentication. 

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: SPEC.txt
>
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-765) Add python example script

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-765:
--

Attachment: ZOOKEEPER-765.patch

Added license files and a reference to Henry's queue implementation hosted on 
Github. 

> Add python example script
> -
>
> Key: ZOOKEEPER-765
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-765
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings, documentation
>Reporter: Travis Crawford
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: zk.py, ZOOKEEPER-765.patch, ZOOKEEPER-765.patch
>
>
> When adding some zookeeper-based functionality to a python script I had to 
> figure everything out without guidance, which while doable, would have been a 
> lot easier with an example. I extracted a skeleton program structure out with 
> hopes its useful to others (maybe add as an example in the source or wiki?).
> This script does an aget() and sets a watch, and hopefully illustrates what's 
> going on, and where to plug in your application code that gets run when the 
> znode changes.
> There are probably some bugs, which if we fix now and provide a well-reviewed 
> example hopefully others will not run into the same mistakes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-765) Add python example script

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-765:
--

Status: Patch Available  (was: Open)

> Add python example script
> -
>
> Key: ZOOKEEPER-765
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-765
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings, documentation
>Reporter: Travis Crawford
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: zk.py, ZOOKEEPER-765.patch, ZOOKEEPER-765.patch
>
>
> When adding some zookeeper-based functionality to a python script I had to 
> figure everything out without guidance, which while doable, would have been a 
> lot easier with an example. I extracted a skeleton program structure out with 
> hopes its useful to others (maybe add as an example in the source or wiki?).
> This script does an aget() and sets a watch, and hopefully illustrates what's 
> going on, and where to plug in your application code that gets run when the 
> znode changes.
> There are probably some bugs, which if we fix now and provide a well-reviewed 
> example hopefully others will not run into the same mistakes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-814) monitoring scripts are missing apache license headers

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-814:
--

Status: Patch Available  (was: Open)

> monitoring scripts are missing apache license headers
> -
>
> Key: ZOOKEEPER-814
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-814
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib
>Reporter: Patrick Hunt
>    Assignee: Andrei Savu
>Priority: Blocker
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-814.patch
>
>
> Andrei, I just realized that src/contrib/monitoring files are missing apache 
> license headers.  Please add them (in particular any script files like 
> python, see similar files in svn for examples - in some cases like README 
> it's not strictly necessary.) 
> You can run the RAT tool to verify (see build.xml or 
> http://incubator.apache.org/rat/)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-814) monitoring scripts are missing apache license headers

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-814:
--

Attachment: ZOOKEEPER-814.patch

Added license headers to all files. Sorry about missing this in the first 
place. 

> monitoring scripts are missing apache license headers
> -
>
> Key: ZOOKEEPER-814
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-814
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib
>Reporter: Patrick Hunt
>    Assignee: Andrei Savu
>Priority: Blocker
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-814.patch
>
>
> Andrei, I just realized that src/contrib/monitoring files are missing apache 
> license headers.  Please add them (in particular any script files like 
> python, see similar files in svn for examples - in some cases like README 
> it's not strictly necessary.) 
> You can run the RAT tool to verify (see build.xml or 
> http://incubator.apache.org/rat/)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888224#action_12888224
 ] 

Andrei Savu commented on ZOOKEEPER-799:
---

Awesome! Thanks for reviewing Patrick! 

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Fix For: 3.4.0
>
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-765) Add python example script

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887896#action_12887896
 ] 

Andrei Savu commented on ZOOKEEPER-765:
---

I think Henry's queue should also be part of this patch: 
http://github.com/henryr/pyzk-recipes What do you think? 

> Add python example script
> -
>
> Key: ZOOKEEPER-765
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-765
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings, documentation
>Reporter: Travis Crawford
>Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: zk.py, ZOOKEEPER-765.patch
>
>
> When adding some zookeeper-based functionality to a python script I had to 
> figure everything out without guidance, which while doable, would have been a 
> lot easier with an example. I extracted a skeleton program structure out with 
> hopes its useful to others (maybe add as an example in the source or wiki?).
> This script does an aget() and sets a watch, and hopefully illustrates what's 
> going on, and where to plug in your application code that gets run when the 
> znode changes.
> There are probably some bugs, which if we fix now and provide a well-reviewed 
> example hopefully others will not run into the same mistakes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887870#action_12887870
 ] 

Andrei Savu commented on ZOOKEEPER-799:
---

Not really. The archive only contains some extra files (screenshots). I don't 
understand why Hudson keeps trying to apply it as patch even of it's not marked 
for inclusion. 


-original message-
Subject: [jira] Commented: (ZOOKEEPER-799) Add tools and recipes for monitoring 
as a contrib
From: "Patrick Hunt (JIRA)" 
Date: 13/07/2010 20:13


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887852#action_12887852
 ] 

Patrick Hunt commented on ZOOKEEPER-799:


I see, both files are necessary to build. I'll take a look at this asap (don't 
worry about hudson).


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.





> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Status: Patch Available  (was: Open)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: monitoring.tar.gz

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: (was: ZOOKEEPER-799.patch)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: (was: ZOOKEEPER-799.patch)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: (was: monitoring.tar.gz)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: (was: monitoring.tar.gz)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: (was: monitoring.tar.gz)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887045#action_12887045
 ] 

Andrei Savu commented on ZOOKEEPER-809:
---

Very soon I'm also going to attach an updated version of the REST SPEC.txt file 
because I would like to get more feedback from you before writing any code. 

> Improved REST Interface
> ---
>
> Key: ZOOKEEPER-809
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib
>Reporter: Andrei Savu
>Assignee: Andrei Savu
>
> I would like to extend the existing REST Interface to also support:
> * configuration
> * ephemeral znodes
> * watches - PubSubHubbub 
> * ACLs 
> * basic authentication
> I want to do this because when building web applications that talks directly 
> to ZooKeeper a REST API it's a lot easier to use (there is no protocol 
> mismatch) than an API that uses persistent connections. I plan to use the 
> improved version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (ZOOKEEPER-809) Improved REST Interface

[Andrei Savu (JIRA)]

Improved REST Interface
---

 Key: ZOOKEEPER-809
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-809
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Andrei Savu
Assignee: Andrei Savu


I would like to extend the existing REST Interface to also support:
* configuration
* ephemeral znodes
* watches - PubSubHubbub 
* ACLs 
* basic authentication

I want to do this because when building web applications that talks directly to 
ZooKeeper a REST API it's a lot easier to use (there is no protocol mismatch) 
than an API that uses persistent connections. I plan to use the improved 
version to build a web-based administrative interface. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887042#action_12887042
 ] 

Andrei Savu commented on ZOOKEEPER-808:
---

I've created this JIRA to track my progress on this GSoC subtask. I will attach 
a specification describing how I think it should be implemented. 

I'm thinking about using an improved version of the REST ZooKeeper interface 
(available as a contrib), a version that should also support ephemerals, 
watches and ACLs. I believe this is a good idea because there is a mismatch 
between how a typical web application works (HTTP requests) and how a typical 
ZooKeeper client works (persistent connections). On the other hand there is a 
perfect fit between HTTP and REST.  I also believe that  an improved version of 
the REST interface, one that implements the whole API, would be really useful 
for other projects / tasks. 

> Web-based Administrative Interface
> --
>
> Key: ZOOKEEPER-808
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Reporter: Andrei Savu
>Assignee: Andrei Savu
>
> Implement a web-based administrative interface that should allow the user to 
> perform all the tasks that can be done using the interactive shell (zkCli.sh) 
> from a browser. It should also display cluster and individual server info 
> extracted using the 4letter word commands. 
> I'm going to build starting from the 
> http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (ZOOKEEPER-808) Web-based Administrative Interface

[Andrei Savu (JIRA)]

Web-based Administrative Interface
--

 Key: ZOOKEEPER-808
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-808
 Project: Zookeeper
  Issue Type: New Feature
  Components: contrib
Reporter: Andrei Savu
Assignee: Andrei Savu


Implement a web-based administrative interface that should allow the user to 
perform all the tasks that can be done using the interactive shell (zkCli.sh) 
from a browser. It should also display cluster and individual server info 
extracted using the 4letter word commands. 

I'm going to build starting from the 
http://github.com/phunt/zookeeper_dashboard implemented by Patrick Hunt. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: ZOOKEEPER-799.patch
monitoring.tar.gz

* removed two files: LICENCE and a copyright NOTICE

I believe the patch is now ready to be committed. 

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, monitoring.tar.gz, monitoring.tar.gz, 
> ZOOKEEPER-799.patch, ZOOKEEPER-799.patch, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

   Status: Patch Available  (was: Open)
Affects Version/s: (was: 3.3.0)
   (was: 3.4.0)
   (was: 3.3.1)

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>    Reporter: Andrei Savu
>    Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, monitoring.tar.gz, monitoring.tar.gz, 
> ZOOKEEPER-799.patch, ZOOKEEPER-799.patch, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-780:
--

   Status: Patch Available  (was: Open)
 Release Note: If no data is provided for the new node when using the 
"create" zkCli.sh command assume an empty byte array. 
Fix Version/s: 3.4.0

> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: ZOOKEEPER-780.patch
>
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-765) Add python example script

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-765:
--

Attachment: ZOOKEEPER-765.patch

I have created a patch containing the script Travis wrote. I have also fixed 
some typos and added more comments that explain how to play with it. 

I have also added a reference to zk-smoketest [1] because that's another good 
example that shows how to use the python ZooKeeper client library. 

[1] http://github.com/phunt/zk-smoketest 

> Add python example script
> -
>
> Key: ZOOKEEPER-765
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-765
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings, documentation
>Reporter: Travis Crawford
>Assignee: Travis Crawford
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: zk.py, ZOOKEEPER-765.patch
>
>
> When adding some zookeeper-based functionality to a python script I had to 
> figure everything out without guidance, which while doable, would have been a 
> lot easier with an example. I extracted a skeleton program structure out with 
> hopes its useful to others (maybe add as an example in the source or wiki?).
> This script does an aget() and sets a watch, and hopefully illustrates what's 
> going on, and where to plug in your application code that gets run when the 
> znode changes.
> There are probably some bugs, which if we fix now and provide a well-reviewed 
> example hopefully others will not run into the same mistakes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-765) Add python example script

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-765:
--

  Status: Patch Available  (was: Open)
Release Note: Travis Crawford wrote a skeleton script that shows how to 
setup znode watches and how to react to events using the Python client 
libraries. 
Assignee: Andrei Savu  (was: Travis Crawford)

> Add python example script
> -
>
> Key: ZOOKEEPER-765
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-765
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib-bindings, documentation
>Reporter: Travis Crawford
>    Assignee: Andrei Savu
>Priority: Minor
> Fix For: 3.4.0
>
> Attachments: zk.py, ZOOKEEPER-765.patch
>
>
> When adding some zookeeper-based functionality to a python script I had to 
> figure everything out without guidance, which while doable, would have been a 
> lot easier with an example. I extracted a skeleton program structure out with 
> hopes its useful to others (maybe add as an example in the source or wiki?).
> This script does an aget() and sets a watch, and hopefully illustrates what's 
> going on, and where to plug in your application code that gets run when the 
> znode changes.
> There are probably some bugs, which if we fix now and provide a well-reviewed 
> example hopefully others will not run into the same mistakes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-165) Content needed: "Monitoring"

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886745#action_12886745
 ] 

Andrei Savu commented on ZOOKEEPER-165:
---

How do you think this JIRA should be solved? Is is enough to just specify in 
the forrest docs that there is a monitoring contrib ZOOKEEPER-799? 

> Content needed: "Monitoring"
> 
>
> Key: ZOOKEEPER-165
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-165
> Project: Zookeeper
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Robbie Scott
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Content/information needed on how to Monitor a zooKeeper deployment. I think 
> we can talk about jmx, etc

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: ZOOKEEPER-799.patch
monitoring.tar.gz


* fixed {{GangliaHandler}} in {{check_zookeeper.py}} to allow the user to 
specify the path to gmetric on the command line (default value: 
/usr/bin/gmetric)
* it seems like it's safe to to use {{unit32}}, at least for now 
* added notice for the Ganglia Python module - it only works with 3.1.x 

Matt thanks again for reviewing this patch. 

Travis I would really like to know what you think about this because as I 
remember, at Twitter, you are using Ganglia for monitoring ZooKeeper. 

What else should I do to get this patch committed? Add more source code 
comments? More details in the docs?

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Affects Versions: 3.3.0, 3.3.1, 3.4.0
>Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, monitoring.tar.gz, 
> ZOOKEEPER-799.patch, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885331#action_12885331
 ] 

Andrei Savu commented on ZOOKEEPER-799:
---

Thanks for reviewing. I will check the data types again so that I'm
sure I'm not making any wrong assumptions and I'm also going to let
the user specify  the path to {{gmetric}} as cli parameter.




> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Affects Versions: 3.3.0, 3.3.1, 3.4.0
>Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-744) Add monitoring four-letter word

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885296#action_12885296
 ] 

Andrei Savu commented on ZOOKEEPER-744:
---

Thanks for reviewing.




> Add monitoring four-letter word
> ---
>
> Key: ZOOKEEPER-744
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-744
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: server
>Affects Versions: 3.4.0
>Reporter: Travis Crawford
>Assignee: Andrei Savu
> Fix For: 3.4.0
>
> Attachments: zk-ganglia.png, ZOOKEEPER-744.patch, 
> ZOOKEEPER-744.patch, ZOOKEEPER-744.patch, ZOOKEEPER-744.patch
>
>
> Filing a feature request based on a zookeeper-user discussion.
> Zookeeper should have a new four-letter word that returns key-value pairs 
> appropriate for importing to a monitoring system (such as Ganglia which has a 
> large installed base)
> This command should initially export the following:
> (a) Count of instances in the ensemble.
> (b) Count of up-to-date instances in the ensemble.
> But be designed such that in the future additional data can be added. For 
> example, the output could define the statistic in a comment, then print a key 
> "space character" value line:
> """
> # Total number of instances in the ensemble
> zk_ensemble_instances_total 5
> # Number of instances currently participating in the quorum.
> zk_ensemble_instances_active 4
> """
> From the mailing list:
> """
> Date: Mon, 19 Apr 2010 12:10:44 -0700
> From: Patrick Hunt 
> To: zookeeper-u...@hadoop.apache.org
> Subject: Re: Recovery issue - how to debug?
> On 04/19/2010 11:55 AM, Travis Crawford wrote:
> > It would be a lot easier from the operations perspective if the leader
> > explicitly published some health stats:
> >
> > (a) Count of instances in the ensemble.
> > (b) Count of up-to-date instances in the ensemble.
> >
> > This would greatly simplify monitoring&  alerting - when an instance
> > falls behind one could configure their monitoring system to let
> > someone know and take a look at the logs.
> That's a great idea. Please enter a JIRA for this - a new 4 letter word 
> and JMX support. It would also be a great starter project for someone 
> interested in becoming more familiar with the server code.
> Patrick
> """

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-613) add ganglia monitoring support as contrib

[Andrei Savu (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883719#action_12883719
 ] 

Andrei Savu commented on ZOOKEEPER-613:
---

I think this JIRA should be closed because I have opened ZOOKEEPER-799 and 
added a patch containing monitoring scripts for multiple platforms: Cacti, 
Nagios and Ganglia. 

> add ganglia monitoring support as contrib
> -
>
> Key: ZOOKEEPER-613
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-613
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: contrib, scripts
>Reporter: Patrick Hunt
>
> It would be great to add ganglia monitoring support for ZooKeeper Cluster. 
> AFAIK this means writing a ganglia plugin that knows
> how to talk to ZK servers (either JMX, or the command port via 4letterwords)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrei Savu updated ZOOKEEPER-799:
--

Attachment: ZOOKEEPER-799.patch
monitoring.tar.gz

I've attached a patch and an archive containing all the files in the patch + 
some screenshots.  I'm waiting for your feedback. 

> Add tools and recipes for monitoring as a contrib
> -
>
> Key: ZOOKEEPER-799
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Affects Versions: 3.3.0, 3.3.1, 3.4.0
>Reporter: Andrei Savu
>Assignee: Andrei Savu
> Attachments: monitoring.tar.gz, ZOOKEEPER-799.patch
>
>
> Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (ZOOKEEPER-799) Add tools and recipes for monitoring as a contrib

[Andrei Savu (JIRA)]

Add tools and recipes for monitoring as a contrib
-

 Key: ZOOKEEPER-799
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-799
 Project: Zookeeper
  Issue Type: New Feature
  Components: contrib
Affects Versions: 3.3.1, 3.3.0, 3.4.0
Reporter: Andrei Savu
Assignee: Andrei Savu


Tools and Recipes for Monitoring ZooKeeper using Cacti, Nagios or Ganglia. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

ZooKeeper Monitoring using Ganglia, Cacti and Nagios

[Andrei Savu]

Hi,

I've just finished writing and testing a set of scripts and recipes
for ZooKeeper monitoring using Cacti, Nagios and Ganglia.

You can find the repository on Github:
http://github.com/andreisavu/zookeeper-monitoring

I want to submit this on JIRA as a contrib but before doing this I
would really like to get more feedback from you. Let me know if I
should provide more detailed install instructions.

Thanks,
Andrei

-- 
Andrei Savu

http://www.andreisavu.ro/

Re: [VOTE] Release ZooKeeper 3.3.1 (candidate 0)

[Andrei Savu]

All the Junit tests work as expected but I've got a failing test on
the C client. I have attached the log messages.

Is this an expected (accepted) error? I'm now running the tests on
zookeeper 3.3.0.

I'm testing on: Ubuntu 10.4 LTS Server Edition (64 bit) running inside
VMWare Workstation on Windows7

$ java -version
java version "1.6.0_20"
Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
Java HotSpot(TM) 64-Bit Server VM (build 16.3-b01, mixed mode)

$ gcc -v
Using built-in specs.
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu
4.4.3-4ubuntu5'
--with-bugurl=file:///usr/share/doc/gcc-4.4/README.Bugs
--enable-languages=c,c++,fortran,objc,obj-c++ --prefix=/usr
--enable-shared --enable-multiarch --enable-linker-build-id
--with-system-zlib --libexecdir=/usr/lib --without-included-gettext
--enable-threads=posix --with-gxx-include-dir=/usr/include/c++/4.4
--program-suffix=-4.4 --enable-nls --enable-clocale=gnu
--enable-libstdcxx-debug --enable-plugin --enable-objc-gc
--disable-werror --with-arch-32=i486 --with-tune=generic
--enable-checking=release --build=x86_64-linux-gnu
--host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 4.4.3 (Ubuntu 4.4.3-4ubuntu5)


On Wed, May 12, 2010 at 10:01 PM, Flavio Junqueira  wrote:
> +1, works for me as well.
>
> -Flavio
>
> On May 12, 2010, at 7:58 PM, Benjamin Reed wrote:
>
>> +1, things check out for me too.
>>
>> ben
>>
>> On 05/11/2010 11:19 PM, Henry Robinson wrote:
>>>
>>> +1, Java tests pass for me, as do Python ones.
>>>
>>> Henry
>>>
>>> On 11 May 2010 22:32, Patrick Hunt  wrote:
>>>
>>>
 +1, tests pass for me, also verified that nc/zktop worked properly on a
 real cluster (4letter word fix).

 Patrick


 On 05/07/2010 11:25 AM, Patrick Hunt wrote:


> I've created a candidate build for ZooKeeper 3.3.1. This is a bug fix
> release addressing seventeen issues (one critical) -- see the release
> notes for details.
>
> *** Please download, test and VOTE before the
> *** vote closes 11am pacific time, Wednesday, May 12.***
>
> http://people.apache.org/~phunt/zookeeper-3.3.1-candidate-0/
>
> Should we release this?
>
> Patrick
>
>
>
>
>
>
>
>>>
>>>
>>
>
>



-- 
Savu Andrei

Website: http://www.andreisavu.ro/
 [exec] make[1]: Leaving directory 
`/home/andrei/release/zookeeper-3.3.1/build/test/test-cppunit'
 [exec] ./zktest-st
 [exec]  ZooKeeper server startedRunning
 [exec] Zookeeper_operations::testPing : elapsed 2 : OK
 [exec] Zookeeper_operations::testTimeoutCausedByWatches1 : elapsed 0 : OK
 [exec] Zookeeper_operations::testTimeoutCausedByWatches2 : elapsed 0 : OK
 [exec] Zookeeper_operations::testOperationsAndDisconnectConcurrently1 : 
elapsed 0 : OK
 [exec] Zookeeper_operations::testOperationsAndDisconnectConcurrently2 : 
elapsed 0 : OK
 [exec] Zookeeper_operations::testConcurrentOperations1 : elapsed 202 : OK
 [exec] Zookeeper_init::testBasic : elapsed 0 : OK
 [exec] Zookeeper_init::testAddressResolution : elapsed 0 : OK
 [exec] Zookeeper_init::testMultipleAddressResolution : elapsed 0 : OK
 [exec] Zookeeper_init::testNullAddressString : elapsed 0 : OK
 [exec] Zookeeper_init::testEmptyAddressString : elapsed 0 : OK
 [exec] Zookeeper_init::testOneSpaceAddressString : elapsed 0 : OK
 [exec] Zookeeper_init::testTwoSpacesAddressString : elapsed 0 : OK
 [exec] Zookeeper_init::testInvalidAddressString1 : elapsed 0 : OK
 [exec] Zookeeper_init::testInvalidAddressString2 : assertion : elapsed 
10012
 [exec] Zookeeper_init::testNonexistentHost : elapsed 57 : OK
 [exec] Zookeeper_init::testOutOfMemory_init : elapsed 0 : OK
 [exec] Zookeeper_init::testOutOfMemory_getaddrs1 : elapsed 0 : OK
 [exec] Zookeeper_init::testOutOfMemory_getaddrs2 : elapsed 0 : OK
 [exec] Zookeeper_init::testPermuteAddrsList : elapsed 0 : OK
 [exec] Zookeeper_close::testCloseUnconnected : elapsed 0 : OK
 [exec] Zookeeper_close::testCloseUnconnected1 : elapsed 0 : OK
 [exec] Zookeeper_close::testCloseConnected1 : elapsed 0 : OK
 [exec] Zookeeper_close::testCloseFromWatcher1 : elapsed 0 : OK
 [exec] Zookeeper_simpleSystem::testAsyncWatcherAutoReset ZooKeeper server 
started : elapsed 15025 : OK
 [exec] Zookeeper_simpleSystem::testDeserializeString : elapsed 0 : OK
 [exec] Zookeeper_watchers::testDefaultSessionWatcher1 : elapsed 0 : OK
 [exec] Zookeeper_watchers::testDefaultSessionWatcher2 : elapsed 0 : OK
 [exec] Zookeeper_watchers::testObjectSessionWatcher1 : elapsed 0 : OK
 [exec] Zookeeper_watchers::testObjectSessionWatcher2 : elapsed 202 : OK
 [exec] Zookeeper_watchers::testNodeWatcher1 : elapsed 407 : OK
 [exec] Zookeeper_watchers::testChildWatcher1 : elapsed 302 : OK
 [exec] Zookeeper_watchers::testChildWatcher2 : elapsed 303 : OK
 [exec] 
/home/andrei/release/zookeeper-3.