[jira] Updated: (ZOOKEEPER-773) Log visualisation

2010-06-04 Thread Ivan Kelly (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Kelly updated ZOOKEEPER-773:
-

Attachment: (was: ZOOKEEPER-773_2.diff)

 Log visualisation
 -

 Key: ZOOKEEPER-773
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-773
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Priority: Minor
 Fix For: 3.4.0

 Attachments: ZOOKEEPER-773.binaries.tgz, ZOOKEEPER-773.diff


 Zkgraph is a log viewer for zookeeper. It can handle transaction logs and 
 message logs. There are currently two view.
  
   a) Server view
  The server view shows the interactions between the different servers in 
 an ensemble. The X axis represents time. 
 * Exceptions show up as red dots. Hovering your mouse over them will 
 give you more details of the exception
   * The colour of the line represents the election state of the server. 
  - orange means LOOKING for leader
  - dark green means the server is the leader
  - light green means the server is following a leader
  - yellow means there isn't enough information to determine the state 
 of the server. 
   * The gray arrows denote election messages between servers. Pink dashed 
 arrows are messages that were sent but never delivered.
b) Session view
   The session view shows the lifetime of sessions on a server. Use the 
 time filter to narrow down the view. Any more than about 2000 events will 
 take a long time to view in your browser. 
   The Y axis represents time in this case. Each line is a session. The 
 black dots represent events on the session. You can click on the black dots 
 for more details of the event.
 2 - Compiling  Running
 Run ant jar in src/contrib/zkgraph/. This will download all dependencies 
 and compile all the zkgraph code.
 Once compilation has finished, you can run it the the zkgraph.sh script in 
 src/contrib/zkgraph/bin. This will start and embedded web server on you 
 machine. Navigate to http://localhost:8182/graph/main.html.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-773) Log visualisation

2010-06-04 Thread Ivan Kelly (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Kelly updated ZOOKEEPER-773:
-

Attachment: (was: ZOOKEEPER-773.diff)

 Log visualisation
 -

 Key: ZOOKEEPER-773
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-773
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Priority: Minor
 Fix For: 3.4.0

 Attachments: ZOOKEEPER-773.binaries.tgz, ZOOKEEPER-773.diff


 Zkgraph is a log viewer for zookeeper. It can handle transaction logs and 
 message logs. There are currently two view.
  
   a) Server view
  The server view shows the interactions between the different servers in 
 an ensemble. The X axis represents time. 
 * Exceptions show up as red dots. Hovering your mouse over them will 
 give you more details of the exception
   * The colour of the line represents the election state of the server. 
  - orange means LOOKING for leader
  - dark green means the server is the leader
  - light green means the server is following a leader
  - yellow means there isn't enough information to determine the state 
 of the server. 
   * The gray arrows denote election messages between servers. Pink dashed 
 arrows are messages that were sent but never delivered.
b) Session view
   The session view shows the lifetime of sessions on a server. Use the 
 time filter to narrow down the view. Any more than about 2000 events will 
 take a long time to view in your browser. 
   The Y axis represents time in this case. Each line is a session. The 
 black dots represent events on the session. You can click on the black dots 
 for more details of the event.
 2 - Compiling  Running
 Run ant jar in src/contrib/zkgraph/. This will download all dependencies 
 and compile all the zkgraph code.
 Once compilation has finished, you can run it the the zkgraph.sh script in 
 src/contrib/zkgraph/bin. This will start and embedded web server on you 
 machine. Navigate to http://localhost:8182/graph/main.html.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-773) Log visualisation

2010-06-04 Thread Ivan Kelly (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Kelly updated ZOOKEEPER-773:
-

Attachment: ZOOKEEPER-773.binaries.tgz
ZOOKEEPER-773.diff

Finished renaming to loggraph. Fixed the ordering of files in selector. Minor 
build fixes

 Log visualisation
 -

 Key: ZOOKEEPER-773
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-773
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Priority: Minor
 Fix For: 3.4.0

 Attachments: ZOOKEEPER-773.binaries.tgz, ZOOKEEPER-773.diff


 Zkgraph is a log viewer for zookeeper. It can handle transaction logs and 
 message logs. There are currently two view.
  
   a) Server view
  The server view shows the interactions between the different servers in 
 an ensemble. The X axis represents time. 
 * Exceptions show up as red dots. Hovering your mouse over them will 
 give you more details of the exception
   * The colour of the line represents the election state of the server. 
  - orange means LOOKING for leader
  - dark green means the server is the leader
  - light green means the server is following a leader
  - yellow means there isn't enough information to determine the state 
 of the server. 
   * The gray arrows denote election messages between servers. Pink dashed 
 arrows are messages that were sent but never delivered.
b) Session view
   The session view shows the lifetime of sessions on a server. Use the 
 time filter to narrow down the view. Any more than about 2000 events will 
 take a long time to view in your browser. 
   The Y axis represents time in this case. Each line is a session. The 
 black dots represent events on the session. You can click on the black dots 
 for more details of the event.
 2 - Compiling  Running
 Run ant jar in src/contrib/zkgraph/. This will download all dependencies 
 and compile all the zkgraph code.
 Once compilation has finished, you can run it the the zkgraph.sh script in 
 src/contrib/zkgraph/bin. This will start and embedded web server on you 
 machine. Navigate to http://localhost:8182/graph/main.html.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-773) Log visualisation

2010-06-04 Thread Ivan Kelly (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12875603#action_12875603
 ] 

Ivan Kelly commented on ZOOKEEPER-773:
--

I've verified with firefox on another machine, running ubuntu lucid + Firefox 
3.6.3 . What does dpkg -l xul-ext* and dpkg -l firefox* tell you? Does anything 
show up in the javascript console at all?

1) This is probably due to the detection of the server ID being a bit dodgy. 
Still not show how to fix this. 

2) Fixed

3) All renamed.

I just uploaded a patch with the fixes. There's also a tarball with the 
binaries in it.  

 Log visualisation
 -

 Key: ZOOKEEPER-773
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-773
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Priority: Minor
 Fix For: 3.4.0

 Attachments: ZOOKEEPER-773.binaries.tgz, ZOOKEEPER-773.diff


 Zkgraph is a log viewer for zookeeper. It can handle transaction logs and 
 message logs. There are currently two view.
  
   a) Server view
  The server view shows the interactions between the different servers in 
 an ensemble. The X axis represents time. 
 * Exceptions show up as red dots. Hovering your mouse over them will 
 give you more details of the exception
   * The colour of the line represents the election state of the server. 
  - orange means LOOKING for leader
  - dark green means the server is the leader
  - light green means the server is following a leader
  - yellow means there isn't enough information to determine the state 
 of the server. 
   * The gray arrows denote election messages between servers. Pink dashed 
 arrows are messages that were sent but never delivered.
b) Session view
   The session view shows the lifetime of sessions on a server. Use the 
 time filter to narrow down the view. Any more than about 2000 events will 
 take a long time to view in your browser. 
   The Y axis represents time in this case. Each line is a session. The 
 black dots represent events on the session. You can click on the black dots 
 for more details of the event.
 2 - Compiling  Running
 Run ant jar in src/contrib/zkgraph/. This will download all dependencies 
 and compile all the zkgraph code.
 Once compilation has finished, you can run it the the zkgraph.sh script in 
 src/contrib/zkgraph/bin. This will start and embedded web server on you 
 machine. Navigate to http://localhost:8182/graph/main.html.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-773) Log visualisation

2010-06-04 Thread Patrick Hunt (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12875655#action_12875655
 ] 

Patrick Hunt commented on ZOOKEEPER-773:


$ dpkg -l xul-ext*
No packages found matching xul-ext*.

$ dpkg -l firefox*
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Cfg-files/Unpacked/Failed-cfg/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name   VersionDescription
+++-==-==-
ii  firefox3.5.9+nobinonly-0ubunt meta package for the popular 
mozilla web browser
un  firefox-2  none (no description available)
un  firefox-3.0none (no description available)
un  firefox-3.0-branding   none (no description available)
un  firefox-3.0-dom-inspec none (no description available)
un  firefox-3.0-gnome-supp none (no description available)
un  firefox-3.0-venkmannone (no description available)
un  firefox-3.1none (no description available)
un  firefox-3.1-branding   none (no description available)
un  firefox-3.1-gnome-supp none (no description available)
ii  firefox-3.53.5.9+nobinonly-0ubunt safe and easy web browser 
from Mozilla
ii  firefox-3.5-branding   3.5.9+nobinonly-0ubunt Package that ships the 
firefox branding
ii  firefox-3.5-gnome-supp 3.5.9+nobinonly-0ubunt Support for Gnome in Mozilla 
Firefox
un  firefox-dom-inspector  none (no description available)
ii  firefox-gnome-support  3.5.9+nobinonly-0ubunt meta package pointing to the 
latest gnome-support package fo


 Log visualisation
 -

 Key: ZOOKEEPER-773
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-773
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Priority: Minor
 Fix For: 3.4.0

 Attachments: ZOOKEEPER-773.binaries.tgz, ZOOKEEPER-773.diff


 Zkgraph is a log viewer for zookeeper. It can handle transaction logs and 
 message logs. There are currently two view.
  
   a) Server view
  The server view shows the interactions between the different servers in 
 an ensemble. The X axis represents time. 
 * Exceptions show up as red dots. Hovering your mouse over them will 
 give you more details of the exception
   * The colour of the line represents the election state of the server. 
  - orange means LOOKING for leader
  - dark green means the server is the leader
  - light green means the server is following a leader
  - yellow means there isn't enough information to determine the state 
 of the server. 
   * The gray arrows denote election messages between servers. Pink dashed 
 arrows are messages that were sent but never delivered.
b) Session view
   The session view shows the lifetime of sessions on a server. Use the 
 time filter to narrow down the view. Any more than about 2000 events will 
 take a long time to view in your browser. 
   The Y axis represents time in this case. Each line is a session. The 
 black dots represent events on the session. You can click on the black dots 
 for more details of the event.
 2 - Compiling  Running
 Run ant jar in src/contrib/zkgraph/. This will download all dependencies 
 and compile all the zkgraph code.
 Once compilation has finished, you can run it the the zkgraph.sh script in 
 src/contrib/zkgraph/bin. This will start and embedded web server on you 
 machine. Navigate to http://localhost:8182/graph/main.html.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Issue Comment Edited: (ZOOKEEPER-773) Log visualisation

2010-06-04 Thread Patrick Hunt (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12875655#action_12875655
 ] 

Patrick Hunt edited comment on ZOOKEEPER-773 at 6/4/10 12:40 PM:
-

{noformat}
$ dpkg -l xul-ext*
No packages found matching xul-ext*.

$ dpkg -l firefox*
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Cfg-files/Unpacked/Failed-cfg/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name   VersionDescription
+++-==-==-
ii  firefox3.5.9+nobinonly-0ubunt meta package for the popular 
mozilla web browser
un  firefox-2  none (no description available)
un  firefox-3.0none (no description available)
un  firefox-3.0-branding   none (no description available)
un  firefox-3.0-dom-inspec none (no description available)
un  firefox-3.0-gnome-supp none (no description available)
un  firefox-3.0-venkmannone (no description available)
un  firefox-3.1none (no description available)
un  firefox-3.1-branding   none (no description available)
un  firefox-3.1-gnome-supp none (no description available)
ii  firefox-3.53.5.9+nobinonly-0ubunt safe and easy web browser 
from Mozilla
ii  firefox-3.5-branding   3.5.9+nobinonly-0ubunt Package that ships the 
firefox branding
ii  firefox-3.5-gnome-supp 3.5.9+nobinonly-0ubunt Support for Gnome in Mozilla 
Firefox
un  firefox-dom-inspector  none (no description available)
ii  firefox-gnome-support  3.5.9+nobinonly-0ubunt meta package pointing to the 
latest gnome-support package fo
{noformat}


  was (Author: phunt):
{quote}
$ dpkg -l xul-ext*
No packages found matching xul-ext*.

$ dpkg -l firefox*
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Cfg-files/Unpacked/Failed-cfg/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name   VersionDescription
+++-==-==-
ii  firefox3.5.9+nobinonly-0ubunt meta package for the popular 
mozilla web browser
un  firefox-2  none (no description available)
un  firefox-3.0none (no description available)
un  firefox-3.0-branding   none (no description available)
un  firefox-3.0-dom-inspec none (no description available)
un  firefox-3.0-gnome-supp none (no description available)
un  firefox-3.0-venkmannone (no description available)
un  firefox-3.1none (no description available)
un  firefox-3.1-branding   none (no description available)
un  firefox-3.1-gnome-supp none (no description available)
ii  firefox-3.53.5.9+nobinonly-0ubunt safe and easy web browser 
from Mozilla
ii  firefox-3.5-branding   3.5.9+nobinonly-0ubunt Package that ships the 
firefox branding
ii  firefox-3.5-gnome-supp 3.5.9+nobinonly-0ubunt Support for Gnome in Mozilla 
Firefox
un  firefox-dom-inspector  none (no description available)
ii  firefox-gnome-support  3.5.9+nobinonly-0ubunt meta package pointing to the 
latest gnome-support package fo
{quote}

  
 Log visualisation
 -

 Key: ZOOKEEPER-773
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-773
 Project: Zookeeper
  Issue Type: Improvement
  Components: contrib
Reporter: Ivan Kelly
Assignee: Ivan Kelly
Priority: Minor
 Fix For: 3.4.0

 Attachments: ZOOKEEPER-773.binaries.tgz, ZOOKEEPER-773.diff


 Zkgraph is a log viewer for zookeeper. It can handle transaction logs and 
 message logs. There are currently two view.
  
   a) Server view
  The server view shows the interactions between the different servers in 
 an ensemble. The X axis represents time. 
 * Exceptions show up as red dots. Hovering your mouse over them will 
 give you more details of the exception
   * The colour of the line represents the election state of the server. 
  - orange means LOOKING for leader
  - dark green means the server is the leader
  - light green means the server is following a leader
  - yellow means there isn't enough information to determine the state 
 of the server. 
   * The gray arrows denote election messages between servers. Pink dashed 
 arrows are messages that were sent but never delivered.
 

[jira] Created: (ZOOKEEPER-786) Exception in ZooKeeper.toString

2010-06-04 Thread Stephen Green (JIRA)
Exception in ZooKeeper.toString
---

 Key: ZOOKEEPER-786
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-786
 Project: Zookeeper
  Issue Type: Bug
  Components: java client
Affects Versions: 3.3.1
 Environment: Mac OS X, x86
Reporter: Stephen Green


When trying to call ZooKeeper.toString during client disconnections, an 
exception can be generated:


[04/06/10 15:39:57.744] ERROR Error while calling watcher 
java.lang.Error: java.net.SocketException: Socket operation on non-socket
at sun.nio.ch.Net.localAddress(Net.java:128)
at sun.nio.ch.SocketChannelImpl.localAddress(SocketChannelImpl.java:430)
at sun.nio.ch.SocketAdaptor.getLocalAddress(SocketAdaptor.java:147)
at java.net.Socket.getLocalSocketAddress(Socket.java:717)
at 
org.apache.zookeeper.ClientCnxn.getLocalSocketAddress(ClientCnxn.java:227)
at org.apache.zookeeper.ClientCnxn.toString(ClientCnxn.java:183)
at java.lang.String.valueOf(String.java:2826)
at java.lang.StringBuilder.append(StringBuilder.java:115)
at org.apache.zookeeper.ZooKeeper.toString(ZooKeeper.java:1486)
at java.util.Formatter$FormatSpecifier.printString(Formatter.java:2794)
at java.util.Formatter$FormatSpecifier.print(Formatter.java:2677)
at java.util.Formatter.format(Formatter.java:2433)
at java.util.Formatter.format(Formatter.java:2367)
at java.lang.String.format(String.java:2769)
at com.echonest.cluster.ZooContainer.process(ZooContainer.java:544)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:488)
Caused by: java.net.SocketException: Socket operation on non-socket
at sun.nio.ch.Net.localInetAddress(Native Method)
at sun.nio.ch.Net.localAddress(Net.java:125)
... 15 more


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-740) zkpython leading to segfault on zookeeper

2010-06-04 Thread Mike Solomon (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12875842#action_12875842
 ] 

Mike Solomon commented on ZOOKEEPER-740:


The common cases is when you supply a watcher for a get().

Start a zk server on localhost and create a node /zk.

Connect a python process like this:

import sys
import zookeeper

zh = zookeeper.init('localhost:2181')

def _zk_callback(*args):
  print  sys.stderr, _zk_callback,  args

zookeeper.get(zh, '/zk', _zk_callback)

Kill the zk server. The client will idle fine. When restarting the zk server, I 
get a SIGSEGV on reconnect 100% of the time.

This is fixed by the following patch:

[msolomon]yuriko:~/src/zookeeper-3.3.1/src/contrib/zkpython svn di
Index: src/c/zookeeper.c
===
--- src/c/zookeeper.c   (revision 951628)
+++ src/c/zookeeper.c   (working copy)
@@ -436,7 +436,9 @@
   if (PyObject_CallObject((PyObject*)callback, arglist) == NULL) {
 PyErr_Print();
   }
-  if (pyw-permanent == 0) {
+  // msolomon: when a session event happens, watchers get dispatched,
+  // but they are retained in the C client for dispatch again.
+  if (pyw-permanent == 0  type != ZOO_SESSION_EVENT) {
 free_pywatcher(pyw);
   }
   PyGILState_Release(gstate);




 zkpython leading to segfault on zookeeper
 -

 Key: ZOOKEEPER-740
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-740
 Project: Zookeeper
  Issue Type: Bug
Affects Versions: 3.3.0
Reporter: Federico
Assignee: Henry Robinson
Priority: Critical
 Fix For: 3.4.0


 The program that we are implementing uses the python binding for zookeeper 
 but sometimes it crash with segfault; here is the bt from gdb:
 Program received signal SIGSEGV, Segmentation fault.
 [Switching to Thread 0xad244b70 (LWP 28216)]
 0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
 at ../Objects/abstract.c:2488
 2488../Objects/abstract.c: No such file or directory.
 in ../Objects/abstract.c
 (gdb) bt
 #0  0x080611d5 in PyObject_Call (func=0x862fab0, arg=0x8837194, kw=0x0)
 at ../Objects/abstract.c:2488
 #1  0x080d6ef2 in PyEval_CallObjectWithKeywords (func=0x862fab0,
 arg=0x8837194, kw=0x0) at ../Python/ceval.c:3575
 #2  0x080612a0 in PyObject_CallObject (o=0x862fab0, a=0x8837194)
 at ../Objects/abstract.c:2480
 #3  0x0047af42 in watcher_dispatch (zzh=0x86174e0, type=-1, state=1,
 path=0x86337c8 , context=0x8588660) at src/c/zookeeper.c:314
 #4  0x00496559 in do_foreach_watcher (zh=0x86174e0, type=-1, state=1,
 path=0x86337c8 , list=0xa5354140) at src/zk_hashtable.c:275
 #5  deliverWatchers (zh=0x86174e0, type=-1, state=1, path=0x86337c8 ,
 list=0xa5354140) at src/zk_hashtable.c:317
 #6  0x0048ae3c in process_completions (zh=0x86174e0) at src/zookeeper.c:1766
 #7  0x0049706b in do_completion (v=0x86174e0) at src/mt_adaptor.c:333
 #8  0x0013380e in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
 #9  0x002578de in clone () from /lib/tls/i686/cmov/libc.so.6

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.