[jira] Commented: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string

2010-02-22 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12837110#action_12837110
 ] 

Hadoop QA commented on ZOOKEEPER-677:
-

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12436677/ZOOKEEPER-677.patch
  against trunk revision 912119.

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 6 new or modified tests.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 findbugs.  The patch does not introduce any new Findbugs warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

-1 core tests.  The patch failed core unit tests.

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h8.grid.sp2.yahoo.net/122/testReport/
Findbugs warnings: 
http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h8.grid.sp2.yahoo.net/122/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: 
http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h8.grid.sp2.yahoo.net/122/console

This message is automatically generated.

> c client doesn't allow ipv6 numeric connect string
> --
>
> Key: ZOOKEEPER-677
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677
> Project: Zookeeper
>  Issue Type: Bug
>  Components: c client
>Affects Versions: 3.2.2
>Reporter: Patrick Hunt
>Priority: Critical
> Fix For: 3.3.0
>
> Attachments: ZOOKEEPER-677.patch
>
>
> The c client doesn't handle ipv6 numeric addresses as they are colon : 
> delmited. After splitting the host/port on : we look for the port as the 
> second entry in the array rather than the last entry in the array.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string

2010-02-22 Thread Benjamin Reed (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Reed updated ZOOKEEPER-677:


Attachment: ZOOKEEPER-677.patch

this patch finds the port using strrchr instead of strchr to allow ipv6 
addresses. the test case assumes that localhost is reachable with ::1

> c client doesn't allow ipv6 numeric connect string
> --
>
> Key: ZOOKEEPER-677
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677
> Project: Zookeeper
>  Issue Type: Bug
>  Components: c client
>Affects Versions: 3.2.2
>Reporter: Patrick Hunt
>Priority: Critical
> Fix For: 3.3.0
>
> Attachments: ZOOKEEPER-677.patch
>
>
> The c client doesn't handle ipv6 numeric addresses as they are colon : 
> delmited. After splitting the host/port on : we look for the port as the 
> second entry in the array rather than the last entry in the array.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string

2010-02-22 Thread Benjamin Reed (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Reed updated ZOOKEEPER-677:


Status: Patch Available  (was: Open)

> c client doesn't allow ipv6 numeric connect string
> --
>
> Key: ZOOKEEPER-677
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677
> Project: Zookeeper
>  Issue Type: Bug
>  Components: c client
>Affects Versions: 3.2.2
>Reporter: Patrick Hunt
>Priority: Critical
> Fix For: 3.3.0
>
> Attachments: ZOOKEEPER-677.patch
>
>
> The c client doesn't handle ipv6 numeric addresses as they are colon : 
> delmited. After splitting the host/port on : we look for the port as the 
> second entry in the array rather than the last entry in the array.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-678) Browser application to view and edit the contents of a zookeeper instance

2010-02-22 Thread Colin Goodheart-Smithe (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Colin Goodheart-Smithe updated ZOOKEEPER-678:
-

Attachment: ZooInspector.zip

The zip file which contains the source and built version of the application

> Browser application to view and edit the contents of a zookeeper instance
> -
>
> Key: ZOOKEEPER-678
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-678
> Project: Zookeeper
>  Issue Type: New Feature
>Affects Versions: 3.3.0
>Reporter: Colin Goodheart-Smithe
> Fix For: 3.3.0
>
> Attachments: ZooInspector.zip
>
>
> An application which shows a tree view of the nodes currently in a zookeeper 
> instance and allow the user to view and update the contents of the nodes as 
> well as allowing users to add and remove nodes from the tree, similar in use 
> to the Luke application in the Lucene project.
> I have a list of other features that I want to add to this application but I 
> wanted to gauge the response before I implemented them all.  I have found 
> this useful when debugging my application and thought that it may be useful 
> to others.
> I was going to submit this as a patch file but I have used some icon files 
> and one library which isn't available in the maven/ivy repositories and these 
> don't seem to work when creating a patch file using subversion.  Because of 
> this I have attached a zip containing this application to this issue.  If 
> there is a better way to submit this please let me know.
> The zip contains two directories, the src directory contains the source as it 
> would be added to the contrib folder and the build folder contains a build 
> version of the with a runnable jar.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Created: (ZOOKEEPER-678) Browser application to view and edit the contents of a zookeeper instance

2010-02-22 Thread Colin Goodheart-Smithe (JIRA)
Browser application to view and edit the contents of a zookeeper instance
-

 Key: ZOOKEEPER-678
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-678
 Project: Zookeeper
  Issue Type: New Feature
Affects Versions: 3.3.0
Reporter: Colin Goodheart-Smithe
 Fix For: 3.3.0


An application which shows a tree view of the nodes currently in a zookeeper 
instance and allow the user to view and update the contents of the nodes as 
well as allowing users to add and remove nodes from the tree, similar in use to 
the Luke application in the Lucene project.

I have a list of other features that I want to add to this application but I 
wanted to gauge the response before I implemented them all.  I have found this 
useful when debugging my application and thought that it may be useful to 
others.

I was going to submit this as a patch file but I have used some icon files and 
one library which isn't available in the maven/ivy repositories and these don't 
seem to work when creating a patch file using subversion.  Because of this I 
have attached a zip containing this application to this issue.  If there is a 
better way to submit this please let me know.

The zip contains two directories, the src directory contains the source as it 
would be added to the contrib folder and the build folder contains a build 
version of the with a runnable jar.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython

2010-02-22 Thread Josh Fraser (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836822#action_12836822
 ] 

Josh Fraser commented on ZOOKEEPER-676:
---

Awesome!  Thanks for the attention to the issue, and thanks Patrick for your 
talk at our offices last week.

> 50%-75% connection loss exceptions using zkpython
> -
>
> Key: ZOOKEEPER-676
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib, contrib-bindings
>Affects Versions: 3.2.2
> Environment: Mac OS X 10.5.8,   MacBook Air Intel Core 2 Duo @ 
> 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone
>Reporter: Josh Fraser
> Attachments: connection_test.py
>
>
> I get about 50-75% connection loss exceptions and about 10% Bus Error when 
> using the contrib/zkpython zookeeper.so.  Below is the exception:
> 2010-02-21 
> 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket 
> [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not 
> supported by protocol family): connect() call failed
> Traceback (most recent call last):
>   File "./zksh.py", line 63, in 
> 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: 
> initiated connection to server [127.0.0.1:2181]
> zkcli.dispatch(cmd,*args)
>   File "./zksh.py", line 56, in dispatch
> returned = run(*args)
>   File "./zksh.py", line 48, in ls
> print "\n".join(self.cmd.listNode(node))
>   File "/Users/josh/git/zktools/commands.py", line 22, in listNode
> for path in zookeeper.get_children(self.zk, node):
> zookeeper.ConnectionLossException: connection loss
> I've run this in gdb and have this backtrace:
> #0  free_pywatcher (pw=0x0) at src/c/zookeeper.c:199
> #1  0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765
> #2  0x0018f51e in PyEval_EvalFrameEx ()
> #3  0x00191173 in PyEval_EvalCodeEx ()
> #4  0x0013b488 in PyFunction_SetClosure ()
> #5  0x00121505 in PyObject_Call ()
> #6  0x0018fcd0 in PyEval_EvalFrameEx ()
> #7  0x00191173 in PyEval_EvalCodeEx ()
> #8  0x0013b488 in PyFunction_SetClosure ()
> #9  0x00121505 in PyObject_Call ()
> #10 0x0018fcd0 in PyEval_EvalFrameEx ()
> #11 0x00191173 in PyEval_EvalCodeEx ()
> #12 0x0018f79d in PyEval_EvalFrameEx ()
> #13 0x00191173 in PyEval_EvalCodeEx ()
> #14 0x00191260 in PyEval_EvalCode ()
> #15 0x001a883c in PyErr_Display ()
> #16 0x001aa4ab in PyRun_InteractiveOneFlags ()
> #17 0x001aa5f9 in PyRun_InteractiveLoopFlags ()
> #18 0x001aaa2b in PyRun_AnyFileExFlags ()
> #19 0x001b5a57 in Py_Main ()
> #20 0x1fca in ?? ()
> zookeeper.c @ line 199:
>  void free_pywatcher( pywatcher_t *pw)
> {
>   Py_DECREF(pw->callback);
>   free(pw);
> }
> That's as far as I've dug so far -- I ended up just writing a retry decorator 
> to get around it for now.  On the same machine, the zkCli.sh test client 
> works flawlessly.  Also, here's the Mac OS X Bus Error trace:
> Process: Python [18556]
> Path:
> /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python
> Identifier:  Python
> Version: ??? (???)
> Code Type:   X86 (Native)
> Parent Process:  bash [18436]
> Interval Since Last Report:  3323078 sec
> Crashes Since Last Report:   50
> Per-App Interval Since Last Report:  0 sec
> Per-App Crashes Since Last Report:   38
> Date/Time:   2010-02-21 17:07:27.399 -0800
> OS Version:  Mac OS X 10.5.8 (9L31a)
> Report Version:  6
> Anonymous UUID:  FA533BDA-50B2-47A9-931C-6F2614C741F0
> Exception Type:  EXC_BAD_ACCESS (SIGBUS)
> Exception Codes: KERN_PROTECTION_FAILURE at 0x0004
> Crashed Thread:  0
> Thread 0 Crashed:
> 0   zookeeper.so  0x002332bd free_pywatcher + 10 
> (zookeeper.c:199)
> 1   zookeeper.so  0x00239e09 pyzoo_exists + 984 
> (zookeeper.c:765)
> 2   org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116
> 3   org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598
> 4   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 5   org.python.python 0x0013b488 PyFunction_SetClosure + 2667
> 6   org.python.python 0x00121505 PyObject_Call + 50
> 7   org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086
> 8   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 9   org.python.python 0x0013b488 PyFunction_SetClosure + 2667
> 10  org.python.python 0x00121505 PyObject_Call + 50
> 11  org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086
> 12  org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 13  org.python.python 0x00191

[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython

2010-02-22 Thread Patrick Hunt (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836814#action_12836814
 ] 

Patrick Hunt commented on ZOOKEEPER-676:


re use of ipv6 numeric address - I fixed a similar issue with java on this 
recently ZOOKEEPER-667, looking at the c code now it seems that we are looking 
for the first occurrence of ':' rather than the last. I've opened an issue 
ZOOKEEPER-677 to track this.

One issue we've had with this is very little access to ipv6 machines on which 
to do dev/testing. Also few ipv6 users. Thanks for the report!

> 50%-75% connection loss exceptions using zkpython
> -
>
> Key: ZOOKEEPER-676
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib, contrib-bindings
>Affects Versions: 3.2.2
> Environment: Mac OS X 10.5.8,   MacBook Air Intel Core 2 Duo @ 
> 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone
>Reporter: Josh Fraser
> Attachments: connection_test.py
>
>
> I get about 50-75% connection loss exceptions and about 10% Bus Error when 
> using the contrib/zkpython zookeeper.so.  Below is the exception:
> 2010-02-21 
> 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket 
> [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not 
> supported by protocol family): connect() call failed
> Traceback (most recent call last):
>   File "./zksh.py", line 63, in 
> 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: 
> initiated connection to server [127.0.0.1:2181]
> zkcli.dispatch(cmd,*args)
>   File "./zksh.py", line 56, in dispatch
> returned = run(*args)
>   File "./zksh.py", line 48, in ls
> print "\n".join(self.cmd.listNode(node))
>   File "/Users/josh/git/zktools/commands.py", line 22, in listNode
> for path in zookeeper.get_children(self.zk, node):
> zookeeper.ConnectionLossException: connection loss
> I've run this in gdb and have this backtrace:
> #0  free_pywatcher (pw=0x0) at src/c/zookeeper.c:199
> #1  0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765
> #2  0x0018f51e in PyEval_EvalFrameEx ()
> #3  0x00191173 in PyEval_EvalCodeEx ()
> #4  0x0013b488 in PyFunction_SetClosure ()
> #5  0x00121505 in PyObject_Call ()
> #6  0x0018fcd0 in PyEval_EvalFrameEx ()
> #7  0x00191173 in PyEval_EvalCodeEx ()
> #8  0x0013b488 in PyFunction_SetClosure ()
> #9  0x00121505 in PyObject_Call ()
> #10 0x0018fcd0 in PyEval_EvalFrameEx ()
> #11 0x00191173 in PyEval_EvalCodeEx ()
> #12 0x0018f79d in PyEval_EvalFrameEx ()
> #13 0x00191173 in PyEval_EvalCodeEx ()
> #14 0x00191260 in PyEval_EvalCode ()
> #15 0x001a883c in PyErr_Display ()
> #16 0x001aa4ab in PyRun_InteractiveOneFlags ()
> #17 0x001aa5f9 in PyRun_InteractiveLoopFlags ()
> #18 0x001aaa2b in PyRun_AnyFileExFlags ()
> #19 0x001b5a57 in Py_Main ()
> #20 0x1fca in ?? ()
> zookeeper.c @ line 199:
>  void free_pywatcher( pywatcher_t *pw)
> {
>   Py_DECREF(pw->callback);
>   free(pw);
> }
> That's as far as I've dug so far -- I ended up just writing a retry decorator 
> to get around it for now.  On the same machine, the zkCli.sh test client 
> works flawlessly.  Also, here's the Mac OS X Bus Error trace:
> Process: Python [18556]
> Path:
> /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python
> Identifier:  Python
> Version: ??? (???)
> Code Type:   X86 (Native)
> Parent Process:  bash [18436]
> Interval Since Last Report:  3323078 sec
> Crashes Since Last Report:   50
> Per-App Interval Since Last Report:  0 sec
> Per-App Crashes Since Last Report:   38
> Date/Time:   2010-02-21 17:07:27.399 -0800
> OS Version:  Mac OS X 10.5.8 (9L31a)
> Report Version:  6
> Anonymous UUID:  FA533BDA-50B2-47A9-931C-6F2614C741F0
> Exception Type:  EXC_BAD_ACCESS (SIGBUS)
> Exception Codes: KERN_PROTECTION_FAILURE at 0x0004
> Crashed Thread:  0
> Thread 0 Crashed:
> 0   zookeeper.so  0x002332bd free_pywatcher + 10 
> (zookeeper.c:199)
> 1   zookeeper.so  0x00239e09 pyzoo_exists + 984 
> (zookeeper.c:765)
> 2   org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116
> 3   org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598
> 4   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 5   org.python.python 0x0013b488 PyFunction_SetClosure + 2667
> 6   org.python.python 0x00121505 PyObject_Call + 50
> 7   org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086
> 8   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 9   org.python.python 0x0013b488 PyF

[jira] Created: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string

2010-02-22 Thread Patrick Hunt (JIRA)
c client doesn't allow ipv6 numeric connect string
--

 Key: ZOOKEEPER-677
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677
 Project: Zookeeper
  Issue Type: Bug
  Components: c client
Affects Versions: 3.2.2
Reporter: Patrick Hunt
Priority: Critical
 Fix For: 3.3.0


The c client doesn't handle ipv6 numeric addresses as they are colon : 
delmited. After splitting the host/port on : we look for the port as the second 
entry in the array rather than the last entry in the array.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-661) Add Ruby bindings

2010-02-22 Thread Patrick Hunt (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836760#action_12836760
 ] 

Patrick Hunt commented on ZOOKEEPER-661:


I'd like to encourage both of you to consider submitting a patch to include the 
binding in ZK contrib. I realize that doing it on github makes for a more agile 
process, perhaps if not today then at some point in the future.

Also, would it make sense for the two projects/bindings to collaborate? Having 
two bindings is fine, but having one would be better. ;-) Esp if the 
collaboration will focus features/testing/usability/docs/etc... that each 
project individually might not have (ie pool your resources).

Regards and thanks!

> Add Ruby bindings
> -
>
> Key: ZOOKEEPER-661
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-661
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib-bindings
> Environment: MRI Ruby 1.9
> JRuby 1.4
>Reporter: Andrew Reynhout
>Priority: Minor
>
> Add Ruby bindings to the ZooKeeper distribution.
> Ruby presents special threading difficulties for asynchronous ZK calls (aget, 
> watchers, etc).  It looks like the simplest workaround is to patch the ZK C 
> API.
> Proposed approach will be described in comment.
> Please use this ticket for discussion and suggestions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-418) Need nifty zookeeper browser

2010-02-22 Thread Mark Masse (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836663#action_12836663
 ] 

Mark Masse commented on ZOOKEEPER-418:
--

Hi,

I have developed an Eclipse plug-in for Zookeeper.  You can find out all about 
it and download it from my website here:  

http://www.massedynamic.org/eclipse/zookeeper/
 

> Need nifty zookeeper browser
> 
>
> Key: ZOOKEEPER-418
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-418
> Project: Zookeeper
>  Issue Type: Bug
>Reporter: Ted Dunning
>Assignee: Ted Dunning
> Fix For: 3.3.0
>
> Attachments: pom.xml, screenshot-1.jpg, zk-view-0.1.tgz, ZooKeeper 
> Eclipse Plug-in.pdf
>
>
> It would be very nice to have a browser that would allow the state of a Zoo 
> to be examined.  Even nice would be such a utility that showed changes in 
> real time.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython

2010-02-22 Thread Josh Fraser (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836547#action_12836547
 ] 

Josh Fraser commented on ZOOKEEPER-676:
---

I have a feeling it's related to 
src/c/zookeeper.c 

zhandle_t *zookeeper_init(const char *host, watcher_fn watcher,
  int recv_timeout, const clientid_t *clientid, void *context, int flags)

*host shouldn't be hostname:port and then split on : because an ipv6 address 
might be passed to it, and that seems to the problem.  I'd offer a patch, but 
my C knowledge is limited to reading and comprehension :) 




> 50%-75% connection loss exceptions using zkpython
> -
>
> Key: ZOOKEEPER-676
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib, contrib-bindings
>Affects Versions: 3.2.2
> Environment: Mac OS X 10.5.8,   MacBook Air Intel Core 2 Duo @ 
> 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone
>Reporter: Josh Fraser
> Attachments: connection_test.py
>
>
> I get about 50-75% connection loss exceptions and about 10% Bus Error when 
> using the contrib/zkpython zookeeper.so.  Below is the exception:
> 2010-02-21 
> 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket 
> [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not 
> supported by protocol family): connect() call failed
> Traceback (most recent call last):
>   File "./zksh.py", line 63, in 
> 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: 
> initiated connection to server [127.0.0.1:2181]
> zkcli.dispatch(cmd,*args)
>   File "./zksh.py", line 56, in dispatch
> returned = run(*args)
>   File "./zksh.py", line 48, in ls
> print "\n".join(self.cmd.listNode(node))
>   File "/Users/josh/git/zktools/commands.py", line 22, in listNode
> for path in zookeeper.get_children(self.zk, node):
> zookeeper.ConnectionLossException: connection loss
> I've run this in gdb and have this backtrace:
> #0  free_pywatcher (pw=0x0) at src/c/zookeeper.c:199
> #1  0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765
> #2  0x0018f51e in PyEval_EvalFrameEx ()
> #3  0x00191173 in PyEval_EvalCodeEx ()
> #4  0x0013b488 in PyFunction_SetClosure ()
> #5  0x00121505 in PyObject_Call ()
> #6  0x0018fcd0 in PyEval_EvalFrameEx ()
> #7  0x00191173 in PyEval_EvalCodeEx ()
> #8  0x0013b488 in PyFunction_SetClosure ()
> #9  0x00121505 in PyObject_Call ()
> #10 0x0018fcd0 in PyEval_EvalFrameEx ()
> #11 0x00191173 in PyEval_EvalCodeEx ()
> #12 0x0018f79d in PyEval_EvalFrameEx ()
> #13 0x00191173 in PyEval_EvalCodeEx ()
> #14 0x00191260 in PyEval_EvalCode ()
> #15 0x001a883c in PyErr_Display ()
> #16 0x001aa4ab in PyRun_InteractiveOneFlags ()
> #17 0x001aa5f9 in PyRun_InteractiveLoopFlags ()
> #18 0x001aaa2b in PyRun_AnyFileExFlags ()
> #19 0x001b5a57 in Py_Main ()
> #20 0x1fca in ?? ()
> zookeeper.c @ line 199:
>  void free_pywatcher( pywatcher_t *pw)
> {
>   Py_DECREF(pw->callback);
>   free(pw);
> }
> That's as far as I've dug so far -- I ended up just writing a retry decorator 
> to get around it for now.  On the same machine, the zkCli.sh test client 
> works flawlessly.  Also, here's the Mac OS X Bus Error trace:
> Process: Python [18556]
> Path:
> /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python
> Identifier:  Python
> Version: ??? (???)
> Code Type:   X86 (Native)
> Parent Process:  bash [18436]
> Interval Since Last Report:  3323078 sec
> Crashes Since Last Report:   50
> Per-App Interval Since Last Report:  0 sec
> Per-App Crashes Since Last Report:   38
> Date/Time:   2010-02-21 17:07:27.399 -0800
> OS Version:  Mac OS X 10.5.8 (9L31a)
> Report Version:  6
> Anonymous UUID:  FA533BDA-50B2-47A9-931C-6F2614C741F0
> Exception Type:  EXC_BAD_ACCESS (SIGBUS)
> Exception Codes: KERN_PROTECTION_FAILURE at 0x0004
> Crashed Thread:  0
> Thread 0 Crashed:
> 0   zookeeper.so  0x002332bd free_pywatcher + 10 
> (zookeeper.c:199)
> 1   zookeeper.so  0x00239e09 pyzoo_exists + 984 
> (zookeeper.c:765)
> 2   org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116
> 3   org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598
> 4   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 5   org.python.python 0x0013b488 PyFunction_SetClosure + 2667
> 6   org.python.python 0x00121505 PyObject_Call + 50
> 7   org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086
> 8   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 9   org.python.python 0x0013b4

[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython

2010-02-22 Thread Josh Fraser (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836542#action_12836542
 ] 

Josh Fraser commented on ZOOKEEPER-676:
---

OK -- more info, and this makes me think this is due to the zookeeper binding 
not specifically allowing for the ipv6 address family.  I commented out both of 
these lines out of /etc/hosts:

::1 localhost 
fe80::1%lo0 localhost

and after doing so, can run the connection_test.py script thousands of time 
without a single error, using localhost as the hostname.  I verified that 
python itself can bind to the ::1 address:

Joshs-MacBook-Air:zktools josh$ python
Python 2.5.1 (r251:54863, Feb  6 2009, 19:02:12) 
[GCC 4.0.1 (Apple Inc. build 5465)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import socket
>>> sock = socket.socket(socket.AF_INET6)
>>> sock.bind(("::1", 21432))
>>> sock.close()
>>> 


> 50%-75% connection loss exceptions using zkpython
> -
>
> Key: ZOOKEEPER-676
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib, contrib-bindings
>Affects Versions: 3.2.2
> Environment: Mac OS X 10.5.8,   MacBook Air Intel Core 2 Duo @ 
> 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone
>Reporter: Josh Fraser
> Attachments: connection_test.py
>
>
> I get about 50-75% connection loss exceptions and about 10% Bus Error when 
> using the contrib/zkpython zookeeper.so.  Below is the exception:
> 2010-02-21 
> 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket 
> [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not 
> supported by protocol family): connect() call failed
> Traceback (most recent call last):
>   File "./zksh.py", line 63, in 
> 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: 
> initiated connection to server [127.0.0.1:2181]
> zkcli.dispatch(cmd,*args)
>   File "./zksh.py", line 56, in dispatch
> returned = run(*args)
>   File "./zksh.py", line 48, in ls
> print "\n".join(self.cmd.listNode(node))
>   File "/Users/josh/git/zktools/commands.py", line 22, in listNode
> for path in zookeeper.get_children(self.zk, node):
> zookeeper.ConnectionLossException: connection loss
> I've run this in gdb and have this backtrace:
> #0  free_pywatcher (pw=0x0) at src/c/zookeeper.c:199
> #1  0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765
> #2  0x0018f51e in PyEval_EvalFrameEx ()
> #3  0x00191173 in PyEval_EvalCodeEx ()
> #4  0x0013b488 in PyFunction_SetClosure ()
> #5  0x00121505 in PyObject_Call ()
> #6  0x0018fcd0 in PyEval_EvalFrameEx ()
> #7  0x00191173 in PyEval_EvalCodeEx ()
> #8  0x0013b488 in PyFunction_SetClosure ()
> #9  0x00121505 in PyObject_Call ()
> #10 0x0018fcd0 in PyEval_EvalFrameEx ()
> #11 0x00191173 in PyEval_EvalCodeEx ()
> #12 0x0018f79d in PyEval_EvalFrameEx ()
> #13 0x00191173 in PyEval_EvalCodeEx ()
> #14 0x00191260 in PyEval_EvalCode ()
> #15 0x001a883c in PyErr_Display ()
> #16 0x001aa4ab in PyRun_InteractiveOneFlags ()
> #17 0x001aa5f9 in PyRun_InteractiveLoopFlags ()
> #18 0x001aaa2b in PyRun_AnyFileExFlags ()
> #19 0x001b5a57 in Py_Main ()
> #20 0x1fca in ?? ()
> zookeeper.c @ line 199:
>  void free_pywatcher( pywatcher_t *pw)
> {
>   Py_DECREF(pw->callback);
>   free(pw);
> }
> That's as far as I've dug so far -- I ended up just writing a retry decorator 
> to get around it for now.  On the same machine, the zkCli.sh test client 
> works flawlessly.  Also, here's the Mac OS X Bus Error trace:
> Process: Python [18556]
> Path:
> /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python
> Identifier:  Python
> Version: ??? (???)
> Code Type:   X86 (Native)
> Parent Process:  bash [18436]
> Interval Since Last Report:  3323078 sec
> Crashes Since Last Report:   50
> Per-App Interval Since Last Report:  0 sec
> Per-App Crashes Since Last Report:   38
> Date/Time:   2010-02-21 17:07:27.399 -0800
> OS Version:  Mac OS X 10.5.8 (9L31a)
> Report Version:  6
> Anonymous UUID:  FA533BDA-50B2-47A9-931C-6F2614C741F0
> Exception Type:  EXC_BAD_ACCESS (SIGBUS)
> Exception Codes: KERN_PROTECTION_FAILURE at 0x0004
> Crashed Thread:  0
> Thread 0 Crashed:
> 0   zookeeper.so  0x002332bd free_pywatcher + 10 
> (zookeeper.c:199)
> 1   zookeeper.so  0x00239e09 pyzoo_exists + 984 
> (zookeeper.c:765)
> 2   org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116
> 3   org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598
> 4   org.python.python 0x00191173 PyEval_EvalCodeEx + 1638
> 5   org.pytho

[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython

2010-02-22 Thread Josh Fraser (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836538#action_12836538
 ] 

Josh Fraser commented on ZOOKEEPER-676:
---

Also, I think I may have just figured it out.  I changed from using a name 
(zookeeper.local.twitter.com) to 127.0.0.1 and cannot reproduce the errors.  
Possibly this is some weird resolver problem using localhost, maybe compounded 
with some ipv6 weirdness.  Here's my /etc/hosts:

Joshs-MacBook-Air:zktools josh$ cat /etc/hosts
##
# Host Database
#
# localhost is used to configure the loopback interface
# when the system is booting.  Do not change this entry.
##
127.0.0.1   localhost zookeeper.local.twitter.com
255.255.255.255 broadcasthost
::1 localhost 
fe80::1%lo0 localhost

Additionally, changing the first two lines to:

127.0.0.1 localhost
127.0.0.1 zookeeper.local.twitter.com

fixes it when I use zookeeper.local.twitter.com, but I still have the errors 
when I use localhost as the hostname

Not sure if my update makes any sense; feel free to ask for clarification and 
I'll be able to provide it in the morning :)


> 50%-75% connection loss exceptions using zkpython
> -
>
> Key: ZOOKEEPER-676
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676
> Project: Zookeeper
>  Issue Type: Bug
>  Components: contrib, contrib-bindings
>Affects Versions: 3.2.2
> Environment: Mac OS X 10.5.8,   MacBook Air Intel Core 2 Duo @ 
> 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone
>Reporter: Josh Fraser
> Attachments: connection_test.py
>
>
> I get about 50-75% connection loss exceptions and about 10% Bus Error when 
> using the contrib/zkpython zookeeper.so.  Below is the exception:
> 2010-02-21 
> 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket 
> [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not 
> supported by protocol family): connect() call failed
> Traceback (most recent call last):
>   File "./zksh.py", line 63, in 
> 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: 
> initiated connection to server [127.0.0.1:2181]
> zkcli.dispatch(cmd,*args)
>   File "./zksh.py", line 56, in dispatch
> returned = run(*args)
>   File "./zksh.py", line 48, in ls
> print "\n".join(self.cmd.listNode(node))
>   File "/Users/josh/git/zktools/commands.py", line 22, in listNode
> for path in zookeeper.get_children(self.zk, node):
> zookeeper.ConnectionLossException: connection loss
> I've run this in gdb and have this backtrace:
> #0  free_pywatcher (pw=0x0) at src/c/zookeeper.c:199
> #1  0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765
> #2  0x0018f51e in PyEval_EvalFrameEx ()
> #3  0x00191173 in PyEval_EvalCodeEx ()
> #4  0x0013b488 in PyFunction_SetClosure ()
> #5  0x00121505 in PyObject_Call ()
> #6  0x0018fcd0 in PyEval_EvalFrameEx ()
> #7  0x00191173 in PyEval_EvalCodeEx ()
> #8  0x0013b488 in PyFunction_SetClosure ()
> #9  0x00121505 in PyObject_Call ()
> #10 0x0018fcd0 in PyEval_EvalFrameEx ()
> #11 0x00191173 in PyEval_EvalCodeEx ()
> #12 0x0018f79d in PyEval_EvalFrameEx ()
> #13 0x00191173 in PyEval_EvalCodeEx ()
> #14 0x00191260 in PyEval_EvalCode ()
> #15 0x001a883c in PyErr_Display ()
> #16 0x001aa4ab in PyRun_InteractiveOneFlags ()
> #17 0x001aa5f9 in PyRun_InteractiveLoopFlags ()
> #18 0x001aaa2b in PyRun_AnyFileExFlags ()
> #19 0x001b5a57 in Py_Main ()
> #20 0x1fca in ?? ()
> zookeeper.c @ line 199:
>  void free_pywatcher( pywatcher_t *pw)
> {
>   Py_DECREF(pw->callback);
>   free(pw);
> }
> That's as far as I've dug so far -- I ended up just writing a retry decorator 
> to get around it for now.  On the same machine, the zkCli.sh test client 
> works flawlessly.  Also, here's the Mac OS X Bus Error trace:
> Process: Python [18556]
> Path:
> /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python
> Identifier:  Python
> Version: ??? (???)
> Code Type:   X86 (Native)
> Parent Process:  bash [18436]
> Interval Since Last Report:  3323078 sec
> Crashes Since Last Report:   50
> Per-App Interval Since Last Report:  0 sec
> Per-App Crashes Since Last Report:   38
> Date/Time:   2010-02-21 17:07:27.399 -0800
> OS Version:  Mac OS X 10.5.8 (9L31a)
> Report Version:  6
> Anonymous UUID:  FA533BDA-50B2-47A9-931C-6F2614C741F0
> Exception Type:  EXC_BAD_ACCESS (SIGBUS)
> Exception Codes: KERN_PROTECTION_FAILURE at 0x0004
> Crashed Thread:  0
> Thread 0 Crashed:
> 0   zookeeper.so  0x002332bd free_pywatcher + 10 
> (zookeeper.c:199)
> 1   zookeeper.so  0x00239e09 pyzoo_exists + 984 
> (zookeeper.c:765)
> 2   org.python.python 0x