[jira] Commented: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string
[ https://issues.apache.org/jira/browse/ZOOKEEPER-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12837110#action_12837110 ] Hadoop QA commented on ZOOKEEPER-677: - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12436677/ZOOKEEPER-677.patch against trunk revision 912119. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h8.grid.sp2.yahoo.net/122/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h8.grid.sp2.yahoo.net/122/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h8.grid.sp2.yahoo.net/122/console This message is automatically generated. > c client doesn't allow ipv6 numeric connect string > -- > > Key: ZOOKEEPER-677 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677 > Project: Zookeeper > Issue Type: Bug > Components: c client >Affects Versions: 3.2.2 >Reporter: Patrick Hunt >Priority: Critical > Fix For: 3.3.0 > > Attachments: ZOOKEEPER-677.patch > > > The c client doesn't handle ipv6 numeric addresses as they are colon : > delmited. After splitting the host/port on : we look for the port as the > second entry in the array rather than the last entry in the array. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string
[ https://issues.apache.org/jira/browse/ZOOKEEPER-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-677: Attachment: ZOOKEEPER-677.patch this patch finds the port using strrchr instead of strchr to allow ipv6 addresses. the test case assumes that localhost is reachable with ::1 > c client doesn't allow ipv6 numeric connect string > -- > > Key: ZOOKEEPER-677 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677 > Project: Zookeeper > Issue Type: Bug > Components: c client >Affects Versions: 3.2.2 >Reporter: Patrick Hunt >Priority: Critical > Fix For: 3.3.0 > > Attachments: ZOOKEEPER-677.patch > > > The c client doesn't handle ipv6 numeric addresses as they are colon : > delmited. After splitting the host/port on : we look for the port as the > second entry in the array rather than the last entry in the array. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string
[ https://issues.apache.org/jira/browse/ZOOKEEPER-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-677: Status: Patch Available (was: Open) > c client doesn't allow ipv6 numeric connect string > -- > > Key: ZOOKEEPER-677 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677 > Project: Zookeeper > Issue Type: Bug > Components: c client >Affects Versions: 3.2.2 >Reporter: Patrick Hunt >Priority: Critical > Fix For: 3.3.0 > > Attachments: ZOOKEEPER-677.patch > > > The c client doesn't handle ipv6 numeric addresses as they are colon : > delmited. After splitting the host/port on : we look for the port as the > second entry in the array rather than the last entry in the array. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-678) Browser application to view and edit the contents of a zookeeper instance
[ https://issues.apache.org/jira/browse/ZOOKEEPER-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Goodheart-Smithe updated ZOOKEEPER-678: - Attachment: ZooInspector.zip The zip file which contains the source and built version of the application > Browser application to view and edit the contents of a zookeeper instance > - > > Key: ZOOKEEPER-678 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-678 > Project: Zookeeper > Issue Type: New Feature >Affects Versions: 3.3.0 >Reporter: Colin Goodheart-Smithe > Fix For: 3.3.0 > > Attachments: ZooInspector.zip > > > An application which shows a tree view of the nodes currently in a zookeeper > instance and allow the user to view and update the contents of the nodes as > well as allowing users to add and remove nodes from the tree, similar in use > to the Luke application in the Lucene project. > I have a list of other features that I want to add to this application but I > wanted to gauge the response before I implemented them all. I have found > this useful when debugging my application and thought that it may be useful > to others. > I was going to submit this as a patch file but I have used some icon files > and one library which isn't available in the maven/ivy repositories and these > don't seem to work when creating a patch file using subversion. Because of > this I have attached a zip containing this application to this issue. If > there is a better way to submit this please let me know. > The zip contains two directories, the src directory contains the source as it > would be added to the contrib folder and the build folder contains a build > version of the with a runnable jar. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (ZOOKEEPER-678) Browser application to view and edit the contents of a zookeeper instance
Browser application to view and edit the contents of a zookeeper instance - Key: ZOOKEEPER-678 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-678 Project: Zookeeper Issue Type: New Feature Affects Versions: 3.3.0 Reporter: Colin Goodheart-Smithe Fix For: 3.3.0 An application which shows a tree view of the nodes currently in a zookeeper instance and allow the user to view and update the contents of the nodes as well as allowing users to add and remove nodes from the tree, similar in use to the Luke application in the Lucene project. I have a list of other features that I want to add to this application but I wanted to gauge the response before I implemented them all. I have found this useful when debugging my application and thought that it may be useful to others. I was going to submit this as a patch file but I have used some icon files and one library which isn't available in the maven/ivy repositories and these don't seem to work when creating a patch file using subversion. Because of this I have attached a zip containing this application to this issue. If there is a better way to submit this please let me know. The zip contains two directories, the src directory contains the source as it would be added to the contrib folder and the build folder contains a build version of the with a runnable jar. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython
[ https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836822#action_12836822 ] Josh Fraser commented on ZOOKEEPER-676: --- Awesome! Thanks for the attention to the issue, and thanks Patrick for your talk at our offices last week. > 50%-75% connection loss exceptions using zkpython > - > > Key: ZOOKEEPER-676 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676 > Project: Zookeeper > Issue Type: Bug > Components: contrib, contrib-bindings >Affects Versions: 3.2.2 > Environment: Mac OS X 10.5.8, MacBook Air Intel Core 2 Duo @ > 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone >Reporter: Josh Fraser > Attachments: connection_test.py > > > I get about 50-75% connection loss exceptions and about 10% Bus Error when > using the contrib/zkpython zookeeper.so. Below is the exception: > 2010-02-21 > 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket > [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not > supported by protocol family): connect() call failed > Traceback (most recent call last): > File "./zksh.py", line 63, in > 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: > initiated connection to server [127.0.0.1:2181] > zkcli.dispatch(cmd,*args) > File "./zksh.py", line 56, in dispatch > returned = run(*args) > File "./zksh.py", line 48, in ls > print "\n".join(self.cmd.listNode(node)) > File "/Users/josh/git/zktools/commands.py", line 22, in listNode > for path in zookeeper.get_children(self.zk, node): > zookeeper.ConnectionLossException: connection loss > I've run this in gdb and have this backtrace: > #0 free_pywatcher (pw=0x0) at src/c/zookeeper.c:199 > #1 0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765 > #2 0x0018f51e in PyEval_EvalFrameEx () > #3 0x00191173 in PyEval_EvalCodeEx () > #4 0x0013b488 in PyFunction_SetClosure () > #5 0x00121505 in PyObject_Call () > #6 0x0018fcd0 in PyEval_EvalFrameEx () > #7 0x00191173 in PyEval_EvalCodeEx () > #8 0x0013b488 in PyFunction_SetClosure () > #9 0x00121505 in PyObject_Call () > #10 0x0018fcd0 in PyEval_EvalFrameEx () > #11 0x00191173 in PyEval_EvalCodeEx () > #12 0x0018f79d in PyEval_EvalFrameEx () > #13 0x00191173 in PyEval_EvalCodeEx () > #14 0x00191260 in PyEval_EvalCode () > #15 0x001a883c in PyErr_Display () > #16 0x001aa4ab in PyRun_InteractiveOneFlags () > #17 0x001aa5f9 in PyRun_InteractiveLoopFlags () > #18 0x001aaa2b in PyRun_AnyFileExFlags () > #19 0x001b5a57 in Py_Main () > #20 0x1fca in ?? () > zookeeper.c @ line 199: > void free_pywatcher( pywatcher_t *pw) > { > Py_DECREF(pw->callback); > free(pw); > } > That's as far as I've dug so far -- I ended up just writing a retry decorator > to get around it for now. On the same machine, the zkCli.sh test client > works flawlessly. Also, here's the Mac OS X Bus Error trace: > Process: Python [18556] > Path: > /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python > Identifier: Python > Version: ??? (???) > Code Type: X86 (Native) > Parent Process: bash [18436] > Interval Since Last Report: 3323078 sec > Crashes Since Last Report: 50 > Per-App Interval Since Last Report: 0 sec > Per-App Crashes Since Last Report: 38 > Date/Time: 2010-02-21 17:07:27.399 -0800 > OS Version: Mac OS X 10.5.8 (9L31a) > Report Version: 6 > Anonymous UUID: FA533BDA-50B2-47A9-931C-6F2614C741F0 > Exception Type: EXC_BAD_ACCESS (SIGBUS) > Exception Codes: KERN_PROTECTION_FAILURE at 0x0004 > Crashed Thread: 0 > Thread 0 Crashed: > 0 zookeeper.so 0x002332bd free_pywatcher + 10 > (zookeeper.c:199) > 1 zookeeper.so 0x00239e09 pyzoo_exists + 984 > (zookeeper.c:765) > 2 org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116 > 3 org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598 > 4 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 5 org.python.python 0x0013b488 PyFunction_SetClosure + 2667 > 6 org.python.python 0x00121505 PyObject_Call + 50 > 7 org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086 > 8 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 9 org.python.python 0x0013b488 PyFunction_SetClosure + 2667 > 10 org.python.python 0x00121505 PyObject_Call + 50 > 11 org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086 > 12 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 13 org.python.python 0x00191
[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython
[ https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836814#action_12836814 ] Patrick Hunt commented on ZOOKEEPER-676: re use of ipv6 numeric address - I fixed a similar issue with java on this recently ZOOKEEPER-667, looking at the c code now it seems that we are looking for the first occurrence of ':' rather than the last. I've opened an issue ZOOKEEPER-677 to track this. One issue we've had with this is very little access to ipv6 machines on which to do dev/testing. Also few ipv6 users. Thanks for the report! > 50%-75% connection loss exceptions using zkpython > - > > Key: ZOOKEEPER-676 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676 > Project: Zookeeper > Issue Type: Bug > Components: contrib, contrib-bindings >Affects Versions: 3.2.2 > Environment: Mac OS X 10.5.8, MacBook Air Intel Core 2 Duo @ > 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone >Reporter: Josh Fraser > Attachments: connection_test.py > > > I get about 50-75% connection loss exceptions and about 10% Bus Error when > using the contrib/zkpython zookeeper.so. Below is the exception: > 2010-02-21 > 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket > [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not > supported by protocol family): connect() call failed > Traceback (most recent call last): > File "./zksh.py", line 63, in > 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: > initiated connection to server [127.0.0.1:2181] > zkcli.dispatch(cmd,*args) > File "./zksh.py", line 56, in dispatch > returned = run(*args) > File "./zksh.py", line 48, in ls > print "\n".join(self.cmd.listNode(node)) > File "/Users/josh/git/zktools/commands.py", line 22, in listNode > for path in zookeeper.get_children(self.zk, node): > zookeeper.ConnectionLossException: connection loss > I've run this in gdb and have this backtrace: > #0 free_pywatcher (pw=0x0) at src/c/zookeeper.c:199 > #1 0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765 > #2 0x0018f51e in PyEval_EvalFrameEx () > #3 0x00191173 in PyEval_EvalCodeEx () > #4 0x0013b488 in PyFunction_SetClosure () > #5 0x00121505 in PyObject_Call () > #6 0x0018fcd0 in PyEval_EvalFrameEx () > #7 0x00191173 in PyEval_EvalCodeEx () > #8 0x0013b488 in PyFunction_SetClosure () > #9 0x00121505 in PyObject_Call () > #10 0x0018fcd0 in PyEval_EvalFrameEx () > #11 0x00191173 in PyEval_EvalCodeEx () > #12 0x0018f79d in PyEval_EvalFrameEx () > #13 0x00191173 in PyEval_EvalCodeEx () > #14 0x00191260 in PyEval_EvalCode () > #15 0x001a883c in PyErr_Display () > #16 0x001aa4ab in PyRun_InteractiveOneFlags () > #17 0x001aa5f9 in PyRun_InteractiveLoopFlags () > #18 0x001aaa2b in PyRun_AnyFileExFlags () > #19 0x001b5a57 in Py_Main () > #20 0x1fca in ?? () > zookeeper.c @ line 199: > void free_pywatcher( pywatcher_t *pw) > { > Py_DECREF(pw->callback); > free(pw); > } > That's as far as I've dug so far -- I ended up just writing a retry decorator > to get around it for now. On the same machine, the zkCli.sh test client > works flawlessly. Also, here's the Mac OS X Bus Error trace: > Process: Python [18556] > Path: > /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python > Identifier: Python > Version: ??? (???) > Code Type: X86 (Native) > Parent Process: bash [18436] > Interval Since Last Report: 3323078 sec > Crashes Since Last Report: 50 > Per-App Interval Since Last Report: 0 sec > Per-App Crashes Since Last Report: 38 > Date/Time: 2010-02-21 17:07:27.399 -0800 > OS Version: Mac OS X 10.5.8 (9L31a) > Report Version: 6 > Anonymous UUID: FA533BDA-50B2-47A9-931C-6F2614C741F0 > Exception Type: EXC_BAD_ACCESS (SIGBUS) > Exception Codes: KERN_PROTECTION_FAILURE at 0x0004 > Crashed Thread: 0 > Thread 0 Crashed: > 0 zookeeper.so 0x002332bd free_pywatcher + 10 > (zookeeper.c:199) > 1 zookeeper.so 0x00239e09 pyzoo_exists + 984 > (zookeeper.c:765) > 2 org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116 > 3 org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598 > 4 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 5 org.python.python 0x0013b488 PyFunction_SetClosure + 2667 > 6 org.python.python 0x00121505 PyObject_Call + 50 > 7 org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086 > 8 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 9 org.python.python 0x0013b488 PyF
[jira] Created: (ZOOKEEPER-677) c client doesn't allow ipv6 numeric connect string
c client doesn't allow ipv6 numeric connect string -- Key: ZOOKEEPER-677 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-677 Project: Zookeeper Issue Type: Bug Components: c client Affects Versions: 3.2.2 Reporter: Patrick Hunt Priority: Critical Fix For: 3.3.0 The c client doesn't handle ipv6 numeric addresses as they are colon : delmited. After splitting the host/port on : we look for the port as the second entry in the array rather than the last entry in the array. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-661) Add Ruby bindings
[ https://issues.apache.org/jira/browse/ZOOKEEPER-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836760#action_12836760 ] Patrick Hunt commented on ZOOKEEPER-661: I'd like to encourage both of you to consider submitting a patch to include the binding in ZK contrib. I realize that doing it on github makes for a more agile process, perhaps if not today then at some point in the future. Also, would it make sense for the two projects/bindings to collaborate? Having two bindings is fine, but having one would be better. ;-) Esp if the collaboration will focus features/testing/usability/docs/etc... that each project individually might not have (ie pool your resources). Regards and thanks! > Add Ruby bindings > - > > Key: ZOOKEEPER-661 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-661 > Project: Zookeeper > Issue Type: New Feature > Components: contrib-bindings > Environment: MRI Ruby 1.9 > JRuby 1.4 >Reporter: Andrew Reynhout >Priority: Minor > > Add Ruby bindings to the ZooKeeper distribution. > Ruby presents special threading difficulties for asynchronous ZK calls (aget, > watchers, etc). It looks like the simplest workaround is to patch the ZK C > API. > Proposed approach will be described in comment. > Please use this ticket for discussion and suggestions. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-418) Need nifty zookeeper browser
[ https://issues.apache.org/jira/browse/ZOOKEEPER-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836663#action_12836663 ] Mark Masse commented on ZOOKEEPER-418: -- Hi, I have developed an Eclipse plug-in for Zookeeper. You can find out all about it and download it from my website here: http://www.massedynamic.org/eclipse/zookeeper/ > Need nifty zookeeper browser > > > Key: ZOOKEEPER-418 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-418 > Project: Zookeeper > Issue Type: Bug >Reporter: Ted Dunning >Assignee: Ted Dunning > Fix For: 3.3.0 > > Attachments: pom.xml, screenshot-1.jpg, zk-view-0.1.tgz, ZooKeeper > Eclipse Plug-in.pdf > > > It would be very nice to have a browser that would allow the state of a Zoo > to be examined. Even nice would be such a utility that showed changes in > real time. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython
[ https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836547#action_12836547 ] Josh Fraser commented on ZOOKEEPER-676: --- I have a feeling it's related to src/c/zookeeper.c zhandle_t *zookeeper_init(const char *host, watcher_fn watcher, int recv_timeout, const clientid_t *clientid, void *context, int flags) *host shouldn't be hostname:port and then split on : because an ipv6 address might be passed to it, and that seems to the problem. I'd offer a patch, but my C knowledge is limited to reading and comprehension :) > 50%-75% connection loss exceptions using zkpython > - > > Key: ZOOKEEPER-676 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676 > Project: Zookeeper > Issue Type: Bug > Components: contrib, contrib-bindings >Affects Versions: 3.2.2 > Environment: Mac OS X 10.5.8, MacBook Air Intel Core 2 Duo @ > 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone >Reporter: Josh Fraser > Attachments: connection_test.py > > > I get about 50-75% connection loss exceptions and about 10% Bus Error when > using the contrib/zkpython zookeeper.so. Below is the exception: > 2010-02-21 > 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket > [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not > supported by protocol family): connect() call failed > Traceback (most recent call last): > File "./zksh.py", line 63, in > 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: > initiated connection to server [127.0.0.1:2181] > zkcli.dispatch(cmd,*args) > File "./zksh.py", line 56, in dispatch > returned = run(*args) > File "./zksh.py", line 48, in ls > print "\n".join(self.cmd.listNode(node)) > File "/Users/josh/git/zktools/commands.py", line 22, in listNode > for path in zookeeper.get_children(self.zk, node): > zookeeper.ConnectionLossException: connection loss > I've run this in gdb and have this backtrace: > #0 free_pywatcher (pw=0x0) at src/c/zookeeper.c:199 > #1 0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765 > #2 0x0018f51e in PyEval_EvalFrameEx () > #3 0x00191173 in PyEval_EvalCodeEx () > #4 0x0013b488 in PyFunction_SetClosure () > #5 0x00121505 in PyObject_Call () > #6 0x0018fcd0 in PyEval_EvalFrameEx () > #7 0x00191173 in PyEval_EvalCodeEx () > #8 0x0013b488 in PyFunction_SetClosure () > #9 0x00121505 in PyObject_Call () > #10 0x0018fcd0 in PyEval_EvalFrameEx () > #11 0x00191173 in PyEval_EvalCodeEx () > #12 0x0018f79d in PyEval_EvalFrameEx () > #13 0x00191173 in PyEval_EvalCodeEx () > #14 0x00191260 in PyEval_EvalCode () > #15 0x001a883c in PyErr_Display () > #16 0x001aa4ab in PyRun_InteractiveOneFlags () > #17 0x001aa5f9 in PyRun_InteractiveLoopFlags () > #18 0x001aaa2b in PyRun_AnyFileExFlags () > #19 0x001b5a57 in Py_Main () > #20 0x1fca in ?? () > zookeeper.c @ line 199: > void free_pywatcher( pywatcher_t *pw) > { > Py_DECREF(pw->callback); > free(pw); > } > That's as far as I've dug so far -- I ended up just writing a retry decorator > to get around it for now. On the same machine, the zkCli.sh test client > works flawlessly. Also, here's the Mac OS X Bus Error trace: > Process: Python [18556] > Path: > /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python > Identifier: Python > Version: ??? (???) > Code Type: X86 (Native) > Parent Process: bash [18436] > Interval Since Last Report: 3323078 sec > Crashes Since Last Report: 50 > Per-App Interval Since Last Report: 0 sec > Per-App Crashes Since Last Report: 38 > Date/Time: 2010-02-21 17:07:27.399 -0800 > OS Version: Mac OS X 10.5.8 (9L31a) > Report Version: 6 > Anonymous UUID: FA533BDA-50B2-47A9-931C-6F2614C741F0 > Exception Type: EXC_BAD_ACCESS (SIGBUS) > Exception Codes: KERN_PROTECTION_FAILURE at 0x0004 > Crashed Thread: 0 > Thread 0 Crashed: > 0 zookeeper.so 0x002332bd free_pywatcher + 10 > (zookeeper.c:199) > 1 zookeeper.so 0x00239e09 pyzoo_exists + 984 > (zookeeper.c:765) > 2 org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116 > 3 org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598 > 4 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 5 org.python.python 0x0013b488 PyFunction_SetClosure + 2667 > 6 org.python.python 0x00121505 PyObject_Call + 50 > 7 org.python.python 0x0018fcd0 PyEval_EvalFrameEx + 19086 > 8 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 9 org.python.python 0x0013b4
[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython
[ https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836542#action_12836542 ] Josh Fraser commented on ZOOKEEPER-676: --- OK -- more info, and this makes me think this is due to the zookeeper binding not specifically allowing for the ipv6 address family. I commented out both of these lines out of /etc/hosts: ::1 localhost fe80::1%lo0 localhost and after doing so, can run the connection_test.py script thousands of time without a single error, using localhost as the hostname. I verified that python itself can bind to the ::1 address: Joshs-MacBook-Air:zktools josh$ python Python 2.5.1 (r251:54863, Feb 6 2009, 19:02:12) [GCC 4.0.1 (Apple Inc. build 5465)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> import socket >>> sock = socket.socket(socket.AF_INET6) >>> sock.bind(("::1", 21432)) >>> sock.close() >>> > 50%-75% connection loss exceptions using zkpython > - > > Key: ZOOKEEPER-676 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676 > Project: Zookeeper > Issue Type: Bug > Components: contrib, contrib-bindings >Affects Versions: 3.2.2 > Environment: Mac OS X 10.5.8, MacBook Air Intel Core 2 Duo @ > 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone >Reporter: Josh Fraser > Attachments: connection_test.py > > > I get about 50-75% connection loss exceptions and about 10% Bus Error when > using the contrib/zkpython zookeeper.so. Below is the exception: > 2010-02-21 > 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket > [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not > supported by protocol family): connect() call failed > Traceback (most recent call last): > File "./zksh.py", line 63, in > 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: > initiated connection to server [127.0.0.1:2181] > zkcli.dispatch(cmd,*args) > File "./zksh.py", line 56, in dispatch > returned = run(*args) > File "./zksh.py", line 48, in ls > print "\n".join(self.cmd.listNode(node)) > File "/Users/josh/git/zktools/commands.py", line 22, in listNode > for path in zookeeper.get_children(self.zk, node): > zookeeper.ConnectionLossException: connection loss > I've run this in gdb and have this backtrace: > #0 free_pywatcher (pw=0x0) at src/c/zookeeper.c:199 > #1 0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765 > #2 0x0018f51e in PyEval_EvalFrameEx () > #3 0x00191173 in PyEval_EvalCodeEx () > #4 0x0013b488 in PyFunction_SetClosure () > #5 0x00121505 in PyObject_Call () > #6 0x0018fcd0 in PyEval_EvalFrameEx () > #7 0x00191173 in PyEval_EvalCodeEx () > #8 0x0013b488 in PyFunction_SetClosure () > #9 0x00121505 in PyObject_Call () > #10 0x0018fcd0 in PyEval_EvalFrameEx () > #11 0x00191173 in PyEval_EvalCodeEx () > #12 0x0018f79d in PyEval_EvalFrameEx () > #13 0x00191173 in PyEval_EvalCodeEx () > #14 0x00191260 in PyEval_EvalCode () > #15 0x001a883c in PyErr_Display () > #16 0x001aa4ab in PyRun_InteractiveOneFlags () > #17 0x001aa5f9 in PyRun_InteractiveLoopFlags () > #18 0x001aaa2b in PyRun_AnyFileExFlags () > #19 0x001b5a57 in Py_Main () > #20 0x1fca in ?? () > zookeeper.c @ line 199: > void free_pywatcher( pywatcher_t *pw) > { > Py_DECREF(pw->callback); > free(pw); > } > That's as far as I've dug so far -- I ended up just writing a retry decorator > to get around it for now. On the same machine, the zkCli.sh test client > works flawlessly. Also, here's the Mac OS X Bus Error trace: > Process: Python [18556] > Path: > /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python > Identifier: Python > Version: ??? (???) > Code Type: X86 (Native) > Parent Process: bash [18436] > Interval Since Last Report: 3323078 sec > Crashes Since Last Report: 50 > Per-App Interval Since Last Report: 0 sec > Per-App Crashes Since Last Report: 38 > Date/Time: 2010-02-21 17:07:27.399 -0800 > OS Version: Mac OS X 10.5.8 (9L31a) > Report Version: 6 > Anonymous UUID: FA533BDA-50B2-47A9-931C-6F2614C741F0 > Exception Type: EXC_BAD_ACCESS (SIGBUS) > Exception Codes: KERN_PROTECTION_FAILURE at 0x0004 > Crashed Thread: 0 > Thread 0 Crashed: > 0 zookeeper.so 0x002332bd free_pywatcher + 10 > (zookeeper.c:199) > 1 zookeeper.so 0x00239e09 pyzoo_exists + 984 > (zookeeper.c:765) > 2 org.python.python 0x0018f51e PyEval_EvalFrameEx + 17116 > 3 org.python.python 0x0018f700 PyEval_EvalFrameEx + 17598 > 4 org.python.python 0x00191173 PyEval_EvalCodeEx + 1638 > 5 org.pytho
[jira] Commented: (ZOOKEEPER-676) 50%-75% connection loss exceptions using zkpython
[ https://issues.apache.org/jira/browse/ZOOKEEPER-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836538#action_12836538 ] Josh Fraser commented on ZOOKEEPER-676: --- Also, I think I may have just figured it out. I changed from using a name (zookeeper.local.twitter.com) to 127.0.0.1 and cannot reproduce the errors. Possibly this is some weird resolver problem using localhost, maybe compounded with some ipv6 weirdness. Here's my /etc/hosts: Joshs-MacBook-Air:zktools josh$ cat /etc/hosts ## # Host Database # # localhost is used to configure the loopback interface # when the system is booting. Do not change this entry. ## 127.0.0.1 localhost zookeeper.local.twitter.com 255.255.255.255 broadcasthost ::1 localhost fe80::1%lo0 localhost Additionally, changing the first two lines to: 127.0.0.1 localhost 127.0.0.1 zookeeper.local.twitter.com fixes it when I use zookeeper.local.twitter.com, but I still have the errors when I use localhost as the hostname Not sure if my update makes any sense; feel free to ask for clarification and I'll be able to provide it in the morning :) > 50%-75% connection loss exceptions using zkpython > - > > Key: ZOOKEEPER-676 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-676 > Project: Zookeeper > Issue Type: Bug > Components: contrib, contrib-bindings >Affects Versions: 3.2.2 > Environment: Mac OS X 10.5.8, MacBook Air Intel Core 2 Duo @ > 1.86GHz, Python 2.5.1, ZooKeeper 3.2.2 Standalone >Reporter: Josh Fraser > Attachments: connection_test.py > > > I get about 50-75% connection loss exceptions and about 10% Bus Error when > using the contrib/zkpython zookeeper.so. Below is the exception: > 2010-02-21 > 16:57:56,138:18481(0xb0081000):zoo_er...@handle_socket_error_msg@1359: Socket > [fe80::1002:885:7f00:1:2181] zk retcode=-4, errno=47(Address family not > supported by protocol family): connect() call failed > Traceback (most recent call last): > File "./zksh.py", line 63, in > 2010-02-21 16:57:56,138:18481(0xb0081000):zoo_i...@check_events@1439: > initiated connection to server [127.0.0.1:2181] > zkcli.dispatch(cmd,*args) > File "./zksh.py", line 56, in dispatch > returned = run(*args) > File "./zksh.py", line 48, in ls > print "\n".join(self.cmd.listNode(node)) > File "/Users/josh/git/zktools/commands.py", line 22, in listNode > for path in zookeeper.get_children(self.zk, node): > zookeeper.ConnectionLossException: connection loss > I've run this in gdb and have this backtrace: > #0 free_pywatcher (pw=0x0) at src/c/zookeeper.c:199 > #1 0x0025ae09 in pyzoo_exists (self=0x0, args=0x0) at src/c/zookeeper.c:765 > #2 0x0018f51e in PyEval_EvalFrameEx () > #3 0x00191173 in PyEval_EvalCodeEx () > #4 0x0013b488 in PyFunction_SetClosure () > #5 0x00121505 in PyObject_Call () > #6 0x0018fcd0 in PyEval_EvalFrameEx () > #7 0x00191173 in PyEval_EvalCodeEx () > #8 0x0013b488 in PyFunction_SetClosure () > #9 0x00121505 in PyObject_Call () > #10 0x0018fcd0 in PyEval_EvalFrameEx () > #11 0x00191173 in PyEval_EvalCodeEx () > #12 0x0018f79d in PyEval_EvalFrameEx () > #13 0x00191173 in PyEval_EvalCodeEx () > #14 0x00191260 in PyEval_EvalCode () > #15 0x001a883c in PyErr_Display () > #16 0x001aa4ab in PyRun_InteractiveOneFlags () > #17 0x001aa5f9 in PyRun_InteractiveLoopFlags () > #18 0x001aaa2b in PyRun_AnyFileExFlags () > #19 0x001b5a57 in Py_Main () > #20 0x1fca in ?? () > zookeeper.c @ line 199: > void free_pywatcher( pywatcher_t *pw) > { > Py_DECREF(pw->callback); > free(pw); > } > That's as far as I've dug so far -- I ended up just writing a retry decorator > to get around it for now. On the same machine, the zkCli.sh test client > works flawlessly. Also, here's the Mac OS X Bus Error trace: > Process: Python [18556] > Path: > /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python > Identifier: Python > Version: ??? (???) > Code Type: X86 (Native) > Parent Process: bash [18436] > Interval Since Last Report: 3323078 sec > Crashes Since Last Report: 50 > Per-App Interval Since Last Report: 0 sec > Per-App Crashes Since Last Report: 38 > Date/Time: 2010-02-21 17:07:27.399 -0800 > OS Version: Mac OS X 10.5.8 (9L31a) > Report Version: 6 > Anonymous UUID: FA533BDA-50B2-47A9-931C-6F2614C741F0 > Exception Type: EXC_BAD_ACCESS (SIGBUS) > Exception Codes: KERN_PROTECTION_FAILURE at 0x0004 > Crashed Thread: 0 > Thread 0 Crashed: > 0 zookeeper.so 0x002332bd free_pywatcher + 10 > (zookeeper.c:199) > 1 zookeeper.so 0x00239e09 pyzoo_exists + 984 > (zookeeper.c:765) > 2 org.python.python 0x