Socket is not connected
Hi, I managed to upgrade my zookeeper 2 application to zookeeper 3.1.1/ All my tests run though my logs is full of following exception. In my code I basically just invoice ZooKeeper.close(); Any idea what the problem could be? Thanks, Stefan 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:434 - Closing session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:999 - Closing ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO server.PrepRequestProcessor:360 - Processed session termination request for id: 0x120472f36480002 09/03/27 02:07:51 INFO server.NIOServerCnxn:752 - closing session: 0x120472f36480002 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/ 0:0:0:0:0:0:0:1%0:2181 remote=/0:0:0:0:0:0:0:1%0:53636] 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:892 - Exception while closing send thread for session 0x120472f36480002 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] 09/03/27 02:07:51 WARN zookeeper.ClientCnxn:932 - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java: 640) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java: 930) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:915) 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:985 - Disconnecting ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:442 - Session: 0x120472f36480002 closed
[jira] Updated: (ZOOKEEPER-356) Masking bookie failure during writes to a ledger
[ https://issues.apache.org/jira/browse/ZOOKEEPER-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Paiva Junqueira updated ZOOKEEPER-356: - Attachment: ZOOKEEPER-BOOKKEEPER-356.patch Masking bookie failure during writes to a ledger Key: ZOOKEEPER-356 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-356 Project: Zookeeper Issue Type: New Feature Components: contrib-bookkeeper Reporter: Flavio Paiva Junqueira Assignee: Flavio Paiva Junqueira Attachments: ZOOKEEPER-BOOKKEEPER-356.patch The idea of this jira is to work out the changes necessary to make a client mask the failure of a bookie while writing to a ledger. I'm submitting a preliminary patch, but before I submit a final one, I need to have 288 committed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Hudson build is back to normal: ZooKeeper-trunk #266
See http://hudson.zones.apache.org/hudson/job/ZooKeeper-trunk/266/changes
[jira] Commented: (ZOOKEEPER-353) javadoc warnings needs to be fixed
[ https://issues.apache.org/jira/browse/ZOOKEEPER-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689897#action_12689897 ] Hudson commented on ZOOKEEPER-353: -- Integrated in ZooKeeper-trunk #266 (See [http://hudson.zones.apache.org/hudson/job/ZooKeeper-trunk/266/]) . javadoc warnings needs to be fixed. (giridharan kesavan via mahadev) javadoc warnings needs to be fixed --- Key: ZOOKEEPER-353 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-353 Project: Zookeeper Issue Type: Sub-task Components: build Affects Versions: 3.0.0, 3.0.1, 3.1.0, 3.1.1 Reporter: Giridharan Kesavan Assignee: Giridharan Kesavan Fix For: 3.2.0 Attachments: ZK-353.patch, ZK-353.patch [javadoc] /.../SOMETHING/trunk/src/java/generated/org/apache/zookeeper/server/quorum/QuorumPacket.java:46: cannot find symbol [javadoc] symbol : class OutputArchive [javadoc] location: class org.apache.zookeeper.server.quorum.QuorumPacket [javadoc] public void serialize(OutputArchive a_, String tag) throws java.io.IOException { [javadoc] ^ [javadoc] /.../SOMETHING/trunk/src/java/generated/org/apache/zookeeper/server/quorum/QuorumPacket.java:63: cannot find symbol [javadoc] symbol : class InputArchive [javadoc] location: class org.apache.zookeeper.server.quorum.QuorumPacket [javadoc] public void deserialize(InputArchive a_, String tag) throws java.io.IOException { [javadoc] ^ [javadoc] Building index for all the packages and classes... [javadoc] Building index for all classes... [javadoc] Generating /.../SOMETHING/trunk/build/docs/api/stylesheet.css... [javadoc] 4 errors [javadoc] 124 warnings -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-354) to fix javadoc warning in the source files
[ https://issues.apache.org/jira/browse/ZOOKEEPER-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689898#action_12689898 ] Hudson commented on ZOOKEEPER-354: -- Integrated in ZooKeeper-trunk #266 (See [http://hudson.zones.apache.org/hudson/job/ZooKeeper-trunk/266/]) . to fix javadoc warning in the source files. (mahadev) to fix javadoc warning in the source files -- Key: ZOOKEEPER-354 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-354 Project: Zookeeper Issue Type: Sub-task Components: documentation Affects Versions: 3.0.0, 3.0.1, 3.1.0, 3.1.1 Reporter: Giridharan Kesavan Assignee: Mahadev konar Fix For: 3.2.0 Attachments: ZOOKEEPER-354.patch [javadoc] trunk/src/java/main/org/apache/zookeeper/ZooKeeper.java:597: warning - Tag @see:illegal character: 60 in #create(String, byte[], ListACL, CreateMode) [javadoc]trunk/src/java/main/org/apache/zookeeper/ZooKeeper.java:597: warning - Tag @see:illegal character: 62 in #create(String, byte[], ListACL, CreateMode) [javadoc]trunk/src/java/main/org/apache/zookeeper/ZooKeeper.java:597: warning - Tag @see: can't find create(String, byte[], ListACL, CreateMode) in org.apache.zookeeper.ZooKeeper [javadoc]trunk/src/java/main/org/apache/zookeeper/ZooKeeper.java:499: warning - @param argument flags is not a parameter name. [javadoc] Building index for all the packages and classes... [javadoc] Building index for all classes... [javadoc] Generating trunk/build/docs/api/stylesheet.css... [javadoc] 24 warnings -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-350) to run rats for releaseaudit
[ https://issues.apache.org/jira/browse/ZOOKEEPER-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689899#action_12689899 ] Hudson commented on ZOOKEEPER-350: -- Integrated in ZooKeeper-trunk #266 (See [http://hudson.zones.apache.org/hudson/job/ZooKeeper-trunk/266/]) . to run rats for releaseaudit. (giridharan kesavan via mahadev) to run rats for releaseaudit - Key: ZOOKEEPER-350 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-350 Project: Zookeeper Issue Type: Sub-task Components: build Affects Versions: 3.0.0, 3.0.1, 3.1.0, 3.1.1 Reporter: Giridharan Kesavan Assignee: Giridharan Kesavan Fix For: 3.2.0 Attachments: ZK-350.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-351) to run checkstyle
[ https://issues.apache.org/jira/browse/ZOOKEEPER-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689901#action_12689901 ] Hudson commented on ZOOKEEPER-351: -- Integrated in ZooKeeper-trunk #266 (See [http://hudson.zones.apache.org/hudson/job/ZooKeeper-trunk/266/]) . to run checkstyle (giridharan kesavan via mahadev) to run checkstyle - Key: ZOOKEEPER-351 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-351 Project: Zookeeper Issue Type: Sub-task Components: build Affects Versions: 3.0.0, 3.0.1, 3.1.0, 3.1.1 Reporter: Giridharan Kesavan Assignee: Giridharan Kesavan Fix For: 3.2.0 Attachments: ZK-351.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (ZOOKEEPER-352) to add standard ant targets required by test-patch.sh script
[ https://issues.apache.org/jira/browse/ZOOKEEPER-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12689900#action_12689900 ] Hudson commented on ZOOKEEPER-352: -- Integrated in ZooKeeper-trunk #266 (See [http://hudson.zones.apache.org/hudson/job/ZooKeeper-trunk/266/]) . to add standard ant targets required by test-patch.sh script (giridharan kesavan via mahadev) to add standard ant targets required by test-patch.sh script Key: ZOOKEEPER-352 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-352 Project: Zookeeper Issue Type: Sub-task Components: build Affects Versions: 3.0.0, 3.0.1, 3.1.0, 3.1.1 Reporter: Giridharan Kesavan Assignee: Giridharan Kesavan Fix For: 3.2.0 Attachments: ZK-352.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Re: Socket is not connected
Hi Stefan, There's a timing issue when the client closes the connection. It sends a session close to the server and then starts to close it's own sockets. If the server closes the socket before the client does you can sometimes see the client get java.net.SocketException: Socket is not connected we are a bit paranoid about making sure you/we can debug unusual situations, so we include the trace in the WARN message in the log, just in case. In this situation though it is not an issue, in other situations (say the server drops it's connection) it would help to have the trace in a debugging situation, so we include it. Btw, in general in the code if we are more concerned about an event we would output as an ERROR, not as a WARN. Patrick Stefan Groschupf wrote: Hi, I managed to upgrade my zookeeper 2 application to zookeeper 3.1.1/ All my tests run though my logs is full of following exception. In my code I basically just invoice ZooKeeper.close(); Any idea what the problem could be? Thanks, Stefan 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:434 - Closing session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:999 - Closing ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO server.PrepRequestProcessor:360 - Processed session termination request for id: 0x120472f36480002 09/03/27 02:07:51 INFO server.NIOServerCnxn:752 - closing session:0x120472f36480002 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/0:0:0:0:0:0:0:1%0:2181 remote=/0:0:0:0:0:0:0:1%0:53636] 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:892 - Exception while closing send thread for session 0x120472f36480002 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] 09/03/27 02:07:51 WARN zookeeper.ClientCnxn:932 - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:640) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:930) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:915) 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:985 - Disconnecting ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:442 - Session: 0x120472f36480002 closed
[jira] Resolved: (ZOOKEEPER-349) to automate patch testing
[ https://issues.apache.org/jira/browse/ZOOKEEPER-349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar resolved ZOOKEEPER-349. - Resolution: Fixed Fix Version/s: 3.2.0 Hadoop Flags: [Reviewed] +1, i just committed this. to automate patch testing -- Key: ZOOKEEPER-349 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-349 Project: Zookeeper Issue Type: Improvement Components: build Reporter: Giridharan Kesavan Assignee: Giridharan Kesavan Fix For: 3.2.0 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[ANNOUNCE] Apache ZooKeeper 3.1.1
The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.1.1. ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so you don't have to write them from scratch. You can use it off-the-shelf to implement consensus, group management, leader election, and presence protocols. And you can build on it for your own, specific needs. If you are upgrading from version 2.2.1 on SourceForge be sure to review the 3.0.1 release notes for migration instructions. For ZooKeeper release details and downloads, visit: http://hadoop.apache.org/zookeeper/releases.html ZooKeeper 3.1.1 Release Notes are at: http://hadoop.apache.org/zookeeper/docs/r3.1.1/releasenotes.html Regards, The ZooKeeper Team
Re: Socket is not connected
Hi Patrick, thanks for the clarification. I can see your point but as user of zookeeper I personal would prefer to have this as debug message. Maybe something like log.debug(WARN: + msg). ... just a user feedback. Thanks, Stefan ~~~ Hadoop training and consulting http://www.scaleunlimited.com http://www.101tec.com On Mar 27, 2009, at 10:19 AM, Patrick Hunt wrote: Hi Stefan, There's a timing issue when the client closes the connection. It sends a session close to the server and then starts to close it's own sockets. If the server closes the socket before the client does you can sometimes see the client get java.net.SocketException: Socket is not connected we are a bit paranoid about making sure you/we can debug unusual situations, so we include the trace in the WARN message in the log, just in case. In this situation though it is not an issue, in other situations (say the server drops it's connection) it would help to have the trace in a debugging situation, so we include it. Btw, in general in the code if we are more concerned about an event we would output as an ERROR, not as a WARN. Patrick Stefan Groschupf wrote: Hi, I managed to upgrade my zookeeper 2 application to zookeeper 3.1.1/ All my tests run though my logs is full of following exception. In my code I basically just invoice ZooKeeper.close(); Any idea what the problem could be? Thanks, Stefan 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:434 - Closing session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:999 - Closing ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO server.PrepRequestProcessor:360 - Processed session termination request for id: 0x120472f36480002 09/03/27 02:07:51 INFO server.NIOServerCnxn:752 - closing session: 0x120472f36480002 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/ 0:0:0:0:0:0:0:1%0:2181 remote=/0:0:0:0:0:0:0:1%0:53636] 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:892 - Exception while closing send thread for session 0x120472f36480002 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] 09/03/27 02:07:51 WARN zookeeper.ClientCnxn:932 - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java: 640) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn $SendThread.cleanup(ClientCnxn.java:930) at org.apache.zookeeper.ClientCnxn $SendThread.run(ClientCnxn.java:915) 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:985 - Disconnecting ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:442 - Session: 0x120472f36480002 closed
Re: Socket is not connected
Thanks for the feedback. It's definitely not a clearcut decision on how to log it. As most ppl tend to run in INFO level on production systems we wanted to keep it visible for the time being. Patrick Stefan Groschupf wrote: Hi Patrick, thanks for the clarification. I can see your point but as user of zookeeper I personal would prefer to have this as debug message. Maybe something like log.debug(WARN: + msg). ... just a user feedback. Thanks, Stefan ~~~ Hadoop training and consulting http://www.scaleunlimited.com http://www.101tec.com On Mar 27, 2009, at 10:19 AM, Patrick Hunt wrote: Hi Stefan, There's a timing issue when the client closes the connection. It sends a session close to the server and then starts to close it's own sockets. If the server closes the socket before the client does you can sometimes see the client get java.net.SocketException: Socket is not connected we are a bit paranoid about making sure you/we can debug unusual situations, so we include the trace in the WARN message in the log, just in case. In this situation though it is not an issue, in other situations (say the server drops it's connection) it would help to have the trace in a debugging situation, so we include it. Btw, in general in the code if we are more concerned about an event we would output as an ERROR, not as a WARN. Patrick Stefan Groschupf wrote: Hi, I managed to upgrade my zookeeper 2 application to zookeeper 3.1.1/ All my tests run though my logs is full of following exception. In my code I basically just invoice ZooKeeper.close(); Any idea what the problem could be? Thanks, Stefan 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:434 - Closing session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:999 - Closing ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO server.PrepRequestProcessor:360 - Processed session termination request for id: 0x120472f36480002 09/03/27 02:07:51 INFO server.NIOServerCnxn:752 - closing session:0x120472f36480002 NIOServerCnxn: java.nio.channels.SocketChannel[connected local=/0:0:0:0:0:0:0:1%0:2181 remote=/0:0:0:0:0:0:0:1%0:53636] 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:892 - Exception while closing send thread for session 0x120472f36480002 : Read error rc = -1 java.nio.DirectByteBuffer[pos=0 lim=4 cap=4] 09/03/27 02:07:51 WARN zookeeper.ClientCnxn:932 - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:640) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:930) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:915) 09/03/27 02:07:51 INFO zookeeper.ClientCnxn:985 - Disconnecting ClientCnxn for session: 0x120472f36480002 09/03/27 02:07:51 INFO zookeeper.ZooKeeper:442 - Session: 0x120472f36480002 closed
[jira] Updated: (ZOOKEEPER-60) Get cppunit tests running as part of Hudson CI
[ https://issues.apache.org/jira/browse/ZOOKEEPER-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated ZOOKEEPER-60: Status: Patch Available (was: Open) Get cppunit tests running as part of Hudson CI -- Key: ZOOKEEPER-60 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-60 Project: Zookeeper Issue Type: Improvement Components: build Reporter: Patrick Hunt Assignee: Giridharan Kesavan Attachments: ZK-60.patch, ZK-60.patch, ZK-60.patch Investigate if it is possible to run cppunit tests as part of Hudson. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-60) Get cppunit tests running as part of Hudson CI
[ https://issues.apache.org/jira/browse/ZOOKEEPER-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated ZOOKEEPER-60: Status: Open (was: Patch Available) Get cppunit tests running as part of Hudson CI -- Key: ZOOKEEPER-60 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-60 Project: Zookeeper Issue Type: Improvement Components: build Reporter: Patrick Hunt Assignee: Giridharan Kesavan Attachments: ZK-60.patch, ZK-60.patch, ZK-60.patch Investigate if it is possible to run cppunit tests as part of Hudson. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-60) Get cppunit tests running as part of Hudson CI
[ https://issues.apache.org/jira/browse/ZOOKEEPER-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated ZOOKEEPER-60: Status: Patch Available (was: Open) re-submitting the patch. Get cppunit tests running as part of Hudson CI -- Key: ZOOKEEPER-60 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-60 Project: Zookeeper Issue Type: Improvement Components: build Reporter: Patrick Hunt Assignee: Giridharan Kesavan Attachments: ZK-60.patch, ZK-60.patch, ZK-60.patch Investigate if it is possible to run cppunit tests as part of Hudson. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.