ZooKeeper-trunk-solaris - Build # 1416 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-solaris/1416/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 29 lines...] clean: [echo] contrib: loggraph clean: [echo] contrib: rest clean: [echo] contrib: zkfuse clean: [echo] contrib: zkperl clean: [echo] contrib: zkpython clean: [echo] contrib: zktreeutil clean: [echo] contrib: ZooInspector clean-recipes: clean: clean: [echo] recipes: election clean: [echo] recipes: lock clean: [echo] recipes: queue clean: init: [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/classes [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/lib [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/package/lib [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/lib ivy-download: [get] Getting: https://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar [get] To: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/src/java/lib/ivy-2.4.0.jar # # There is insufficient memory for the Java Runtime Environment to continue. # Out of swap space to map in thread stack. # An error report file with more information is saved as: # /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/hs_err_pid23007.log [thread 19 also had an error] Build step 'Invoke Ant' marked build as failure [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper-trunk-WinVS2008 - Build # 2354 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-WinVS2008/2354/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 78 lines...] ivy-retrieve: [ivy:retrieve] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ :: [ivy:retrieve] :: loading settings :: file = f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\ivysettings.xml [ivy:retrieve] :: resolving dependencies :: org.apache.zookeeper#zookeeper;3.6.0-SNAPSHOT [ivy:retrieve] confs: [default] [ivy:retrieve] found jline#jline;2.11 in maven2 [ivy:retrieve] found org.eclipse.jetty#jetty-server;9.2.18.v20160721 in maven2 [ivy:retrieve] found javax.servlet#javax.servlet-api;3.1.0 in maven2 [ivy:retrieve] found org.eclipse.jetty#jetty-http;9.2.18.v20160721 in maven2 [ivy:retrieve] found org.eclipse.jetty#jetty-util;9.2.18.v20160721 in maven2 [ivy:retrieve] found org.eclipse.jetty#jetty-io;9.2.18.v20160721 in maven2 [ivy:retrieve] found org.eclipse.jetty#jetty-servlet;9.2.18.v20160721 in maven2 [ivy:retrieve] found org.eclipse.jetty#jetty-security;9.2.18.v20160721 in maven2 [ivy:retrieve] found org.codehaus.jackson#jackson-mapper-asl;1.9.11 in maven2 [ivy:retrieve] found org.codehaus.jackson#jackson-core-asl;1.9.11 in maven2 [ivy:retrieve] found org.slf4j#slf4j-api;1.7.5 in maven2 [ivy:retrieve] found org.slf4j#slf4j-log4j12;1.7.5 in maven2 [ivy:retrieve] found commons-cli#commons-cli;1.2 in maven2 [ivy:retrieve] found log4j#log4j;1.2.17 in maven2 [ivy:retrieve] found io.netty#netty;3.10.5.Final in maven2 [ivy:retrieve] found net.java.dev.javacc#javacc;5.0 in maven2 [ivy:retrieve] :: resolution report :: resolve 394ms :: artifacts dl 19ms - | |modules|| artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| - | default | 16 | 0 | 0 | 0 || 16 | 0 | - [ivy:retrieve] :: retrieving :: org.apache.zookeeper#zookeeper [ivy:retrieve] confs: [default] [ivy:retrieve] 16 artifacts copied, 0 already retrieved (4635kB/41ms) generate_jute_parser: [mkdir] Created dir: f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\build\jute_compiler\org\apache\jute\compiler\generated [ivy:artifactproperty] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:artifactproperty] :: loading settings :: file = f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\ivysettings.xml [move] Moving 1 file to f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\build\lib [javacc] Java Compiler Compiler Version 5.0 (Parser Generator) [javacc] (type "javacc" with no arguments for help) [javacc] Reading from file f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\java\main\org\apache\jute\compiler\generated\rcc.jj . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "SimpleCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. jute: BUILD FAILED f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\build.xml:273: Unable to find a javac compiler; com.sun.tools.javac.Main is not on the classpath. Perhaps JAVA_HOME does not point to the JDK. It is currently set to "C:\Program Files\Java\jre1.8.0_92" Total time: 3 seconds Build step 'Invoke Ant' marked build as failure Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Commented] (ZOOKEEPER-2104) Sudden crash of all nodes in the cluster
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737108#comment-15737108 ] Haitao Yao commented on ZOOKEEPER-2104: --- I encountered the same problem. Is any fead back about whether increase the init limit values will work? thanks. > Sudden crash of all nodes in the cluster > > > Key: ZOOKEEPER-2104 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2104 > Project: ZooKeeper > Issue Type: Bug > Components: server >Affects Versions: 3.4.6 >Reporter: Benjamin Jaton > Attachments: zookeeper-errors.txt, zookeeper-warns.txt > > > In a 3 nodes ensemble, suddenly all the nodes seem to fail, displaying > "ZooKeeper is not running" messages. > Not retry seems to be happening after that. > This a request to understand what happened and probably to improve the logs > when it does. > See logs below: > NODE1: > -- no log for several days before this -- > 2015-01-04 16:18:22,259 [myid:1] - WARN [SyncThread:1:FileTxnLog@321] - > fsync-ing the write ahead log in SyncThread:1 took 11024ms which will > adversely effect operation latency. See the ZooKeeper troubleshooting guide > 2015-01-04 16:18:22,380 [myid:1] - WARN > [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@89] - Exception when > following the leader > java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:392) > at > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63) > at > org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83) > at > org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:103) > at > org.apache.zookeeper.server.quorum.Learner.readPacket(Learner.java:153) > at > org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.java:85) > at > org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:786) > 2015-01-04 16:18:23,384 [myid:1] - WARN > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception > causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not > running > 2015-01-04 16:18:23,492 [myid:1] - WARN > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception > causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not > running > 2015-01-04 16:18:24,060 [myid:1] - WARN > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception > causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not > running > NODE2: > -- no log for several days before this -- > 2015-01-04 16:18:21,899 [myid:3] - WARN > [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Follower@89] - Exception when > following the leader > java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:392) > at > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63) > at > org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83) > at > org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:103) > at > org.apache.zookeeper.server.quorum.Learner.readPacket(Learner.java:153) > at > org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.java:85) > at > org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:786) > 2015-01-04 16:18:22,760 [myid:3] - WARN > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception > causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not > running > 2015-01-04 16:18:22,801 [myid:3] - WARN > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception > causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not > running > 2015-01-04 16:18:22,886 [myid:3] - WARN > [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception > causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not > running > NODE3 (leader): > -- no log for several days before this -- > 2015-01-04 16:18:21,897 [myid:2] - WARN > [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2181:LearnerHandler@687] - Closing > connection to peer due to transaction timeout. > 2015-01-04 16:18:21,898 [myid:2] - WARN > [LearnerHandler-/204.53.107.249:43402:LearnerHandler@646] - *** GOODBYE > /204.53.107.249:43402 > 2015-01-04 16:18:21,905 [myid:2] - WARN > [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2181:LearnerHandler@687] - Closing > connection to peer due to transaction timeout. > 2015-01-04 16:18:21,907 [myid:2] - WARN > [LearnerHandler-/204.53.107.247:45953:LearnerHandler@646] - *** GOODBYE > /204.53.107.247:45953 > 2015-01-04 16:18:21,918 [myid:2] - WARN >
ZooKeeper_branch34 - Build # 1748 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34/1748/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 206161 lines...] [junit] 2016-12-10 00:16:21,512 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2016-12-10 00:16:21,512 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-10 00:16:21,512 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2016-12-10 00:16:21,512 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2016-12-10 00:16:21,512 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2016-12-10 00:16:21,512 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2016-12-10 00:16:21,513 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2016-12-10 00:16:21,513 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2016-12-10 00:16:21,514 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-12-10 00:16:21,515 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2016-12-10 00:16:21,516 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2016-12-10 00:16:21,516 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2016-12-10 00:16:21,517 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2016-12-10 00:16:21,517 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2016-12-10 00:16:21,518 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34/build/test/tmp/test2217497057602983876.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34/build/test/tmp/test2217497057602983876.junit.dir/version-2 [junit] 2016-12-10 00:16:21,524 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-10 00:16:21,524 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-12-10 00:16:21,525 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:55838 [junit] 2016-12-10 00:16:21,525 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:55838 [junit] 2016-12-10 00:16:21,525 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2016-12-10 00:16:21,526 [myid:] - INFO [Thread-4:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:55838 (no session established for client) [junit] 2016-12-10 00:16:21,526 [myid:] - INFO [main:JMXEnv@229] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2016-12-10 00:16:21,529 [myid:] - INFO [main:JMXEnv@246] - expect:InMemoryDataTree [junit] 2016-12-10 00:16:21,529 [myid:] - INFO [main:JMXEnv@250] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2016-12-10 00:16:21,529 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2016-12-10 00:16:21,530 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2016-12-10 00:16:21,530 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 32703 [junit] 2016-12-10 00:16:21,531 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2016-12-10 00:16:21,531 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2016-12-10 00:16:21,531 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2016-12-10 00:16:21,593 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x158e6167556 closed [junit] 2016-12-10 00:16:21,593 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2016-12-10 00:16:21,593 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x158e6167556 [junit] 2016-12-10 00:16:21,594 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2016-12-10 00:16:21,594 [myid:] -
ZooKeeper-trunk - Build # 3187 - Failure
See https://builds.apache.org/job/ZooKeeper-trunk/3187/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 427018 lines...] [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2016-12-09 23:29:47,814 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19545,name1=Connections,name2=127.0.0.1,name3=0x10179a7de32] [junit] 2016-12-09 23:29:47,914 [myid:] - INFO [main:ZooKeeper@1313] - Session: 0x10179a7de32 closed [junit] 2016-12-09 23:29:47,915 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 186203 [junit] 2016-12-09 23:29:47,915 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 1644 [junit] 2016-12-09 23:29:47,915 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2016-12-09 23:29:47,915 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2016-12-09 23:29:47,915 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2016-12-09 23:29:47,915 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:19545 [junit] 2016-12-09 23:29:47,914 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x10179a7de32 [junit] 2016-12-09 23:29:47,921 [myid:] - INFO [main:ZooKeeperServer@534] - shutting down [junit] 2016-12-09 23:29:47,921 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-09 23:29:47,921 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2016-12-09 23:29:47,921 [myid:] - INFO [main:PrepRequestProcessor@1009] - Shutting down [junit] 2016-12-09 23:29:47,922 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2016-12-09 23:29:47,922 [myid:] - INFO [ProcessThread(sid:0 cport:19545)::PrepRequestProcessor@157] - PrepRequestProcessor exited loop! [junit] 2016-12-09 23:29:47,922 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2016-12-09 23:29:47,922 [myid:] - INFO [main:FinalRequestProcessor@481] - shutdown of request processor complete [junit] 2016-12-09 23:29:47,923 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19545,name1=InMemoryDataTree] [junit] 2016-12-09 23:29:47,923 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19545] [junit] 2016-12-09 23:29:47,923 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 19545 [junit] 2016-12-09 23:29:47,923 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2016-12-09 23:29:47,929 [myid:] - INFO [main:ClientBase@568] - fdcount after test is: 4824 at start it was 4824 [junit] 2016-12-09 23:29:47,929 [myid:] - INFO [main:ZKTestCase$1@65] - SUCCEEDED testWatcherAutoResetWithLocal [junit] 2016-12-09 23:29:47,929 [myid:] - INFO [main:ZKTestCase$1@60] - FINISHED testWatcherAutoResetWithLocal [junit] Tests run: 101, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 555.732 sec, Thread: 4, Class: org.apache.zookeeper.test.NioNettySuiteTest [junit] 2016-12-09 23:29:48,016 [myid:127.0.0.1:19301] - INFO [main-SendThread(127.0.0.1:19301):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:19301. Will not attempt to authenticate using SASL (unknown error) [junit] 2016-12-09 23:29:48,017 [myid:127.0.0.1:19301] - WARN [main-SendThread(127.0.0.1:19301):ClientCnxn$SendThread@1235] - Session 0x101799f7bca for server 127.0.0.1/127.0.0.1:19301, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2016-12-09 23:29:48,302 [myid:] - INFO [SessionTracker:SessionTrackerImpl@158] - SessionTrackerImpl exited loop! [junit] 2016-12-09 23:29:48,303 [myid:] - INFO [SessionTracker:SessionTrackerImpl@158] - SessionTrackerImpl exited loop! BUILD FAILED
ZooKeeper-trunk-openjdk7 - Build # 1271 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-openjdk7/1271/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 444960 lines...] [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2016-12-09 20:02:52,815 [myid:] - INFO [ProcessThread(sid:0 cport:11466)::PrepRequestProcessor@618] - Processed session termination for sessionid: 0x100fc5951ed [junit] 2016-12-09 20:02:52,817 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11466,name1=Connections,name2=127.0.0.1,name3=0x100fc5951ed] [junit] 2016-12-09 20:02:52,818 [myid:] - WARN [New I/O worker #1811:NettyServerCnxnFactory$CnxnChannelHandler@142] - Exception caught [id: 0xa96b7d22, /127.0.0.1:54336 :> /127.0.0.1:11466] EXCEPTION: java.nio.channels.ClosedChannelException [junit] java.nio.channels.ClosedChannelException [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.cleanUpWriteBuffer(AbstractNioWorker.java:433) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:373) [junit] at org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:81) [junit] at org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:36) [junit] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendDownstream(DefaultChannelPipeline.java:779) [junit] at org.jboss.netty.channel.SimpleChannelHandler.closeRequested(SimpleChannelHandler.java:334) [junit] at org.jboss.netty.channel.SimpleChannelHandler.handleDownstream(SimpleChannelHandler.java:260) [junit] at org.jboss.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:591) [junit] at org.jboss.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:582) [junit] at org.jboss.netty.channel.Channels.close(Channels.java:812) [junit] at org.jboss.netty.channel.AbstractChannel.close(AbstractChannel.java:206) [junit] at org.apache.zookeeper.server.NettyServerCnxn.close(NettyServerCnxn.java:111) [junit] at org.apache.zookeeper.server.NettyServerCnxn.sendBuffer(NettyServerCnxn.java:215) [junit] at org.apache.zookeeper.server.NettyServerCnxn.sendCloseSession(NettyServerCnxn.java:441) [junit] at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:461) [junit] at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:182) [junit] at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:113) [junit] 2016-12-09 20:02:52,918 [myid:] - INFO [main:ZooKeeper@1313] - Session: 0x100fc5951ed closed [junit] 2016-12-09 20:02:52,918 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x100fc5951ed [junit] 2016-12-09 20:02:52,918 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 52826 [junit] 2016-12-09 20:02:52,919 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 466 [junit] 2016-12-09 20:02:52,919 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2016-12-09 20:02:52,919 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2016-12-09 20:02:52,919 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2016-12-09 20:02:52,919 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:11466 [junit] 2016-12-09 20:02:52,920 [myid:] - INFO [main:ZooKeeperServer@534] - shutting down [junit] 2016-12-09 20:02:52,920 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-09 20:02:52,920 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2016-12-09 20:02:52,920 [myid:] - INFO [main:PrepRequestProcessor@1009] - Shutting down [junit] 2016-12-09 20:02:52,920 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2016-12-09 20:02:52,920 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited!
Re: reconfig APIs
+1 for having this feature only in master branch(3.6.0) +1 for reverting the change from branch-3.5 On Fri, Dec 9, 2016 at 4:20 AM, Jordan Zimmermanwrote: > Thanks for the replies everyone. Adding the methods back with a > deprecation notice solves Curator’s problems so I’ll proceed with that on > ZOOKEEPER-2642. > > -Jordan > > > On Dec 8, 2016, at 6:56 PM, Michael Han wrote: > > > > Thanks Jordan for raising the concern. It's a reasonable concern with > good > > intention to make user's life easier, which is important to the project. > > > > There are two separate issues we need to reach a consensus here: > > > > * Move reconfig API > > The details of why the decision was made is documented in ZOOKEEPER-2014 > > JIRA, but just to recap, the API is moved because it's the right thing to > > do in long term, which yield a cleaner interface design for ZooKeeper > > client API. In future, we might also want to clean up other APIs (i.e. > move > > quota related APIs over as well.) as well. While seemingly stylish as it > > might look like, I believe a clean API is also important for a project's > > usability / adoption. From the discussions so far I think everyone either > > agree with this, or have no strong opinion against it, so I consider this > > question is solved. > > > > * Backward compatibility between releases > > Since we decide refactor reconfig API, the question is when. The reconfig > > API was removed from ZOOKEEPER-2014 (which targets 3.5.3 alpha) because > of > > the definition of alpha / beta releases in the context of ZooKeeper > project > > (I'm not saying this is right or wrong, simply state a fact up to date): > an > > alpha release implies that we allow backward incompatible changes, and a > > beta release implies that the APIs are locked down and none backward > > compatible change. Given this definition, it is perfectly legitimate to > > move API around w/o considering compatibility. Now what Jordan pointed > out > > regarding definition of 'alpha' combined with some old discussion > threads I > > found in user list indicate that our definition of 'alpha', and 'beta' is > > none standard and could cause confusions. So I think we should try reach > a > > consensus on whether we stick with current definition of 'alpha' and > 'beta' > > release during 3.5.3 release cycle, or adopt something else. > > > > With all these said, I think options are: > > * Do nothing, stick with current alpha / beta definition. > > * Try redefine what 'alpha' and 'beta' means in the context of ZooKeeper > > and then go from there in 3.5.3 release cycle. > > > > In any cases, I'd like to propose we keep the reconfig API in > > ZooKeeperAdmin which as previously stated is the right thing to do in > long > > term. If we decide to maintain backward API compatibility for 3.5.3-beta > > release, we could add reconfig API back to ZooKeeper but mark it as > > deprecated, then remove the API in next major release (3.6 or 4.x). > > > > > > On Thu, Dec 8, 2016 at 8:27 AM, Patrick Hunt wrote: > > > >> I've only seen a few questions about versioning come up on the ZK lists, > >> they were quickly responded to with pointers to the process. iirc we > based > >> our versioning scheme on what Hadoop was/is using. Additionally if we > don't > >> allow for alpha time it will further slow progress as there will be no > >> opportunity to adjust things like APIs once they are committed and > >> generally available for people to "kick the tires". > >> > >> I'll leave it up to the rest of the community to state their opinions, > but > >> as i have stated imo it would be a mistake to revert this change. Jordan > >> has raised a reasonable concern - I consider this a blocker for > 3.5.3-alpha > >> until it is resolved. > >> > >> Patrick > >> > >> On Thu, Dec 8, 2016 at 1:46 AM, Jordan Zimmerman < > >> jor...@jordanzimmerman.com > >>> wrote: > >> > I think people understand what alpha means. > >>> > >>> With respect, the ZooKeeper team has used “alpha” in a novel way that > is > >>> sowing considerable confusion. I wrote emails about this a while back. > >> But, > >>> here again, is another case where the non-standard usage of “alpha” > will > >>> cause confusion. To reiterate: someone who sees "3.5.2-alpha” will > think > >>> that there will eventually be a “3.5.2-beta” and finally a “3.5.2” > >> release > >>> version. But, with ZooKeeper there will never be a “3.5.2” release. In > >>> fact, the “-alpha” label is mis-located. The real version is > >>> “3.5.?-alpha1”, “3.5.?-alpha2”, etc. There’s an important implication > >> here. > >>> If a ZooKeeper user who doesn’t follow the mailing lists, etc. sees > >>> “3.5.2-alpha” and “3.5.3-alpha” they will mentally see these as two > >>> different releases. What ZOOKEEPER-2014 has done is remove an existing > >> API > >>> from what appears to be a released version 3.5.2 (which never really > >>> existed). This
[jira] [Commented] (ZOOKEEPER-2643) Configurable SSLContext
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736025#comment-15736025 ] Hadoop QA commented on ZOOKEEPER-2643: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12842597/configurable_ssl.patch against trunk revision 73d6bf5353586e49740f77291d1fd98b07f916cc. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-ZOOKEEPER-Build/3540//console This message is automatically generated. > Configurable SSLContext > --- > > Key: ZOOKEEPER-2643 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2643 > Project: ZooKeeper > Issue Type: Wish >Reporter: George Goddard > Attachments: configurable_ssl.patch > > > Being able to configure the SSLContext in X509Util.java, ZKConfig.java and > NettyServerCnxnFactory.java would add flexibility to use cipher suites other > than TLSv1. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Failed: ZOOKEEPER-2643 PreCommit Build #3540
Jira: https://issues.apache.org/jira/browse/ZOOKEEPER-2643 Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-Build/3540/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 144 lines...] [exec] [exec] [exec] [exec] -1 overall. Here are the results of testing the latest attachment [exec] http://issues.apache.org/jira/secure/attachment/12842597/configurable_ssl.patch [exec] against trunk revision 73d6bf5353586e49740f77291d1fd98b07f916cc. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] -1 tests included. The patch doesn't appear to include any new or modified tests. [exec] Please justify why no new tests are needed for this patch. [exec] Also please list what manual steps were performed to verify this patch. [exec] [exec] -1 patch. The patch command could not apply the patch. [exec] [exec] Console output: https://builds.apache.org/job/PreCommit-ZOOKEEPER-Build/3540//console [exec] [exec] This message is automatically generated. [exec] [exec] [exec] == [exec] == [exec] Adding comment to Jira. [exec] == [exec] == [exec] [exec] [exec] Comment added. [exec] 748f6a443dec735ab9e64b3e1a7d9aa14cfb1cb4 logged out [exec] [exec] [exec] == [exec] == [exec] Finished build. [exec] == [exec] == [exec] [exec] [exec] mv: ‘/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/patchprocess’ and ‘/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/patchprocess’ are the same file BUILD FAILED /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/build.xml:1607: exec returned: 1 Total time: 49 seconds Build step 'Execute shell' marked build as failure Archiving artifacts Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Recording test results Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 [description-setter] Description set: ZOOKEEPER-2643 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Updated] (ZOOKEEPER-2643) Configurable SSLContext
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Goddard updated ZOOKEEPER-2643: -- Attachment: configurable_ssl.patch > Configurable SSLContext > --- > > Key: ZOOKEEPER-2643 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2643 > Project: ZooKeeper > Issue Type: Wish >Reporter: George Goddard > Attachments: configurable_ssl.patch > > > Being able to configure the SSLContext in X509Util.java, ZKConfig.java and > NettyServerCnxnFactory.java would add flexibility to use cipher suites other > than TLSv1. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZOOKEEPER-2643) Configurable SSLContext
George Goddard created ZOOKEEPER-2643: - Summary: Configurable SSLContext Key: ZOOKEEPER-2643 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2643 Project: ZooKeeper Issue Type: Wish Reporter: George Goddard Being able to configure the SSLContext in X509Util.java, ZKConfig.java and NettyServerCnxnFactory.java would add flexibility to use cipher suites other than TLSv1. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ZOOKEEPER-761) Remove *synchronous* calls from the *single-threaded* C clieant API, since they are documented not to work
[ https://issues.apache.org/jira/browse/ZOOKEEPER-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735934#comment-15735934 ] ASF GitHub Bot commented on ZOOKEEPER-761: -- Github user fpj commented on the issue: https://github.com/apache/zookeeper/pull/90 It sounds like there is a conflict in `TestReconfigServer`, could you resolve it, please @breed ? > Remove *synchronous* calls from the *single-threaded* C clieant API, since > they are documented not to work > -- > > Key: ZOOKEEPER-761 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-761 > Project: ZooKeeper > Issue Type: Improvement > Components: c client >Affects Versions: 3.1.1, 3.2.2 > Environment: RHEL 4u8 (Linux). The issue is not OS-specific though. >Reporter: Jozef Hatala >Assignee: Benjamin Reed >Priority: Minor > Fix For: 3.5.3, 3.6.0 > > Attachments: fix-sync-apis-in-st-adaptor.patch, > fix-sync-apis-in-st-adaptor.v2.patch > > > Since the synchronous calls are > [known|http://hadoop.apache.org/zookeeper/docs/current/zookeeperProgrammers.html#Using+the+C+Client] > to be unimplemented in the single threaded version of the client library > libzookeeper_st.so, I believe that it would be helpful towards users of the > library if that information was also obvious from the header file. > Anecdotally more than one of us here made the mistake of starting by using > the synchronous calls with the single-threaded library, and we found > ourselves debugging it. An early warning would have been greatly appreciated. > 1. Could you please add warnings to the doxygen blocks of all synchronous > calls saying that they are not available in the single-threaded API. This > cannot be safely done with {{#ifdef THREADED}}, obviously, because the same > header file is included whichever client library implementation one is > compiling for. > 2. Could you please bracket the implementation of all synchronous calls in > zookeeper.c with {{#ifdef THREADED}} and {{#endif}}, so that those symbols > are not present in libzookeeper_st.so? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zookeeper issue #90: ZOOKEEPER-761: Remove *synchronous* calls from the *sin...
Github user fpj commented on the issue: https://github.com/apache/zookeeper/pull/90 It sounds like there is a conflict in `TestReconfigServer`, could you resolve it, please @breed ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
ZooKeeper_branch35_solaris - Build # 345 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_solaris/345/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 30668 lines...] [junit] 2016-12-09 17:01:18,826 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3,name2=Leader,name3=InMemoryDataTree] [junit] 2016-12-09 17:01:18,826 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2016-12-09 17:01:18,826 [myid:] - WARN [LearnerHandler-/127.0.0.1:43121:LearnerHandler@619] - *** GOODBYE /127.0.0.1:43121 [junit] 2016-12-09 17:01:18,827 [myid:] - WARN [LearnerHandler-/127.0.0.1:43121:LearnerHandler@903] - Ignoring unexpected exception [junit] java.lang.InterruptedException [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219) [junit] at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340) [junit] at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338) [junit] at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901) [junit] at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622) [junit] 2016-12-09 17:01:18,826 [myid:] - WARN [LearnerHandler-/127.0.0.1:43122:LearnerHandler@619] - *** GOODBYE /127.0.0.1:43122 [junit] 2016-12-09 17:01:18,827 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2016-12-09 17:01:18,828 [myid:] - WARN [LearnerHandler-/127.0.0.1:43122:LearnerHandler@903] - Ignoring unexpected exception [junit] java.lang.InterruptedException [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219) [junit] at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340) [junit] at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338) [junit] at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901) [junit] at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622) [junit] 2016-12-09 17:01:18,828 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11264:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2016-12-09 17:01:18,828 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2016-12-09 17:01:18,828 [myid:] - INFO [/127.0.0.1:11266:QuorumCnxManager$Listener@661] - Leaving listener [junit] 2016-12-09 17:01:18,829 [myid:] - INFO [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled) [junit] 2016-12-09 17:01:18,829 [myid:] - INFO [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled) to exit thread [junit] 2016-12-09 17:01:18,829 [myid:] - INFO [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3,name2=Leader] [junit] 2016-12-09 17:01:18,830 [myid:] - WARN [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):QuorumPeer@1127] - Unexpected exception [junit] java.lang.InterruptedException [junit] at java.lang.Object.wait(Native Method) [junit] at org.apache.zookeeper.server.quorum.Leader.lead(Leader.java:561) [junit] at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1124) [junit] 2016-12-09 17:01:18,830 [myid:] - INFO [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):Leader@623] - Shutting down [junit] 2016-12-09 17:01:18,830 [myid:] - WARN [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING [junit] 2016-12-09 17:01:18,830 [myid:] - WARN [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited [junit] 2016-12-09 17:01:18,830 [myid:] - INFO [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3] [junit] 2016-12-09 17:01:18,830 [myid:] - INFO [QuorumPeer[myid=3](plain=/127.0.0.1:11264)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3] [junit] 2016-12-09 17:01:18,830 [myid:] - INFO
ZooKeeper_branch34_openjdk7 - Build # 1301 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1301/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by timer [EnvInject] - Loading node environment variables. Building remotely on H13 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git -c core.askpass=true fetch --tags --progress > git://git.apache.org/zookeeper.git +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.4^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.4^{commit} # timeout=10 Checking out Revision 8a06bd1ccef382461c7b0a63f2012f4aeac90753 (refs/remotes/origin/branch-3.4) > git config core.sparsecheckout # timeout=10 > git checkout -f 8a06bd1ccef382461c7b0a63f2012f4aeac90753 > git rev-list 8a06bd1ccef382461c7b0a63f2012f4aeac90753 # timeout=10 No emails were triggered. [ZooKeeper_branch34_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Error: JAVA_HOME is not defined correctly. We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper_branch34_solaris - Build # 1383 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_solaris/1383/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 178511 lines...] [junit] 2016-12-09 13:56:49,510 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2016-12-09 13:56:49,510 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-09 13:56:49,510 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2016-12-09 13:56:49,510 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2016-12-09 13:56:49,510 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2016-12-09 13:56:49,510 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2016-12-09 13:56:49,511 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2016-12-09 13:56:49,511 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2016-12-09 13:56:49,511 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-12-09 13:56:49,512 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2016-12-09 13:56:49,513 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2016-12-09 13:56:49,513 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2016-12-09 13:56:49,513 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2016-12-09 13:56:49,514 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2016-12-09 13:56:49,514 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/build/test/tmp/test2588087733032590543.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/build/test/tmp/test2588087733032590543.junit.dir/version-2 [junit] 2016-12-09 13:56:49,517 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-09 13:56:49,517 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-12-09 13:56:49,517 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:41817 [junit] 2016-12-09 13:56:49,518 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:41817 [junit] 2016-12-09 13:56:49,518 [myid:] - INFO [Thread-5:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2016-12-09 13:56:49,518 [myid:] - INFO [Thread-5:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:41817 (no session established for client) [junit] 2016-12-09 13:56:49,519 [myid:] - INFO [main:JMXEnv@229] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2016-12-09 13:56:49,520 [myid:] - INFO [main:JMXEnv@246] - expect:InMemoryDataTree [junit] 2016-12-09 13:56:49,520 [myid:] - INFO [main:JMXEnv@250] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2016-12-09 13:56:49,520 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2016-12-09 13:56:49,521 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2016-12-09 13:56:49,521 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 10704 [junit] 2016-12-09 13:56:49,522 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2016-12-09 13:56:49,522 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2016-12-09 13:56:49,522 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2016-12-09 13:56:49,602 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x158e3df4150 closed [junit] 2016-12-09 13:56:49,603 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2016-12-09 13:56:49,603 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x158e3df4150 [junit] 2016-12-09 13:56:49,604 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2016-12-09 13:56:49,604 [myid:] -
ZooKeeper_branch35_jdk8 - Build # 328 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_jdk8/328/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 438931 lines...] [junit] 2016-12-09 12:17:09,961 [myid:127.0.0.1:11346] - INFO [main-SendThread(127.0.0.1:11346):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11346. Will not attempt to authenticate using SASL (unknown error) [junit] 2016-12-09 12:17:09,961 [myid:127.0.0.1:11346] - WARN [main-SendThread(127.0.0.1:11346):ClientCnxn$SendThread@1235] - Session 0x20103302b0d for server 127.0.0.1/127.0.0.1:11346, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2016-12-09 12:17:10,028 [myid:] - INFO [ProcessThread(sid:0 cport:11466)::PrepRequestProcessor@656] - Processed session termination for sessionid: 0x1010333618d [junit] 2016-12-09 12:17:10,035 [myid:] - WARN [New I/O worker #6635:NettyServerCnxnFactory$CnxnChannelHandler@142] - Exception caught [id: 0xb0d73163, /127.0.0.1:40443 :> /127.0.0.1:11466] EXCEPTION: java.nio.channels.ClosedChannelException [junit] java.nio.channels.ClosedChannelException [junit] at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:270) [junit] at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:461) [junit] at org.jboss.netty.channel.socket.nio.SocketSendBufferPool$UnpooledSendBuffer.transferTo(SocketSendBufferPool.java:203) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.write0(AbstractNioWorker.java:201) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.writeFromTaskLoop(AbstractNioWorker.java:151) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioChannel$WriteTask.run(AbstractNioChannel.java:315) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [junit] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2016-12-09 12:17:10,035 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11466,name1=Connections,name2=127.0.0.1,name3=0x1010333618d] [junit] 2016-12-09 12:17:10,136 [myid:] - INFO [main:ZooKeeper@1311] - Session: 0x1010333618d closed [junit] 2016-12-09 12:17:10,136 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 161748 [junit] 2016-12-09 12:17:10,136 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 1643 [junit] 2016-12-09 12:17:10,136 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2016-12-09 12:17:10,136 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x1010333618d [junit] 2016-12-09 12:17:10,136 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2016-12-09 12:17:10,137 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2016-12-09 12:17:10,137 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:11466 [junit] 2016-12-09 12:17:10,140 [myid:] - INFO [main:ZooKeeperServer@533] - shutting down [junit] 2016-12-09 12:17:10,140 [myid:] - ERROR [main:ZooKeeperServer@505] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-09 12:17:10,140 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2016-12-09 12:17:10,141 [myid:] - INFO [main:PrepRequestProcessor@974] - Shutting down [junit] 2016-12-09 12:17:10,141 [myid:] - INFO
How zookeeper deal with partial-write when load WAL from log files?
I am trying to figure out how zookeeper implements transaction. I am reading source code in directory org/apache/zookeeper/server/persistence/ but I could not find how zookeeper manager no-integration WAL files. So could you offer a simple introduction for that to me? Thanks very much.
ZooKeeper-trunk-jdk8 - Build # 850 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/850/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 466519 lines...] [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2016-12-09 12:00:33,138 [myid:] - INFO [New I/O boss #9966:ClientCnxnSocketNetty@208] - channel is told closing [junit] 2016-12-09 12:00:33,138 [myid:127.0.0.1:22115] - INFO [main-SendThread(127.0.0.1:22115):ClientCnxn$SendThread@1231] - channel for sessionid 0x10177274872 is lost, closing socket connection and attempting reconnect [junit] 2016-12-09 12:02:44,388 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 133272 [junit] 2016-12-09 12:02:44,389 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 55 [junit] 2016-12-09 12:02:44,389 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testManyChildWatchersAutoReset [junit] 2016-12-09 12:02:44,389 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2016-12-09 12:02:44,392 [myid:] - INFO [ProcessThread(sid:0 cport:13918)::PrepRequestProcessor@618] - Processed session termination for sessionid: 0x101771f9b7b [junit] 2016-12-09 12:02:44,447 [myid:] - INFO [main:ZooKeeper@1313] - Session: 0x101771f9b7b closed [junit] 2016-12-09 12:02:44,447 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x101771f9b7b [junit] 2016-12-09 12:02:44,447 [myid:] - INFO [NIOWorkerThread-25:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port13918,name1=Connections,name2=127.0.0.1,name3=0x101771f9b7b] [junit] 2016-12-09 12:02:44,447 [myid:] - INFO [ProcessThread(sid:0 cport:13918)::PrepRequestProcessor@618] - Processed session termination for sessionid: 0x101771f9b7b0001 [junit] 2016-12-09 12:02:44,448 [myid:] - INFO [NIOWorkerThread-25:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:49630 which had sessionid 0x101771f9b7b [junit] 2016-12-09 12:02:44,488 [myid:] - INFO [main:ZooKeeper@1313] - Session: 0x101771f9b7b0001 closed [junit] 2016-12-09 12:02:44,488 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x101771f9b7b0001 [junit] 2016-12-09 12:02:44,488 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2016-12-09 12:02:44,488 [myid:] - INFO [NIOWorkerThread-18:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port13918,name1=Connections,name2=127.0.0.1,name3=0x101771f9b7b0001] [junit] 2016-12-09 12:02:44,489 [myid:] - INFO [NIOWorkerThread-18:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:49645 which had sessionid 0x101771f9b7b0001 [junit] 2016-12-09 12:02:44,489 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2016-12-09 12:02:44,491 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2016-12-09 12:02:44,492 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:13918:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2016-12-09 12:02:44,496 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2016-12-09 12:02:44,496 [myid:] - INFO [main:ZooKeeperServer@534] - shutting down [junit] 2016-12-09 12:02:44,497 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so
ZooKeeper_branch35_openjdk7 - Build # 325 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_openjdk7/325/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by timer [EnvInject] - Loading node environment variables. Building remotely on H16 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git -c core.askpass=true fetch --tags --progress > git://git.apache.org/zookeeper.git +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.5^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.5^{commit} # timeout=10 Checking out Revision 3119a194ac0738b00a4e22095449ea4c4dbb8f31 (refs/remotes/origin/branch-3.5) > git config core.sparsecheckout # timeout=10 > git checkout -f 3119a194ac0738b00a4e22095449ea4c4dbb8f31 > git rev-list 3119a194ac0738b00a4e22095449ea4c4dbb8f31 # timeout=10 No emails were triggered. [ZooKeeper_branch35_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Error: JAVA_HOME is not defined correctly. We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[GitHub] zookeeper pull request #119: ZOOKEEPER-2251:Add Client side packet response ...
Github user wuwen5 commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/119#discussion_r91682496 --- Diff: src/java/main/org/apache/zookeeper/ClientCnxn.java --- @@ -1495,10 +1504,21 @@ public ReplyHeader submitRequest(RequestHeader h, Record request, Packet packet = queuePacket(h, r, request, response, null, null, null, null, watchRegistration, watchDeregistration); synchronized (packet) { +long waitStartTime = System.currentTimeMillis(); while (!packet.finished) { -packet.wait(); +packet.wait(requestTimeout); +if (!packet.finished && ((System.currentTimeMillis() --- End diff -- System.currentTimeMillis() is dependent on System clock. It probably micro-corrected by an external programme.. I think using System.nanoTime() to measure elapsed time is the correct solution. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2251) Add Client side packet response timeout to avoid infinite wait.
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734817#comment-15734817 ] ASF GitHub Bot commented on ZOOKEEPER-2251: --- Github user wuwen5 commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/119#discussion_r91682496 --- Diff: src/java/main/org/apache/zookeeper/ClientCnxn.java --- @@ -1495,10 +1504,21 @@ public ReplyHeader submitRequest(RequestHeader h, Record request, Packet packet = queuePacket(h, r, request, response, null, null, null, null, watchRegistration, watchDeregistration); synchronized (packet) { +long waitStartTime = System.currentTimeMillis(); while (!packet.finished) { -packet.wait(); +packet.wait(requestTimeout); +if (!packet.finished && ((System.currentTimeMillis() --- End diff -- System.currentTimeMillis() is dependent on System clock. It probably micro-corrected by an external programme.. I think using System.nanoTime() to measure elapsed time is the correct solution. > Add Client side packet response timeout to avoid infinite wait. > --- > > Key: ZOOKEEPER-2251 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2251 > Project: ZooKeeper > Issue Type: Bug > Components: java client >Affects Versions: 3.4.9, 3.5.2 >Reporter: nijel >Assignee: Arshad Mohammad >Priority: Critical > Labels: fault > Fix For: 3.4.10, 3.5.3, 3.6.0 > > Attachments: ZOOKEEPER-2251-01.patch, ZOOKEEPER-2251-02.patch, > ZOOKEEPER-2251-03.patch, ZOOKEEPER-2251-04.patch > > > I came across one issue related to Client side packet response timeout In my > cluster many packet drops happened for some time. > One observation is the zookeeper client got hanged. As per the thread dump it > is waiting for the response/ACK for the operation performed (synchronous API > used here). > I am using > zookeeper.serverCnxnFactory=org.apache.zookeeper.server.NIOServerCnxnFactory > Since only few packets missed there is no DISCONNECTED event occurred. > Need add a "response time out" for the operations or packets. > *Comments from [~rakeshr]* > My observation about the problem:- > * Can use tools like 'Wireshark' to simulate the artificial packet loss. > * Assume there is only one packet in the 'outgoingQueue' and unfortunately > the server response packet lost. Now, client will enter into infinite > waiting. > https://github.com/apache/zookeeper/blob/trunk/src/java/main/org/apache/zookeeper/ClientCnxn.java#L1515 > * Probably we can discuss more about this problem and possible solutions(add > packet ACK timeout or another better approach) in the jira. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
ZooKeeper_branch35_jdk7 - Build # 760 - Failure
See https://builds.apache.org/job/ZooKeeper_branch35_jdk7/760/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 446203 lines...] [junit] 2016-12-09 08:55:35,306 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: /127.0.0.1:59742, server: 127.0.0.1/127.0.0.1:16608 [junit] 2016-12-09 08:55:35,306 [myid:0] - INFO [NIOServerCxnFactory.AcceptThread:localhost/127.0.0.1:16608:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:59742 [junit] 2016-12-09 08:55:35,306 [myid:0] - WARN [NIOWorkerThread-5:NIOServerCnxn@369] - Exception causing close of session 0x0: ZooKeeperServer not running [junit] 2016-12-09 08:55:35,307 [myid:0] - INFO [NIOWorkerThread-5:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:59742 (no session established for client) [junit] 2016-12-09 08:55:35,307 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@1231] - Unable to read additional data from server sessionid 0xfa47a8f50001, likely server has closed socket, closing socket connection and attempting reconnect [junit] 2016-12-09 08:55:35,406 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:16608. Will not attempt to authenticate using SASL (unknown error) [junit] 2016-12-09 08:55:35,406 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: /127.0.0.1:59743, server: 127.0.0.1/127.0.0.1:16608 [junit] 2016-12-09 08:55:35,406 [myid:0] - INFO [NIOServerCxnFactory.AcceptThread:localhost/127.0.0.1:16608:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:59743 [junit] 2016-12-09 08:55:35,407 [myid:0] - WARN [NIOWorkerThread-6:NIOServerCnxn@369] - Exception causing close of session 0x0: ZooKeeperServer not running [junit] 2016-12-09 08:55:35,407 [myid:0] - INFO [NIOWorkerThread-6:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:59743 (no session established for client) [junit] 2016-12-09 08:55:35,407 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@1231] - Unable to read additional data from server sessionid 0xfa47a8f5, likely server has closed socket, closing socket connection and attempting reconnect [junit] 2016-12-09 08:55:36,650 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:16608. Will not attempt to authenticate using SASL (unknown error) [junit] 2016-12-09 08:55:36,650 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: /127.0.0.1:59744, server: 127.0.0.1/127.0.0.1:16608 [junit] 2016-12-09 08:55:36,650 [myid:0] - INFO [NIOServerCxnFactory.AcceptThread:localhost/127.0.0.1:16608:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:59744 [junit] 2016-12-09 08:55:36,651 [myid:0] - WARN [NIOWorkerThread-7:NIOServerCnxn@369] - Exception causing close of session 0x0: ZooKeeperServer not running [junit] 2016-12-09 08:55:36,651 [myid:0] - INFO [NIOWorkerThread-7:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:59744 (no session established for client) [junit] 2016-12-09 08:55:36,651 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@1231] - Unable to read additional data from server sessionid 0xfa47a8f5, likely server has closed socket, closing socket connection and attempting reconnect [junit] 2016-12-09 08:55:36,898 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:16608. Will not attempt to authenticate using SASL (unknown error) [junit] 2016-12-09 08:55:36,899 [myid:127.0.0.1:16608] - INFO [main-SendThread(127.0.0.1:16608):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: /127.0.0.1:59745, server: 127.0.0.1/127.0.0.1:16608 [junit] 2016-12-09 08:55:36,899 [myid:0] - INFO [NIOServerCxnFactory.AcceptThread:localhost/127.0.0.1:16608:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:59745 [junit] 2016-12-09 08:55:36,899 [myid:0] - WARN [NIOWorkerThread-8:NIOServerCnxn@369] - Exception causing close of session 0x0: ZooKeeperServer not running [junit] 2016-12-09 08:55:36,900 [myid:0] - INFO [NIOWorkerThread-8:NIOServerCnxn@607] - Closed
ZooKeeper-trunk-solaris - Build # 1415 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-solaris/1415/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 472782 lines...] [junit] 2016-12-09 08:24:35,372 [myid:] - INFO [main:ClientBase@386] - CREATING server instance 127.0.0.1:11222 [junit] 2016-12-09 08:24:35,373 [myid:] - INFO [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. [junit] 2016-12-09 08:24:35,373 [myid:] - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/0.0.0.0:11222 [junit] 2016-12-09 08:24:35,374 [myid:] - INFO [main:ClientBase@361] - STARTING server instance 127.0.0.1:11222 [junit] 2016-12-09 08:24:35,374 [myid:] - INFO [main:ZooKeeperServer@894] - minSessionTimeout set to 6000 [junit] 2016-12-09 08:24:35,374 [myid:] - INFO [main:ZooKeeperServer@903] - maxSessionTimeout set to 6 [junit] 2016-12-09 08:24:35,375 [myid:] - INFO [main:ZooKeeperServer@160] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test3665647529113486674.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test3665647529113486674.junit.dir/version-2 [junit] 2016-12-09 08:24:35,375 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test3665647529113486674.junit.dir/version-2/snapshot.b [junit] 2016-12-09 08:24:35,378 [myid:] - INFO [main:FileTxnSnapLog@306] - Snapshotting: 0xb to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test3665647529113486674.junit.dir/version-2/snapshot.b [junit] 2016-12-09 08:24:35,379 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2016-12-09 08:24:35,379 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222 [junit] 2016-12-09 08:24:35,380 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:34051 [junit] 2016-12-09 08:24:35,380 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@485] - Processing stat command from /127.0.0.1:34051 [junit] 2016-12-09 08:24:35,381 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2016-12-09 08:24:35,381 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:34051 (no session established for client) [junit] 2016-12-09 08:24:35,381 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2016-12-09 08:24:35,382 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2016-12-09 08:24:35,382 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2016-12-09 08:24:35,383 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2016-12-09 08:24:35,383 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2016-12-09 08:24:35,383 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17814 [junit] 2016-12-09 08:24:35,383 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2016-12-09 08:24:35,383 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2016-12-09 08:24:35,384 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2016-12-09 08:24:35,462 [myid:] - INFO [main:ZooKeeper@1313] - Session: 0x1255fa9145d closed [junit] 2016-12-09 08:24:35,462 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2016-12-09 08:24:35,462 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x1255fa9145d [junit] 2016-12-09 08:24:35,463 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2016-12-09 08:24:35,463 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2016-12-09 08:24:35,463 [myid:] - INFO