ZooKeeper_branch34_jdk7 - Build # 1392 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1392/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 212576 lines...] [junit] 2017-02-04 03:58:27,095 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-02-04 03:58:27,095 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-02-04 03:58:27,096 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-04 03:58:27,096 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-02-04 03:58:27,096 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2017-02-04 03:58:27,096 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-02-04 03:58:27,096 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-02-04 03:58:27,097 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-02-04 03:58:27,097 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-02-04 03:58:27,097 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-02-04 03:58:27,098 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-02-04 03:58:27,099 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-02-04 03:58:27,099 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-02-04 03:58:27,100 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-02-04 03:58:27,100 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-02-04 03:58:27,100 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test495325017057785114.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test495325017057785114.junit.dir/version-2 [junit] 2017-02-04 03:58:27,104 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-04 03:58:27,104 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-02-04 03:58:27,104 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:36366 [junit] 2017-02-04 03:58:27,105 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@838] - Processing stat command from /127.0.0.1:36366 [junit] 2017-02-04 03:58:27,105 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-02-04 03:58:27,106 [myid:] - INFO [Thread-4:NIOServerCnxn@1019] - Closed socket connection for client /127.0.0.1:36366 (no session established for client) [junit] 2017-02-04 03:58:27,106 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-02-04 03:58:27,107 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-02-04 03:58:27,108 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-02-04 03:58:27,108 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-02-04 03:58:27,108 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-02-04 03:58:27,108 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 32680 [junit] 2017-02-04 03:58:27,108 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-02-04 03:58:27,109 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-02-04 03:58:27,109 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-02-04 03:58:27,182 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15a0745ea25 closed [junit] 2017-02-04 03:58:27,182 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-02-04 03:58:27,182 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15a0745ea25 [junit] 2017-02-04 03:58:27,183 [
ZooKeeper-trunk - Build # 3261 - Failure
See https://builds.apache.org/job/ZooKeeper-trunk/3261/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 437391 lines...] [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2017-02-04 00:02:46,957 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11468,name1=Connections,name2=127.0.0.1,name3=0x10053cac31c] [junit] 2017-02-04 00:02:47,020 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11222. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-02-04 00:02:47,021 [myid:127.0.0.1:11222] - WARN [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1235] - Session 0x10053c3ab95 for server 127.0.0.1/127.0.0.1:11222, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-02-04 00:02:47,057 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x10053cac31c closed [junit] 2017-02-04 00:02:47,057 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x10053cac31c [junit] 2017-02-04 00:02:47,057 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 197052 [junit] 2017-02-04 00:02:47,058 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 1642 [junit] 2017-02-04 00:02:47,058 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2017-02-04 00:02:47,058 [myid:] - INFO [main:ClientBase@558] - tearDown starting [junit] 2017-02-04 00:02:47,058 [myid:] - INFO [main:ClientBase@528] - STOPPING server [junit] 2017-02-04 00:02:47,058 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:11468 [junit] 2017-02-04 00:02:47,062 [myid:] - INFO [main:ZooKeeperServer@534] - shutting down [junit] 2017-02-04 00:02:47,063 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-04 00:02:47,063 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2017-02-04 00:02:47,063 [myid:] - INFO [main:PrepRequestProcessor@1009] - Shutting down [junit] 2017-02-04 00:02:47,063 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-02-04 00:02:47,063 [myid:] - INFO [ProcessThread(sid:0 cport:11468)::PrepRequestProcessor@157] - PrepRequestProcessor exited loop! [junit] 2017-02-04 00:02:47,063 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-02-04 00:02:47,064 [myid:] - INFO [main:FinalRequestProcessor@481] - shutdown of request processor complete [junit] 2017-02-04 00:02:47,064 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11468,name1=InMemoryDataTree] [junit] 2017-02-04 00:02:47,064 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11468] [junit] 2017-02-04 00:02:47,065 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11468 [junit] 2017-02-04 00:02:47,065 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2017-02-04 00:02:47,071 [myid:] - INFO [main:ClientBase@583] - fdcount after test is: 4834 at start it was 4838 [junit] 2017-02-04 00:02:47,071 [myid:] - INFO [main:ZKTestCase$1@65] - SUCCEEDED testWatcherAutoResetWithLocal [junit] 2017-02-04 00:02:47,071 [myid:] - INFO [main:ZKTestCase$1@60] - FINISHED testWatcherAutoResetWithLocal [junit] Tests run: 103, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 470.016 sec, Thread: 1, Class: org.apache.zookeeper.test.NioNettySuiteTest BUILD FAILED /home/jenkins/jenkins-slave/workspace/ZooKeeper-t
ZooKeeper_branch34_jdk8 - Build # 868 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34_jdk8/868/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 208851 lines...] [junit] 2017-02-03 22:57:42,653 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-02-03 22:57:42,654 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-02-03 22:57:42,654 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 22:57:42,654 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-02-03 22:57:42,654 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2017-02-03 22:57:42,654 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-02-03 22:57:42,654 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-02-03 22:57:42,654 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-02-03 22:57:42,655 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-02-03 22:57:42,655 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-02-03 22:57:42,656 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-02-03 22:57:42,657 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-02-03 22:57:42,657 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-02-03 22:57:42,657 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-02-03 22:57:42,658 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-02-03 22:57:42,658 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test4329055890160838809.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test4329055890160838809.junit.dir/version-2 [junit] 2017-02-03 22:57:42,661 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 22:57:42,661 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-02-03 22:57:42,662 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:48257 [junit] 2017-02-03 22:57:42,662 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@838] - Processing stat command from /127.0.0.1:48257 [junit] 2017-02-03 22:57:42,663 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-02-03 22:57:42,663 [myid:] - INFO [Thread-4:NIOServerCnxn@1019] - Closed socket connection for client /127.0.0.1:48257 (no session established for client) [junit] 2017-02-03 22:57:42,663 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-02-03 22:57:42,665 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-02-03 22:57:42,665 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-02-03 22:57:42,666 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-02-03 22:57:42,666 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-02-03 22:57:42,666 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 33646 [junit] 2017-02-03 22:57:42,667 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-02-03 22:57:42,667 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-02-03 22:57:42,667 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-02-03 22:57:42,736 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15a06329468 closed [junit] 2017-02-03 22:57:42,736 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15a06329468 [junit] 2017-02-03 22:57:42,737 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-02-03 22:57:42,737
ZooKeeper-trunk-openjdk7 - Build # 1346 - Failure
See https://builds.apache.org/job/ZooKeeper-trunk-openjdk7/1346/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 459546 lines...] [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.writeFromTaskLoop(AbstractNioWorker.java:151) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioChannel$WriteTask.run(AbstractNioChannel.java:315) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [junit] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2017-02-03 20:06:07,182 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port24933,name1=Connections,name2=127.0.0.1,name3=0x10230891cfe] [junit] 2017-02-03 20:06:07,182 [myid:127.0.0.1:24810] - INFO [main-SendThread(127.0.0.1:24810):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:24810. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-02-03 20:06:07,182 [myid:127.0.0.1:24810] - WARN [main-SendThread(127.0.0.1:24810):ClientCnxn$SendThread@1235] - Session 0x1023085c50a for server 127.0.0.1/127.0.0.1:24810, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-02-03 20:06:07,282 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x10230891cfe closed [junit] 2017-02-03 20:06:07,282 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x10230891cfe [junit] 2017-02-03 20:06:07,282 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 233515 [junit] 2017-02-03 20:06:07,282 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 2427 [junit] 2017-02-03 20:06:07,282 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2017-02-03 20:06:07,282 [myid:] - INFO [main:ClientBase@558] - tearDown starting [junit] 2017-02-03 20:06:07,283 [myid:] - INFO [main:ClientBase@528] - STOPPING server [junit] 2017-02-03 20:06:07,283 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:24933 [junit] 2017-02-03 20:06:07,291 [myid:] - INFO [main:ZooKeeperServer@534] - shutting down [junit] 2017-02-03 20:06:07,291 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 20:06:07,291 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2017-02-03 20:06:07,292 [myid:] - INFO [main:PrepRequestProcessor@1009] - Shutting down [junit] 2017-02-03 20:06:07,292 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-02-03 20:06:07,292 [myid:] - INFO [ProcessThread(sid:0 cport:24933)::PrepRequestProcessor@157] - PrepRequestProcessor exited loop! [junit] 2017-02-03 20:06:07,292 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-02-03 20:06:07,294 [myid:] - INFO [main:FinalRequestProcessor@481] - shutdown of request processor complete [junit] 2017-02-03 20:06:07,295 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port24933,name1=InMemoryDataTree] [junit] 2017-02-03 20:06:07,295 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port24933] [junit] 2017-02-03 20:06:07,298 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 24
ZooKeeper_branch35_solaris - Build # 420 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_solaris/420/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 462851 lines...] [junit] 2017-02-03 17:16:24,947 [myid:] - INFO [main:ClientBase@386] - CREATING server instance 127.0.0.1:11222 [junit] 2017-02-03 17:16:24,948 [myid:] - INFO [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. [junit] 2017-02-03 17:16:24,948 [myid:] - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/0.0.0.0:11222 [junit] 2017-02-03 17:16:24,949 [myid:] - INFO [main:ClientBase@361] - STARTING server instance 127.0.0.1:11222 [junit] 2017-02-03 17:16:24,949 [myid:] - INFO [main:ZooKeeperServer@893] - minSessionTimeout set to 6000 [junit] 2017-02-03 17:16:24,950 [myid:] - INFO [main:ZooKeeperServer@902] - maxSessionTimeout set to 6 [junit] 2017-02-03 17:16:24,950 [myid:] - INFO [main:ZooKeeperServer@159] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test3518516926178056411.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test3518516926178056411.junit.dir/version-2 [junit] 2017-02-03 17:16:24,951 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test3518516926178056411.junit.dir/version-2/snapshot.b [junit] 2017-02-03 17:16:24,953 [myid:] - INFO [main:FileTxnSnapLog@320] - Snapshotting: 0xb to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test3518516926178056411.junit.dir/version-2/snapshot.b [junit] 2017-02-03 17:16:24,954 [myid:] - ERROR [main:ZooKeeperServer@505] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 17:16:24,954 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222 [junit] 2017-02-03 17:16:24,955 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:50071 [junit] 2017-02-03 17:16:24,955 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@485] - Processing stat command from /127.0.0.1:50071 [junit] 2017-02-03 17:16:24,956 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2017-02-03 17:16:24,956 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:50071 (no session established for client) [junit] 2017-02-03 17:16:24,956 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-02-03 17:16:24,957 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2017-02-03 17:16:24,958 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2017-02-03 17:16:24,958 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2017-02-03 17:16:24,958 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2017-02-03 17:16:24,958 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17889 [junit] 2017-02-03 17:16:24,958 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2017-02-03 17:16:24,959 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2017-02-03 17:16:24,959 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2017-02-03 17:16:25,032 [myid:] - INFO [main:ZooKeeper@1322] - Session: 0x12681f33ab5 closed [junit] 2017-02-03 17:16:25,033 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x12681f33ab5 [junit] 2017-02-03 17:16:25,033 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2017-02-03 17:16:25,033 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2017-02-03 17:16:25,033 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-02-03 17:16:25,033 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactor
[jira] [Commented] (ZOOKEEPER-2678) Large databases take a long time to regain a quorum
[
https://issues.apache.org/jira/browse/ZOOKEEPER-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851558#comment-15851558
]
ASF GitHub Bot commented on ZOOKEEPER-2678:
---
Github user revans2 commented on a diff in the pull request:
https://github.com/apache/zookeeper/pull/157#discussion_r99347551
--- Diff: src/java/test/org/apache/zookeeper/server/quorum/Zab1_0Test.java
---
@@ -839,12 +839,25 @@ public void converseWithFollower(InputArchive ia,
OutputArchive oa,
Assert.assertEquals(1, f.self.getAcceptedEpoch());
Assert.assertEquals(1, f.self.getCurrentEpoch());
+//Wait for the transactions to be written out. The
thread that writes them out
+// does not send anything back when it is done.
+long start = System.currentTimeMillis();
+while (createSessionZxid !=
f.fzk.getLastProcessedZxid() && (System.currentTimeMillis() - start) < 50) {
--- End diff --
OK Will see what I can do
> Large databases take a long time to regain a quorum
> ---
>
> Key: ZOOKEEPER-2678
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2678
> Project: ZooKeeper
> Issue Type: Bug
> Components: server
>Affects Versions: 3.4.9, 3.5.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>
> I know this is long but please here me out.
> I recently inherited a massive zookeeper ensemble. The snapshot is 3.4 GB on
> disk. Because of its massive size we have been running into a number of
> issues. There are lots of problems that we hope to fix with tuning GC etc,
> but the big one right now that is blocking us making a lot of progress on the
> rest of them is that when we lose a quorum because the leader left, for what
> ever reason, it can take well over 5 mins for a new quorum to be established.
> So we cannot tune the leader without risking downtime.
> We traced down where the time was being spent and found that each server was
> clearing the database so it would be read back in again before leader
> election even started. Then as part of the sync phase each server will write
> out a snapshot to checkpoint the progress it made as part of the sync.
> I will be putting up a patch shortly with some proposed changes in it.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[GitHub] zookeeper pull request #157: ZOOKEEPER-2678: Discovery and Sync can take a v...
Github user revans2 commented on a diff in the pull request:
https://github.com/apache/zookeeper/pull/157#discussion_r99347551
--- Diff: src/java/test/org/apache/zookeeper/server/quorum/Zab1_0Test.java
---
@@ -839,12 +839,25 @@ public void converseWithFollower(InputArchive ia,
OutputArchive oa,
Assert.assertEquals(1, f.self.getAcceptedEpoch());
Assert.assertEquals(1, f.self.getCurrentEpoch());
+//Wait for the transactions to be written out. The
thread that writes them out
+// does not send anything back when it is done.
+long start = System.currentTimeMillis();
+while (createSessionZxid !=
f.fzk.getLastProcessedZxid() && (System.currentTimeMillis() - start) < 50) {
--- End diff --
OK Will see what I can do
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
ZooKeeper_branch35_jdk8 - Build # 401 - Failure
See https://builds.apache.org/job/ZooKeeper_branch35_jdk8/401/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 448405 lines...] [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-02-03 13:56:16,126 [myid:127.0.0.1:24933] - INFO [main-SendThread(127.0.0.1:24933):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:24933. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-02-03 13:56:16,127 [myid:127.0.0.1:24933] - INFO [main-SendThread(127.0.0.1:24933):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: /127.0.0.1:58354, server: 127.0.0.1/127.0.0.1:24933 [junit] 2017-02-03 13:56:16,127 [myid:] - INFO [New I/O worker #1829:ZooKeeperServer@1004] - Client attempting to renew session 0x1034a11fd66 at /127.0.0.1:58354 [junit] 2017-02-03 13:56:16,128 [myid:] - INFO [New I/O worker #1829:ZooKeeperServer@713] - Established session 0x1034a11fd66 with negotiated timeout 6000 for client /127.0.0.1:58354 [junit] 2017-02-03 13:56:16,128 [myid:127.0.0.1:24933] - INFO [main-SendThread(127.0.0.1:24933):ClientCnxn$SendThread@1381] - Session establishment complete on server 127.0.0.1/127.0.0.1:24933, sessionid = 0x1034a11fd66, negotiated timeout = 6000 [junit] 2017-02-03 13:56:16,130 [myid:] - INFO [SyncThread:0:FileTxnLog@204] - Creating new log file: log.7 [junit] 2017-02-03 13:56:17,002 [myid:127.0.0.1:24816] - INFO [main-SendThread(127.0.0.1:24816):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:24816. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-02-03 13:56:17,003 [myid:127.0.0.1:24816] - WARN [main-SendThread(127.0.0.1:24816):ClientCnxn$SendThread@1235] - Session 0x3034a0efb58 for server 127.0.0.1/127.0.0.1:24816, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-02-03 13:56:17,137 [myid:] - INFO [ProcessThread(sid:0 cport:24933)::PrepRequestProcessor@656] - Processed session termination for sessionid: 0x1034a11fd66 [junit] 2017-02-03 13:56:17,139 [myid:] - INFO [main:ZooKeeper@1322] - Session: 0x1034a11fd66 closed [junit] 2017-02-03 13:56:17,139 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port24933,name1=Connections,name2=127.0.0.1,name3=0x1034a11fd66] [junit] 2017-02-03 13:56:17,139 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x1034a11fd66 [junit] 2017-02-03 13:56:17,139 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 67967 [junit] 2017-02-03 13:56:17,139 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 468 [junit] 2017-02-03 13:56:17,140 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2017-02-03 13:56:17,140 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2017-02-03 13:56:17,140 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2017-02-03 13:56:17,140 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:24933 [junit] 2017-02-03 13:56:17,141 [myid:] - INFO [main:ZooKeeperServer@533] - shutting down [junit] 2017-02-03 13:56:17,141 [myid:] - ERROR [main:ZooKeeperServer@505] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 13:56:17,142 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2017-02-03 13:56:17,142 [myid:] - INFO [main:PrepRequestProcessor@974] - Shutting down [junit] 2017-02-03 13:56:17,142 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-02-03 13:56:17,142 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-02-03 13:56:17,142 [myid:] - INFO [ProcessThread(sid:0 cport:24933)::PrepRequestProcessor@154] - PrepRequestProcessor exited loop! [junit] 2017-02-03 13:56:17,142 [myid:] - INFO [main:FinalRequestProcessor@479] - shutdown
ZooKeeper_branch34_solaris - Build # 1456 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_solaris/1456/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 183312 lines...] [junit] 2017-02-03 13:55:35,193 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-02-03 13:55:35,193 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 13:55:35,193 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-02-03 13:55:35,193 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2017-02-03 13:55:35,193 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-02-03 13:55:35,193 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-02-03 13:55:35,194 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-02-03 13:55:35,194 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-02-03 13:55:35,194 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-02-03 13:55:35,194 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-02-03 13:55:35,195 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-02-03 13:55:35,195 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-02-03 13:55:35,196 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-02-03 13:55:35,196 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-02-03 13:55:35,196 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/build/test/tmp/test2649221740737945182.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/build/test/tmp/test2649221740737945182.junit.dir/version-2 [junit] 2017-02-03 13:55:35,199 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-02-03 13:55:35,199 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-02-03 13:55:35,199 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:64118 [junit] 2017-02-03 13:55:35,200 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@838] - Processing stat command from /127.0.0.1:64118 [junit] 2017-02-03 13:55:35,200 [myid:] - INFO [Thread-5:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-02-03 13:55:35,200 [myid:] - INFO [Thread-5:NIOServerCnxn@1019] - Closed socket connection for client /127.0.0.1:64118 (no session established for client) [junit] 2017-02-03 13:55:35,200 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-02-03 13:55:35,201 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 8997 [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-02-03 13:55:35,202 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-02-03 13:55:35,290 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15a04423f76 closed [junit] 2017-02-03 13:55:35,290 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15a04423f76 [junit] 2017-02-03 13:55:35,290 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-02-03 13:55:35,291 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-02-03 13:55:35,291 [myid:] - E
ZooKeeper-trunk-jdk8 - Build # 924 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/924/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 460771 lines...] [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-02-03 12:04:35,620 [myid:127.0.0.1:14062] - INFO [main-SendThread(127.0.0.1:14062):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:14062. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-02-03 12:04:35,620 [myid:127.0.0.1:14062] - INFO [main-SendThread(127.0.0.1:14062):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: /127.0.0.1:43352, server: 127.0.0.1/127.0.0.1:14062 [junit] 2017-02-03 12:04:35,620 [myid:] - WARN [New I/O worker #4101:NettyServerCnxn@399] - Closing connection to /127.0.0.1:43352 [junit] java.io.IOException: ZK down [junit] at org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:336) [junit] at org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:244) [junit] at org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:166) [junit] at org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) [junit] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [junit] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) [junit] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [junit] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [junit] at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [junit] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) Build timed out (after 120 minutes). Marking the build as failed. Build was aborted [WARNINGS] Skipping publisher since build result is FAILURE Recording test results ERROR: Step ?Publish JUnit test result report? aborted due to exception: java.io.IOException: remote file operation failed: /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk-jdk8 at hudson.remoting.Channel@22969cb7:H11: hudson.remoting.ChannelClosedException: channel is already closed at hudson.FilePath.act(FilePath.java:1014) at hudson.FilePath.act(FilePath.java:996) at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:103) at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:128) at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:149) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:78) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:779) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720) at hudson.model.Build$BuildExecution.post2(Build.java:185) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:665) at hudson.model.Run.execute(Run.java:1766) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:410) Caused by: hudson.remoting.ChannelClosedException: channel is already closed at hudson.remoting.Channel.send(Channel.java:578) at hudson.remoting.Request.call(Request.java:130) at hudson.remoting.Channel.call(Channel.java:780) at hudson.FilePath.act(FilePath.java:1007) ... 14 more Caused by: java.io.IOException at hudson.remoting.Channel.close(Channel.java:1163) at hudson.slaves.ChannelPinger$1.onDe
ZooKeeper-trunk-solaris - Build # 1489 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-solaris/1489/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 455036 lines...] [junit] 2017-02-03 08:46:02,191 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2017-02-03 08:46:02,192 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:56084 (no session established for client) [junit] 2017-02-03 08:46:02,192 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-02-03 08:46:02,193 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2017-02-03 08:46:02,193 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2017-02-03 08:46:02,194 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2017-02-03 08:46:02,194 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2017-02-03 08:46:02,194 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17997 [junit] 2017-02-03 08:46:02,194 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2017-02-03 08:46:02,194 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2017-02-03 08:46:02,194 [myid:] - INFO [main:ClientBase@558] - tearDown starting [junit] 2017-02-03 08:46:03,991 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11222. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-02-03 08:46:03,991 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: null, server: null [junit] 2017-02-03 08:46:03,992 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:56085 [junit] 2017-02-03 08:46:03,993 [myid:] - INFO [NIOWorkerThread-2:ZooKeeperServer@1005] - Client attempting to renew session 0x126801fe0c8 at /127.0.0.1:56085 [junit] 2017-02-03 08:46:03,994 [myid:] - INFO [NIOWorkerThread-2:ZooKeeperServer@714] - Established session 0x126801fe0c8 with negotiated timeout 3 for client /127.0.0.1:56085 [junit] 2017-02-03 08:46:03,995 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1381] - Session establishment complete on server null, sessionid = 0x126801fe0c8, negotiated timeout = 3 [junit] 2017-02-03 08:46:03,996 [myid:] - INFO [ProcessThread(sid:0 cport:11222)::PrepRequestProcessor@618] - Processed session termination for sessionid: 0x126801fe0c8 [junit] 2017-02-03 08:46:03,996 [myid:] - INFO [SyncThread:0:FileTxnLog@204] - Creating new log file: log.c [junit] 2017-02-03 08:46:04,205 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x126801fe0c8 closed [junit] 2017-02-03 08:46:04,205 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x126801fe0c8 [junit] 2017-02-03 08:46:04,205 [myid:] - INFO [NIOWorkerThread-5:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=Connections,name2=127.0.0.1,name3=0x126801fe0c8] [junit] 2017-02-03 08:46:04,205 [myid:] - INFO [main:ClientBase@528] - STOPPING server [junit] 2017-02-03 08:46:04,206 [myid:] - INFO [NIOWorkerThread-5:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:56085 which had sessionid 0x126801fe0c8 [junit] 2017-02-03 08:46:04,206 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2017-02-03 08:46:04,207 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2017-02-03 08:46:04,207 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-02-03 08:46:04,207 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-02-03 08:46:04,207 [myid:] - INFO [main:ZooKeeperServer@534] - shutting down [junit] 2017-02-03 08:46:04,208 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or
