[jira] [Commented] (ZOOKEEPER-1045) Quorum Peer mutual authentication
[ https://issues.apache.org/jira/browse/ZOOKEEPER-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292621#comment-15292621 ] Rakesh R commented on ZOOKEEPER-1045: - Attached another patch with the following diff: # build related changes. # removed unwanted BaseSysTest modifications. Thanks a lot [~phunt], [~hanm] for the reviews. I've updated [PR-49|https://github.com/apache/zookeeper/pull/49] and [RB-47354|https://reviews.apache.org/r/47354/] uploaded the latest changes. Kindly review it again when you get a chance. > Quorum Peer mutual authentication > - > > Key: ZOOKEEPER-1045 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1045 > Project: ZooKeeper > Issue Type: New Feature > Components: server >Reporter: Eugene Koontz >Assignee: Rakesh R >Priority: Critical > Attachments: 0001-ZOOKEEPER-1045-br-3-4.patch, > ZOOKEEPER-1045-00.patch, ZOOKEEPER-1045-Rolling Upgrade Design Proposal.pdf, > ZOOKEEPER-1045-br-3-4.patch > > > ZOOKEEPER-938 addresses mutual authentication between clients and servers. > This bug, on the other hand, is for authentication among quorum peers. > Hopefully much of the work done on SASL integration with Zookeeper for > ZOOKEEPER-938 can be used as a foundation for this enhancement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 47354: ZOOKEEPER-1045 : Quorum mutual authentication using SASL mechanism
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47354/ --- (Updated May 20, 2016, 3:10 a.m.) Review request for zookeeper, fpj, Ivan Kelly, Patrick Hunt, and Raul Gutierrez Segales. Bugs: ZOOKEEPER-1045 https://issues.apache.org/jira/browse/ZOOKEEPER-1045 Repository: zookeeper-git Description --- Quorum mutual authentication using SASL mechanism - Digest/Kerberos Diffs (updated) - build.xml ab254b2 ivy.xml 95b0e5a src/java/main/org/apache/zookeeper/Login.java a214c9c src/java/main/org/apache/zookeeper/client/ZooKeeperSaslClient.java 21ef0fa src/java/main/org/apache/zookeeper/server/ZooKeeperSaslServer.java 71870ce src/java/main/org/apache/zookeeper/server/auth/SaslServerCallbackHandler.java 2fbd6ed src/java/main/org/apache/zookeeper/server/quorum/Leader.java 40c6748 src/java/main/org/apache/zookeeper/server/quorum/Learner.java c73a8ee src/java/main/org/apache/zookeeper/server/quorum/LearnerHandler.java 8a748c7 src/java/main/org/apache/zookeeper/server/quorum/QuorumCnxManager.java 20e5f16 src/java/main/org/apache/zookeeper/server/quorum/QuorumPeer.java 2f0f21b src/java/main/org/apache/zookeeper/server/quorum/QuorumPeerConfig.java 8ae820d src/java/main/org/apache/zookeeper/server/quorum/QuorumPeerMain.java e9c8007 src/java/main/org/apache/zookeeper/server/quorum/auth/NullQuorumAuthClient.java PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/NullQuorumAuthServer.java PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/QuorumAuth.java PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/QuorumAuthClient.java PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/QuorumAuthServer.java PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/README.md PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/SaslQuorumAuthClient.java PRE-CREATION src/java/main/org/apache/zookeeper/server/quorum/auth/SaslQuorumAuthServer.java PRE-CREATION src/java/main/org/apache/zookeeper/util/SecurityUtils.java PRE-CREATION src/java/test/data/kerberos/minikdc-krb5.conf PRE-CREATION src/java/test/data/kerberos/minikdc.ldiff PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/CnxManagerTest.java 831d3ed src/java/test/org/apache/zookeeper/server/quorum/FLEBackwardElectionRoundTest.java c1259d1 src/java/test/org/apache/zookeeper/server/quorum/FLECompatibilityTest.java 72e4fc9 src/java/test/org/apache/zookeeper/server/quorum/FLEDontCareTest.java a4c0cb0 src/java/test/org/apache/zookeeper/server/quorum/FLELostMessageTest.java 39a53ca src/java/test/org/apache/zookeeper/server/quorum/LearnerTest.java 2ae57ce src/java/test/org/apache/zookeeper/server/quorum/QuorumCnxManagerTest.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/QuorumPeerTestBase.java ef552db src/java/test/org/apache/zookeeper/server/quorum/Zab1_0Test.java ab8ce42 src/java/test/org/apache/zookeeper/server/quorum/auth/KerberosSecurityTestcase.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/KerberosTestUtils.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/MiniKdc.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/MiniKdcTest.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/QuorumAuthTestBase.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/QuorumAuthUpgradeTest.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/QuorumDigestAuthTest.java PRE-CREATION src/java/test/org/apache/zookeeper/server/quorum/auth/QuorumKerberosAuthTest.java PRE-CREATION src/java/test/org/apache/zookeeper/test/FLEPredicateTest.java 8088505 src/zookeeper.jute 6521e54 Diff: https://reviews.apache.org/r/47354/diff/ Testing --- Added unit test cases to verify the changes. Thanks, Rakesh R
[jira] [Updated] (ZOOKEEPER-1045) Quorum Peer mutual authentication
[ https://issues.apache.org/jira/browse/ZOOKEEPER-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated ZOOKEEPER-1045: Attachment: ZOOKEEPER-1045-br-3-4.patch > Quorum Peer mutual authentication > - > > Key: ZOOKEEPER-1045 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1045 > Project: ZooKeeper > Issue Type: New Feature > Components: server >Reporter: Eugene Koontz >Assignee: Rakesh R >Priority: Critical > Attachments: 0001-ZOOKEEPER-1045-br-3-4.patch, > ZOOKEEPER-1045-00.patch, ZOOKEEPER-1045-Rolling Upgrade Design Proposal.pdf, > ZOOKEEPER-1045-br-3-4.patch > > > ZOOKEEPER-938 addresses mutual authentication between clients and servers. > This bug, on the other hand, is for authentication among quorum peers. > Hopefully much of the work done on SASL integration with Zookeeper for > ZOOKEEPER-938 can be used as a foundation for this enhancement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
ZooKeeper_branch34 - Build # 1524 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34/1524/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 221428 lines...] [junit] 2016-05-20 00:38:13,098 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2016-05-20 00:38:13,098 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2016-05-20 00:38:13,098 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2016-05-20 00:38:13,099 [myid:] - INFO [main:ZooKeeperServer@469] - shutting down [junit] 2016-05-20 00:38:13,099 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2016-05-20 00:38:13,099 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2016-05-20 00:38:13,099 [myid:] - INFO [main:SyncRequestProcessor@209] - Shutting down [junit] 2016-05-20 00:38:13,099 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2016-05-20 00:38:13,100 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@187] - SyncRequestProcessor exited! [junit] 2016-05-20 00:38:13,100 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2016-05-20 00:38:13,101 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-05-20 00:38:13,101 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2016-05-20 00:38:13,102 [myid:] - INFO [main:ClientBase@443] - STARTING server [junit] 2016-05-20 00:38:13,103 [myid:] - INFO [main:ClientBase@364] - CREATING server instance 127.0.0.1:11221 [junit] 2016-05-20 00:38:13,103 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2016-05-20 00:38:13,103 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2016-05-20 00:38:13,104 [myid:] - INFO [main:ZooKeeperServer@170] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34/branch-3.4/build/test/tmp/test434080195677782622.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34/branch-3.4/build/test/tmp/test434080195677782622.junit.dir/version-2 [junit] 2016-05-20 00:38:13,109 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-05-20 00:38:13,109 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:34023 [junit] 2016-05-20 00:38:13,109 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:34023 [junit] 2016-05-20 00:38:13,110 [myid:] - INFO [Thread-5:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2016-05-20 00:38:13,111 [myid:] - INFO [Thread-5:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:34023 (no session established for client) [junit] 2016-05-20 00:38:13,111 [myid:] - INFO [main:JMXEnv@229] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2016-05-20 00:38:13,113 [myid:] - INFO [main:JMXEnv@246] - expect:InMemoryDataTree [junit] 2016-05-20 00:38:13,113 [myid:] - INFO [main:JMXEnv@250] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2016-05-20 00:38:13,114 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2016-05-20 00:38:13,114 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2016-05-20 00:38:13,114 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 31174 [junit] 2016-05-20 00:38:13,115 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2016-05-20 00:38:13,115 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2016-05-20 00:38:13,115 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2016-05-20 00:38:13,180 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x154cb992854 closed [junit] 2016-05-20 00:38:13,180 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2016-05-20 00:38:13,181 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x154cb992854 [junit] 2016-05-20 00:38:13,181 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2016
ZooKeeper_branch34_openjdk7 - Build # 1081 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1081/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 209394 lines...] [junit] 2016-05-19 15:21:31,538 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2016-05-19 15:21:31,538 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2016-05-19 15:21:31,539 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2016-05-19 15:21:31,539 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2016-05-19 15:21:31,539 [myid:] - INFO [main:ZooKeeperServer@469] - shutting down [junit] 2016-05-19 15:21:31,539 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2016-05-19 15:21:31,539 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2016-05-19 15:21:31,540 [myid:] - INFO [main:SyncRequestProcessor@209] - Shutting down [junit] 2016-05-19 15:21:31,540 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2016-05-19 15:21:31,540 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@187] - SyncRequestProcessor exited! [junit] 2016-05-19 15:21:31,541 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2016-05-19 15:21:31,541 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-05-19 15:21:31,542 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2016-05-19 15:21:31,543 [myid:] - INFO [main:ClientBase@443] - STARTING server [junit] 2016-05-19 15:21:31,543 [myid:] - INFO [main:ClientBase@364] - CREATING server instance 127.0.0.1:11221 [junit] 2016-05-19 15:21:31,543 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2016-05-19 15:21:31,544 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2016-05-19 15:21:31,544 [myid:] - INFO [main:ZooKeeperServer@170] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7/branch-3.4/build/test/tmp/test490752097829363861.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7/branch-3.4/build/test/tmp/test490752097829363861.junit.dir/version-2 [junit] 2016-05-19 15:21:31,601 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2016-05-19 15:21:31,602 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:35930 [junit] 2016-05-19 15:21:31,602 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:35930 [junit] 2016-05-19 15:21:31,617 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2016-05-19 15:21:31,618 [myid:] - INFO [Thread-4:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:35930 (no session established for client) [junit] 2016-05-19 15:21:31,618 [myid:] - INFO [main:JMXEnv@229] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2016-05-19 15:21:31,621 [myid:] - INFO [main:JMXEnv@246] - expect:InMemoryDataTree [junit] 2016-05-19 15:21:31,621 [myid:] - INFO [main:JMXEnv@250] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2016-05-19 15:21:31,621 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2016-05-19 15:21:31,621 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2016-05-19 15:21:31,622 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 32676 [junit] 2016-05-19 15:21:31,622 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2016-05-19 15:21:31,622 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2016-05-19 15:21:31,623 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2016-05-19 15:21:32,691 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x154c99b7dd1 closed [junit] 2016-05-19 15:21:32,691 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2016-05-19 15:21:32,691 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x154c99b7dd1 [junit] 2016-05-19 15:21:32,692 [myid:] - INFO
ZooKeeper-trunk-jdk8 - Build # 604 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/604/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 892594 lines...] [junit] 2016-05-19 12:04:38,411 [myid:] - WARN [WorkerSender[myid=2]:QuorumCnxManager@459] - Cannot open channel to 5 at election address /127.0.0.1:14147 [junit] java.net.ConnectException: Connection refused [junit] at java.net.PlainSocketImpl.socketConnect(Native Method) [junit] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345) [junit] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) [junit] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) [junit] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [junit] at java.net.Socket.connect(Socket.java:589) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:444) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:485) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:421) [junit] at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486) [junit] at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465) [junit] at java.lang.Thread.run(Thread.java:744) [junit] 2016-05-19 12:04:38,412 [myid:] - WARN [WorkerSender[myid=1]:QuorumCnxManager@459] - Cannot open channel to 4 at election address /127.0.0.1:14146 [junit] java.net.ConnectException: Connection refused [junit] at java.net.PlainSocketImpl.socketConnect(Native Method) [junit] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345) [junit] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) [junit] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) [junit] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [junit] at java.net.Socket.connect(Socket.java:589) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:444) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:485) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:421) [junit] at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486) [junit] at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465) [junit] at java.lang.Thread.run(Thread.java:744) [junit] 2016-05-19 12:04:38,412 [myid:] - INFO [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version) [junit] 2016-05-19 12:04:38,412 [myid:] - WARN [WorkerSender[myid=1]:QuorumCnxManager@459] - Cannot open channel to 5 at election address /127.0.0.1:14147 [junit] java.net.ConnectException: Connection refused [junit] at java.net.PlainSocketImpl.socketConnect(Native Method) [junit] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345) [junit] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) [junit] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) [junit] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [junit] at java.net.Socket.connect(Socket.java:589) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:444) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:485) [junit] at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:421) [junit] at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486) [junit] at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465) [junit] at java.lang.Thread.run(Thread.java:744) [junit] 2016-05-19 12:04:38,412 [myid:] - INFO [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version) [junit] 2016-05-19 12:04:38,412 [myid:] - INFO [Worker
ZooKeeper_branch35_openjdk7 - Build # 86 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_openjdk7/86/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1523 lines...] [ivy:retrieve] downloading http://repo1.maven.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar ... [ivy:retrieve] ... (478kB) [ivy:retrieve] .. (0kB) [ivy:retrieve] [SUCCESSFUL ] log4j#log4j;1.2.17!log4j.jar(bundle) (13ms) [ivy:retrieve] downloading http://repo1.maven.org/maven2/io/netty/netty/3.10.5.Final/netty-3.10.5.Final.jar ... [ivy:retrieve] . (1299kB) [ivy:retrieve] .. (0kB) [ivy:retrieve] [SUCCESSFUL ] io.netty#netty;3.10.5.Final!netty.jar (27ms) [ivy:retrieve] downloading http://repo1.maven.org/maven2/net/java/dev/javacc/javacc/5.0/javacc-5.0.jar ... [ivy:retrieve] (291kB) [ivy:retrieve] .. (0kB) [ivy:retrieve] [SUCCESSFUL ] net.java.dev.javacc#javacc;5.0!javacc.jar (12ms) [ivy:retrieve] :: resolution report :: resolve 4186ms :: artifacts dl 189ms - | |modules|| artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| - | default | 12 | 12 | 12 | 0 || 12 | 12 | - [ivy:retrieve] :: retrieving :: org.apache.zookeeper#zookeeper [ivy:retrieve] confs: [default] [ivy:retrieve] 12 artifacts copied, 0 already retrieved (4167kB/31ms) clover.setup: clover.info: clover: generate_jute_parser: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7/branch-3.5/build/jute_compiler/org/apache/jute/compiler/generated [ivy:artifactproperty] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:artifactproperty] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7/branch-3.5/ivysettings.xml [move] Moving 1 file to /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7/branch-3.5/build/lib [javacc] Java Compiler Compiler Version 5.0 (Parser Generator) [javacc] (type "javacc" with no arguments for help) [javacc] Reading from file /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7/branch-3.5/src/java/main/org/apache/jute/compiler/generated/rcc.jj . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "SimpleCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. jute: BUILD FAILED /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7/branch-3.5/build.xml:1322: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_openjdk7/branch-3.5/build.xml:272: Unable to find a javac compiler; com.sun.tools.javac.Main is not on the classpath. Perhaps JAVA_HOME does not point to the JDK. It is currently set to "/usr/lib/jvm/java-7-openjdk-amd64/jre" Total time: 6 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper-trunk-solaris - Build # 1164 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-solaris/1164/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 362538 lines...] [junit] 2016-05-19 08:16:33,000 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2016-05-19 08:16:33,001 [myid:] - INFO [main:ClientBase@460] - STARTING server [junit] 2016-05-19 08:16:33,001 [myid:] - INFO [main:ClientBase@380] - CREATING server instance 127.0.0.1:11222 [junit] 2016-05-19 08:16:33,002 [myid:] - INFO [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. [junit] 2016-05-19 08:16:33,003 [myid:] - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/0.0.0.0:11222 [junit] 2016-05-19 08:16:33,003 [myid:] - INFO [main:ClientBase@355] - STARTING server instance 127.0.0.1:11222 [junit] 2016-05-19 08:16:33,004 [myid:] - INFO [main:ZooKeeperServer@858] - minSessionTimeout set to 6000 [junit] 2016-05-19 08:16:33,004 [myid:] - INFO [main:ZooKeeperServer@867] - maxSessionTimeout set to 6 [junit] 2016-05-19 08:16:33,004 [myid:] - INFO [main:ZooKeeperServer@156] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/trunk/build/test/tmp/test8561823671457839141.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/trunk/build/test/tmp/test8561823671457839141.junit.dir/version-2 [junit] 2016-05-19 08:16:33,005 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/trunk/build/test/tmp/test8561823671457839141.junit.dir/version-2/snapshot.b [junit] 2016-05-19 08:16:33,007 [myid:] - INFO [main:FileTxnSnapLog@298] - Snapshotting: 0xb to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/trunk/build/test/tmp/test8561823671457839141.junit.dir/version-2/snapshot.b [junit] 2016-05-19 08:16:33,009 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222 [junit] 2016-05-19 08:16:33,009 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:48900 [junit] 2016-05-19 08:16:33,010 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@485] - Processing stat command from /127.0.0.1:48900 [junit] 2016-05-19 08:16:33,011 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2016-05-19 08:16:33,011 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@607] - Closed socket connection for client /127.0.0.1:48900 (no session established for client) [junit] 2016-05-19 08:16:33,011 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2016-05-19 08:16:33,013 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2016-05-19 08:16:33,013 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2016-05-19 08:16:33,013 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2016-05-19 08:16:33,013 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2016-05-19 08:16:33,014 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17711 [junit] 2016-05-19 08:16:33,014 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2016-05-19 08:16:33,014 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2016-05-19 08:16:33,014 [myid:] - INFO [main:ClientBase@537] - tearDown starting [junit] 2016-05-19 08:16:33,082 [myid:] - INFO [main:ZooKeeper@1313] - Session: 0x1214513ad92 closed [junit] 2016-05-19 08:16:33,082 [myid:] - INFO [main:ClientBase@507] - STOPPING server [junit] 2016-05-19 08:16:33,082 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x1214513ad92 [junit] 2016-05-19 08:16:33,083 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2016-05-19 08:16:33,083 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2016-05-19 08:16:33,083 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selecto
[jira] [Commented] (ZOOKEEPER-2420) Autopurge deletes log file prior to oldest retained snapshot even though restore may need it
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290613#comment-15290613 ] Ed Rowe commented on ZOOKEEPER-2420: Thanks Michael. I'm looking into your suggestion. In the process I think I've discovered another bug. Stay tuned. > Autopurge deletes log file prior to oldest retained snapshot even though > restore may need it > > > Key: ZOOKEEPER-2420 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2420 > Project: ZooKeeper > Issue Type: Bug > Components: server >Reporter: Ed Rowe > Attachments: ZOOKEEPER-2420.patch > > > Autopurge retains all log files whose zxid are >= the zxid of the oldest > snapshot file that it is going to retain (in PurgeTxnLog > retainNRecentSnapshots()). Given that loading the database from > snapshots/logs will start with the log file _prior_ to the snapshot's zxid, > autopurge should retain the log file prior to the oldest retained snapshot as > well, unless it verifies that it contains no zxids beyond what the snapshot > contains. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
