ZooKeeper_branch34_jdk7 - Build # 1385 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1385/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 238030 lines...] [junit] 2017-01-29 02:49:53,430 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-01-29 02:49:53,431 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-01-29 02:49:53,431 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-01-29 02:49:53,431 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-01-29 02:49:53,431 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2017-01-29 02:49:53,431 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-01-29 02:49:53,431 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-01-29 02:49:53,432 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-01-29 02:49:53,432 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-01-29 02:49:53,433 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-01-29 02:49:53,433 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-01-29 02:49:53,435 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-01-29 02:49:53,435 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-01-29 02:49:53,435 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-01-29 02:49:53,436 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-01-29 02:49:53,436 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test5016383351230838497.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test5016383351230838497.junit.dir/version-2 [junit] 2017-01-29 02:49:53,441 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-01-29 02:49:53,441 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-01-29 02:49:53,442 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:55100 [junit] 2017-01-29 02:49:53,442 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:55100 [junit] 2017-01-29 02:49:53,443 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2017-01-29 02:49:53,443 [myid:] - INFO [Thread-4:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:55100 (no session established for client) [junit] 2017-01-29 02:49:53,443 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-01-29 02:49:53,446 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-01-29 02:49:53,446 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-01-29 02:49:53,446 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-01-29 02:49:53,446 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-01-29 02:49:53,447 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 32680 [junit] 2017-01-29 02:49:53,447 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-01-29 02:49:53,448 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-01-29 02:49:53,448 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-01-29 02:49:53,512 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x159e820fcfe closed [junit] 2017-01-29 02:49:53,512 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-01-29 02:49:53,513 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x159e820fcfe [junit] 2017-01-29
[jira] [Commented] (ZOOKEEPER-2678) Large databases take a long time to regain a quorum
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15844166#comment-15844166 ] ASF GitHub Bot commented on ZOOKEEPER-2678: --- Github user fpj commented on the issue: https://github.com/apache/zookeeper/pull/157 Thanks for the patch @revans2 . It makes sense to port this change to both 3.5 and master. > Large databases take a long time to regain a quorum > --- > > Key: ZOOKEEPER-2678 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2678 > Project: ZooKeeper > Issue Type: Bug > Components: server >Affects Versions: 3.4.9, 3.5.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans > > I know this is long but please here me out. > I recently inherited a massive zookeeper ensemble. The snapshot is 3.4 GB on > disk. Because of its massive size we have been running into a number of > issues. There are lots of problems that we hope to fix with tuning GC etc, > but the big one right now that is blocking us making a lot of progress on the > rest of them is that when we lose a quorum because the leader left, for what > ever reason, it can take well over 5 mins for a new quorum to be established. > So we cannot tune the leader without risking downtime. > We traced down where the time was being spent and found that each server was > clearing the database so it would be read back in again before leader > election even started. Then as part of the sync phase each server will write > out a snapshot to checkpoint the progress it made as part of the sync. > I will be putting up a patch shortly with some proposed changes in it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ZOOKEEPER-2678) Large databases take a long time to regain a quorum
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15844165#comment-15844165 ] ASF GitHub Bot commented on ZOOKEEPER-2678: --- Github user fpj commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/157#discussion_r98337403 --- Diff: src/java/test/org/apache/zookeeper/server/quorum/Zab1_0Test.java --- @@ -839,6 +839,13 @@ public void converseWithFollower(InputArchive ia, OutputArchive oa, Assert.assertEquals(1, f.self.getAcceptedEpoch()); Assert.assertEquals(1, f.self.getCurrentEpoch()); +//Wait for the edits to be written out --- End diff -- I need to think some more whether it makes any sense to add test cases for this. The test cases we already have probably cover this enough given that there is no real change of behavior. This change here is necessary, though. We don't really care about time in general in our tests because we can never be sure of the timing we will get across runs and with different settings. > Large databases take a long time to regain a quorum > --- > > Key: ZOOKEEPER-2678 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2678 > Project: ZooKeeper > Issue Type: Bug > Components: server >Affects Versions: 3.4.9, 3.5.2 >Reporter: Robert Joseph Evans >Assignee: Robert Joseph Evans > > I know this is long but please here me out. > I recently inherited a massive zookeeper ensemble. The snapshot is 3.4 GB on > disk. Because of its massive size we have been running into a number of > issues. There are lots of problems that we hope to fix with tuning GC etc, > but the big one right now that is blocking us making a lot of progress on the > rest of them is that when we lose a quorum because the leader left, for what > ever reason, it can take well over 5 mins for a new quorum to be established. > So we cannot tune the leader without risking downtime. > We traced down where the time was being spent and found that each server was > clearing the database so it would be read back in again before leader > election even started. Then as part of the sync phase each server will write > out a snapshot to checkpoint the progress it made as part of the sync. > I will be putting up a patch shortly with some proposed changes in it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zookeeper issue #157: ZOOKEEPER-2678: Discovery and Sync can take a very lon...
Github user fpj commented on the issue: https://github.com/apache/zookeeper/pull/157 Thanks for the patch @revans2 . It makes sense to port this change to both 3.5 and master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2678) Large databases take a long time to regain a quorum
[
https://issues.apache.org/jira/browse/ZOOKEEPER-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15844164#comment-15844164
]
ASF GitHub Bot commented on ZOOKEEPER-2678:
---
Github user fpj commented on a diff in the pull request:
https://github.com/apache/zookeeper/pull/157#discussion_r98336253
--- Diff: src/java/main/org/apache/zookeeper/server/quorum/Learner.java ---
@@ -364,10 +367,12 @@ else if (qp.getType() == Leader.SNAP) {
long lastQueued = 0;
-// in V1.0 we take a snapshot when we get the NEWLEADER
message, but in pre V1.0
+// in Zab V1.0 (ZK 3.4+) we might take a snapshot when we get
the NEWLEADER message, but in pre V1.0
// we take the snapshot at the UPDATE, since V1.0 also gets
the UPDATE (after the NEWLEADER)
// we need to make sure that we don't take the snapshot twice.
-boolean snapshotTaken = false;
+boolean isPreZAB1_0 = true;
+//If we are not going to take the snapshot be sure the edits
are not applied in memory
+boolean writeToEditLog = !snapshotNeeded;
--- End diff --
The changes here are using `edit` to refer to `txns`. I'd rather use `txn`
to be consistent across the project. Specifically here, you're using `EditLog`
to refer to the `TxnLog`, please change accordingly to have it consistent
across the project.
> Large databases take a long time to regain a quorum
> ---
>
> Key: ZOOKEEPER-2678
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2678
> Project: ZooKeeper
> Issue Type: Bug
> Components: server
>Affects Versions: 3.4.9, 3.5.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>
> I know this is long but please here me out.
> I recently inherited a massive zookeeper ensemble. The snapshot is 3.4 GB on
> disk. Because of its massive size we have been running into a number of
> issues. There are lots of problems that we hope to fix with tuning GC etc,
> but the big one right now that is blocking us making a lot of progress on the
> rest of them is that when we lose a quorum because the leader left, for what
> ever reason, it can take well over 5 mins for a new quorum to be established.
> So we cannot tune the leader without risking downtime.
> We traced down where the time was being spent and found that each server was
> clearing the database so it would be read back in again before leader
> election even started. Then as part of the sync phase each server will write
> out a snapshot to checkpoint the progress it made as part of the sync.
> I will be putting up a patch shortly with some proposed changes in it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] zookeeper pull request #157: ZOOKEEPER-2678: Discovery and Sync can take a v...
Github user fpj commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/157#discussion_r98337403 --- Diff: src/java/test/org/apache/zookeeper/server/quorum/Zab1_0Test.java --- @@ -839,6 +839,13 @@ public void converseWithFollower(InputArchive ia, OutputArchive oa, Assert.assertEquals(1, f.self.getAcceptedEpoch()); Assert.assertEquals(1, f.self.getCurrentEpoch()); +//Wait for the edits to be written out --- End diff -- I need to think some more whether it makes any sense to add test cases for this. The test cases we already have probably cover this enough given that there is no real change of behavior. This change here is necessary, though. We don't really care about time in general in our tests because we can never be sure of the timing we will get across runs and with different settings. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zookeeper pull request #157: ZOOKEEPER-2678: Discovery and Sync can take a v...
Github user fpj commented on a diff in the pull request:
https://github.com/apache/zookeeper/pull/157#discussion_r98336253
--- Diff: src/java/main/org/apache/zookeeper/server/quorum/Learner.java ---
@@ -364,10 +367,12 @@ else if (qp.getType() == Leader.SNAP) {
long lastQueued = 0;
-// in V1.0 we take a snapshot when we get the NEWLEADER
message, but in pre V1.0
+// in Zab V1.0 (ZK 3.4+) we might take a snapshot when we get
the NEWLEADER message, but in pre V1.0
// we take the snapshot at the UPDATE, since V1.0 also gets
the UPDATE (after the NEWLEADER)
// we need to make sure that we don't take the snapshot twice.
-boolean snapshotTaken = false;
+boolean isPreZAB1_0 = true;
+//If we are not going to take the snapshot be sure the edits
are not applied in memory
+boolean writeToEditLog = !snapshotNeeded;
--- End diff --
The changes here are using `edit` to refer to `txns`. I'd rather use `txn`
to be consistent across the project. Specifically here, you're using `EditLog`
to refer to the `TxnLog`, please change accordingly to have it consistent
across the project.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
ZooKeeper_branch35_solaris - Build # 414 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_solaris/414/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 470429 lines...] [junit] 2017-01-28 17:23:24,228 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@485] - Processing stat command from /127.0.0.1:43157 [junit] 2017-01-28 17:23:24,228 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2017-01-28 17:23:24,229 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:43157 (no session established for client) [junit] 2017-01-28 17:23:24,229 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-01-28 17:23:24,230 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2017-01-28 17:23:24,230 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2017-01-28 17:23:24,231 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2017-01-28 17:23:24,231 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2017-01-28 17:23:24,231 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17889 [junit] 2017-01-28 17:23:24,231 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2017-01-28 17:23:24,232 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2017-01-28 17:23:24,232 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2017-01-28 17:23:25,261 [myid:] - INFO [SessionTracker:SessionTrackerImpl@158] - SessionTrackerImpl exited loop! [junit] 2017-01-28 17:23:25,261 [myid:] - INFO [SessionTracker:SessionTrackerImpl@158] - SessionTrackerImpl exited loop! [junit] 2017-01-28 17:23:25,971 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11222. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-01-28 17:23:25,971 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@948] - Socket connection established, initiating session, client: null, server: null [junit] 2017-01-28 17:23:25,971 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:43158 [junit] 2017-01-28 17:23:25,973 [myid:] - INFO [NIOWorkerThread-2:ZooKeeperServer@1004] - Client attempting to renew session 0x12663138662 at /127.0.0.1:43158 [junit] 2017-01-28 17:23:25,973 [myid:] - INFO [NIOWorkerThread-2:ZooKeeperServer@713] - Established session 0x12663138662 with negotiated timeout 3 for client /127.0.0.1:43158 [junit] 2017-01-28 17:23:25,974 [myid:127.0.0.1:11222] - INFO [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1381] - Session establishment complete on server null, sessionid = 0x12663138662, negotiated timeout = 3 [junit] 2017-01-28 17:23:25,975 [myid:] - INFO [ProcessThread(sid:0 cport:11222)::PrepRequestProcessor@656] - Processed session termination for sessionid: 0x12663138662 [junit] 2017-01-28 17:23:25,975 [myid:] - INFO [SyncThread:0:FileTxnLog@204] - Creating new log file: log.c [junit] 2017-01-28 17:23:26,022 [myid:] - INFO [NIOWorkerThread-5:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=Connections,name2=127.0.0.1,name3=0x12663138662] [junit] 2017-01-28 17:23:26,023 [myid:] - INFO [main:ZooKeeper@1322] - Session: 0x12663138662 closed [junit] 2017-01-28 17:23:26,023 [myid:] - INFO [NIOWorkerThread-5:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:43158 which had sessionid 0x12663138662 [junit] 2017-01-28 17:23:26,023 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x12663138662 [junit] 2017-01-28 17:23:26,023 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2017-01-28 17:23:26,024 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2017-01-28 17:23:26,024 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-01-28 17:23:26,024 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2017-01-28 17:23:26,025
ZooKeeper_branch34_openjdk7 - Build # 1368 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1368/
###
## LAST 60 LINES OF THE CONSOLE
###
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H13 (ubuntu) in workspace
/home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/zookeeper.git
> git --version # timeout=10
> git -c core.askpass=true fetch --tags --progress
> git://git.apache.org/zookeeper.git +refs/heads/*:refs/remotes/origin/*
> git rev-parse refs/remotes/origin/branch-3.4^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/branch-3.4^{commit} # timeout=10
Checking out Revision f0ef24a5e5df110ae569c1d3085e3cea8b454d9c
(refs/remotes/origin/branch-3.4)
> git config core.sparsecheckout # timeout=10
> git checkout -f f0ef24a5e5df110ae569c1d3085e3cea8b454d9c
> git rev-list f0ef24a5e5df110ae569c1d3085e3cea8b454d9c # timeout=10
No emails were triggered.
[ZooKeeper_branch34_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant
-Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml
-Djavac.target=1.7 clean test-core-java
Error: JAVA_HOME is not defined correctly.
We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java
Build step 'Invoke Ant' marked build as failure
Recording test results
ERROR: Step ?Publish JUnit test result report? failed: No test report files
were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###
## FAILED TESTS (if any)
##
No tests ran.
[jira] [Commented] (ZOOKEEPER-2260) Paginated getChildren call
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15844081#comment-15844081 ] Flavio Junqueira commented on ZOOKEEPER-2260: - I really like this feature! Please submit a pull request, though, see the how-to-contribute page: https://cwiki.apache.org/confluence/display/ZOOKEEPER/HowToContribute > Paginated getChildren call > -- > > Key: ZOOKEEPER-2260 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2260 > Project: ZooKeeper > Issue Type: New Feature >Affects Versions: 3.4.6, 3.5.0 >Reporter: Marco P. >Assignee: Marco P. > Labels: api, features > Fix For: 3.5.3, 3.6.0 > > Attachments: ZOOKEEPER-2260.patch, ZOOKEEPER-2260.patch > > > Add pagination support to the getChildren() call, allowing clients to iterate > over children N at the time. > Motivations for this include: > - Getting out of a situation where so many children were created that > listing them exceeded the network buffer sizes (making it impossible to > recover by deleting)[1] > - More efficient traversal of nodes with large number of children [2] > I do have a patch (for 3.4.6) we've been using successfully for a while, but > I suspect much more work is needed for this to be accepted. > [1] https://issues.apache.org/jira/browse/ZOOKEEPER-272 > [2] https://issues.apache.org/jira/browse/ZOOKEEPER-282 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
ZooKeeper_branch34_solaris - Build # 1449 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_solaris/1449/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 192964 lines...] [junit] 2017-01-28 13:55:02,494 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-01-28 13:55:02,494 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-01-28 13:55:02,495 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-01-28 13:55:02,495 [myid:] - INFO [main:PrepRequestProcessor@765] - Shutting down [junit] 2017-01-28 13:55:02,495 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-01-28 13:55:02,495 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-01-28 13:55:02,495 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-01-28 13:55:02,495 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-01-28 13:55:02,496 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-01-28 13:55:02,496 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-01-28 13:55:02,497 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-01-28 13:55:02,497 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-01-28 13:55:02,498 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-01-28 13:55:02,498 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-01-28 13:55:02,498 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/build/test/tmp/test6034965030141916040.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/build/test/tmp/test6034965030141916040.junit.dir/version-2 [junit] 2017-01-28 13:55:02,501 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-01-28 13:55:02,501 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-01-28 13:55:02,501 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:56600 [junit] 2017-01-28 13:55:02,502 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:56600 [junit] 2017-01-28 13:55:02,502 [myid:] - INFO [Thread-5:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2017-01-28 13:55:02,503 [myid:] - INFO [Thread-5:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:56600 (no session established for client) [junit] 2017-01-28 13:55:02,503 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-01-28 13:55:02,504 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-01-28 13:55:02,504 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-01-28 13:55:02,504 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-01-28 13:55:02,504 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-01-28 13:55:02,505 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 8949 [junit] 2017-01-28 13:55:02,505 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-01-28 13:55:02,505 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-01-28 13:55:02,505 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-01-28 13:55:02,582 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x159e55b9734 closed [junit] 2017-01-28 13:55:02,582 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x159e55b9734 [junit] 2017-01-28 13:55:02,582 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-01-28 13:55:02,583 [myid:] - INFO [main:ZooKeeperServer@497] - shutting down [junit] 2017-01-28 13:55:02,583 [myid:] -
[jira] [Resolved] (ZOOKEEPER-2681) ConnectionState does not sync startup of ExhibitorEnsembleProvider and Zookeeper connection
[
https://issues.apache.org/jira/browse/ZOOKEEPER-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Egor Ryashin resolved ZOOKEEPER-2681.
-
Resolution: Invalid
It is actually a Curator Framework issue.
https://issues.apache.org/jira/browse/CURATOR-382
> ConnectionState does not sync startup of ExhibitorEnsembleProvider and
> Zookeeper connection
> ---
>
> Key: ZOOKEEPER-2681
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2681
> Project: ZooKeeper
> Issue Type: Bug
> Components: java client
>Affects Versions: 3.4.5
>Reporter: Egor Ryashin
>
> Use CuratorFrameworkFactory.Builder and specify ExhibitorEnsembleProvider.
> Call build() and start().
> Internal ConnectionState.start() calls ensembleProvider.start() which should
> poll for hostnames to produce connectionString.
> Without waiting (for connectionString) ConnectionState calls
> zooKeeper.closeAndReset() and ClientCnxn is created with empty
> connectionString. That leads to lame zooKeeper sending requests to localhost.
> {noformat}
> 2017-01-27T22:56:17,618 INFO [Agents-0]
> org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
> 2017-01-27T22:56:17,619 INFO [Agents-0] org.apache.zookeeper.ZooKeeper -
> Initiating client connection, connectString= sessionTimeout=60001
> watcher=org.apache.curator.ConnectionState@4402fad2
> 2017-01-27T22:56:17,625 INFO [Agents-0-SendThread(127.0.0.1:2181)]
> org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL
> (unknown error)
> 2017-01-27T22:56:18,632 WARN [Agents-0-SendThread(127.0.0.1:2181)]
> org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected
> error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused: no further information
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> ~[?:1.8.0_74]
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> ~[?:1.8.0_74]
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> ~[zookeeper-3.4.5.jar:3.4.5-1392090]
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> [zookeeper-3.4.5.jar:3.4.5-1392090]
> 2017-01-27T22:56:19,733 INFO [Agents-0-SendThread(127.0.0.1:2181)]
> org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL
> (unknown error)
> 2017-01-27T22:56:19,807 INFO [Curator-ExhibitorEnsembleProvider-0]
> org.apache.curator.ensemble.exhibitor.ExhibitorEnsembleProvider - Connection
> string has changed. Old value (), new value
> (172.19.2.158:2181,172.19.2.15:2181,172.19.2.177:2181,172.19.2.4:2181,172.19.2.89:2181,172.19.2.72:2181)
> 2017-01-27T22:56:20,734 WARN [Agents-0-SendThread(127.0.0.1:2181)]
> org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected
> error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused: no further information
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> ~[?:1.8.0_74]
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> ~[?:1.8.0_74]
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> ~[zookeeper-3.4.5.jar:3.4.5-1392090]
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> [zookeeper-3.4.5.jar:3.4.5-1392090]
> 2017-01-27T22:56:21,835 INFO [Agents-0-SendThread(127.0.0.1:2181)]
> org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL
> (unknown error)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
ZooKeeper-trunk-jdk8 - Build # 918 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/918/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 458369 lines...] [junit] 2017-01-28 11:59:52,739 [myid:] - INFO [main:PrepRequestProcessor@1009] - Shutting down [junit] 2017-01-28 11:59:52,740 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-01-28 11:59:52,740 [myid:] - INFO [ProcessThread(sid:0 cport:27626)::PrepRequestProcessor@157] - PrepRequestProcessor exited loop! [junit] 2017-01-28 11:59:52,740 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-01-28 11:59:52,740 [myid:] - INFO [main:FinalRequestProcessor@481] - shutdown of request processor complete [junit] 2017-01-28 11:59:52,741 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port27626,name1=InMemoryDataTree] [junit] 2017-01-28 11:59:52,741 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port27626] [junit] 2017-01-28 11:59:52,741 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 27626 [junit] 2017-01-28 11:59:52,741 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2017-01-28 11:59:52,756 [myid:] - INFO [main:ClientBase@583] - fdcount after test is: 4834 at start it was 4838 [junit] 2017-01-28 11:59:52,756 [myid:] - INFO [main:ZKTestCase$1@65] - SUCCEEDED testWatcherAutoResetWithLocal [junit] 2017-01-28 11:59:52,756 [myid:] - INFO [main:ZKTestCase$1@60] - FINISHED testWatcherAutoResetWithLocal [junit] Tests run: 103, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 566.818 sec, Thread: 7, Class: org.apache.zookeeper.test.NioNettySuiteTest [junit] 2017-01-28 11:59:53,167 [myid:] - INFO [SessionTracker:SessionTrackerImpl@158] - SessionTrackerImpl exited loop! [junit] 2017-01-28 12:00:06,358 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 127556 [junit] 2017-01-28 12:00:06,359 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 55 [junit] 2017-01-28 12:00:06,359 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testManyChildWatchersAutoReset [junit] 2017-01-28 12:00:06,359 [myid:] - INFO [main:ClientBase@558] - tearDown starting [junit] 2017-01-28 12:00:06,360 [myid:] - INFO [ProcessThread(sid:0 cport:19304)::PrepRequestProcessor@618] - Processed session termination for sessionid: 0x102789d9652 [junit] 2017-01-28 12:00:06,384 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x102789d9652 closed [junit] 2017-01-28 12:00:06,384 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x102789d9652 [junit] 2017-01-28 12:00:06,384 [myid:] - INFO [NIOWorkerThread-14:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19304,name1=Connections,name2=127.0.0.1,name3=0x102789d9652] [junit] 2017-01-28 12:00:06,385 [myid:] - INFO [ProcessThread(sid:0 cport:19304)::PrepRequestProcessor@618] - Processed session termination for sessionid: 0x102789d96520001 [junit] 2017-01-28 12:00:06,385 [myid:] - INFO [NIOWorkerThread-14:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:58406 which had sessionid 0x102789d9652 [junit] 2017-01-28 12:00:06,436 [myid:] - INFO [NIOWorkerThread-13:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19304,name1=Connections,name2=127.0.0.1,name3=0x102789d96520001] [junit] 2017-01-28 12:00:06,436 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x102789d96520001 [junit] 2017-01-28 12:00:06,436 [myid:] - INFO [NIOWorkerThread-13:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:58427 which had sessionid 0x102789d96520001 [junit] 2017-01-28 12:00:06,437 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x102789d96520001 closed [junit] 2017-01-28 12:00:06,437 [myid:] - INFO [main:ClientBase@528] - STOPPING server [junit] 2017-01-28 12:00:06,438 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2017-01-28 12:00:06,441 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-01-28 12:00:06,442 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:19304:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2017-01-28 12:00:06,442 [myid:] - INFO
ZooKeeper_branch35_solaris - Build # 413 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_solaris/413/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 468487 lines...] [junit] 2017-01-28 11:02:28,509 [myid:] - INFO [main:ClientBase@386] - CREATING server instance 127.0.0.1:11222 [junit] 2017-01-28 11:02:28,509 [myid:] - INFO [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. [junit] 2017-01-28 11:02:28,509 [myid:] - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/0.0.0.0:11222 [junit] 2017-01-28 11:02:28,510 [myid:] - INFO [main:ClientBase@361] - STARTING server instance 127.0.0.1:11222 [junit] 2017-01-28 11:02:28,510 [myid:] - INFO [main:ZooKeeperServer@893] - minSessionTimeout set to 6000 [junit] 2017-01-28 11:02:28,511 [myid:] - INFO [main:ZooKeeperServer@902] - maxSessionTimeout set to 6 [junit] 2017-01-28 11:02:28,511 [myid:] - INFO [main:ZooKeeperServer@159] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test4622905627051390776.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test4622905627051390776.junit.dir/version-2 [junit] 2017-01-28 11:02:28,511 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test4622905627051390776.junit.dir/version-2/snapshot.b [junit] 2017-01-28 11:02:28,513 [myid:] - INFO [main:FileTxnSnapLog@320] - Snapshotting: 0xb to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch35_solaris/build/test/tmp/test4622905627051390776.junit.dir/version-2/snapshot.b [junit] 2017-01-28 11:02:28,515 [myid:] - ERROR [main:ZooKeeperServer@505] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-01-28 11:02:28,515 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222 [junit] 2017-01-28 11:02:28,515 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:48452 [junit] 2017-01-28 11:02:28,516 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@485] - Processing stat command from /127.0.0.1:48452 [junit] 2017-01-28 11:02:28,516 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2017-01-28 11:02:28,517 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:48452 (no session established for client) [junit] 2017-01-28 11:02:28,517 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-01-28 11:02:28,518 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2017-01-28 11:02:28,518 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2017-01-28 11:02:28,518 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2017-01-28 11:02:28,519 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2017-01-28 11:02:28,519 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17882 [junit] 2017-01-28 11:02:28,519 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2017-01-28 11:02:28,519 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2017-01-28 11:02:28,519 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2017-01-28 11:02:28,592 [myid:] - INFO [main:ZooKeeper@1322] - Session: 0x12661b6cedd closed [junit] 2017-01-28 11:02:28,592 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x12661b6cedd [junit] 2017-01-28 11:02:28,592 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2017-01-28 11:02:28,593 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2017-01-28 11:02:28,593 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-01-28 11:02:28,593 [myid:] - INFO
ZooKeeper-trunk-jdk8 - Build # 917 - Failure
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/917/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 487623 lines...]
[junit] at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268)
[junit] at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255)
[junit] at
org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
[junit] at
org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
[junit] at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
[junit] at
org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
[junit] at
org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
[junit] at
org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
[junit] at
org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
[junit] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit] at java.lang.Thread.run(Thread.java:745)
[junit] 2017-01-28 09:28:19,199 [myid:] - INFO [New I/O worker
#11059:ClientCnxnSocketNetty$ZKClientHandler@384] - channel is disconnected:
[id: 0x71b04764, /127.0.0.1:57259 :> 127.0.0.1/127.0.0.1:30226]
[junit] 2017-01-28 09:28:19,199 [myid:] - INFO [New I/O worker
#11059:ClientCnxnSocketNetty@208] - channel is told closing
[junit] 2017-01-28 09:28:19,199 [myid:127.0.0.1:30226] - INFO
[main-SendThread(127.0.0.1:30226):ClientCnxn$SendThread@1231] - channel for
sessionid 0x5027814e081 is lost, closing socket connection and attempting
reconnect
[junit] 2017-01-28 09:28:19,225 [myid:127.0.0.1:30199] - INFO
[main-SendThread(127.0.0.1:30199):ClientCnxn$SendThread@1113] - Opening socket
connection to server 127.0.0.1/127.0.0.1:30199. Will not attempt to
authenticate using SASL (unknown error)
[junit] 2017-01-28 09:28:19,226 [myid:] - INFO [New I/O boss
#10164:ClientCnxnSocketNetty$1@127] - future isn't success, cause: {}
[junit] java.net.ConnectException: Connection refused:
127.0.0.1/127.0.0.1:30199
[junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit] at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
[junit] at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
[junit] at
org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
[junit] at
org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
[junit] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit] at java.lang.Thread.run(Thread.java:745)
[junit] 2017-01-28 09:28:19,297 [myid:] - WARN [New I/O boss
#10164:ClientCnxnSocketNetty$ZKClientHandler@439] - Exception caught: [id:
0x70ed05e9] EXCEPTION: java.net.ConnectException: Connection refused:
127.0.0.1/127.0.0.1:30199
[junit] java.net.ConnectException: Connection refused:
127.0.0.1/127.0.0.1:30199
[junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit] at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
[junit] at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
[junit] at
org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
[junit] at
org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
[junit] at
org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
[junit] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit] at
ZooKeeper-trunk-solaris - Build # 1483 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-solaris/1483/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 467356 lines...] [junit] 2017-01-28 09:12:12,076 [myid:] - INFO [main:ClientBase@401] - CREATING server instance 127.0.0.1:11222 [junit] 2017-01-28 09:12:12,076 [myid:] - INFO [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. [junit] 2017-01-28 09:12:12,077 [myid:] - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/0.0.0.0:11222 [junit] 2017-01-28 09:12:12,077 [myid:] - INFO [main:ClientBase@376] - STARTING server instance 127.0.0.1:11222 [junit] 2017-01-28 09:12:12,078 [myid:] - INFO [main:ZooKeeperServer@894] - minSessionTimeout set to 6000 [junit] 2017-01-28 09:12:12,078 [myid:] - INFO [main:ZooKeeperServer@903] - maxSessionTimeout set to 6 [junit] 2017-01-28 09:12:12,078 [myid:] - INFO [main:ZooKeeperServer@160] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test1252015169544144728.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test1252015169544144728.junit.dir/version-2 [junit] 2017-01-28 09:12:12,079 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test1252015169544144728.junit.dir/version-2/snapshot.b [junit] 2017-01-28 09:12:12,081 [myid:] - INFO [main:FileTxnSnapLog@346] - Snapshotting: 0xb to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris/build/test/tmp/test1252015169544144728.junit.dir/version-2/snapshot.b [junit] 2017-01-28 09:12:12,082 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-01-28 09:12:12,082 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222 [junit] 2017-01-28 09:12:12,083 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11222:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:62374 [junit] 2017-01-28 09:12:12,083 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@485] - Processing stat command from /127.0.0.1:62374 [junit] 2017-01-28 09:12:12,084 [myid:] - INFO [NIOWorkerThread-1:StatCommand@49] - Stat command output [junit] 2017-01-28 09:12:12,084 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@614] - Closed socket connection for client /127.0.0.1:62374 (no session established for client) [junit] 2017-01-28 09:12:12,084 [myid:] - INFO [main:JMXEnv@228] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-01-28 09:12:12,086 [myid:] - INFO [main:JMXEnv@245] - expect:InMemoryDataTree [junit] 2017-01-28 09:12:12,086 [myid:] - INFO [main:JMXEnv@249] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11222,name1=InMemoryDataTree [junit] 2017-01-28 09:12:12,086 [myid:] - INFO [main:JMXEnv@245] - expect:StandaloneServer_port [junit] 2017-01-28 09:12:12,086 [myid:] - INFO [main:JMXEnv@249] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11222 [junit] 2017-01-28 09:12:12,086 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 17905 [junit] 2017-01-28 09:12:12,086 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 24 [junit] 2017-01-28 09:12:12,087 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testQuota [junit] 2017-01-28 09:12:12,087 [myid:] - INFO [main:ClientBase@558] - tearDown starting [junit] 2017-01-28 09:12:12,162 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x1266151d7d3 closed [junit] 2017-01-28 09:12:12,162 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x1266151d7d3 [junit] 2017-01-28 09:12:12,162 [myid:] - INFO [main:ClientBase@528] - STOPPING server [junit] 2017-01-28 09:12:12,162 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2017-01-28 09:12:12,162 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2017-01-28 09:12:12,162 [myid:] - INFO
ZooKeeper-trunk-WinVS2008 - Build # 2433 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-WinVS2008/2433/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 122 lines...] [javacc] File "SimpleCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. jute: [javac] Compiling 39 source files to f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\build\classes [javac] warning: [options] bootstrap class path not set in conjunction with -source 1.7 [javac] 1 warning compile_jute_uptodate: compile_jute: [mkdir] Created dir: f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\java\generated [mkdir] Created dir: f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\generated [java] ../../zookeeper.jute Parsed Successfully [java] ../../zookeeper.jute Parsed Successfully [touch] Creating f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\java\generated\.generated BUILD SUCCESSFUL Total time: 9 seconds [ZooKeeper-trunk-WinVS2008] $ cmd /c call C:\Users\jenkins\AppData\Local\Temp\1\hudson7985283193935658291.bat f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008>set ZOOKEEPER_HOME=f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008 f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008>set PATH=F:\\hudson\\tools\\java\\jdk1.8.0_92-unlimited-security/bin;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Microsoft SQL Server\130\Tools\Binn\;F:\Program Files\CMake\bin;F:\Program Files (x86)\Subversion\bin;C:\Program Files\Microsoft SQL Server\120\Tools\Binn\;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\;C:\Program Files (x86)\nodejs\;C:\Users\jenkins\.dnx\bin;C:\Program Files\Microsoft DNX\Dnvm\;C:\Program Files (x86)\Microsoft Emulator Manager\1.0\;C:\Program Files (x86)\PuTTY\;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Microsoft SQL Server\130\Tools\Binn\;F:\Program Files\CMake\bin;F:\Program Files (x86)\Subversion\bin;C:\Program Files\Microsoft SQL Server\120\Tools\Binn\;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\;C:\Program Files (x86)\nodejs\;C:\Users\jenkins\.dnx\bin;C:\Program Files\Microsoft DNX\Dnvm\;C:\Program Files (x86)\Microsoft Emulator Manager\1.0\;F:\Program Files\Git\cmd;"C:\Program Files\Java\jre1.8.0_92\bin";C:/Windows/Microsoft.NET/Framework/v4.0.30319/ f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008>msbuild src/c/zookeeper.sln /p:Configuration=Release Microsoft (R) Build Engine version 4.6.1087.0 [Microsoft .NET Framework, version 4.0.30319.42000] Copyright (C) Microsoft Corporation. All rights reserved. Building the projects in this solution one at a time. To enable parallel build, please add the "/m" switch. Build started 1/28/2017 8:28:56 AM. Project "f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln" on node 1 (default targets). ValidateSolutionConfiguration: Building solution configuration "Release|Win32". MSBUILD : error MSB3411: Could not load the Visual C++ component "VCBuild.exe". If the component is not installed, either 1) install the Microsoft Windows SDK for Windows Server 2008 and .NET Framework 3.5, or 2) install Microsoft Visual Studio 2008. [f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln] MSBUILD : error MSB3411: Could not load the Visual C++ component "VCBuild.exe". If the component is not installed, either 1) install the Microsoft Windows SDK for Windows Server 2008 and .NET Framework 3.5, or 2) install Microsoft Visual Studio 2008. [f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln] Done Building Project "f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln" (default targets) -- FAILED. Build FAILED. "f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln" (default target) (1) -> (zookeeper target) -> MSBUILD : error MSB3411: Could not load the Visual C++ component "VCBuild.exe". If the component is not installed, either 1) install the Microsoft Windows SDK for Windows Server 2008 and .NET Framework 3.5, or 2) install Microsoft Visual Studio 2008. [f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln] "f:\jenkins\jenkins-slave\workspace\ZooKeeper-trunk-WinVS2008\src\c\zookeeper.sln" (default target) (1) -> (Cli target) -> MSBUILD : error MSB3411: Could not load the Visual C++ component "VCBuild.exe". If the component is not installed, either 1) install the Microsoft Windows SDK for Windows Server 2008 and .NET Framework 3.5, or 2)
