ZooKeeper-3.4-WinVS2008_java - Build # 493 - Still Failing
See https://builds.apache.org/job/ZooKeeper-3.4-WinVS2008_java/493/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 180398 lines...] [junit] 2014-05-26 10:22:18,730 [myid:] - INFO [main-SendThread(127.0.0.1:11221):ClientCnxn$SendThread@975] - Opening socket connection to server 127.0.0.1/127.0.0.1:11221. Will not attempt to authenticate using SASL (unknown error) [junit] 2014-05-26 10:22:19,178 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2014-05-26 10:22:19,179 [myid:] - INFO [main:ClientBase@443] - STARTING server [junit] 2014-05-26 10:22:19,179 [myid:] - INFO [main:ClientBase@364] - CREATING server instance 127.0.0.1:11221 [junit] 2014-05-26 10:22:19,180 [myid:] - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2014-05-26 10:22:19,181 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2014-05-26 10:22:19,181 [myid:] - INFO [main:ZooKeeperServer@162] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir f:\hudson\hudson-slave\workspace\ZooKeeper-3.4-WinVS2008_java\branch-3.4\build\test\tmp\test8630628319679490243.junit.dir\version-2 snapdir f:\hudson\hudson-slave\workspace\ZooKeeper-3.4-WinVS2008_java\branch-3.4\build\test\tmp\test8630628319679490243.junit.dir\version-2 [junit] 2014-05-26 10:22:19,184 [myid:] - INFO [main:FourLetterWordMain@43] - connecting to 127.0.0.1 11221 [junit] 2014-05-26 10:22:19,185 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@197] - Accepted socket connection from /127.0.0.1:61722 [junit] 2014-05-26 10:22:19,185 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:61722 [junit] 2014-05-26 10:22:19,185 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2014-05-26 10:22:19,186 [myid:] - INFO [Thread-4:NIOServerCnxn@1007] - Closed socket connection for client /127.0.0.1:61722 (no session established for client) [junit] 2014-05-26 10:22:19,186 [myid:] - INFO [main:JMXEnv@229] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2014-05-26 10:22:19,187 [myid:] - INFO [main:JMXEnv@246] - expect:InMemoryDataTree [junit] 2014-05-26 10:22:19,188 [myid:] - INFO [main:JMXEnv@250] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port-1,name1=InMemoryDataTree [junit] 2014-05-26 10:22:19,188 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2014-05-26 10:22:19,188 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port-1 [junit] 2014-05-26 10:22:19,188 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@55] - Memory used 10814 [junit] 2014-05-26 10:22:19,188 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@60] - Number of threads 20 [junit] 2014-05-26 10:22:19,189 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@65] - FINISHED TEST METHOD testQuota [junit] 2014-05-26 10:22:19,189 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2014-05-26 10:22:19,223 [myid:] - INFO [main-SendThread(127.0.0.1:11221):ClientCnxn$SendThread@852] - Socket connection established to 127.0.0.1/127.0.0.1:11221, initiating session [junit] 2014-05-26 10:22:19,223 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@197] - Accepted socket connection from /127.0.0.1:61719 [junit] 2014-05-26 10:22:19,223 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:ZooKeeperServer@861] - Client attempting to renew session 0x14637d6690a at /127.0.0.1:61719 [junit] 2014-05-26 10:22:19,224 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:ZooKeeperServer@617] - Established session 0x14637d6690a with negotiated timeout 3 for client /127.0.0.1:61719 [junit] 2014-05-26 10:22:19,224 [myid:] - INFO [main-SendThread(127.0.0.1:11221):ClientCnxn$SendThread@1235] - Session establishment complete on server 127.0.0.1/127.0.0.1:11221, sessionid = 0x14637d6690a, negotiated timeout = 3 [junit] 2014-05-26 10:22:19,224 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@494] - Processed session termination for sessionid: 0x14637d6690a [junit] 2014-05-26 10:22:19,225 [myid:] - INFO [SyncThread:0:FileTxnLog@199] - Creating new log file: log.c [junit] 2014-05-26 10:22:19,235 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x14637d6690a closed [junit] 2014-05-26 10:22:19,235 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2014-05-26 10:22:19,235 [myid:] - INFO [main:NIOServerCnxn@1007] - Closed socket
ZooKeeper-trunk-jdk7 - Build # 864 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk7/864/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 245318 lines...] [junit] 2014-05-26 10:35:44,469 [myid:] - INFO [main:ClientBase@443] - STARTING server [junit] 2014-05-26 10:35:44,469 [myid:] - INFO [main:ClientBase@364] - CREATING server instance 127.0.0.1:11221 [junit] 2014-05-26 10:35:44,469 [myid:] - INFO [main:NIOServerCnxnFactory@670] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. [junit] 2014-05-26 10:35:44,469 [myid:] - INFO [main:NIOServerCnxnFactory@683] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2014-05-26 10:35:44,470 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2014-05-26 10:35:44,470 [myid:] - INFO [main:ZooKeeperServer@766] - minSessionTimeout set to 6000 [junit] 2014-05-26 10:35:44,470 [myid:] - INFO [main:ZooKeeperServer@775] - maxSessionTimeout set to 6 [junit] 2014-05-26 10:35:44,470 [myid:] - INFO [main:ZooKeeperServer@149] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/hudson/jenkins-slave/workspace/ZooKeeper-trunk-jdk7/trunk/build/test/tmp/test7785190709635164595.junit.dir/version-2 snapdir /home/hudson/jenkins-slave/workspace/ZooKeeper-trunk-jdk7/trunk/build/test/tmp/test7785190709635164595.junit.dir/version-2 [junit] 2014-05-26 10:35:44,471 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /home/hudson/jenkins-slave/workspace/ZooKeeper-trunk-jdk7/trunk/build/test/tmp/test7785190709635164595.junit.dir/version-2/snapshot.b [junit] 2014-05-26 10:35:44,473 [myid:] - INFO [main:FileTxnSnapLog@298] - Snapshotting: 0xb to /home/hudson/jenkins-slave/workspace/ZooKeeper-trunk-jdk7/trunk/build/test/tmp/test7785190709635164595.junit.dir/version-2/snapshot.b [junit] 2014-05-26 10:35:44,474 [myid:] - INFO [main:FourLetterWordMain@43] - connecting to 127.0.0.1 11221 [junit] 2014-05-26 10:35:44,474 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:45976 [junit] 2014-05-26 10:35:44,475 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@835] - Processing stat command from /127.0.0.1:45976 [junit] 2014-05-26 10:35:44,475 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn$StatCommand@684] - Stat command output [junit] 2014-05-26 10:35:44,475 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@1006] - Closed socket connection for client /127.0.0.1:45976 (no session established for client) [junit] 2014-05-26 10:35:44,476 [myid:] - INFO [main:JMXEnv@224] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2014-05-26 10:35:44,477 [myid:] - INFO [main:JMXEnv@241] - expect:InMemoryDataTree [junit] 2014-05-26 10:35:44,477 [myid:] - INFO [main:JMXEnv@245] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port-1,name1=InMemoryDataTree [junit] 2014-05-26 10:35:44,477 [myid:] - INFO [main:JMXEnv@241] - expect:StandaloneServer_port [junit] 2014-05-26 10:35:44,477 [myid:] - INFO [main:JMXEnv@245] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port-1 [junit] 2014-05-26 10:35:44,478 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@55] - Memory used 15025 [junit] 2014-05-26 10:35:44,478 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@60] - Number of threads 24 [junit] 2014-05-26 10:35:44,478 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@65] - FINISHED TEST METHOD testQuota [junit] 2014-05-26 10:35:44,478 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [main:ZooKeeper@968] - Session: 0x1463819a856 closed [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@529] - EventThread shut down [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2014-05-26 10:35:44,511 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit]
ZooKeeper-trunk - Build # 2314 - Failure
See https://builds.apache.org/job/ZooKeeper-trunk/2314/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 246384 lines...] [junit] 2014-05-26 11:07:31,351 [myid:] - INFO [main:NIOServerCnxnFactory@683] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2014-05-26 11:07:31,351 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2014-05-26 11:07:31,351 [myid:] - INFO [main:ZooKeeperServer@766] - minSessionTimeout set to 6000 [junit] 2014-05-26 11:07:31,352 [myid:] - INFO [main:ZooKeeperServer@775] - maxSessionTimeout set to 6 [junit] 2014-05-26 11:07:31,352 [myid:] - INFO [main:ZooKeeperServer@149] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test1531802905380963113.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test1531802905380963113.junit.dir/version-2 [junit] 2014-05-26 11:07:31,353 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test1531802905380963113.junit.dir/version-2/snapshot.b [junit] 2014-05-26 11:07:31,355 [myid:] - INFO [main:FileTxnSnapLog@298] - Snapshotting: 0xb to /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test1531802905380963113.junit.dir/version-2/snapshot.b [junit] 2014-05-26 11:07:31,357 [myid:] - INFO [main:FourLetterWordMain@43] - connecting to 127.0.0.1 11221 [junit] 2014-05-26 11:07:31,357 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:49652 [junit] 2014-05-26 11:07:31,358 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@835] - Processing stat command from /127.0.0.1:49652 [junit] 2014-05-26 11:07:31,359 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn$StatCommand@684] - Stat command output [junit] 2014-05-26 11:07:31,359 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@1006] - Closed socket connection for client /127.0.0.1:49652 (no session established for client) [junit] 2014-05-26 11:07:31,359 [myid:] - INFO [main:JMXEnv@224] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2014-05-26 11:07:31,361 [myid:] - INFO [main:JMXEnv@241] - expect:InMemoryDataTree [junit] 2014-05-26 11:07:31,361 [myid:] - INFO [main:JMXEnv@245] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port-1,name1=InMemoryDataTree [junit] 2014-05-26 11:07:31,361 [myid:] - INFO [main:JMXEnv@241] - expect:StandaloneServer_port [junit] 2014-05-26 11:07:31,361 [myid:] - INFO [main:JMXEnv@245] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port-1 [junit] 2014-05-26 11:07:31,361 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@55] - Memory used 14755 [junit] 2014-05-26 11:07:31,362 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@60] - Number of threads 24 [junit] 2014-05-26 11:07:31,362 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@65] - FINISHED TEST METHOD testQuota [junit] 2014-05-26 11:07:31,362 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2014-05-26 11:07:31,420 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@529] - EventThread shut down [junit] 2014-05-26 11:07:31,420 [myid:] - INFO [main:ZooKeeper@968] - Session: 0x1463836c167 closed [junit] 2014-05-26 11:07:31,421 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2014-05-26 11:07:31,422 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2014-05-26 11:07:31,422 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2014-05-26 11:07:31,422 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2014-05-26 11:07:31,422 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2014-05-26 11:07:31,422 [myid:] - INFO [main:ZooKeeperServer@428] - shutting down [junit] 2014-05-26 11:07:31,423 [myid:] - INFO [main:SessionTrackerImpl@184] - Shutting down [junit] 2014-05-26 11:07:31,423 [myid:] - INFO [main:PrepRequestProcessor@981] - Shutting down [junit] 2014-05-26 11:07:31,423 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2014-05-26 11:07:31,423 [myid:] - INFO
ZooKeeper-trunk-jdk8 - Build # 27 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/27/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 247207 lines...] [junit] 2014-05-26 12:23:51,005 [myid:] - INFO [main:ClientBase@364] - CREATING server instance 127.0.0.1:11221 [junit] 2014-05-26 12:23:51,005 [myid:] - INFO [main:NIOServerCnxnFactory@670] - Configuring NIO connection handler with 10s sessionless connection timeout, 3 selector thread(s), 48 worker threads, and 64 kB direct buffers. [junit] 2014-05-26 12:23:51,005 [myid:] - INFO [main:NIOServerCnxnFactory@683] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2014-05-26 12:23:51,005 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2014-05-26 12:23:51,006 [myid:] - INFO [main:ZooKeeperServer@766] - minSessionTimeout set to 6000 [junit] 2014-05-26 12:23:51,006 [myid:] - INFO [main:ZooKeeperServer@775] - maxSessionTimeout set to 6 [junit] 2014-05-26 12:23:51,006 [myid:] - INFO [main:ZooKeeperServer@149] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /x1/jenkins/jenkins-slave/workspace/ZooKeeper-trunk-jdk8/trunk/build/test/tmp/test1112313076550973269.junit.dir/version-2 snapdir /x1/jenkins/jenkins-slave/workspace/ZooKeeper-trunk-jdk8/trunk/build/test/tmp/test1112313076550973269.junit.dir/version-2 [junit] 2014-05-26 12:23:51,007 [myid:] - INFO [main:FileSnap@83] - Reading snapshot /x1/jenkins/jenkins-slave/workspace/ZooKeeper-trunk-jdk8/trunk/build/test/tmp/test1112313076550973269.junit.dir/version-2/snapshot.b [junit] 2014-05-26 12:23:51,008 [myid:] - INFO [main:FileTxnSnapLog@298] - Snapshotting: 0xb to /x1/jenkins/jenkins-slave/workspace/ZooKeeper-trunk-jdk8/trunk/build/test/tmp/test1112313076550973269.junit.dir/version-2/snapshot.b [junit] 2014-05-26 12:23:51,010 [myid:] - INFO [main:FourLetterWordMain@43] - connecting to 127.0.0.1 11221 [junit] 2014-05-26 12:23:51,011 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory$AcceptThread@296] - Accepted socket connection from /127.0.0.1:58470 [junit] 2014-05-26 12:23:51,012 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@835] - Processing stat command from /127.0.0.1:58470 [junit] 2014-05-26 12:23:51,012 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn$StatCommand@684] - Stat command output [junit] 2014-05-26 12:23:51,012 [myid:] - INFO [NIOWorkerThread-1:NIOServerCnxn@1006] - Closed socket connection for client /127.0.0.1:58470 (no session established for client) [junit] 2014-05-26 12:23:51,012 [myid:] - INFO [main:JMXEnv@224] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2014-05-26 12:23:51,014 [myid:] - INFO [main:JMXEnv@241] - expect:InMemoryDataTree [junit] 2014-05-26 12:23:51,014 [myid:] - INFO [main:JMXEnv@245] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port-1,name1=InMemoryDataTree [junit] 2014-05-26 12:23:51,014 [myid:] - INFO [main:JMXEnv@241] - expect:StandaloneServer_port [junit] 2014-05-26 12:23:51,015 [myid:] - INFO [main:JMXEnv@245] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port-1 [junit] 2014-05-26 12:23:51,015 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@55] - Memory used 4179 [junit] 2014-05-26 12:23:51,015 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@60] - Number of threads 24 [junit] 2014-05-26 12:23:51,015 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@65] - FINISHED TEST METHOD testQuota [junit] 2014-05-26 12:23:51,016 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [main:ZooKeeper@968] - Session: 0x146387ca275 closed [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@529] - EventThread shut down [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-2:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method [junit] 2014-05-26 12:23:51,075 [myid:] - INFO [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method [junit] 2014-05-26 12:23:51,075 [myid:] - INFO
[jira] [Commented] (ZOOKEEPER-1929) std::length_error on update children
[ https://issues.apache.org/jira/browse/ZOOKEEPER-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009080#comment-14009080 ] Raul Gutierrez Segales commented on ZOOKEEPER-1929: --- how can I reproduce this? what operations on the mount point trigger the issue? what were the contents of /? std::length_error on update children Key: ZOOKEEPER-1929 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1929 Project: ZooKeeper Issue Type: Bug Components: contrib-zkfuse Affects Versions: 3.4.6 Environment: debian Reporter: Eduard White Trying to open zk root directory: ./zkfuse -z localhost:2181 -m /CLOUD/zookeeper -d 1[0x7f89362d0780] INFO zkfuse null - Starting zkfuse cacheSize = 256, debug = 1, forceDirSuffix = ._dir_, mount = /CLOUD/zookeeper, name = _data_, zookeeper = localhost:2181, optind = 6, argc = 6, current arg = NULL 1[0x7f89362d0780] INFO zkfuse null - Create ZK adapter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::ZooKeeperAdapter(zk::ZooKeeperConfig, zk::ZKEventListener*, bool)::Trace::Trace(const void*) 0x434ecd Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::ZooKeeperAdapter(zk::ZooKeeperConfig, zk::ZKEventListener*, bool)::Trace::~Trace() 0x434ecd Exit 1[0x7f89362bd700] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::processEvents()::Trace::Trace(const void*) 0x434df4 Enter 1[0x7f89327bb700] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::processUserEvents()::Trace::Trace(const void*) 0x434e60 Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::reconnect()::Trace::Trace(const void*) 0x434c71 Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::disconnect()::Trace::Trace(const void*) 0x434c4c Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - mp_zkHandle: (nil), state 0 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::disconnect()::Trace::~Trace() 0x434c4c Exit 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.6 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@716: Client environment:host.name=nanoha 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@723: Client environment:os.name=Linux 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@724: Client environment:os.arch=3.2.0-4-amd64 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@725: Client environment:os.version=#1 SMP Debian 3.2.54-2 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@733: Client environment:user.name=root 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@741: Client environment:user.home=/root 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@753: Client environment:user.dir=/opt/zoo/3.4.6/build/contrib/zkfuse/src 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=localhost:2181 sessionTimeout=1000 watcher=0x429780 sessionId=0 sessionPasswd=null context=0x9b5e30 flags=0 2014-05-24 08:07:44,861:20540(0x7f89362d0780):ZOO_DEBUG@start_threads@221: starting threads... 2[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::setState(zk::ZooKeeperAdapter::AdapterState)::Trace::Trace(const void*) 0x434c43 Enter 2[0x7f89362d0780] INFO zookeeper.adapter null - Adapter state transition: 0 - 1 2014-05-24 08:07:44,861:20540(0x7f8931899700):ZOO_DEBUG@do_completion@459: started completion thread 2[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::setState(zk::ZooKeeperAdapter::AdapterState)::Trace::~Trace() 0x434c43 Exit 3[0x7f89362d0780] DEBUG zookeeper.adapter null - mp_zkHandle: 0x9bbba0, state 1 2014-05-24 08:07:44,861:20540(0x7f893209a700):ZOO_DEBUG@do_io@367: started IO thread 3[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::reconnect()::Trace::~Trace() 0x434c71 Exit ZOOKEEPER_ROOT_CHILDREN_WATCH_BUG enabled 3[0x7f89362d0780] INFO zkfuse null - Initialize fuse 2014-05-24 08:07:44,861:20540(0x7f893209a700):ZOO_INFO@check_events@1705: initiated connection to server [127.0.0.1:2181] FUSE library version: 2.9.3 nullpath_ok: 0 nopath: 0 utime_omit_ok: 0 unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0 INIT: 7.17 flags=0x047b max_readahead=0x0002 INIT: 7.19 flags=0x0013 max_readahead=0x0002 max_write=0x0002 max_background=0 congestion_threshold=0 unique: 1, success, outsize: 40 2014-05-24 08:07:44,909:20540(0x7f893209a700):ZOO_INFO@check_events@1752:
[jira] [Commented] (ZOOKEEPER-1907) Improve Thread handling
[
https://issues.apache.org/jira/browse/ZOOKEEPER-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009082#comment-14009082
]
Raul Gutierrez Segales commented on ZOOKEEPER-1907:
---
[~rakeshr]: were you planning on updating that RB with (some of) the comments I
made? (I see you posted the link to the RB, but didn't see an updated diff).
Improve Thread handling
---
Key: ZOOKEEPER-1907
URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1907
Project: ZooKeeper
Issue Type: Improvement
Components: server
Reporter: Rakesh R
Assignee: Rakesh R
Fix For: 3.6.0
Attachments: ZOOKEEPER-1907.patch, ZOOKEEPER-1907.patch,
ZOOKEEPER-1907.patch
Server has many critical threads running and co-ordinating each other like
RequestProcessor chains et. When going through each threads, most of them
having the similar structure like:
{code}
public void run() {
try {
while(running)
// processing logic
}
} catch (InterruptedException e) {
LOG.error(Unexpected interruption, e);
} catch (Exception e) {
LOG.error(Unexpected exception, e);
}
LOG.info(...exited loop!);
}
{code}
From the design I could see, there could be a chance of silently leaving the
thread by swallowing the exception. If this happens in the production, the
server would get hanged forever and would not be able to deliver its role.
Now its hard for the management tool to detect this.
The idea of this JIRA is to discuss and imprv.
Reference: [Community discussion
thread|http://mail-archives.apache.org/mod_mbox/zookeeper-user/201403.mbox/%3cc2496325850aa74c92aaf83aa9662d26458a1...@szxeml561-mbx.china.huawei.com%3E]
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (ZOOKEEPER-770) Slow add_auth calls with multi-threaded client
[ https://issues.apache.org/jira/browse/ZOOKEEPER-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009094#comment-14009094 ] Raul Gutierrez Segales commented on ZOOKEEPER-770: -- lgtm, +1 - thanks [~michim]. Slow add_auth calls with multi-threaded client -- Key: ZOOKEEPER-770 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-770 Project: ZooKeeper Issue Type: Bug Components: c client, contrib-bindings Affects Versions: 3.3.0, 3.3.3, 3.4.0 Environment: ubuntu lucid (10.04), zk trunk (3.4) Reporter: Kapil Thangavelu Assignee: Craig Calef Priority: Minor Fix For: 3.5.0 Attachments: ZOOKEEPER-770-FIX.patch, ZOOKEEPER-770.patch, ZOOKEEPER-770.patch, ZOOKEEPER-770.patch, authtest.py Calls to add_auth are a bit slow from the c client library. The auth callback typically takes multiple seconds to fire. I instrumented the java, c binding, and python binding with a few log statements to find out where the slowness was occuring ( http://bazaar.launchpad.net/~hazmat/zookeeper/fast-auth-instrumented/revision/647). It looks like when the io thread polls, it doesn't register interest in the incoming packet, so the auth success message from the server and the auth callback are only processed when the poll timeouts. I tried modifying mt_adapter.c so the poll registers interest in both events, this causes a considerably more wakeups but it does address the issue of making add_auth fast. I think the ideal solution would be some sort of additional auth handshake state on the handle, that zookeeper_interest could utilize to suggest both POLLIN|POLLOUT are wanted for subsequent calls to poll during the auth handshake handle state. i'm attaching a script that takes 13s or 1.6s for the auth callback depending on the session time out value (which in turn figures into the calculation of the poll timeout). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (ZOOKEEPER-1907) Improve Thread handling
[
https://issues.apache.org/jira/browse/ZOOKEEPER-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009203#comment-14009203
]
Rakesh R commented on ZOOKEEPER-1907:
-
[~rgs], before preparing the patch I would like to discuss about one of your
comments and make it clear. I have replied sometime back in RB, could you
please have a look at it. Thanks!
Improve Thread handling
---
Key: ZOOKEEPER-1907
URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1907
Project: ZooKeeper
Issue Type: Improvement
Components: server
Reporter: Rakesh R
Assignee: Rakesh R
Fix For: 3.6.0
Attachments: ZOOKEEPER-1907.patch, ZOOKEEPER-1907.patch,
ZOOKEEPER-1907.patch
Server has many critical threads running and co-ordinating each other like
RequestProcessor chains et. When going through each threads, most of them
having the similar structure like:
{code}
public void run() {
try {
while(running)
// processing logic
}
} catch (InterruptedException e) {
LOG.error(Unexpected interruption, e);
} catch (Exception e) {
LOG.error(Unexpected exception, e);
}
LOG.info(...exited loop!);
}
{code}
From the design I could see, there could be a chance of silently leaving the
thread by swallowing the exception. If this happens in the production, the
server would get hanged forever and would not be able to deliver its role.
Now its hard for the management tool to detect this.
The idea of this JIRA is to discuss and imprv.
Reference: [Community discussion
thread|http://mail-archives.apache.org/mod_mbox/zookeeper-user/201403.mbox/%3cc2496325850aa74c92aaf83aa9662d26458a1...@szxeml561-mbx.china.huawei.com%3E]
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (ZOOKEEPER-1929) std::length_error on update children
[ https://issues.apache.org/jira/browse/ZOOKEEPER-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009299#comment-14009299 ] Eduard White commented on ZOOKEEPER-1929: - trying to open mounted root zk's directory content was pretty standard: zk + solr config files under /collections/ and /configs/ everything else including eclipse plugin is working fine std::length_error on update children Key: ZOOKEEPER-1929 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1929 Project: ZooKeeper Issue Type: Bug Components: contrib-zkfuse Affects Versions: 3.4.6 Environment: debian Reporter: Eduard White Trying to open zk root directory: ./zkfuse -z localhost:2181 -m /CLOUD/zookeeper -d 1[0x7f89362d0780] INFO zkfuse null - Starting zkfuse cacheSize = 256, debug = 1, forceDirSuffix = ._dir_, mount = /CLOUD/zookeeper, name = _data_, zookeeper = localhost:2181, optind = 6, argc = 6, current arg = NULL 1[0x7f89362d0780] INFO zkfuse null - Create ZK adapter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::ZooKeeperAdapter(zk::ZooKeeperConfig, zk::ZKEventListener*, bool)::Trace::Trace(const void*) 0x434ecd Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::ZooKeeperAdapter(zk::ZooKeeperConfig, zk::ZKEventListener*, bool)::Trace::~Trace() 0x434ecd Exit 1[0x7f89362bd700] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::processEvents()::Trace::Trace(const void*) 0x434df4 Enter 1[0x7f89327bb700] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::processUserEvents()::Trace::Trace(const void*) 0x434e60 Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::reconnect()::Trace::Trace(const void*) 0x434c71 Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::disconnect()::Trace::Trace(const void*) 0x434c4c Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - mp_zkHandle: (nil), state 0 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::disconnect()::Trace::~Trace() 0x434c4c Exit 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.6 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@716: Client environment:host.name=nanoha 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@723: Client environment:os.name=Linux 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@724: Client environment:os.arch=3.2.0-4-amd64 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@725: Client environment:os.version=#1 SMP Debian 3.2.54-2 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@733: Client environment:user.name=root 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@741: Client environment:user.home=/root 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@753: Client environment:user.dir=/opt/zoo/3.4.6/build/contrib/zkfuse/src 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=localhost:2181 sessionTimeout=1000 watcher=0x429780 sessionId=0 sessionPasswd=null context=0x9b5e30 flags=0 2014-05-24 08:07:44,861:20540(0x7f89362d0780):ZOO_DEBUG@start_threads@221: starting threads... 2[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::setState(zk::ZooKeeperAdapter::AdapterState)::Trace::Trace(const void*) 0x434c43 Enter 2[0x7f89362d0780] INFO zookeeper.adapter null - Adapter state transition: 0 - 1 2014-05-24 08:07:44,861:20540(0x7f8931899700):ZOO_DEBUG@do_completion@459: started completion thread 2[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::setState(zk::ZooKeeperAdapter::AdapterState)::Trace::~Trace() 0x434c43 Exit 3[0x7f89362d0780] DEBUG zookeeper.adapter null - mp_zkHandle: 0x9bbba0, state 1 2014-05-24 08:07:44,861:20540(0x7f893209a700):ZOO_DEBUG@do_io@367: started IO thread 3[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::reconnect()::Trace::~Trace() 0x434c71 Exit ZOOKEEPER_ROOT_CHILDREN_WATCH_BUG enabled 3[0x7f89362d0780] INFO zkfuse null - Initialize fuse 2014-05-24 08:07:44,861:20540(0x7f893209a700):ZOO_INFO@check_events@1705: initiated connection to server [127.0.0.1:2181] FUSE library version: 2.9.3 nullpath_ok: 0 nopath: 0 utime_omit_ok: 0 unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0 INIT: 7.17 flags=0x047b max_readahead=0x0002 INIT: 7.19 flags=0x0013 max_readahead=0x0002 max_write=0x0002 max_background=0 congestion_threshold=0 unique: 1, success, outsize: 40 2014-05-24
[jira] [Commented] (ZOOKEEPER-1929) std::length_error on update children
[ https://issues.apache.org/jira/browse/ZOOKEEPER-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009304#comment-14009304 ] Eduard White commented on ZOOKEEPER-1929: - the included debug log is complete: from mounting to exception std::length_error on update children Key: ZOOKEEPER-1929 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1929 Project: ZooKeeper Issue Type: Bug Components: contrib-zkfuse Affects Versions: 3.4.6 Environment: debian Reporter: Eduard White Trying to open zk root directory: ./zkfuse -z localhost:2181 -m /CLOUD/zookeeper -d 1[0x7f89362d0780] INFO zkfuse null - Starting zkfuse cacheSize = 256, debug = 1, forceDirSuffix = ._dir_, mount = /CLOUD/zookeeper, name = _data_, zookeeper = localhost:2181, optind = 6, argc = 6, current arg = NULL 1[0x7f89362d0780] INFO zkfuse null - Create ZK adapter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::ZooKeeperAdapter(zk::ZooKeeperConfig, zk::ZKEventListener*, bool)::Trace::Trace(const void*) 0x434ecd Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::ZooKeeperAdapter(zk::ZooKeeperConfig, zk::ZKEventListener*, bool)::Trace::~Trace() 0x434ecd Exit 1[0x7f89362bd700] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::processEvents()::Trace::Trace(const void*) 0x434df4 Enter 1[0x7f89327bb700] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::processUserEvents()::Trace::Trace(const void*) 0x434e60 Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::reconnect()::Trace::Trace(const void*) 0x434c71 Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::disconnect()::Trace::Trace(const void*) 0x434c4c Enter 1[0x7f89362d0780] TRACE zookeeper.adapter null - mp_zkHandle: (nil), state 0 1[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::disconnect()::Trace::~Trace() 0x434c4c Exit 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.6 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@716: Client environment:host.name=nanoha 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@723: Client environment:os.name=Linux 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@724: Client environment:os.arch=3.2.0-4-amd64 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@725: Client environment:os.version=#1 SMP Debian 3.2.54-2 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@733: Client environment:user.name=root 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@741: Client environment:user.home=/root 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@log_env@753: Client environment:user.dir=/opt/zoo/3.4.6/build/contrib/zkfuse/src 2014-05-24 08:07:44,860:20540(0x7f89362d0780):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=localhost:2181 sessionTimeout=1000 watcher=0x429780 sessionId=0 sessionPasswd=null context=0x9b5e30 flags=0 2014-05-24 08:07:44,861:20540(0x7f89362d0780):ZOO_DEBUG@start_threads@221: starting threads... 2[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::setState(zk::ZooKeeperAdapter::AdapterState)::Trace::Trace(const void*) 0x434c43 Enter 2[0x7f89362d0780] INFO zookeeper.adapter null - Adapter state transition: 0 - 1 2014-05-24 08:07:44,861:20540(0x7f8931899700):ZOO_DEBUG@do_completion@459: started completion thread 2[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::setState(zk::ZooKeeperAdapter::AdapterState)::Trace::~Trace() 0x434c43 Exit 3[0x7f89362d0780] DEBUG zookeeper.adapter null - mp_zkHandle: 0x9bbba0, state 1 2014-05-24 08:07:44,861:20540(0x7f893209a700):ZOO_DEBUG@do_io@367: started IO thread 3[0x7f89362d0780] TRACE zookeeper.adapter null - zk::ZooKeeperAdapter::reconnect()::Trace::~Trace() 0x434c71 Exit ZOOKEEPER_ROOT_CHILDREN_WATCH_BUG enabled 3[0x7f89362d0780] INFO zkfuse null - Initialize fuse 2014-05-24 08:07:44,861:20540(0x7f893209a700):ZOO_INFO@check_events@1705: initiated connection to server [127.0.0.1:2181] FUSE library version: 2.9.3 nullpath_ok: 0 nopath: 0 utime_omit_ok: 0 unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0 INIT: 7.17 flags=0x047b max_readahead=0x0002 INIT: 7.19 flags=0x0013 max_readahead=0x0002 max_write=0x0002 max_background=0 congestion_threshold=0 unique: 1, success, outsize: 40 2014-05-24 08:07:44,909:20540(0x7f893209a700):ZOO_INFO@check_events@1752: session establishment complete on server [127.0.0.1:2181],
Build failed in Jenkins: bookkeeper-trunk #645
See https://builds.apache.org/job/bookkeeper-trunk/645/ -- [...truncated 513 lines...] [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.9:test (default-test) @ bookkeeper-stats-api --- [INFO] Surefire report directory: https://builds.apache.org/job/bookkeeper-trunk/ws/bookkeeper-stats/target/surefire-reports --- T E S T S --- --- T E S T S --- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ bookkeeper-stats-api --- [INFO] Building jar: https://builds.apache.org/job/bookkeeper-trunk/ws/bookkeeper-stats/target/bookkeeper-stats-api-4.3.0-SNAPSHOT.jar [INFO] [INFO] findbugs-maven-plugin:2.5.2:check (default-cli) @ bookkeeper-stats-api [INFO] [INFO] --- findbugs-maven-plugin:2.5.2:findbugs (findbugs) @ bookkeeper-stats-api --- [INFO] Fork Value is true [INFO] Done FindBugs Analysis [INFO] [INFO] findbugs-maven-plugin:2.5.2:check (default-cli) @ bookkeeper-stats-api [INFO] [INFO] --- findbugs-maven-plugin:2.5.2:check (default-cli) @ bookkeeper-stats-api --- [INFO] BugInstance size is 0 [INFO] Error size is 0 [INFO] No errors/warnings found [INFO] [INFO] [INFO] Building bookkeeper-server 4.3.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ bookkeeper-server --- [INFO] Deleting https://builds.apache.org/job/bookkeeper-trunk/ws/bookkeeper-server (includes = [dependency-reduced-pom.xml], excludes = []) [INFO] [INFO] --- apache-rat-plugin:0.7:check (default-cli) @ bookkeeper-server --- [INFO] Exclude: **/DataFormats.java [INFO] [INFO] --- maven-remote-resources-plugin:1.1:process (default) @ bookkeeper-server --- [INFO] [INFO] --- maven-resources-plugin:2.4.3:resources (default-resources) @ bookkeeper-server --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.0:compile (default-compile) @ bookkeeper-server --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 174 source files to https://builds.apache.org/job/bookkeeper-trunk/ws/bookkeeper-server/target/classes [INFO] [INFO] --- maven-resources-plugin:2.4.3:testResources (default-testResources) @ bookkeeper-server --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.0:testCompile (default-testCompile) @ bookkeeper-server --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 84 source files to https://builds.apache.org/job/bookkeeper-trunk/ws/bookkeeper-server/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.9:test (default-test) @ bookkeeper-server --- [INFO] Surefire report directory: https://builds.apache.org/job/bookkeeper-trunk/ws/bookkeeper-server/target/surefire-reports --- T E S T S --- --- T E S T S --- Running org.apache.bookkeeper.client.SlowBookieTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.513 sec Running org.apache.bookkeeper.client.ListLedgersTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.295 sec Running org.apache.bookkeeper.client.BookieRecoveryTest Tests run: 72, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.694 sec Running org.apache.bookkeeper.client.TestReadTimeout Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.406 sec Running org.apache.bookkeeper.client.LedgerRecoveryTest Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.099 sec Running org.apache.bookkeeper.client.BookKeeperTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.904 sec Running org.apache.bookkeeper.client.RoundRobinDistributionScheduleTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.118 sec Running org.apache.bookkeeper.client.BookKeeperCloseTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.471 sec Running org.apache.bookkeeper.client.TestFencing Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.358 sec Running org.apache.bookkeeper.client.TestLedgerChecker Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.338 sec Running org.apache.bookkeeper.client.TestRackawareEnsemblePlacementPolicy Tests run: 7,
[jira] [Commented] (BOOKKEEPER-760) Don't close PCBC proactively if bookies disappeared from zookeeper znodes.
[
https://issues.apache.org/jira/browse/BOOKKEEPER-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009090#comment-14009090
]
Flavio Junqueira commented on BOOKKEEPER-760:
-
If we really don't need this part of the code, I'd rather remove it altogether.
Some questions:
bq. // a. the dead bookies will be removed from topology, which will not be
used in new ensemble.
It depends on whether the session of the bookie has already expired, no?
bq. // b. the read sequence will be reordered based on znode availability, so
most of the reads will not be sent to them.
I'm not sure what reordered means here. Do you mean to say rerouted or resent?
{quote}
// c. the close here is just to disconnect the channel, which doesn't remove
the channel
//from from pcbc map. we don't really need to disconnect the channel here,
since if a bookie is
//really down, PCBC will disconnect itself based on netty callback. if we
try to disconnect
//here, it actually introduces side-effects on case d.
{quote}
Ok, this one sounds like a good reason for removing... but what are the
side-effects?
{quote}
// d. closing the client here will affect latency if the bookie is alive but
just being flaky
//on its znode registration due zookeeper session expire.
{quote}
I don't understand how it affects latency.
bq. // e. if we want to permanently remove a bookkeeper client, we should watch
on the cookies' list.
I'm a bit confused here. Do we even want to remove a bookkeeper client?
Don't close PCBC proactively if bookies disappeared from zookeeper znodes.
--
Key: BOOKKEEPER-760
URL: https://issues.apache.org/jira/browse/BOOKKEEPER-760
Project: Bookkeeper
Issue Type: Improvement
Components: bookkeeper-client
Reporter: Sijie Guo
Assignee: Sijie Guo
Fix For: 4.3.0, 4.2.3
Attachments: BOOKKEEPER-760.diff
Don't close PCBC proactively if bookies disappeared from zookeeper znodes.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (BOOKKEEPER-760) Don't close PCBC proactively if bookies disappeared from zookeeper znodes.
[ https://issues.apache.org/jira/browse/BOOKKEEPER-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009222#comment-14009222 ] Sijie Guo commented on BOOKKEEPER-760: -- It depends on whether the session of the bookie has already expired, no? yup. if the zk session was expired, the znode of that bookie will be removed and the topology will be changed in clients, so the bookie will not be used for new ensemble. for current, a bookie will be shutdown immediately if its zookeeper session is expired. but after BOOKKEEPER-537, a bookie will re-establish the zookeeper session and re-registered itself when its previous session expired. so the change is to prevent closing channels that a bookie isn't actually down but whose session just expired, which cause unnecessary retries and ensemble changes. I don't understand how it affects latency. it would trigger unnecessary ensemble change if a bookie isn't actually down but just whose znode disappeared, so it would increase write latency. for the read latency, it would cause client re-send the read to a different bookie in same quorum, so the read latency will be increased due to retrying the second bookie in same quorum. I'm not sure what reordered means here. Do you mean to say rerouted or resent? Ah, the reorder would be in a different patch. I forgot to create the ticket for it. The reorder means we read the entries based on the availability of bookies (existence of znodes). Do we even want to remove a bookkeeper client? in theory, we might need to remove a bookie client if it is removed from the cluster permanently. but since it is rare, it is ok that we don't remove it. or, we could use a guava cache to maintain the pcbc clients, so we could evict the idle clients to avoid increasing memory. If we really don't need this part of the code, I'd rather remove it altogether. ah. I put it there with the comments so we don't add it back in future by mistake. Don't close PCBC proactively if bookies disappeared from zookeeper znodes. -- Key: BOOKKEEPER-760 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-760 Project: Bookkeeper Issue Type: Improvement Components: bookkeeper-client Reporter: Sijie Guo Assignee: Sijie Guo Fix For: 4.3.0, 4.2.3 Attachments: BOOKKEEPER-760.diff Don't close PCBC proactively if bookies disappeared from zookeeper znodes. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: Review Request 17895: BOOKKEEPER-582: protobuf support for bookkeeper
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17895/#review43940 --- just a ping to @fpj and @Rakesh - Sijie Guo On April 24, 2014, 7:43 a.m., Sijie Guo wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17895/ --- (Updated April 24, 2014, 7:43 a.m.) Review request for bookkeeper and Ivan Kelly. Bugs: BOOKKEEPER-582 https://issues.apache.org/jira/browse/BOOKKEEPER-582 Repository: bookkeeper-git Description --- - introducing protobuf support for bookkeeper - for server: introduce packet processor / EnDecoder for different protocol supports - for client: change PCBC to use protobuf to send requests - misc changes for protobuf support (bookie server is able for backward compatibility) Diffs - bookkeeper-server/pom.xml ebc1198 bookkeeper-server/src/main/java/org/apache/bookkeeper/bookie/IndexInMemPageMgr.java 56487aa bookkeeper-server/src/main/java/org/apache/bookkeeper/client/LedgerChecker.java 28e23d6 bookkeeper-server/src/main/java/org/apache/bookkeeper/client/PendingReadOp.java fb36b90 bookkeeper-server/src/main/java/org/apache/bookkeeper/processor/RequestProcessor.java 241f369 bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookieProtoEncoding.java 1154047 bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookieRequestHandler.java b922a82 bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookieRequestProcessor.java 8155b22 bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookkeeperProtocol.java PRE-CREATION bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/PacketProcessorBase.java PRE-CREATION bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/PacketProcessorBaseV3.java PRE-CREATION bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/PerChannelBookieClient.java a10f7d5 bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/ReadEntryProcessor.java PRE-CREATION bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/ReadEntryProcessorV3.java PRE-CREATION bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/WriteEntryProcessor.java PRE-CREATION bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/WriteEntryProcessorV3.java PRE-CREATION bookkeeper-server/src/main/proto/BookkeeperProtocol.proto PRE-CREATION bookkeeper-server/src/main/resources/findbugsExclude.xml 97a6156 bookkeeper-server/src/test/java/org/apache/bookkeeper/proto/TestProtoVersions.java 5fcc445 bookkeeper-server/src/test/java/org/apache/bookkeeper/replication/AuditorPeriodicCheckTest.java 3f8496f bookkeeper-server/src/test/java/org/apache/bookkeeper/test/BookieClientTest.java bc05229 bookkeeper-server/src/test/java/org/apache/bookkeeper/test/TestBackwardCompat.java 8376b46 compat-deps/bookkeeper-server-compat-4.2.0/pom.xml PRE-CREATION compat-deps/hedwig-server-compat-4.2.0/pom.xml PRE-CREATION compat-deps/pom.xml f79582d hedwig-server/pom.xml 06cf01c hedwig-server/src/test/java/org/apache/hedwig/server/TestBackwardCompat.java 8da109e Diff: https://reviews.apache.org/r/17895/diff/ Testing --- unit tests. backward tests. Thanks, Sijie Guo
