ZooKeeper_branch34 - Build # 1863 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34/1863/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3.19 KB...] collisions:0 txqueuelen:0 RX bytes:30737854362061 (30.7 TB) TX bytes:30737854362061 (30.7 TB) core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 386178 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 6 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 10240 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 6 /home/jenkins/tools/ant/latest/bin/ant clean Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) mv: cannot stat 'build/*.tar.gz': No such file or directory mv: cannot stat 'build/*.jar': No such file or directory mv: cannot stat 'build/test/findbugs': No such file or directory mv: cannot stat 'build/docs/api': No such file or directory Build Failed Build step 'Execute shell' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper_branch34_openjdk7 - Build # 1419 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1419/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7 Cloning the remote Git repository Cloning repository git://git.apache.org/zookeeper.git > git init /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7 # > timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 No valid HEAD. Skipping the resetting > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.4^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.4^{commit} # timeout=10 Checking out Revision 1b59e3cde6457f81951f06c31548cc2064ed69c6 (refs/remotes/origin/branch-3.4) > git config core.sparsecheckout # timeout=10 > git checkout -f 1b59e3cde6457f81951f06c31548cc2064ed69c6 > git rev-list 50448bd92563db79422b4d7207b7e06f476f5d6d # timeout=10 No emails were triggered. [ZooKeeper_branch34_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Error: JAVA_HOME is not defined correctly. We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
Failed: ZOOKEEPER- PreCommit Build #393
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/393/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 75.49 KB...] warning: Cannot merge binary files: docs/zookeeperAdmin.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/recipes.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/linkmap.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/javaExample.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/index.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/bookkeeperStream.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/bookkeeperStarted.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/bookkeeperProgrammer.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/bookkeeperOverview.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) warning: Cannot merge binary files: docs/bookkeeperConfig.pdf (HEAD vs. 1b59e3cde6457f81951f06c31548cc2064ed69c6) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1757) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1753) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1409) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$3.execute(CliGitAPIImpl.java:588) at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.merge(AbstractGitAPIImpl.java:86) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.merge(CliGitAPIImpl.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:894) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:869) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ..remote call to H6(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:256) at com.sun.proxy.$Proxy95.merge(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.merge(RemoteGitImpl.java:434) at com.cloudbees.jenkins.plugins.git.vmerge.BuildChooserImpl.getCandidateRevisions(BuildChooserImpl.java:107) at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:995) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1098) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Archiving artifacts Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? [description-setter] Could not determine description. Putting comment on the pull request Email was triggered for: Failure - Any Sending email
Failed: ZOOKEEPER- PreCommit Build #392
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/392/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2.04 KB...] at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ..remote call to H6(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:256) at com.sun.proxy.$Proxy95.checkoutBranch(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.checkoutBranch(RemoteGitImpl.java:323) at com.cloudbees.jenkins.plugins.git.vmerge.BuildChooserImpl.getCandidateRevisions(BuildChooserImpl.java:78) at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:995) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1098) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Caused by: hudson.plugins.git.GitException: Command "git checkout -f origin/trunk" returned status code 1: stdout: stderr: error: pathspec 'origin/trunk' did not match any file(s) known to git. at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$800(CliGitAPIImpl.java:64) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$9.execute(CliGitAPIImpl.java:2037) at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.checkoutBranch(AbstractGitAPIImpl.java:81) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.checkoutBranch(CliGitAPIImpl.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:894) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:869) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Archiving artifacts Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? [description-setter] Could not determine description. Putting comment on the pull request Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Commented] (ZOOKEEPER-236) SSL Support for Atomic Broadcast protocol
[ https://issues.apache.org/jira/browse/ZOOKEEPER-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900748#comment-15900748 ] Powell Molleti commented on ZOOKEEPER-236: -- Hi Abe, {quote} bq. if I understand correctly, both the operations of managing the certs (add/remove of certs) and reconfig() API to change members of quorum have to be fault-tolerant. Would you mind clarifying what you mean by "fault-tolerant" here? Can you give an example of how a fault would break my patch? {quote} Either it be CA(s) with CRL's or self signed list of certs what I am pointing to is that the way an admin manages this information should also support fault-tolerance. Not only it should be fault-tolerant but also should work nicely/easily with most probable next thing an admin would do i.e issue a reconfig() command, it could be an add/removing/modify quorum peer(s) configuration. It will be nice to provide a way to manage reconfiguration of quorum peers when SSL is enabled with the same weak assumptions that are necessary for reconfig() to work when SSL is not enabled. Providing a Truststore and asking admins to manage them on their own for the entire quorum will mean that this operation is not fault-tolerant i.e we are expecting them to first set all members of the quorum to a consistent SSL config state and then issue reconfig() command. It would seem that a set of quorum IP addresses dictate what the current configuration of connectivity is allowed and this has to be managed properly to ensure safety and extending this idea the set of SSL certs(be self signed or CA signed) also dictate the current configuration of connectivity. Hence if one considers the Pair as config and provide that to reconfig() API it should work. That is what is done for self signed certs in my patch and we should/could provide similar functionality for CA cert case. Hence there is no new problem to solve here, we piggy back on reconfig() API and provide a single API to manage this, we get fault-tolerance for this configuration and safety that reconfig() provides for free. Please consider the above comments and let me know what you think, I was not saying that your patch is breaking fault-tolerance instead what my comments pointed to is that we should provide fault-tolerance and safety for reconfiguration of SSL configuration be it self signed or CA based. There are use cases where CA cert based cluster deployment might not be possible hence it would be nice to see Zookeeper provide both possibilities but also maintain the ease of use and provide same guarantees that reconfig() does. {quote} This is how I feel as well. I'm sure we can pretty quickly come up with a list of deficiencies in the current design but I don't think there is anything severe enough at this moment to give us cause to rewrite right now. {quote} There are bugs like ZOOKEEPER-2164, ZOOKEEPER-1678 to consider along with ZOOKEEPER-901. Netty or NIO will work but considering SSL will mean Netty will make it easier to implement. Doing this in phases is better, getting SSL socket to work with reconfig() support is great first step. The Netty patch I have also gets this support only for FLE and not ZAB. I found it not so easier to abstract away the calls to socket(s) from ZAB code. Cheers Powell. > SSL Support for Atomic Broadcast protocol > - > > Key: ZOOKEEPER-236 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-236 > Project: ZooKeeper > Issue Type: New Feature > Components: quorum, server >Reporter: Benjamin Reed >Assignee: Abraham Fine >Priority: Minor > > We should have the ability to use SSL to authenticate and encrypt the traffic > between ZooKeeper servers. For the most part this is a very easy change. We > would probably only want to support this for TCP based leader elections. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ZOOKEEPER-2665) Port QA github pull request build to branch 3.4 and 3.5
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900683#comment-15900683 ] Rakesh R commented on ZOOKEEPER-2665: - Hi [~fpj], please add [~eolivelli] to the contributor list and assign the issue to him. Thanks! > Port QA github pull request build to branch 3.4 and 3.5 > --- > > Key: ZOOKEEPER-2665 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2665 > Project: ZooKeeper > Issue Type: Test > Components: build >Reporter: Flavio Junqueira > Fix For: 3.4.10, 3.5.3 > > > We have QA build for pull requests against master but not against branches > 3.4 and 3.5. We need to port the necessary wiring to do it, it shouldn't be > difficult. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
ZooKeeper_branch34_jdk7 - Build # 1433 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1433/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 24.30 MB...] [junit] 2017-03-08 02:55:49,445 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-03-08 02:55:49,445 [myid:] - INFO [main:PrepRequestProcessor@764] - Shutting down [junit] 2017-03-08 02:55:49,445 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-03-08 02:55:49,446 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-03-08 02:55:49,446 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-03-08 02:55:49,446 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-03-08 02:55:49,447 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-08 02:55:49,447 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-03-08 02:55:49,449 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-03-08 02:55:49,449 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-03-08 02:55:49,449 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-03-08 02:55:49,450 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-03-08 02:55:49,450 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test7983277883007328732.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test7983277883007328732.junit.dir/version-2 [junit] 2017-03-08 02:55:49,455 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-08 02:55:49,455 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-08 02:55:49,455 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:37369 [junit] 2017-03-08 02:55:49,456 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@883] - Processing stat command from /127.0.0.1:37369 [junit] 2017-03-08 02:55:49,456 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-03-08 02:55:49,457 [myid:] - INFO [Thread-4:NIOServerCnxn@1044] - Closed socket connection for client /127.0.0.1:37369 (no session established for client) [junit] 2017-03-08 02:55:49,457 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-03-08 02:55:49,459 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-03-08 02:55:49,460 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-03-08 02:55:49,460 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-03-08 02:55:49,460 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-03-08 02:55:49,460 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 35676 [junit] 2017-03-08 02:55:49,461 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-03-08 02:55:49,461 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-03-08 02:55:49,461 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-03-08 02:55:49,527 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15aabd81429 closed [junit] 2017-03-08 02:55:49,527 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-03-08 02:55:49,527 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15aabd81429 [junit] 2017-03-08 02:55:49,527 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-03-08 02:55:49,528 [myid:] - INFO [main:ZooKeeperServer@505] - shutting down [junit] 2017-03-08 02:55:49,528 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-08 02:55:49,528
[jira] [Commented] (ZOOKEEPER-2700) Force ZooKeeper to generate snapshot
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900584#comment-15900584 ] ASF GitHub Bot commented on ZOOKEEPER-2700: --- Github user flier commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/180#discussion_r104831719 --- Diff: src/java/main/org/apache/zookeeper/server/ZooKeeperServer.java --- @@ -303,15 +305,38 @@ public void loadData() throws IOException, InterruptedException { public void takeSnapshot(){ --- End diff -- @hanm sure, please check the [zkpipe](https://github.com/flier/zkpipe) project, we are using it to tracing and audit zookeeper operations > Force ZooKeeper to generate snapshot > > > Key: ZOOKEEPER-2700 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2700 > Project: ZooKeeper > Issue Type: Improvement >Reporter: Flier Lu >Priority: Minor > > When cold backup or remote offline sync Zookeeper instances, we need the > latest snapshot. > Add a four letter `snap` command to force Zookeeper to generate snapshot. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper pull request #180: ZOOKEEPER-2700 add JMX `takeSnapshot` method an...
Github user flier commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/180#discussion_r104831719 --- Diff: src/java/main/org/apache/zookeeper/server/ZooKeeperServer.java --- @@ -303,15 +305,38 @@ public void loadData() throws IOException, InterruptedException { public void takeSnapshot(){ --- End diff -- @hanm sure, please check the [zkpipe](https://github.com/flier/zkpipe) project, we are using it to tracing and audit zookeeper operations --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
ZooKeeper_branch34_jdk8 - Build # 910 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_jdk8/910/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 25.57 MB...] [junit] 2017-03-08 02:24:37,756 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-03-08 02:24:37,756 [myid:] - INFO [main:PrepRequestProcessor@764] - Shutting down [junit] 2017-03-08 02:24:37,757 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-03-08 02:24:37,757 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-03-08 02:24:37,757 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-03-08 02:24:37,757 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-03-08 02:24:37,757 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-08 02:24:37,758 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-03-08 02:24:37,759 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-03-08 02:24:37,759 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-03-08 02:24:37,759 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-03-08 02:24:37,759 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-03-08 02:24:37,759 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test1144801277389259934.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test1144801277389259934.junit.dir/version-2 [junit] 2017-03-08 02:24:37,762 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-08 02:24:37,762 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-08 02:24:37,762 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:60830 [junit] 2017-03-08 02:24:37,762 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@883] - Processing stat command from /127.0.0.1:60830 [junit] 2017-03-08 02:24:37,763 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-03-08 02:24:37,763 [myid:] - INFO [Thread-4:NIOServerCnxn@1044] - Closed socket connection for client /127.0.0.1:60830 (no session established for client) [junit] 2017-03-08 02:24:37,763 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-03-08 02:24:37,765 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-03-08 02:24:37,765 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-03-08 02:24:37,765 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-03-08 02:24:37,765 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-03-08 02:24:37,765 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 35520 [junit] 2017-03-08 02:24:37,766 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-03-08 02:24:37,766 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-03-08 02:24:37,766 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-03-08 02:24:37,846 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15aabbb850c closed [junit] 2017-03-08 02:24:37,846 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-03-08 02:24:37,846 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15aabbb850c [junit] 2017-03-08 02:24:37,846 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-03-08 02:24:37,847 [myid:] - INFO [main:ZooKeeperServer@505] - shutting down [junit] 2017-03-08 02:24:37,847 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-08 02:24:37,847
ZooKeeper_branch34_jdk7 - Build # 1432 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1432/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 26.61 MB...] [junit] 2017-03-08 01:54:26,950 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-03-08 01:54:26,951 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-03-08 01:54:26,951 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-03-08 01:54:26,951 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-03-08 01:54:26,952 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-08 01:54:26,952 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-03-08 01:54:26,954 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-03-08 01:54:26,954 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-03-08 01:54:26,955 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-03-08 01:54:26,955 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-03-08 01:54:26,955 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test5067140825529836894.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test5067140825529836894.junit.dir/version-2 [junit] 2017-03-08 01:54:26,959 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-08 01:54:26,960 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-08 01:54:26,960 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:55594 [junit] 2017-03-08 01:54:26,961 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@883] - Processing stat command from /127.0.0.1:55594 [junit] 2017-03-08 01:54:26,961 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-03-08 01:54:26,962 [myid:] - INFO [Thread-4:NIOServerCnxn@1044] - Closed socket connection for client /127.0.0.1:55594 (no session established for client) [junit] 2017-03-08 01:54:26,962 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-03-08 01:54:26,964 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-03-08 01:54:26,964 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-03-08 01:54:26,964 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-03-08 01:54:26,965 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-03-08 01:54:26,965 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 35676 [junit] 2017-03-08 01:54:26,965 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-03-08 01:54:26,965 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-03-08 01:54:26,966 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-03-08 01:54:27,000 [myid:] - INFO [SessionTracker:SessionTrackerImpl@162] - SessionTrackerImpl exited loop! [junit] 2017-03-08 01:54:27,001 [myid:] - INFO [SessionTracker:SessionTrackerImpl@162] - SessionTrackerImpl exited loop! [junit] 2017-03-08 01:54:27,032 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15aab9fe365 closed [junit] 2017-03-08 01:54:27,032 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-03-08 01:54:27,032 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15aab9fe365 [junit] 2017-03-08 01:54:27,032 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-03-08 01:54:27,033 [myid:] - INFO [main:ZooKeeperServer@505] - shutting down [junit] 2017-03-08 01:54:27,033 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN
ZooKeeper_branch35_openjdk7 - Build # 442 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_openjdk7/442/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 59.34 MB...] [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-08 01:24:08,401 [myid:127.0.0.1:30073] - INFO [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:30073. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-08 01:24:08,402 [myid:127.0.0.1:30073] - WARN [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1235] - Session 0x199f6dd3 for server 127.0.0.1/127.0.0.1:30073, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-08 01:24:08,759 [myid:127.0.0.1:30073] - INFO [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:30073. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-08 01:24:08,760 [myid:127.0.0.1:30073] - WARN [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1235] - Session 0x199f6dd30001 for server 127.0.0.1/127.0.0.1:30073, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-08 01:24:09,534 [myid:127.0.0.1:30073] - INFO [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:30073. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-08 01:24:09,534 [myid:127.0.0.1:30073] - WARN [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1235] - Session 0x199f6dd3 for server 127.0.0.1/127.0.0.1:30073, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-08 01:24:10,630 [myid:127.0.0.1:30073] - INFO [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:30073. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-08 01:24:10,630 [myid:127.0.0.1:30073] - WARN [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1235] - Session 0x199f6dd30001 for server 127.0.0.1/127.0.0.1:30073, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-08 01:24:10,794 [myid:127.0.0.1:30073] - INFO [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:30073. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-08 01:24:10,795 [myid:127.0.0.1:30073] - WARN [main-SendThread(127.0.0.1:30073):ClientCnxn$SendThread@1235] - Session 0x199f6dd3 for server 127.0.0.1/127.0.0.1:30073, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at
[jira] [Commented] (ZOOKEEPER-236) SSL Support for Atomic Broadcast protocol
[ https://issues.apache.org/jira/browse/ZOOKEEPER-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900521#comment-15900521 ] Abraham Fine commented on ZOOKEEPER-236: [~hanm]- bq. Separate configuration option provides better flexibility and is also consistent with SASL / Kerberos configurations for client-server and server-server. That makes sense to me. I'll update the patch. I'm also taking suggestions for what such an option should be named. :) bq. unless it is trivial to implement and test rolling upgrade It was pretty trivial to implement and I imagine testing should not be too difficult either. bq. Today we don't use Netty for server-server chat so it seems no immediate needs to rely on Netty for this work. This is how I feel as well. I'm sure we can pretty quickly come up with a list of deficiencies in the current design but I don't think there is anything severe enough at this moment to give us cause to rewrite right now. > SSL Support for Atomic Broadcast protocol > - > > Key: ZOOKEEPER-236 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-236 > Project: ZooKeeper > Issue Type: New Feature > Components: quorum, server >Reporter: Benjamin Reed >Assignee: Abraham Fine >Priority: Minor > > We should have the ability to use SSL to authenticate and encrypt the traffic > between ZooKeeper servers. For the most part this is a very easy change. We > would probably only want to support this for TCP based leader elections. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
ZooKeeper_branch34 - Build # 1862 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34/1862/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3.62 KB...] collisions:0 txqueuelen:0 RX bytes:726802 (726.8 KB) TX bytes:27791888 (27.7 MB) core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 386178 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 6 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 10240 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 6 /home/jenkins/tools/ant/latest/bin/ant clean Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) mv: cannot stat 'build/*.tar.gz': No such file or directory mv: cannot stat 'build/*.jar': No such file or directory mv: cannot stat 'build/test/findbugs': No such file or directory mv: cannot stat 'build/docs/api': No such file or directory Build Failed Build step 'Execute shell' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Commented] (ZOOKEEPER-2700) Force ZooKeeper to generate snapshot
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900485#comment-15900485 ] ASF GitHub Bot commented on ZOOKEEPER-2700: --- Github user hanm commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/180#discussion_r104819835 --- Diff: src/java/main/org/apache/zookeeper/server/ZooKeeperServer.java --- @@ -303,15 +305,38 @@ public void loadData() throws IOException, InterruptedException { public void takeSnapshot(){ --- End diff -- >> we have an internal project named zkpipe, it read Zookeeper snapshot/binlog and send it to a Kafka topic, our client could choose to rebuild the transaction or subscribe the changes. I believe it will better than hack Zookeeper itself. If you have interested, I could push it to github later. @flier This sounds interesting. I am sure there are users of ZooKeeper that could benefit from this, because ZooKeeper does not work out of back for such backup scenarios. If you are OK / allowed to open source this work I recommend put it on github. > Force ZooKeeper to generate snapshot > > > Key: ZOOKEEPER-2700 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2700 > Project: ZooKeeper > Issue Type: Improvement >Reporter: Flier Lu >Priority: Minor > > When cold backup or remote offline sync Zookeeper instances, we need the > latest snapshot. > Add a four letter `snap` command to force Zookeeper to generate snapshot. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper pull request #180: ZOOKEEPER-2700 add JMX `takeSnapshot` method an...
Github user hanm commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/180#discussion_r104819835 --- Diff: src/java/main/org/apache/zookeeper/server/ZooKeeperServer.java --- @@ -303,15 +305,38 @@ public void loadData() throws IOException, InterruptedException { public void takeSnapshot(){ --- End diff -- >> we have an internal project named zkpipe, it read Zookeeper snapshot/binlog and send it to a Kafka topic, our client could choose to rebuild the transaction or subscribe the changes. I believe it will better than hack Zookeeper itself. If you have interested, I could push it to github later. @flier This sounds interesting. I am sure there are users of ZooKeeper that could benefit from this, because ZooKeeper does not work out of back for such backup scenarios. If you are OK / allowed to open source this work I recommend put it on github. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
ZooKeeper_branch34_openjdk7 - Build # 1418 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1418/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H22 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.4^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.4^{commit} # timeout=10 Checking out Revision 50448bd92563db79422b4d7207b7e06f476f5d6d (refs/remotes/origin/branch-3.4) > git config core.sparsecheckout # timeout=10 > git checkout -f 50448bd92563db79422b4d7207b7e06f476f5d6d > git rev-list 09555983be93e5278b1ab8a71e3ca9f54ea6c374 # timeout=10 No emails were triggered. [ZooKeeper_branch34_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Error: JAVA_HOME is not defined correctly. We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900472#comment-15900472 ] ASF GitHub Bot commented on ZOOKEEPER-2709: --- Github user hanm commented on the issue: https://github.com/apache/zookeeper/pull/182 Thanks for the quick update @joshelser ! The latest doc looks perfect minors what Abe pointed out. Do you mind to address Abe's comment regarding the id / expression clarification? > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper issue #182: ZOOKEEPER-2709 Clarify documentation around the "auth"...
Github user hanm commented on the issue: https://github.com/apache/zookeeper/pull/182 Thanks for the quick update @joshelser ! The latest doc looks perfect minors what Abe pointed out. Do you mind to address Abe's comment regarding the id / expression clarification? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
ZooKeeper_branch35_jdk7 - Build # 875 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_jdk7/875/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H15 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_jdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.5^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.5^{commit} # timeout=10 Checking out Revision b2d66fa3d07811f3ce2618e8deaafb23f309bbf7 (refs/remotes/origin/branch-3.5) > git config core.sparsecheckout # timeout=10 > git checkout -f b2d66fa3d07811f3ce2618e8deaafb23f309bbf7 > git rev-list 6d9fc04c052adbc791c63f3f00c816fb8e56 # timeout=10 No emails were triggered. [ZooKeeper_branch35_jdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
Failed: ZOOKEEPER- PreCommit Build #389
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/389/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 75.49 KB...] warning: Cannot merge binary files: docs/zookeeperAdmin.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/recipes.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/linkmap.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/javaExample.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/index.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/bookkeeperStream.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/bookkeeperStarted.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/bookkeeperProgrammer.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/bookkeeperOverview.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) warning: Cannot merge binary files: docs/bookkeeperConfig.pdf (HEAD vs. 50448bd92563db79422b4d7207b7e06f476f5d6d) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1757) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1753) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1409) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$3.execute(CliGitAPIImpl.java:588) at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.merge(AbstractGitAPIImpl.java:86) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.merge(CliGitAPIImpl.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:894) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:869) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ..remote call to H6(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:256) at com.sun.proxy.$Proxy95.merge(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.merge(RemoteGitImpl.java:434) at com.cloudbees.jenkins.plugins.git.vmerge.BuildChooserImpl.getCandidateRevisions(BuildChooserImpl.java:107) at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:995) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1098) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Archiving artifacts Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? [description-setter] Could not determine description. Putting comment on the pull request Email was triggered for: Failure - Any Sending email
[jira] [Commented] (ZOOKEEPER-2665) Port QA github pull request build to branch 3.4 and 3.5
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900462#comment-15900462 ] ASF GitHub Bot commented on ZOOKEEPER-2665: --- Github user hanm commented on the issue: https://github.com/apache/zookeeper/pull/165 Thanks @eolivelli, this is merged in 3.4. and 3.5. > Port QA github pull request build to branch 3.4 and 3.5 > --- > > Key: ZOOKEEPER-2665 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2665 > Project: ZooKeeper > Issue Type: Test > Components: build >Reporter: Flavio Junqueira > Fix For: 3.4.10, 3.5.3 > > > We have QA build for pull requests against master but not against branches > 3.4 and 3.5. We need to port the necessary wiring to do it, it shouldn't be > difficult. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Failed: ZOOKEEPER- PreCommit Build #390
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/390/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2.04 KB...] at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ..remote call to H5(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:256) at com.sun.proxy.$Proxy95.checkoutBranch(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.checkoutBranch(RemoteGitImpl.java:323) at com.cloudbees.jenkins.plugins.git.vmerge.BuildChooserImpl.getCandidateRevisions(BuildChooserImpl.java:78) at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:995) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1098) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Caused by: hudson.plugins.git.GitException: Command "git checkout -f origin/trunk" returned status code 1: stdout: stderr: error: pathspec 'origin/trunk' did not match any file(s) known to git. at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$800(CliGitAPIImpl.java:64) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$9.execute(CliGitAPIImpl.java:2037) at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.checkoutBranch(AbstractGitAPIImpl.java:81) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.checkoutBranch(CliGitAPIImpl.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:894) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:869) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Archiving artifacts Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? [description-setter] Could not determine description. Putting comment on the pull request Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[GitHub] zookeeper issue #165: ZOOKEEPER-2665 Port QA github pull request build to br...
Github user hanm commented on the issue: https://github.com/apache/zookeeper/pull/165 Thanks @eolivelli, this is merged in 3.4. and 3.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Failed: ZOOKEEPER- PreCommit Build #391
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/391/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2.04 KB...] at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ..remote call to H5(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:256) at com.sun.proxy.$Proxy95.checkoutBranch(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.checkoutBranch(RemoteGitImpl.java:323) at com.cloudbees.jenkins.plugins.git.vmerge.BuildChooserImpl.getCandidateRevisions(BuildChooserImpl.java:78) at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:995) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1098) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Caused by: hudson.plugins.git.GitException: Command "git checkout -f origin/trunk" returned status code 1: stdout: stderr: error: pathspec 'origin/trunk' did not match any file(s) known to git. at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$800(CliGitAPIImpl.java:64) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$9.execute(CliGitAPIImpl.java:2037) at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.checkoutBranch(AbstractGitAPIImpl.java:81) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.checkoutBranch(CliGitAPIImpl.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:894) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:869) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Archiving artifacts Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? [description-setter] Could not determine description. Putting comment on the pull request Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Resolved] (ZOOKEEPER-2665) Port QA github pull request build to branch 3.4 and 3.5
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Han resolved ZOOKEEPER-2665. Resolution: Fixed Fix Version/s: (was: 3.4.11) 3.4.10 Issue resolved by pull request 165 [https://github.com/apache/zookeeper/pull/165] > Port QA github pull request build to branch 3.4 and 3.5 > --- > > Key: ZOOKEEPER-2665 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2665 > Project: ZooKeeper > Issue Type: Test > Components: build >Reporter: Flavio Junqueira > Fix For: 3.4.10, 3.5.3 > > > We have QA build for pull requests against master but not against branches > 3.4 and 3.5. We need to port the necessary wiring to do it, it shouldn't be > difficult. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ZOOKEEPER-236) SSL Support for Atomic Broadcast protocol
[ https://issues.apache.org/jira/browse/ZOOKEEPER-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900447#comment-15900447 ] Michael Han commented on ZOOKEEPER-236: --- Thanks Abe for driving this. I have some comments for your questions in pull request. bq. I am using the same configuration that points to the truststore/keystore used for server <-> client ssl. Do they need to be separate? Separate configuration option provides better flexibility and is also consistent with SASL / Kerberos configurations for client-server and server-server. For example we have separate server login context for server credential in client-server and server-server cases (ZOOKEEPER-1045), the keytab might be the same but the configuration options are separate. bq. Is port unification the correct approach for rolling upgrades? I think it might be helpful to do some scoping and decide if we want to support rolling upgrade - or supporting rolling upgrade in first release of this patch. When it comes to security usually customers are OK to do a cold restart. Not saying that we should not support rolling upgrade someday but you might also want consider the amount of work involved to support it (implementation, how to properly testing, etc.) and it might be easier if we do this in phases - unless it is trivial to implement and test rolling upgrade (I haven't looked this in much details.) or folks feel it is absolutely required to get rolling upgrade capability before shipping this feature. bq. server logic with netty was necessary given how easy ssl was to implement with standard java `SSLSocket`s. Any arguments to the contrary? Today we don't use Netty for server-server chat so it seems no immediate needs to rely on Netty for this work. Though, issues like ZOOKEEPER-900 and ZOOKEEPER-901 might push towards the direction of using Netty so the FLE and server chats are none blocking, plus we have TLS on Netty for client-server secured communication, so for consistency we could choose to implement TLS on Netty for server-server as well. I am interesting to hear what others think about this. > SSL Support for Atomic Broadcast protocol > - > > Key: ZOOKEEPER-236 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-236 > Project: ZooKeeper > Issue Type: New Feature > Components: quorum, server >Reporter: Benjamin Reed >Assignee: Abraham Fine >Priority: Minor > > We should have the ability to use SSL to authenticate and encrypt the traffic > between ZooKeeper servers. For the most part this is a very easy change. We > would probably only want to support this for TCP based leader elections. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ZOOKEEPER-2693) DOS attack on wchp/wchc four letter words (4lw)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900429#comment-15900429 ] ASF GitHub Bot commented on ZOOKEEPER-2693: --- Github user hanm closed the pull request at: https://github.com/apache/zookeeper/pull/183 > DOS attack on wchp/wchc four letter words (4lw) > --- > > Key: ZOOKEEPER-2693 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2693 > Project: ZooKeeper > Issue Type: Bug > Components: security, server >Affects Versions: 3.4.0, 3.5.1, 3.5.2 >Reporter: Patrick Hunt >Assignee: Michael Han >Priority: Blocker > Fix For: 3.4.10, 3.5.3, 3.6.0 > > Attachments: ZOOKEEPER-2693-01.patch > > > The wchp/wchc four letter words can be exploited in a DOS attack on the ZK > client port - typically 2181. The following POC attack was recently published > on the web: > https://webcache.googleusercontent.com/search?q=cache:_CNGIz10PRYJ:https://www.exploit-db.com/exploits/41277/+=14=en=clnk=us > The most straightforward way to block this attack is to not allow access to > the client port to non-trusted clients - i.e. firewall the ZooKeeper service > and only allow access to trusted applications using it for coordination. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper pull request #183: ZOOKEEPER-2693: DOS attack on wchp/wchc four le...
Github user hanm closed the pull request at: https://github.com/apache/zookeeper/pull/183 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-236) SSL Support for Atomic Broadcast protocol
[ https://issues.apache.org/jira/browse/ZOOKEEPER-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900423#comment-15900423 ] Abraham Fine commented on ZOOKEEPER-236: Hi [~geek101]- bq. if I understand correctly, both the operations of managing the certs (add/remove of certs) and reconfig() API to change members of a quorum have to be fault-tolerant. Would you mind clarifying what you mean by "fault-tolerant" here? Can you give an example of how a fault would break my patch? bq. CA seems like the best way and simple way to go till such a time arrises when the CA has to be changed. You are correct in that there is certainly additional complexity involved here. But these are "solved" problems that I don't feel we need to write a custom solution for. bq. Also prevalent security considerations recommend revoking the cert of the Quorum member that is removed. Again how do we accomplish this in a fault-tolerant way. Hence there is some work still left to do in CA case. Good point. I forgot to include a note on this with my patch. I was thinking supporting OCSP (or even CRL's) would be a fine solution to that. What do you think? bq. Also regarding the path forward do you think we should aim for a Trunk patch or patch to 3.5? I think we should aim for both. bq. Let me know if I got something wrong and what do you think about bringing in Netty support for Quorum communication. What are your motivations for bringing in Netty? Thanks, Abe > SSL Support for Atomic Broadcast protocol > - > > Key: ZOOKEEPER-236 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-236 > Project: ZooKeeper > Issue Type: New Feature > Components: quorum, server >Reporter: Benjamin Reed >Assignee: Abraham Fine >Priority: Minor > > We should have the ability to use SSL to authenticate and encrypt the traffic > between ZooKeeper servers. For the most part this is a very easy change. We > would probably only want to support this for TCP based leader elections. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
ZooKeeper_branch34 - Build # 1861 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34/1861/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3.24 KB...] collisions:0 txqueuelen:0 RX bytes:3428327141669 (3.4 TB) TX bytes:3428327141669 (3.4 TB) core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 386178 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 6 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 10240 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 6 /home/jenkins/tools/ant/latest/bin/ant clean Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) mv: cannot stat 'build/*.tar.gz': No such file or directory mv: cannot stat 'build/*.jar': No such file or directory mv: cannot stat 'build/test/findbugs': No such file or directory mv: cannot stat 'build/docs/api': No such file or directory Build Failed Build step 'Execute shell' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper-trunk - Build # 3303 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk/3303/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3.81 KB...] POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 10240 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 6 /home/jenkins/tools/ant/latest/bin/ant clean Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) mv: cannot stat 'build/*.tar.gz': No such file or directory mv: cannot stat 'build/*.jar': No such file or directory mv: cannot stat 'build/test/findbugs': No such file or directory mv: cannot stat 'build/docs/api': No such file or directory Build Failed Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE [WARNINGS] Skipping publisher since build result is FAILURE Archiving artifacts Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Recording fingerprints Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Recording test results Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Publishing Javadoc Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper_branch34_jdk8 - Build # 909 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_jdk8/909/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 25.87 MB...] [junit] 2017-03-07 22:59:53,115 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-03-07 22:59:53,115 [myid:] - INFO [main:PrepRequestProcessor@764] - Shutting down [junit] 2017-03-07 22:59:53,115 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-03-07 22:59:53,115 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-03-07 22:59:53,116 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-03-07 22:59:53,116 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-03-07 22:59:53,117 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-07 22:59:53,117 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-03-07 22:59:53,119 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-03-07 22:59:53,119 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-03-07 22:59:53,120 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-03-07 22:59:53,120 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-03-07 22:59:53,120 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test3053654057106017847.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test3053654057106017847.junit.dir/version-2 [junit] 2017-03-07 22:59:53,124 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 22:59:53,124 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-07 22:59:53,124 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52054 [junit] 2017-03-07 22:59:53,124 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@883] - Processing stat command from /127.0.0.1:52054 [junit] 2017-03-07 22:59:53,125 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-03-07 22:59:53,125 [myid:] - INFO [Thread-4:NIOServerCnxn@1044] - Closed socket connection for client /127.0.0.1:52054 (no session established for client) [junit] 2017-03-07 22:59:53,125 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-03-07 22:59:53,127 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-03-07 22:59:53,127 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-03-07 22:59:53,127 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-03-07 22:59:53,127 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-03-07 22:59:53,128 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 35519 [junit] 2017-03-07 22:59:53,128 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-03-07 22:59:53,128 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-03-07 22:59:53,128 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-03-07 22:59:53,200 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15aab0011f8 closed [junit] 2017-03-07 22:59:53,200 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-03-07 22:59:53,200 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15aab0011f8 [junit] 2017-03-07 22:59:53,201 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-03-07 22:59:53,201 [myid:] - INFO [main:ZooKeeperServer@505] - shutting down [junit] 2017-03-07 22:59:53,201 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 22:59:53,202
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900267#comment-15900267 ] ASF GitHub Bot commented on ZOOKEEPER-2711: --- Github user joshelser commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/186#discussion_r104792592 --- Diff: src/java/main/org/apache/zookeeper/server/NettyServerCnxnFactory.java --- @@ -162,7 +162,7 @@ public void messageReceived(ChannelHandlerContext ctx, MessageEvent e) + " from " + ctx.getChannel()); } NettyServerCnxn cnxn = (NettyServerCnxn)ctx.getAttachment(); -synchronized(cnxn) { +synchronized(cnxn.getRpcLock()) { processMessage(e, cnxn); --- End diff -- > Now one thread can be in processMessage while another thread is getting stats about the connection. Is that ok? I believe this is OK. We can receive two concurrent `stat` commands, but we only process one of them at a time. I'm also not a Netty wizard, so I could be wildly wrong :) > Basically I am wondering if there is any other code out there that should now sync on what getRpcLock() returns. That's a good point. I had looked to see that there were multiple other methods in `ServerCnxn` which were also synchronized (thus, changing `dumpConnectionInfo(..)` wouldn't have been sufficient). I didn't look to see if there's another code-path which is also synchronizing on the `NettyServerCnxn` (or `ServerCnxn`). > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at >
[GitHub] zookeeper pull request #186: ZOOKEEPER-2711 Avoid synchronization on NettySe...
Github user joshelser commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/186#discussion_r104792592 --- Diff: src/java/main/org/apache/zookeeper/server/NettyServerCnxnFactory.java --- @@ -162,7 +162,7 @@ public void messageReceived(ChannelHandlerContext ctx, MessageEvent e) + " from " + ctx.getChannel()); } NettyServerCnxn cnxn = (NettyServerCnxn)ctx.getAttachment(); -synchronized(cnxn) { +synchronized(cnxn.getRpcLock()) { processMessage(e, cnxn); --- End diff -- > Now one thread can be in processMessage while another thread is getting stats about the connection. Is that ok? I believe this is OK. We can receive two concurrent `stat` commands, but we only process one of them at a time. I'm also not a Netty wizard, so I could be wildly wrong :) > Basically I am wondering if there is any other code out there that should now sync on what getRpcLock() returns. That's a good point. I had looked to see that there were multiple other methods in `ServerCnxn` which were also synchronized (thus, changing `dumpConnectionInfo(..)` wouldn't have been sufficient). I didn't look to see if there's another code-path which is also synchronizing on the `NettyServerCnxn` (or `ServerCnxn`). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900254#comment-15900254 ] ASF GitHub Bot commented on ZOOKEEPER-2711: --- Github user keith-turner commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/186#discussion_r104790720 --- Diff: src/java/main/org/apache/zookeeper/server/NettyServerCnxnFactory.java --- @@ -162,7 +162,7 @@ public void messageReceived(ChannelHandlerContext ctx, MessageEvent e) + " from " + ctx.getChannel()); } NettyServerCnxn cnxn = (NettyServerCnxn)ctx.getAttachment(); -synchronized(cnxn) { +synchronized(cnxn.getRpcLock()) { processMessage(e, cnxn); --- End diff -- Now one thread can be in processMessage while another thread is getting stats about the connection. Is that ok? Do you know if anything else besides ServerCnxn is synchronizing on its monitor? Basically I am wondering if there is any other code out there that should now sync on what getRpcLock() returns. > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "New I/O worker #51": > at >
[GitHub] zookeeper pull request #186: ZOOKEEPER-2711 Avoid synchronization on NettySe...
Github user keith-turner commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/186#discussion_r104790720 --- Diff: src/java/main/org/apache/zookeeper/server/NettyServerCnxnFactory.java --- @@ -162,7 +162,7 @@ public void messageReceived(ChannelHandlerContext ctx, MessageEvent e) + " from " + ctx.getChannel()); } NettyServerCnxn cnxn = (NettyServerCnxn)ctx.getAttachment(); -synchronized(cnxn) { +synchronized(cnxn.getRpcLock()) { processMessage(e, cnxn); --- End diff -- Now one thread can be in processMessage while another thread is getting stats about the connection. Is that ok? Do you know if anything else besides ServerCnxn is synchronizing on its monitor? Basically I am wondering if there is any other code out there that should now sync on what getRpcLock() returns. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Failed: ZOOKEEPER- PreCommit Build #388
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 60.28 MB...] [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs (version 3.0.1) warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] [exec] -1 core tests. The patch failed core unit tests. [exec] [exec] +1 contrib tests. The patch passed contrib unit tests. [exec] [exec] Test results: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388//testReport/ [exec] Findbugs warnings: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html [exec] Console output: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388//console [exec] [exec] This message is automatically generated. [exec] [exec] [exec] == [exec] == [exec] Adding comment to Jira. [exec] == [exec] == [exec] [exec] [exec] Comment added. [exec] e1d4382b9ed57e89e28f88fa4e7da5a1e89ff026 logged out [exec] [exec] [exec] == [exec] == [exec] Finished build. [exec] == [exec] == [exec] [exec] [exec] mv: ‘/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess’ and ‘/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess’ are the same file BUILD FAILED /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1635: exec returned: 1 Total time: 17 minutes 54 seconds Build step 'Execute shell' marked build as failure Archiving artifacts Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Compressed 576.05 KB of artifacts by 38.9% relative to #375 Recording test results Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 [description-setter] Description set: ZOOKEEPER-2711 Putting comment on the pull request Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 ### ## FAILED TESTS (if any) ## 6 tests failed. FAILED: org.apache.zookeeper.server.quorum.ReconfigBackupTest.testVersionOfDynamicFilename Error Message: waiting for server 0 being up Stack Trace: junit.framework.AssertionFailedError: waiting for server 0 being up at org.apache.zookeeper.server.quorum.ReconfigBackupTest.testVersionOfDynamicFilename(ReconfigBackupTest.java:320) at org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79) FAILED: org.apache.zookeeper.test.FourLetterWordsTest.testSetTraceMask Error Message: Exception while executing four letter word: stmk2 Stack Trace: java.io.IOException: Exception while executing four letter word: stmk2 at org.apache.zookeeper.client.FourLetterWordMain.send4LetterWord(FourLetterWordMain.java:124) at org.apache.zookeeper.client.FourLetterWordMain.send4LetterWord(FourLetterWordMain.java:54) at org.apache.zookeeper.test.FourLetterWordsTest.sendRequest(FourLetterWordsTest.java:120) at org.apache.zookeeper.test.FourLetterWordsTest.testSetTraceMask(FourLetterWordsTest.java:219) at org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.lang.Thread.run(Thread.java:745) Caused by:
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900203#comment-15900203 ] Hadoop QA commented on ZOOKEEPER-2711: -- -1 overall. GitHub Pull Request Build +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 3.0.1) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/388//console This message is automatically generated. > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "New I/O worker #51": >
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900172#comment-15900172 ] ASF GitHub Bot commented on ZOOKEEPER-2711: --- Github user joshelser commented on the issue: https://github.com/apache/zookeeper/pull/186 I need to see if I can come up with a unit test to catch this case, but I'm not sure how useful one would be (I think anything I come up with would be a bit contrived..) I was able to test this locally by running 7 iterations of: ```bash while true; do echo stat | nc localhost 2181 >/dev/null 2>&1; echo -n .; sleep 1; done ``` while generating some extra load (heavy java tests from another ASF project, *winks*) on my local machine. This ran for ~10minutes without error. > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "New I/O worker #51": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at >
[GitHub] zookeeper issue #186: ZOOKEEPER-2711 Avoid synchronization on NettyServerCnx...
Github user joshelser commented on the issue: https://github.com/apache/zookeeper/pull/186 I need to see if I can come up with a unit test to catch this case, but I'm not sure how useful one would be (I think anything I come up with would be a bit contrived..) I was able to test this locally by running 7 iterations of: ```bash while true; do echo stat | nc localhost 2181 >/dev/null 2>&1; echo -n .; sleep 1; done ``` while generating some extra load (heavy java tests from another ASF project, *winks*) on my local machine. This ran for ~10minutes without error. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900170#comment-15900170 ] ASF GitHub Bot commented on ZOOKEEPER-2711: --- GitHub user joshelser opened a pull request: https://github.com/apache/zookeeper/pull/186 ZOOKEEPER-2711 Avoid synchronization on NettyServerCnxn in Factory NettyServerCnxnFactory previously synchronized on the (Netty)ServerCnxn object to provide mutual exclusion at the RPC layer. However, this was at odds with the synchronized methods in ServerCnxn (which shared the same monitor). As such, it was possible to deadlock between concurrent 4LW commands that were invoking one of these synchronized methods on ServerCnxn. You can merge this pull request into a Git repository by running: $ git pull https://github.com/joshelser/zookeeper 2711-4lw Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zookeeper/pull/186.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #186 commit 9953e32963e6167f88b97519233b0872cce69a71 Author: Josh ElserDate: 2017-03-07T21:03:57Z ZOOKEEPER-2711 Avoid synchronization on NettyServerCnxn in Factory NettyServerCnxnFactory previously synchronized on the (Netty)ServerCnxn object to provide mutual exclusion at the RPC layer. However, this was at odds with the synchronized methods in ServerCnxn (which shared the same monitor). As such, it was possible to deadlock between concurrent 4LW commands that were invoking one of these synchronized methods on ServerCnxn. > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at
[GitHub] zookeeper pull request #186: ZOOKEEPER-2711 Avoid synchronization on NettySe...
GitHub user joshelser opened a pull request: https://github.com/apache/zookeeper/pull/186 ZOOKEEPER-2711 Avoid synchronization on NettyServerCnxn in Factory NettyServerCnxnFactory previously synchronized on the (Netty)ServerCnxn object to provide mutual exclusion at the RPC layer. However, this was at odds with the synchronized methods in ServerCnxn (which shared the same monitor). As such, it was possible to deadlock between concurrent 4LW commands that were invoking one of these synchronized methods on ServerCnxn. You can merge this pull request into a Git repository by running: $ git pull https://github.com/joshelser/zookeeper 2711-4lw Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zookeeper/pull/186.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #186 commit 9953e32963e6167f88b97519233b0872cce69a71 Author: Josh ElserDate: 2017-03-07T21:03:57Z ZOOKEEPER-2711 Avoid synchronization on NettyServerCnxn in Factory NettyServerCnxnFactory previously synchronized on the (Netty)ServerCnxn object to provide mutual exclusion at the RPC layer. However, this was at odds with the synchronized methods in ServerCnxn (which shared the same monitor). As such, it was possible to deadlock between concurrent 4LW commands that were invoking one of these synchronized methods on ServerCnxn. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900100#comment-15900100 ] ASF GitHub Bot commented on ZOOKEEPER-2709: --- Github user afine commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104765953 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -841,9 +841,9 @@ itself, ZooKeeper associates all the ids that correspond to a client with the clients connection. These ids are checked against the ACLs of znodes when a clients tries to access a node. ACLs are -made up of pairs of (scheme:expression, +made up of pairs of (scheme:id, --- End diff -- I'm not sure if this is the best way to clarify here. As demonstrated below with the ip address example, the second field can be an "expression" that matches against ids. Although in the code we occasionally refer to the second term as an "id" (`ap.matches(authId.getId(), id.getId())` in `PrepRequestProcessor`) we do also refer to it as an "expression" in other places (`boolean matches(String id, String aclExpr)` in `AuthenticationProvider`). I think continuing to refer to the second term as an "expression" and explaining exactly what an "expression" is may be clearer. > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper pull request #182: ZOOKEEPER-2709 Clarify documentation around the...
Github user afine commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104765953 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -841,9 +841,9 @@ itself, ZooKeeper associates all the ids that correspond to a client with the clients connection. These ids are checked against the ACLs of znodes when a clients tries to access a node. ACLs are -made up of pairs of (scheme:expression, +made up of pairs of (scheme:id, --- End diff -- I'm not sure if this is the best way to clarify here. As demonstrated below with the ip address example, the second field can be an "expression" that matches against ids. Although in the code we occasionally refer to the second term as an "id" (`ap.matches(authId.getId(), id.getId())` in `PrepRequestProcessor`) we do also refer to it as an "expression" in other places (`boolean matches(String id, String aclExpr)` in `AuthenticationProvider`). I think continuing to refer to the second term as an "expression" and explaining exactly what an "expression" is may be clearer. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zookeeper pull request #182: ZOOKEEPER-2709 Clarify documentation around the...
Github user afine commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104766400 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -899,9 +899,16 @@ single id, anyone, that represents anyone. -auth doesn't -use any id, represents any authenticated -user. +auth is a special +scheme which ignores any provided ID and instead uses the current user, +credentials, and scheme. Any ID (whether, 'user' like with SASL --- End diff -- not sure the comma after whether is needed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900101#comment-15900101 ] ASF GitHub Bot commented on ZOOKEEPER-2709: --- Github user afine commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104766400 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -899,9 +899,16 @@ single id, anyone, that represents anyone. -auth doesn't -use any id, represents any authenticated -user. +auth is a special +scheme which ignores any provided ID and instead uses the current user, +credentials, and scheme. Any ID (whether, 'user' like with SASL --- End diff -- not sure the comma after whether is needed > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900099#comment-15900099 ] ASF GitHub Bot commented on ZOOKEEPER-2709: --- Github user afine commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104770508 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -899,9 +899,16 @@ single id, anyone, that represents anyone. -auth doesn't -use any id, represents any authenticated -user. +auth is a special +scheme which ignores any provided ID and instead uses the current user, +credentials, and scheme. Any ID (whether, 'user' like with SASL +authentication or 'user:password' like with DIGEST authentication) provided is ignored +by the ZooKeeper server when persisting the ACL. However, the ID must be +provided in the ACL because the ACL must match the form 'scheme:id:perms'. +This scheme is provided as a convenience as it is a common use-case for +a client to create a znode and then restrict access to that znode to only that client. --- End diff -- perhaps "only that user" would be clearer? > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900072#comment-15900072 ] Josh Elser commented on ZOOKEEPER-2711: --- Was able to repro this locally with multiple instances of the following one-liner: {noformat} while true; do echo stat | nc localhost 2181 >/dev/null 2>&1; echo -n .; sleep 3; done {noformat} > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "New I/O worker #51": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at >
ZooKeeper-trunk-openjdk7 - Build # 1389 - Failure
See https://builds.apache.org/job/ZooKeeper-trunk-openjdk7/1389/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 57.99 MB...] [junit] at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:265) [junit] at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:474) [junit] at org.jboss.netty.channel.socket.nio.SocketSendBufferPool$UnpooledSendBuffer.transferTo(SocketSendBufferPool.java:203) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.write0(AbstractNioWorker.java:201) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.writeFromTaskLoop(AbstractNioWorker.java:151) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioChannel$WriteTask.run(AbstractNioChannel.java:315) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [junit] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2017-03-07 20:05:31,964 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19547,name1=Connections,name2=127.0.0.1,name3=0x102d5576c93] [junit] 2017-03-07 20:05:32,064 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x102d5576c93 closed [junit] 2017-03-07 20:05:32,065 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 242154 [junit] 2017-03-07 20:05:32,065 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 2427 [junit] 2017-03-07 20:05:32,065 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2017-03-07 20:05:32,065 [myid:] - INFO [main:ClientBase@558] - tearDown starting [junit] 2017-03-07 20:05:32,065 [myid:] - INFO [main:ClientBase@528] - STOPPING server [junit] 2017-03-07 20:05:32,066 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:19547 [junit] 2017-03-07 20:05:32,066 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x102d5576c93 [junit] 2017-03-07 20:05:32,069 [myid:] - INFO [main:ZooKeeperServer@542] - shutting down [junit] 2017-03-07 20:05:32,070 [myid:] - ERROR [main:ZooKeeperServer@506] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 20:05:32,070 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2017-03-07 20:05:32,070 [myid:] - INFO [main:PrepRequestProcessor@1008] - Shutting down [junit] 2017-03-07 20:05:32,070 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-03-07 20:05:32,070 [myid:] - INFO [ProcessThread(sid:0 cport:19547)::PrepRequestProcessor@157] - PrepRequestProcessor exited loop! [junit] 2017-03-07 20:05:32,070 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-03-07 20:05:32,073 [myid:] - INFO [main:FinalRequestProcessor@481] - shutdown of request processor complete [junit] 2017-03-07 20:05:32,073 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19547,name1=InMemoryDataTree] [junit] 2017-03-07 20:05:32,074 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port19547] [junit] 2017-03-07 20:05:32,074 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 19547 [junit] 2017-03-07 20:05:32,075 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2017-03-07 20:05:32,084 [myid:] - INFO [main:ClientBase@583] - fdcount after test is: 7146 at start it was 7146 [junit] 2017-03-07 20:05:32,085 [myid:] - INFO [main:ZKTestCase$1@68] - SUCCEEDED testWatcherAutoResetWithLocal [junit] 2017-03-07 20:05:32,085 [myid:] - INFO [main:ZKTestCase$1@63] - FINISHED testWatcherAutoResetWithLocal [junit] Tests run: 103, Failures: 0, Errors: 0, Skipped: 0, Time
Failed: ZOOKEEPER- PreCommit Build #387
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 61.80 MB...] [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs (version 3.0.1) warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] [exec] -1 core tests. The patch failed core unit tests. [exec] [exec] +1 contrib tests. The patch passed contrib unit tests. [exec] [exec] Test results: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387//testReport/ [exec] Findbugs warnings: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html [exec] Console output: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387//console [exec] [exec] This message is automatically generated. [exec] [exec] [exec] == [exec] == [exec] Adding comment to Jira. [exec] == [exec] == [exec] [exec] [exec] Comment added. [exec] f2804e72f7367ee461deb3cf953c8e95883d1b3b logged out [exec] [exec] [exec] == [exec] == [exec] Finished build. [exec] == [exec] == [exec] [exec] [exec] mv: '/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess' and '/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess' are the same file BUILD FAILED /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1635: exec returned: 1 Total time: 19 minutes 53 seconds Build step 'Execute shell' marked build as failure Archiving artifacts Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Compressed 576.06 KB of artifacts by 38.9% relative to #375 Recording test results Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 [description-setter] Description set: ZOOKEEPER-2709 Putting comment on the pull request Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 ### ## FAILED TESTS (if any) ## 2 tests failed. FAILED: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff Error Message: expected:<4294967298> but was:<4294967297> Stack Trace: junit.framework.AssertionFailedError: expected:<4294967298> but was:<4294967297> at org.apache.zookeeper.server.quorum.Zab1_0Test$5.converseWithFollower(Zab1_0Test.java:869) at org.apache.zookeeper.server.quorum.Zab1_0Test.testFollowerConversation(Zab1_0Test.java:517) at org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff(Zab1_0Test.java:784) at org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79) FAILED: org.apache.zookeeper.test.AsyncHammerTest.testHammer Error Message: waiting for server up Stack Trace: junit.framework.AssertionFailedError: waiting for server up at org.apache.zookeeper.test.QuorumBase.startServers(QuorumBase.java:223) at org.apache.zookeeper.test.QuorumBase.setUp(QuorumBase.java:120) at org.apache.zookeeper.test.AsyncHammerTest.setUp(AsyncHammerTest.java:52) at org.apache.zookeeper.test.AsyncHammerTest.testHammer(AsyncHammerTest.java:171) at org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900019#comment-15900019 ] Hadoop QA commented on ZOOKEEPER-2709: -- -1 overall. GitHub Pull Request Build +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 3.0.1) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/387//console This message is automatically generated. > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
ZooKeeper_branch34_jdk8 - Build # 908 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_jdk8/908/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 25.20 MB...] [junit] 2017-03-07 19:27:10,635 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-03-07 19:27:10,636 [myid:] - INFO [main:PrepRequestProcessor@764] - Shutting down [junit] 2017-03-07 19:27:10,636 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-03-07 19:27:10,636 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-03-07 19:27:10,636 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-03-07 19:27:10,636 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-03-07 19:27:10,637 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-07 19:27:10,637 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-03-07 19:27:10,639 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-03-07 19:27:10,639 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-03-07 19:27:10,640 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-03-07 19:27:10,640 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-03-07 19:27:10,640 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test6573854380439248869.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk8/build/test/tmp/test6573854380439248869.junit.dir/version-2 [junit] 2017-03-07 19:27:10,643 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 19:27:10,644 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-07 19:27:10,644 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:35115 [junit] 2017-03-07 19:27:10,645 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@883] - Processing stat command from /127.0.0.1:35115 [junit] 2017-03-07 19:27:10,645 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-03-07 19:27:10,645 [myid:] - INFO [Thread-4:NIOServerCnxn@1044] - Closed socket connection for client /127.0.0.1:35115 (no session established for client) [junit] 2017-03-07 19:27:10,646 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-03-07 19:27:10,648 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-03-07 19:27:10,648 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-03-07 19:27:10,648 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-03-07 19:27:10,648 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-03-07 19:27:10,649 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 35517 [junit] 2017-03-07 19:27:10,649 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-03-07 19:27:10,649 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-03-07 19:27:10,649 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-03-07 19:27:10,720 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15aaa3d5438 closed [junit] 2017-03-07 19:27:10,720 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-03-07 19:27:10,720 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15aaa3d5438 [junit] 2017-03-07 19:27:10,720 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-03-07 19:27:10,721 [myid:] - INFO [main:ZooKeeperServer@505] - shutting down [junit] 2017-03-07 19:27:10,721 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 19:27:10,721
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899972#comment-15899972 ] ASF GitHub Bot commented on ZOOKEEPER-2709: --- Github user joshelser commented on the issue: https://github.com/apache/zookeeper/pull/182 LMK what you think of the re-wording in 057cb18, @hanm. Tried to clarify things. > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper issue #182: ZOOKEEPER-2709 Clarify documentation around the "auth"...
Github user joshelser commented on the issue: https://github.com/apache/zookeeper/pull/182 LMK what you think of the re-wording in 057cb18, @hanm. Tried to clarify things. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
ZooKeeper_branch34_jdk7 - Build # 1431 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1431/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 25.06 MB...] [junit] 2017-03-07 18:46:23,084 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2017-03-07 18:46:23,084 [myid:] - INFO [main:PrepRequestProcessor@764] - Shutting down [junit] 2017-03-07 18:46:23,084 [myid:] - INFO [main:SyncRequestProcessor@208] - Shutting down [junit] 2017-03-07 18:46:23,085 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2017-03-07 18:46:23,085 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@186] - SyncRequestProcessor exited! [junit] 2017-03-07 18:46:23,085 [myid:] - INFO [main:FinalRequestProcessor@402] - shutdown of request processor complete [junit] 2017-03-07 18:46:23,086 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-07 18:46:23,086 [myid:] - INFO [main:JMXEnv@147] - ensureOnly:[] [junit] 2017-03-07 18:46:23,087 [myid:] - INFO [main:ClientBase@445] - STARTING server [junit] 2017-03-07 18:46:23,088 [myid:] - INFO [main:ClientBase@366] - CREATING server instance 127.0.0.1:11221 [junit] 2017-03-07 18:46:23,088 [myid:] - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2017-03-07 18:46:23,088 [myid:] - INFO [main:ClientBase@341] - STARTING server instance 127.0.0.1:11221 [junit] 2017-03-07 18:46:23,088 [myid:] - INFO [main:ZooKeeperServer@173] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test2820934263453266810.junit.dir/version-2 snapdir /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_jdk7/build/test/tmp/test2820934263453266810.junit.dir/version-2 [junit] 2017-03-07 18:46:23,092 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 18:46:23,092 [myid:] - INFO [main:FourLetterWordMain@62] - connecting to 127.0.0.1 11221 [junit] 2017-03-07 18:46:23,093 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:53931 [junit] 2017-03-07 18:46:23,093 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@883] - Processing stat command from /127.0.0.1:53931 [junit] 2017-03-07 18:46:23,094 [myid:] - INFO [Thread-4:NIOServerCnxn$StatCommand@674] - Stat command output [junit] 2017-03-07 18:46:23,094 [myid:] - INFO [Thread-4:NIOServerCnxn@1044] - Closed socket connection for client /127.0.0.1:53931 (no session established for client) [junit] 2017-03-07 18:46:23,094 [myid:] - INFO [main:JMXEnv@230] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2017-03-07 18:46:23,096 [myid:] - INFO [main:JMXEnv@247] - expect:InMemoryDataTree [junit] 2017-03-07 18:46:23,096 [myid:] - INFO [main:JMXEnv@251] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2017-03-07 18:46:23,096 [myid:] - INFO [main:JMXEnv@247] - expect:StandaloneServer_port [junit] 2017-03-07 18:46:23,097 [myid:] - INFO [main:JMXEnv@251] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2017-03-07 18:46:23,097 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 35676 [junit] 2017-03-07 18:46:23,097 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2017-03-07 18:46:23,097 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2017-03-07 18:46:23,097 [myid:] - INFO [main:ClientBase@522] - tearDown starting [junit] 2017-03-07 18:46:23,169 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x15aaa17fbce closed [junit] 2017-03-07 18:46:23,170 [myid:] - INFO [main:ClientBase@492] - STOPPING server [junit] 2017-03-07 18:46:23,170 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x15aaa17fbce [junit] 2017-03-07 18:46:23,170 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@219] - NIOServerCnxn factory exited run method [junit] 2017-03-07 18:46:23,171 [myid:] - INFO [main:ZooKeeperServer@505] - shutting down [junit] 2017-03-07 18:46:23,171 [myid:] - ERROR [main:ZooKeeperServer@472] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 18:46:23,171
[jira] [Commented] (ZOOKEEPER-2709) Clarify documentation around "auth" ACL scheme
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899910#comment-15899910 ] ASF GitHub Bot commented on ZOOKEEPER-2709: --- Github user joshelser commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104744229 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -899,9 +899,12 @@ single id, anyone, that represents anyone. -auth doesn't -use any id, represents any authenticated -user. +auth is a convenience +scheme which defaults to the currently-authenticated user and scheme. +Any ID which is provided using this scheme is ignored by ZooKeeper. --- End diff -- Thanks for taking a look, @hanm! > I think the ID here refers to the id of the scheme:id pair of the ID object in the ACL, correct? Yup, that's what I was intending. Perhaps I should try to clarify that better :) > the auth scheme is also referenced in command line where people can do 'setAcl /node auth:username:password:crdwa' in which case the username (sometimes overloaded as id) is required. OK, that's a good point which I didn't realize. I would have expected that `auth:username:password:crdwa` would have resulted in ignoring `username:password`. Let me play with that to better understand it.. > Clarify documentation around "auth" ACL scheme > -- > > Key: ZOOKEEPER-2709 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2709 > Project: ZooKeeper > Issue Type: Task > Components: documentation >Reporter: Josh Elser >Priority: Minor > > We recently found up in HBASE-17717 that we were incorrectly setting an ACL > on our "sensitive" znodes after the output of {{getACL}} on these nodes > didn't match what was expected. > In referencing the documentation about how the {{auth}} ACL scheme was > supposed to work, it was unclear if it was a ZooKeeper bug or an HBase bug. > After reading some ZooKeeper code, we found that it was an HBase bug, but it > would be nice to clarify the docs around this ACL scheme. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zookeeper pull request #182: ZOOKEEPER-2709 Clarify documentation around the...
Github user joshelser commented on a diff in the pull request: https://github.com/apache/zookeeper/pull/182#discussion_r104744229 --- Diff: src/docs/src/documentation/content/xdocs/zookeeperProgrammers.xml --- @@ -899,9 +899,12 @@ single id, anyone, that represents anyone. -auth doesn't -use any id, represents any authenticated -user. +auth is a convenience +scheme which defaults to the currently-authenticated user and scheme. +Any ID which is provided using this scheme is ignored by ZooKeeper. --- End diff -- Thanks for taking a look, @hanm! > I think the ID here refers to the id of the scheme:id pair of the ID object in the ACL, correct? Yup, that's what I was intending. Perhaps I should try to clarify that better :) > the auth scheme is also referenced in command line where people can do 'setAcl /node auth:username:password:crdwa' in which case the username (sometimes overloaded as id) is required. OK, that's a good point which I didn't realize. I would have expected that `auth:username:password:crdwa` would have resulted in ignoring `username:password`. Let me play with that to better understand it.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899888#comment-15899888 ] Josh Elser commented on ZOOKEEPER-2711: --- A few more clarifications: * I observed this from concurrent {{stat}} commands, but I believe the same could happen with an intermingling of {{stat}} and {{cons}} commands. * This appears to only affect the Netty server. I didn't see a similar execution path on the NIO side which would have the same bug. > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "New I/O worker #51": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at >
[jira] [Commented] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899884#comment-15899884 ] Josh Elser commented on ZOOKEEPER-2711: --- Let me put together a patch for what I'm thinking (which is, admittedly, based on my assumptions for why the synchronization works as it does -- not based on truth :)) > Deadlock between concurrent 4LW commands that iterate over connections with > Netty server > > > Key: ZOOKEEPER-2711 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 > Project: ZooKeeper > Issue Type: Bug >Reporter: Josh Elser >Priority: Critical > > Observed the following issue in some $dayjob testing environments. Line > numbers are a little off compared to master/branch-3.5, but I did confirm the > same issue exists there. > With the NettyServerCnxnFactory, before a request is dispatched, the code > synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW > commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to > (safely) iterate over the internal contents of the object to generate the > necessary debug message. As such, multiple concurrent {{stat}} commands can > both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting > to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. > {noformat} > "New I/O worker #55": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfabc01b8> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) > - locked <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) > at > org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) > at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "New I/O worker #51": > at > org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) > - waiting to lock <0xfab68178> (a > org.apache.zookeeper.server.NettyServerCnxn) > at > org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) > at > org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) > at > org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) > at > org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) > at > org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) > at >
[jira] [Created] (ZOOKEEPER-2711) Deadlock between concurrent 4LW commands that iterate over connections with Netty server
Josh Elser created ZOOKEEPER-2711: - Summary: Deadlock between concurrent 4LW commands that iterate over connections with Netty server Key: ZOOKEEPER-2711 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2711 Project: ZooKeeper Issue Type: Bug Reporter: Josh Elser Priority: Critical Observed the following issue in some $dayjob testing environments. Line numbers are a little off compared to master/branch-3.5, but I did confirm the same issue exists there. With the NettyServerCnxnFactory, before a request is dispatched, the code synchronizes on the {{NettyServerCnxn}} object. However, with some 4LW commands (like {{stat}}), each {{ServerCnxn}} object is also synchronized to (safely) iterate over the internal contents of the object to generate the necessary debug message. As such, multiple concurrent {{stat}} commands can both lock their own {{NettyServerCnxn}} objects, and then be blocked waiting to lock each others' {{ServerCnxn}} in the {{StatCommand}}, deadlocked. {noformat} "New I/O worker #55": at org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) - waiting to lock <0xfabc01b8> (a org.apache.zookeeper.server.NettyServerCnxn) at org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) at org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) at org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) at org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) at org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) at org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) at org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) - locked <0xfab68178> (a org.apache.zookeeper.server.NettyServerCnxn) at org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) "New I/O worker #51": at org.apache.zookeeper.server.ServerCnxn.dumpConnectionInfo(ServerCnxn.java:407) - waiting to lock <0xfab68178> (a org.apache.zookeeper.server.NettyServerCnxn) at org.apache.zookeeper.server.NettyServerCnxn$StatCommand.commandRun(NettyServerCnxn.java:478) at org.apache.zookeeper.server.NettyServerCnxn$CommandThread.run(NettyServerCnxn.java:311) at org.apache.zookeeper.server.NettyServerCnxn$CommandThread.start(NettyServerCnxn.java:306) at org.apache.zookeeper.server.NettyServerCnxn.checkFourLetterWord(NettyServerCnxn.java:677) at org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:790) at org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.processMessage(NettyServerCnxnFactory.java:211) at org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.messageReceived(NettyServerCnxnFactory.java:135) - locked <0xfabc01b8> (a org.apache.zookeeper.server.NettyServerCnxn) at org.jboss.netty.channel.SimpleChannelHandler.handleUpstream(SimpleChannelHandler.java:88) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at
ZooKeeper_branch34 - Build # 1860 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34/1860/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3.19 KB...] collisions:0 txqueuelen:0 RX bytes:6542345028440 (6.5 TB) TX bytes:6542345028440 (6.5 TB) core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 386177 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 6 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 10240 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 6 /home/jenkins/tools/ant/latest/bin/ant clean Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) mv: cannot stat ‘build/*.tar.gz’: No such file or directory mv: cannot stat ‘build/*.jar’: No such file or directory mv: cannot stat ‘build/test/findbugs’: No such file or directory mv: cannot stat ‘build/docs/api’: No such file or directory Build Failed Build step 'Execute shell' marked build as failure Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper_branch34_openjdk7 - Build # 1417 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1417/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H22 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.4^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.4^{commit} # timeout=10 Checking out Revision 09555983be93e5278b1ab8a71e3ca9f54ea6c374 (refs/remotes/origin/branch-3.4) > git config core.sparsecheckout # timeout=10 > git checkout -f 09555983be93e5278b1ab8a71e3ca9f54ea6c374 > git rev-list 835377f0e1cd215e791ed29c0bcff95e625f299c # timeout=10 No emails were triggered. [ZooKeeper_branch34_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Error: JAVA_HOME is not defined correctly. We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
Failed: ZOOKEEPER- PreCommit Build #385
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/385/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 75.49 KB...] warning: Cannot merge binary files: docs/zookeeperAdmin.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/recipes.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/linkmap.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/javaExample.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/index.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/bookkeeperStream.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/bookkeeperStarted.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/bookkeeperProgrammer.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/bookkeeperOverview.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) warning: Cannot merge binary files: docs/bookkeeperConfig.pdf (HEAD vs. 09555983be93e5278b1ab8a71e3ca9f54ea6c374) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1757) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1753) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1409) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$3.execute(CliGitAPIImpl.java:588) at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.merge(AbstractGitAPIImpl.java:86) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.merge(CliGitAPIImpl.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:894) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:869) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:828) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ..remote call to H6(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:256) at com.sun.proxy.$Proxy95.merge(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.merge(RemoteGitImpl.java:434) at com.cloudbees.jenkins.plugins.git.vmerge.BuildChooserImpl.getCandidateRevisions(BuildChooserImpl.java:107) at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:995) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1098) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Archiving artifacts Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? [description-setter] Could not determine description. Putting comment on the pull request Email was triggered for: Failure - Any Sending email
[jira] [Resolved] (ZOOKEEPER-2710) Regenerate documentation for branch-3.4 release
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R resolved ZOOKEEPER-2710. - Resolution: Fixed Fix Version/s: 3.4.10 Regenerated ZooKeeper documentation and committed to {{branch-3.4}} Branch 3.4: https://git-wip-us.apache.org/repos/asf?p=zookeeper.git;a=commit;h=09555983be93e5278b1ab8a71e3ca9f54ea6c374 > Regenerate documentation for branch-3.4 release > --- > > Key: ZOOKEEPER-2710 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2710 > Project: ZooKeeper > Issue Type: Bug > Components: documentation >Affects Versions: 3.4.10 >Reporter: Rakesh R >Assignee: Rakesh R > Fix For: 3.4.10 > > > This jira can be used to regenerate the documentation as some of the recent > commits didn't regenerated the doc section. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (ZOOKEEPER-2710) Regenerate documentation for branch-3.4 release
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated ZOOKEEPER-2710: Component/s: documentation > Regenerate documentation for branch-3.4 release > --- > > Key: ZOOKEEPER-2710 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2710 > Project: ZooKeeper > Issue Type: Bug > Components: documentation >Affects Versions: 3.4.10 >Reporter: Rakesh R >Assignee: Rakesh R > Fix For: 3.4.10 > > > This jira can be used to regenerate the documentation as some of the recent > commits didn't regenerated the doc section. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZOOKEEPER-2710) Regenerate documentation for branch-3.4 release
Rakesh R created ZOOKEEPER-2710: --- Summary: Regenerate documentation for branch-3.4 release Key: ZOOKEEPER-2710 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2710 Project: ZooKeeper Issue Type: Bug Affects Versions: 3.4.10 Reporter: Rakesh R Assignee: Rakesh R This jira can be used to regenerate the documentation as some of the recent commits didn't regenerated the doc section. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ZOOKEEPER-236) SSL Support for Atomic Broadcast protocol
[ https://issues.apache.org/jira/browse/ZOOKEEPER-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899664#comment-15899664 ] Powell Molleti commented on ZOOKEEPER-236: -- Hi Abe, I am more then happy to combine efforts and collaborate. I think the significant amount of work is testing which is what I am attempting to get it right in the Trunk patch which also has Netty support when compared to work on branch-3.5 (this patch). This patch has support for configuration of for Truststore. Hence if the admin provides a cert chain that contains the CA(s) or for that matter if the Truststore contains all the self signed certs it should also work. I did not do extensive testing for this in this branch (I did this for branch-3.4, hence I think it should work). Let me point you to the code and let me know if this can work or is what you are expecting: createSSLContext() calls always chain Trustmanagers via X509ChainedTrustManager class with Truststore manager first i.e ZKX509TrustManager class and dynamic trust verification via ZKPeerX509TrustManager class. Client side SSL socket creation: https://github.com/apache/zookeeper/pull/185/files#diff-74d86ae5e83698ad62aada32dcbe615eR53 Quorum server side SSL socket creation: https://github.com/apache/zookeeper/pull/185/files#diff-eb0052bc7ed160b8dee226f2ed1bdad2R51 I do think we need consensus here if there is need or want to support dynamic reconfiguration with SSL in a fault-tolerant way. By which I mean, if I understand correctly, both the operations of managing the certs (add/remove of certs) and reconfig() API to change members of a quorum have to be fault-tolerant. reconfig() is atomic hence no issue there. But then that leaves managing the certs for the Quorum which is a non trivial problem and there exists a solution I think that does need support in the guts of ZK. But I think we can simplify the orchestration of Zookeeper with SSL if it is SSL aware. CA seems like the best way and simple way to go till such a time arrises when the CA has to be changed. Also prevalent security considerations recommend revoking the cert of the Quorum member that is removed. Again how do we accomplish this in a fault-tolerant way. Hence there is some work still left to do in CA case. If we do not consider fault-tolerance for SSL config management or take a stance that ZK does not have to solve this for the admin then just providing a Truststore would suffice. Also regarding the path forward do you think we should aim for a Trunk patch or patch to 3.5?. Also should we split the effort two phases, first without Netty and then perhaps bring in Netty etc. Let me know if I got something wrong and what do you think about bringing in Netty support for Quorum communication. Cheers Powell. > SSL Support for Atomic Broadcast protocol > - > > Key: ZOOKEEPER-236 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-236 > Project: ZooKeeper > Issue Type: New Feature > Components: quorum, server >Reporter: Benjamin Reed >Assignee: Abraham Fine >Priority: Minor > > We should have the ability to use SSL to authenticate and encrypt the traffic > between ZooKeeper servers. For the most part this is a very easy change. We > would probably only want to support this for TCP based leader elections. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
ZooKeeper_branch34_openjdk7 - Build # 1416 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1416/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by timer [EnvInject] - Loading node environment variables. Building remotely on H22 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch34_openjdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.4^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.4^{commit} # timeout=10 Checking out Revision 835377f0e1cd215e791ed29c0bcff95e625f299c (refs/remotes/origin/branch-3.4) > git config core.sparsecheckout # timeout=10 > git checkout -f 835377f0e1cd215e791ed29c0bcff95e625f299c > git rev-list 835377f0e1cd215e791ed29c0bcff95e625f299c # timeout=10 No emails were triggered. [ZooKeeper_branch34_openjdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Error: JAVA_HOME is not defined correctly. We cannot execute /usr/lib/jvm/java-7-openjdk-amd64//bin/java Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper_branch35_jdk8 - Build # 443 - Failure
See https://builds.apache.org/job/ZooKeeper_branch35_jdk8/443/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 57.22 MB...] [junit] 2017-03-07 12:20:56,190 [myid:127.0.0.1:11222] - WARN [main-SendThread(127.0.0.1:11222):ClientCnxn$SendThread@1235] - Session 0x1010514611b for server 127.0.0.1/127.0.0.1:11222, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-07 12:20:56,351 [myid:] - INFO [SessionTracker:SessionTrackerImpl@158] - SessionTrackerImpl exited loop! [junit] 2017-03-07 12:20:56,378 [myid:127.0.0.1:11345] - INFO [main-SendThread(127.0.0.1:11345):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11345. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-07 12:20:56,378 [myid:127.0.0.1:11345] - WARN [main-SendThread(127.0.0.1:11345):ClientCnxn$SendThread@1235] - Session 0x101051a78db for server 127.0.0.1/127.0.0.1:11345, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-07 12:20:56,484 [myid:] - INFO [ProcessThread(sid:0 cport:11468)::PrepRequestProcessor@655] - Processed session termination for sessionid: 0x101051ddcbc [junit] 2017-03-07 12:20:56,493 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11468,name1=Connections,name2=127.0.0.1,name3=0x101051ddcbc] [junit] 2017-03-07 12:20:56,493 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x101051ddcbc closed [junit] 2017-03-07 12:20:56,493 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 139159 [junit] 2017-03-07 12:20:56,493 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 1644 [junit] 2017-03-07 12:20:56,494 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2017-03-07 12:20:56,494 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2017-03-07 12:20:56,494 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2017-03-07 12:20:56,494 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:11468 [junit] 2017-03-07 12:20:56,493 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x101051ddcbc [junit] 2017-03-07 12:20:56,499 [myid:] - INFO [main:ZooKeeperServer@541] - shutting down [junit] 2017-03-07 12:20:56,499 [myid:] - ERROR [main:ZooKeeperServer@505] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 12:20:56,499 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2017-03-07 12:20:56,500 [myid:] - INFO [main:PrepRequestProcessor@973] - Shutting down [junit] 2017-03-07 12:20:56,500 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-03-07 12:20:56,500 [myid:] - INFO [ProcessThread(sid:0 cport:11468)::PrepRequestProcessor@154] - PrepRequestProcessor exited loop! [junit] 2017-03-07 12:20:56,500 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-03-07 12:20:56,500 [myid:] - INFO [main:FinalRequestProcessor@479] - shutdown of request processor complete [junit] 2017-03-07 12:20:56,500 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11468,name1=InMemoryDataTree] [junit] 2017-03-07 12:20:56,501 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port11468] [junit] 2017-03-07 12:20:56,501 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11468 [junit] 2017-03-07 12:20:56,501 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2017-03-07 12:20:56,511 [myid:] -
ZooKeeper-trunk-jdk8 - Build # 966 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-jdk8/966/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 60.36 MB...] [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2017-03-07 12:03:08,497 [myid:] - INFO [New I/O boss #15092:ClientCnxnSocketNetty@208] - channel is told closing [junit] 2017-03-07 12:03:08,497 [myid:127.0.0.1:14041] - INFO [main-SendThread(127.0.0.1:14041):ClientCnxn$SendThread@1231] - channel for sessionid 0x202d348eb2b is lost, closing socket connection and attempting reconnect [junit] 2017-03-07 12:03:07,733 [myid:127.0.0.1:14068] - INFO [main-SendThread(127.0.0.1:14068):ClientCnxn$SendThread@1231] - channel for sessionid 0x502d3491fa8 is lost, closing socket connection and attempting reconnect [junit] 2017-03-07 12:03:08,329 [myid:127.0.0.1:13915] - INFO [main-SendThread(127.0.0.1:13915):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:13915. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-07 12:03:07,835 [myid:127.0.0.1:14056] - INFO [main-SendThread(127.0.0.1:14056):ClientCnxn$SendThread@1231] - channel for sessionid 0x102d3491fa1 is lost, closing socket connection and attempting reconnect [junit] 2017-03-07 12:03:07,835 [myid:] - INFO [New I/O boss #16513:ClientCnxnSocketNetty@208] - channel is told closing [junit] 2017-03-07 12:03:08,499 [myid:] - INFO [New I/O boss #98:ClientCnxnSocketNetty$1@127] - future isn't success, cause: {} [junit] java.net.ConnectException: Connection refused: 127.0.0.1/127.0.0.1:13915 [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) [junit] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [junit] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [junit] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [junit] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit] at java.lang.Thread.run(Thread.java:745) [junit] 2017-03-07 12:03:08,499 [myid:] - WARN [New I/O boss #98:ClientCnxnSocketNetty$ZKClientHandler@439] - Exception caught: [id: 0xa2c4e56e] EXCEPTION: java.net.ConnectException: Connection refused: 127.0.0.1/127.0.0.1:13915 [junit] java.net.ConnectException: Connection refused: 127.0.0.1/127.0.0.1:13915 [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) [junit] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [junit] at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) [junit] at
ZooKeeper_branch35_openjdk7 - Build # 441 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_openjdk7/441/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 57.61 MB...] [junit] 2017-03-07 10:11:43,213 [myid:] - INFO [SyncThread:0:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port27623,name1=Connections,name2=127.0.0.1,name3=0x1001669a5e2] [junit] 2017-03-07 10:11:43,314 [myid:] - INFO [main:ZooKeeper@1324] - Session: 0x1001669a5e2 closed [junit] 2017-03-07 10:11:43,314 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@513] - EventThread shut down for session: 0x1001669a5e2 [junit] 2017-03-07 10:11:43,314 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@82] - Memory used 59836 [junit] 2017-03-07 10:11:43,315 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@87] - Number of threads 478 [junit] 2017-03-07 10:11:43,315 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@102] - FINISHED TEST METHOD testWatcherAutoResetWithLocal [junit] 2017-03-07 10:11:43,315 [myid:] - INFO [main:ClientBase@543] - tearDown starting [junit] 2017-03-07 10:11:43,315 [myid:] - INFO [main:ClientBase@513] - STOPPING server [junit] 2017-03-07 10:11:43,315 [myid:] - INFO [main:NettyServerCnxnFactory@464] - shutdown called 0.0.0.0/0.0.0.0:27623 [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [main:ZooKeeperServer@541] - shutting down [junit] 2017-03-07 10:11:43,316 [myid:] - ERROR [main:ZooKeeperServer@505] - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [main:SessionTrackerImpl@232] - Shutting down [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [main:PrepRequestProcessor@973] - Shutting down [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [main:SyncRequestProcessor@191] - Shutting down [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [ProcessThread(sid:0 cport:27623)::PrepRequestProcessor@154] - PrepRequestProcessor exited loop! [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@169] - SyncRequestProcessor exited! [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [main:FinalRequestProcessor@479] - shutdown of request processor complete [junit] 2017-03-07 10:11:43,316 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port27623,name1=InMemoryDataTree] [junit] 2017-03-07 10:11:43,318 [myid:] - INFO [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=StandaloneServer_port27623] [junit] 2017-03-07 10:11:43,318 [myid:] - INFO [main:FourLetterWordMain@85] - connecting to 127.0.0.1 27623 [junit] 2017-03-07 10:11:43,318 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2017-03-07 10:11:43,322 [myid:] - INFO [main:ClientBase@568] - fdcount after test is: 1400 at start it was 1400 [junit] 2017-03-07 10:11:43,322 [myid:] - INFO [main:ZKTestCase$1@68] - SUCCEEDED testWatcherAutoResetWithLocal [junit] 2017-03-07 10:11:43,322 [myid:] - INFO [main:ZKTestCase$1@63] - FINISHED testWatcherAutoResetWithLocal [junit] Tests run: 103, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 508.677 sec, Thread: 7, Class: org.apache.zookeeper.test.NioNettySuiteTest [junit] 2017-03-07 10:11:43,391 [myid:127.0.0.1:27485] - INFO [main-SendThread(127.0.0.1:27485):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:27485. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-07 10:11:43,392 [myid:127.0.0.1:27485] - WARN [main-SendThread(127.0.0.1:27485):ClientCnxn$SendThread@1235] - Session 0x100166496530002 for server 127.0.0.1/127.0.0.1:27485, unexpected error, closing socket connection and attempting reconnect [junit] java.net.ConnectException: Connection refused [junit] at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [junit] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:357) [junit] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1214) [junit] 2017-03-07 10:11:43,642 [myid:127.0.0.1:27479] - INFO [main-SendThread(127.0.0.1:27479):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:27479. Will not attempt to authenticate using SASL (unknown error) [junit] 2017-03-07 10:11:43,643 [myid:127.0.0.1:27479] - WARN [main-SendThread(127.0.0.1:27479):ClientCnxn$SendThread@1235] - Session 0x20016649654 for server 127.0.0.1/127.0.0.1:27479, unexpected error, closing socket connection and attempting
ZooKeeper_branch35_jdk7 - Build # 874 - Still Failing
See https://builds.apache.org/job/ZooKeeper_branch35_jdk7/874/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by timer [EnvInject] - Loading node environment variables. Building remotely on H15 (ubuntu) in workspace /home/jenkins/jenkins-slave/workspace/ZooKeeper_branch35_jdk7 > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git://git.apache.org/zookeeper.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from git://git.apache.org/zookeeper.git > git --version # timeout=10 > git fetch --tags --progress git://git.apache.org/zookeeper.git > +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/branch-3.5^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/branch-3.5^{commit} # timeout=10 Checking out Revision 6d9fc04c052adbc791c63f3f00c816fb8e56 (refs/remotes/origin/branch-3.5) > git config core.sparsecheckout # timeout=10 > git checkout -f 6d9fc04c052adbc791c63f3f00c816fb8e56 > git rev-list 6d9fc04c052adbc791c63f3f00c816fb8e56 # timeout=10 No emails were triggered. [ZooKeeper_branch35_jdk7] $ /home/jenkins/tools/ant/latest/bin/ant -Dtest.output=yes -Dtest.junit.threads=8 -Dtest.junit.output.format=xml -Djavac.target=1.7 clean test-core-java Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/tools/ant/launch/Launcher : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Build step 'Invoke Ant' marked build as failure Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.