[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2444/



---


[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2445/



---


Failed: ZOOKEEPER- PreCommit Build #2444

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2444/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 22.82 MB...]
 [exec] /bin/kill -9 7667 
 [exec] /bin/kill -9 7697 
 [exec] 
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/zookeeper-common/src/test/resources/test-github-pr.sh:
 line 471:  7719 Killed  $ANT_HOME/bin/ant 
-DZookeeperPatchProcess= -Dtest.junit.output.format=xml -Dtest.output=yes 
test-contrib
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=4DEA35D8C3A4C9F3DF0B1A4BABD7C257.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1958:
 exec returned: 3

Total time: 14 minutes 30 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of ff0e6cd35cd2a3df29f209c23d37c82cde0423e4 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2444/ and 
message: 'FAILURE
 527 tests run, 1 skipped, 46 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2444/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
46 tests failed.
FAILED:  
org.apache.zookeeper.test.FollowerResyncConcurrencyTest.testResyncBySnapThenDiffAfterFollowerCrashes

Error Message:
unable to create new native thread

Stack Trace:
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:717)
at 
org.apache.zookeeper.test.FollowerResyncConcurrencyTest.followerResyncCrashTest(FollowerResyncConcurrencyTest.java:311)
at 
org.apache.zookeeper.test.FollowerResyncConcurrencyTest.testResyncBySnapThenDiffAfterFollowerCrashes(FollowerResyncConcurrencyTest.java:176)
at 
org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)


FAILED:  
org.apache.zookeeper.test.FollowerResyncConcurrencyTest.testFollowerWatcherResync

Error Message:
java.rmi.ServerError: Error occurred in server thread; nested exception is: 
java.lang.OutOfMemoryError: unable to create new native thread

Stack Trace:

Failed: ZOOKEEPER- PreCommit Build #2445

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2445/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 37.66 KB...]
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=C8BBD58DCC07B4A11BBF62B09FC148F8.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/build.xml:1958:
 exec returned: 2

Total time: 2 minutes 28 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
ERROR: Step ?Publish JUnit test result report? failed: No test report files 
were found. Configuration error?
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of dbc73792d4ad3ed25c427fadfec399aa38841df9 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2445/ and 
message: 'FAILURE
 No test results found.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2445/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
No tests ran.

[jira] [Created] (ZOOKEEPER-3176) Quorum TLS - add config options

2018-10-15 Thread Ilya Maykov (JIRA)
Ilya Maykov created ZOOKEEPER-3176:
--

 Summary: Quorum TLS - add config options
 Key: ZOOKEEPER-3176
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3176
 Project: ZooKeeper
  Issue Type: Improvement
Affects Versions: 3.6.0, 3.5.5
Reporter: Ilya Maykov


Some parameters of Quorum TLS connections are not currently configurable. Let's 
add configuration properties for them with reasonable defaults. In particular, 
these are:
 * enabled protocols
 * client auth behavior (want / need / none)
 * a timeout for TLS handshake detection in a UnifiedServerSocket



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper issue #627: ZOOKEEPER-236: SSL Support for Atomic Broadcast protoc...

2018-10-15 Thread ivmaykov
Github user ivmaykov commented on the issue:

https://github.com/apache/zookeeper/pull/627
  
I'm creating separate JIRAs for the different issues fixed in this PR. I 
will break it up into multiple PRs, one for each JIRA.

Fix port unification: https://jira.apache.org/jira/browse/ZOOKEEPER-3172
Add PEM support: https://jira.apache.org/jira/browse/ZOOKEEPER-3173
Reload certs when file changes: 
https://jira.apache.org/jira/browse/ZOOKEEPER-3174
Test improvements: https://jira.apache.org/jira/browse/ZOOKEEPER-3175
More config options: https://jira.apache.org/jira/browse/ZOOKEEPER-3176



---


[jira] [Commented] (ZOOKEEPER-3176) Quorum TLS - add config options

2018-10-15 Thread Ilya Maykov (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650918#comment-16650918
 ] 

Ilya Maykov commented on ZOOKEEPER-3176:


I have a fix for this that's part of a larger pull request right now 
([https://github.com/apache/zookeeper/pull/627),] however I will be breaking 
the fix out into a separate PR specifically for this issue.

> Quorum TLS - add config options
> ---
>
> Key: ZOOKEEPER-3176
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3176
> Project: ZooKeeper
>  Issue Type: Improvement
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Ilya Maykov
>Priority: Major
>
> Some parameters of Quorum TLS connections are not currently configurable. 
> Let's add configuration properties for them with reasonable defaults. In 
> particular, these are:
>  * enabled protocols
>  * client auth behavior (want / need / none)
>  * a timeout for TLS handshake detection in a UnifiedServerSocket



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ZOOKEEPER-3175) Quorum TLS - test improvements

2018-10-15 Thread Ilya Maykov (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650917#comment-16650917
 ] 

Ilya Maykov commented on ZOOKEEPER-3175:


I have a fix for this that's part of a larger pull request right now 
([https://github.com/apache/zookeeper/pull/627),] however I will be breaking 
the fix out into a separate PR specifically for this issue.

> Quorum TLS - test improvements
> --
>
> Key: ZOOKEEPER-3175
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3175
> Project: ZooKeeper
>  Issue Type: Improvement
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Ilya Maykov
>Priority: Major
>
> To simplify testing of Quorum TLS features, let's encapsulate the 
> functionality of creating test trust/key stores in some helper classes so it 
> can be easily shared between different unit tests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZOOKEEPER-3175) Quorum TLS - test improvements

2018-10-15 Thread Ilya Maykov (JIRA)
Ilya Maykov created ZOOKEEPER-3175:
--

 Summary: Quorum TLS - test improvements
 Key: ZOOKEEPER-3175
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3175
 Project: ZooKeeper
  Issue Type: Improvement
Affects Versions: 3.6.0, 3.5.5
Reporter: Ilya Maykov


To simplify testing of Quorum TLS features, let's encapsulate the functionality 
of creating test trust/key stores in some helper classes so it can be easily 
shared between different unit tests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ZOOKEEPER-3174) Quorum TLS - support reloading trust/key store

2018-10-15 Thread Ilya Maykov (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650914#comment-16650914
 ] 

Ilya Maykov commented on ZOOKEEPER-3174:


I have a fix for this that's part of a larger pull request right now 
([https://github.com/apache/zookeeper/pull/627),] however I will be breaking 
the fix out into a separate PR specifically for this issue.

> Quorum TLS - support reloading trust/key store
> --
>
> Key: ZOOKEEPER-3174
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3174
> Project: ZooKeeper
>  Issue Type: Improvement
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Ilya Maykov
>Priority: Major
>
> The Quorum TLS feature recently added in ZOOKEEPER-236 doesn't support 
> reloading a trust/key store from disk when it changes. In an environment 
> where short-lived certificates are used and are refreshed by some background 
> daemon / cron job, this is a problem. Let's support reloading a trust/key 
> store from disk when the file on disk changes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZOOKEEPER-3174) Quorum TLS - support reloading trust/key store

2018-10-15 Thread Ilya Maykov (JIRA)
Ilya Maykov created ZOOKEEPER-3174:
--

 Summary: Quorum TLS - support reloading trust/key store
 Key: ZOOKEEPER-3174
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3174
 Project: ZooKeeper
  Issue Type: Improvement
Affects Versions: 3.6.0, 3.5.5
Reporter: Ilya Maykov


The Quorum TLS feature recently added in ZOOKEEPER-236 doesn't support 
reloading a trust/key store from disk when it changes. In an environment where 
short-lived certificates are used and are refreshed by some background daemon / 
cron job, this is a problem. Let's support reloading a trust/key store from 
disk when the file on disk changes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2443/



---


Failed: ZOOKEEPER- PreCommit Build #2443

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2443/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 75.46 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=22E0C2548CA3D87A7052C3481FFC019C.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1958:
 exec returned: 2

Total time: 20 minutes 21 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 6394a94e3a047010718c7b7fdcbf9e2e6d5ba40e to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2443/ and 
message: 'FAILURE
 1686 tests run, 1 skipped, 9 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2443/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
9 tests failed.
FAILED:  org.apache.zookeeper.test.NettyNettySuiteTest.testQuorumSystemChange

Error Message:
Timeout occurred. Please note the time in the report does not reflect the time 
until the timeout.

Stack Trace:
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in 
the report does not reflect the time until the timeout.
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.FourLetterWordsTest.testFourLetterWords[3]

Error Message:
test timed out after 3 milliseconds

Stack Trace:
org.junit.runners.model.TestTimedOutException: test timed out after 3 
milliseconds
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:326)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
at java.io.PrintStream.write(PrintStream.java:480)
at java.io.PrintStream.write(PrintStream.java:480)
at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
at 

[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread enixon
Github user enixon commented on the issue:

https://github.com/apache/zookeeper/pull/669
  
@ivmaykov (or anyone with a stack overflow account, really), do you want to 
tag a pointer to this PR with 'netty' on stack overflow (as per 
https://netty.io/community.html) and see if any of the project experts want to 
weigh in on this port?



---


[jira] [Commented] (ZOOKEEPER-3173) Quorum TLS - support PEM trust/key stores

2018-10-15 Thread Ilya Maykov (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650909#comment-16650909
 ] 

Ilya Maykov commented on ZOOKEEPER-3173:


I have a fix for this that's part of a larger pull request right now 
([https://github.com/apache/zookeeper/pull/627),] however I will be breaking 
the fix out into a separate PR specifically for this issue.

> Quorum TLS - support PEM trust/key stores
> -
>
> Key: ZOOKEEPER-3173
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3173
> Project: ZooKeeper
>  Issue Type: Improvement
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Ilya Maykov
>Priority: Major
>
> ZOOKEEPER-236 is landed so there is some TLS support in Zookeeper now, but 
> only JKS trust stores are supported. JKS is not really used by non-Java 
> software, where PKCS12 and PEM are more standard. Let's add support for PEM 
> trust / key stores to make Quorum TLS easier to use.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZOOKEEPER-3173) Quorum TLS - support PEM trust/key stores

2018-10-15 Thread Ilya Maykov (JIRA)
Ilya Maykov created ZOOKEEPER-3173:
--

 Summary: Quorum TLS - support PEM trust/key stores
 Key: ZOOKEEPER-3173
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3173
 Project: ZooKeeper
  Issue Type: Improvement
Affects Versions: 3.6.0, 3.5.5
Reporter: Ilya Maykov


ZOOKEEPER-236 is landed so there is some TLS support in Zookeeper now, but only 
JKS trust stores are supported. JKS is not really used by non-Java software, 
where PKCS12 and PEM are more standard. Let's add support for PEM trust / key 
stores to make Quorum TLS easier to use.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ZOOKEEPER-3172) Quorum TLS - fix port unification to allow rolling upgrades

2018-10-15 Thread Ilya Maykov (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650904#comment-16650904
 ] 

Ilya Maykov commented on ZOOKEEPER-3172:


I have a fix for this that's part of a larger pull request right now 
([https://github.com/apache/zookeeper/pull/627),] however I will be breaking 
the fix out into a separate PR specifically for this issue.

> Quorum TLS - fix port unification to allow rolling upgrades
> ---
>
> Key: ZOOKEEPER-3172
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3172
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: security, server
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Ilya Maykov
>Priority: Major
>
> ZOOKEEPER-236 was committed with port unification support disabled, because 
> of various issues with the implementation. These issues should be fixed so 
> port unification can be enabled again. Port unification is necessary to 
> upgrade an ensemble from plaintext to TLS quorum connections without downtime.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3172) Quorum TLS - fix port unification to allow rolling upgrades

2018-10-15 Thread Ilya Maykov (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ilya Maykov updated ZOOKEEPER-3172:
---
Affects Version/s: 3.5.5

> Quorum TLS - fix port unification to allow rolling upgrades
> ---
>
> Key: ZOOKEEPER-3172
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3172
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: security, server
>Affects Versions: 3.6.0, 3.5.5
>Reporter: Ilya Maykov
>Priority: Major
>
> ZOOKEEPER-236 was committed with port unification support disabled, because 
> of various issues with the implementation. These issues should be fixed so 
> port unification can be enabled again. Port unification is necessary to 
> upgrade an ensemble from plaintext to TLS quorum connections without downtime.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZOOKEEPER-3172) Quorum TLS - fix port unification to allow rolling upgrades

2018-10-15 Thread Ilya Maykov (JIRA)
Ilya Maykov created ZOOKEEPER-3172:
--

 Summary: Quorum TLS - fix port unification to allow rolling 
upgrades
 Key: ZOOKEEPER-3172
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3172
 Project: ZooKeeper
  Issue Type: Improvement
  Components: security, server
Affects Versions: 3.6.0
Reporter: Ilya Maykov


ZOOKEEPER-236 was committed with port unification support disabled, because of 
various issues with the implementation. These issues should be fixed so port 
unification can be enabled again. Port unification is necessary to upgrade an 
ensemble from plaintext to TLS quorum connections without downtime.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper issue #627: ZOOKEEPER-236: SSL Support for Atomic Broadcast protoc...

2018-10-15 Thread anmolnar
Github user anmolnar commented on the issue:

https://github.com/apache/zookeeper/pull/627
  
@ivmaykov Sure. I hate committing my own patches, rather wait for others to 
review and merge. Anyway, if no one shows up tomorrow, I'll commit it myself.


---


[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2442/



---


Failed: ZOOKEEPER- PreCommit Build #2442

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2442/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 93.11 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=C433B8349AF16EA4FEF5117317E1F103.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1958:
 exec returned: 2

Total time: 19 minutes 0 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of ed07ad40388440aab824c42246d32c68ada3e728 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2442/ and 
message: 'FAILURE
 1566 tests run, 1 skipped, 6 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2442/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
6 tests failed.
FAILED:  
org.apache.zookeeper.test.NettyNettySuiteTest.testPortChangeToBlockedPortLeader

Error Message:
Timeout occurred. Please note the time in the report does not reflect the time 
until the timeout.

Stack Trace:
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in 
the report does not reflect the time until the timeout.
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.NioNettySuiteTest.testBulkReconfig

Error Message:
Timeout occurred. Please note the time in the report does not reflect the time 
until the timeout.

Stack Trace:
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in 
the report does not reflect the time until the timeout.
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.FourLetterWordsTest.testSetTraceMask[3]

Error Message:
test timed out after 3 milliseconds

Stack Trace:
org.junit.runners.model.TestTimedOutException: test timed out after 3 
milliseconds
at java.lang.Thread.sleep(Native Method)
at 
org.apache.zookeeper.test.ClientBase.waitForServerUp(ClientBase.java:305)
at 
org.apache.zookeeper.test.ClientBase.startServerInstance(ClientBase.java:428)
at 

[GitHub] zookeeper pull request #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread dain
Github user dain commented on a diff in the pull request:

https://github.com/apache/zookeeper/pull/669#discussion_r225332620
  
--- Diff: 
zookeeper-common/src/test/java/org/apache/zookeeper/common/TestByteBufAllocator.java
 ---
@@ -0,0 +1,145 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.zookeeper.common;
+
+import io.netty.buffer.ByteBuf;
+import io.netty.buffer.CompositeByteBuf;
+import io.netty.buffer.PooledByteBufAllocator;
+import io.netty.util.ResourceLeakDetector;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.concurrent.atomic.AtomicReference;
+
+/**
+ * This is a custom ByteBufAllocator that tracks outstanding allocations 
and
+ * crashes the program if any of them are leaked.
+ *
+ * Never use this class in production, it will cause your server to run out
+ * of memory! This is because it holds strong references to all allocated
+ * buffers and doesn't release them until checkForLeaks() is called at the
+ * end of a unit test.
+ *
+ * Note: the original code was copied from 
https://github.com/airlift/drift,
+ * with the permission and encouragement of airlift's author (dain). 
Airlift
+ * uses the same apache 2.0 license as Zookeeper so this should be ok.
+ *
+ * However, the code was modified to take advantage of Netty's built-in
+ * leak tracking and make a best effort to print details about buffer 
leaks.
+ */
+public class TestByteBufAllocator extends PooledByteBufAllocator {
+private static AtomicReference INSTANCE =
+new AtomicReference<>(null);
+
+/**
+ * Get the singleton testing allocator.
+ * @return the singleton allocator, creating it if one does not exist.
+ */
+public static TestByteBufAllocator getInstance() {
+TestByteBufAllocator result = INSTANCE.get();
+if (result == null) {
+// Note: the leak detector level never gets reset after this,
+// but that's probably ok since this is only used by test code.
+
ResourceLeakDetector.setLevel(ResourceLeakDetector.Level.PARANOID);
+INSTANCE.compareAndSet(null, new TestByteBufAllocator());
+result = INSTANCE.get();
+}
+return result;
+}
+
+/**
+ * Destroys the singleton testing allocator and throws an error if any 
of the
+ * buffers allocated by it have been leaked. Attempts to print leak 
details to
+ * standard error before throwing, by using netty's built-in leak 
tracking.
+ * Note that this might not always work, since it only triggers when a 
buffer
+ * is garbage-collected and calling System.gc() does not guarantee 
that a buffer
+ * will actually be GC'ed.
+ *
+ * This should be called at the end of a unit test's tearDown() method.
+ */
+public static void checkForLeaks() {
+TestByteBufAllocator result = INSTANCE.getAndSet(null);
+if (result != null) {
+result.checkInstanceForLeaks();
+}
+
+}
+
+private final List trackedBuffers = new ArrayList<>();
+
+public TestByteBufAllocator()
+{
+super(false);
+}
+
+@Override
+protected ByteBuf newHeapBuffer(int initialCapacity, int maxCapacity)
+{
+return track(super.newHeapBuffer(initialCapacity, maxCapacity));
+}
+
+@Override
+protected ByteBuf newDirectBuffer(int initialCapacity, int maxCapacity)
+{
+return track(super.newDirectBuffer(initialCapacity, maxCapacity));
+}
+
+@Override
+public CompositeByteBuf compositeHeapBuffer(int maxNumComponents)
+{
+return track(super.compositeHeapBuffer(maxNumComponents));
+}
+
+@Override
+public CompositeByteBuf compositeDirectBuffer(int maxNumComponents)
+{
+

Re: [VOTE] Maven migration - separation of java files to server and client project?

2018-10-15 Thread Norbert Kalmar
Sorry, I linked the document instead of the PR. I wanted to link the
document at the beginning of the letter after "It was said here"

The PR:
https://github.com/apache/zookeeper/pull/670

Norbert

On Mon, Oct 15, 2018 at 11:49 PM Norbert Kalmar 
wrote:

> Hi community!
>
> As outlined in the start document, it was planned to separate the java
> files to server and client, with common files in a separate common module.
> It was said here:
>
> "Fifth iteration - move src/java/main to zk-server, which will be further
> separated in Phase 2."
>
> But in order to save rebase for the contributors, I merged this into one
> step. (I had a letter about it)
> So I already created zookeeper-server, zookeeper-client and
> zookeeper-common.
>
> But after doing the separation, I have to say... this just hardly makes
> any sense.
> Without breaking backward compatibility by making changes in the package
> structure, it just makes the code more unreadable than before. Multiple
> packages has to be present in all 3 modules (as it was never an intention
> to separate it, so many classes are just not in their logical package, and
> even inner classes used when top level would be required for the
> separation). Client and server code can not be divided to only depend on
> common. Either server depends on client - which makes more sense than the
> other option - or client depend on server.
> (Or make common so fat, only literally a few class remains in server and
> client - which again, makes no sense).
>
> I created a pull request to illustrate what needs to be done, and this is
> not even half complete:
>
> https://docs.google.com/document/d/1WXqhaPlCwchcWc8RCEzbCmVa4WbBDlfR3GQngikGjqc/edit?usp=sharing
>
> Some more detail in the description.
>
> My suggestion:
> forget about zookeeper-client-java and zookeeper-common, and just leave
> zookeeper-server.
>
> It just doesn't make any sense looking at the result, only makes the
> project much more complicated. The java code is too much tangled together.
>
> What would this mean if I just create zookeeper-common? All the files had
> to be renamed anyway, so some now would have 2 renames (fortunately most of
> the files are in zookeeper-server anyway), and possible another rebase for
> some PR's.
>
> Any input is appreciated.
>
> Regards,
> Norbert
>
>
>
>


[VOTE] Maven migration - separation of java files to server and client project?

2018-10-15 Thread Norbert Kalmar
Hi community!

As outlined in the start document, it was planned to separate the java
files to server and client, with common files in a separate common module.
It was said here:

"Fifth iteration - move src/java/main to zk-server, which will be further
separated in Phase 2."

But in order to save rebase for the contributors, I merged this into one
step. (I had a letter about it)
So I already created zookeeper-server, zookeeper-client and
zookeeper-common.

But after doing the separation, I have to say... this just hardly makes any
sense.
Without breaking backward compatibility by making changes in the package
structure, it just makes the code more unreadable than before. Multiple
packages has to be present in all 3 modules (as it was never an intention
to separate it, so many classes are just not in their logical package, and
even inner classes used when top level would be required for the
separation). Client and server code can not be divided to only depend on
common. Either server depends on client - which makes more sense than the
other option - or client depend on server.
(Or make common so fat, only literally a few class remains in server and
client - which again, makes no sense).

I created a pull request to illustrate what needs to be done, and this is
not even half complete:
https://docs.google.com/document/d/1WXqhaPlCwchcWc8RCEzbCmVa4WbBDlfR3GQngikGjqc/edit?usp=sharing

Some more detail in the description.

My suggestion:
forget about zookeeper-client-java and zookeeper-common, and just leave
zookeeper-server.

It just doesn't make any sense looking at the result, only makes the
project much more complicated. The java code is too much tangled together.

What would this mean if I just create zookeeper-common? All the files had
to be renamed anyway, so some now would have 2 renames (fortunately most of
the files are in zookeeper-server anyway), and possible another rebase for
some PR's.

Any input is appreciated.

Regards,
Norbert


[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2441/



---


Failed: ZOOKEEPER- PreCommit Build #2441

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2441/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 93.92 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1958:
 exec returned: 2

Total time: 19 minutes 10 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of e0bfb1426250ae7eb7aaeed52885c2e6375f86a8 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2441/ and 
message: 'FAILURE
 1566 tests run, 1 skipped, 6 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2441/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
6 tests failed.
FAILED:  org.apache.zookeeper.test.NettyNettySuiteTest.testRemoveAddOne

Error Message:
Timeout occurred. Please note the time in the report does not reflect the time 
until the timeout.

Stack Trace:
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in 
the report does not reflect the time until the timeout.
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.NioNettySuiteTest.testBulkReconfig

Error Message:
Timeout occurred. Please note the time in the report does not reflect the time 
until the timeout.

Stack Trace:
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in 
the report does not reflect the time until the timeout.
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.FourLetterWordsTest.testSetTraceMask[3]

Error Message:
test timed out after 3 milliseconds

Stack Trace:
org.junit.runners.model.TestTimedOutException: test timed out after 3 
milliseconds
at java.lang.Thread.sleep(Native Method)
at 
org.apache.zookeeper.test.ClientBase.waitForServerUp(ClientBase.java:305)
at 
org.apache.zookeeper.test.ClientBase.startServerInstance(ClientBase.java:428)
at org.apache.zookeeper.test.ClientBase.startServer(ClientBase.java:541)
at 

Failed: ZOOKEEPER- PreCommit Build #2439

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2439/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 79.35 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=07413BE6DA814031C220E99C60FBCE76.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1958:
 exec returned: 2

Total time: 23 minutes 4 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 98c210e98ebba527e0f4ac097ad2d37f6ad929c8 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2439/ and 
message: 'FAILURE
 1565 tests run, 1 skipped, 8 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2439/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
8 tests failed.
FAILED:  
org.apache.zookeeper.test.DisconnectedWatcherTest.testManyChildWatchersAutoReset

Error Message:
test timed out after 84 milliseconds

Stack Trace:
org.junit.runners.model.TestTimedOutException: test timed out after 84 
milliseconds
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1524)
at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1507)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1453)
at 
org.apache.zookeeper.test.DisconnectedWatcherTest.testManyChildWatchersAutoReset(DisconnectedWatcherTest.java:236)
at 
org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.NettyNettySuiteHammerTest.testObserversHammer

Error Message:
Timeout occurred. Please note the time in the report does not reflect the time 
until the timeout.

Stack Trace:
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in 
the report does not reflect the time until the 

[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2439/



---


[GitHub] zookeeper issue #668: ZOOKEEPER-3165. Java 9: X509UtilTest.testCreateSSLCont...

2018-10-15 Thread ivmaykov
Github user ivmaykov commented on the issue:

https://github.com/apache/zookeeper/pull/668
  
Your fix looks fine to me. It's fixed in my stack of FB internal diffs too 
(#627 for the time being), where I am explicit about JKS or PEM format. Didn't 
realize that Java 9 supports PKCS12 key/trust stores now, cool.


---


[GitHub] zookeeper issue #627: ZOOKEEPER-236: SSL Support for Atomic Broadcast protoc...

2018-10-15 Thread ivmaykov
Github user ivmaykov commented on the issue:

https://github.com/apache/zookeeper/pull/627
  
@anmolnar it doesn't look like #184 is in master branch yet. Do you have 
any ETA on that?


---


[GitHub] zookeeper issue #184: ZOOKEEPER-236: SSL Support for Atomic Broadcast protoc...

2018-10-15 Thread ivmaykov
Github user ivmaykov commented on the issue:

https://github.com/apache/zookeeper/pull/184
  
@anmolnar any ETA on merging this to master? I'd like to break up #627 into 
several parts with associated JIRAs and start the process on getting that code 
upstream, but need this code in master first.


---


[jira] [Commented] (ZOOKEEPER-3152) Port ZK netty stack to netty 4

2018-10-15 Thread Ilya Maykov (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650821#comment-16650821
 ] 

Ilya Maykov commented on ZOOKEEPER-3152:


Pull request is up, see https://github.com/apache/zookeeper/pull/669

> Port ZK netty stack to netty 4
> --
>
> Key: ZOOKEEPER-3152
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3152
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: java client, server
>Affects Versions: 3.6.0
>Reporter: Ilya Maykov
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Netty 3 is super old. Let's port ZK's netty stack to netty 4. I'm working on 
> a patch that I will put up as a pull request on github once we finish testing 
> it internally at Facebook, just getting the Jira ticket ready ahead of time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/669
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2438/



---


Failed: ZOOKEEPER- PreCommit Build #2438

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2438/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 93.41 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=1F8C73AA0F085BCB9AE0D6B371DB823E.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1958:
 exec returned: 2

Total time: 18 minutes 55 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3152
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 34c3e275d012bd14c243633a638c85f1ca4a36c4 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2438/ and 
message: 'FAILURE
 1566 tests run, 1 skipped, 6 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2438/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
6 tests failed.
FAILED:  org.apache.zookeeper.test.FourLetterWordsTest.testSetTraceMask[3]

Error Message:
test timed out after 3 milliseconds

Stack Trace:
org.junit.runners.model.TestTimedOutException: test timed out after 3 
milliseconds
at java.lang.Thread.sleep(Native Method)
at 
org.apache.zookeeper.test.ClientBase.waitForServerUp(ClientBase.java:305)
at 
org.apache.zookeeper.test.ClientBase.startServerInstance(ClientBase.java:428)
at org.apache.zookeeper.test.ClientBase.startServer(ClientBase.java:541)
at 
org.apache.zookeeper.test.ClientBase.setUpWithServerId(ClientBase.java:528)
at org.apache.zookeeper.test.ClientBase.setUp(ClientBase.java:504)
at 
org.apache.zookeeper.test.FourLetterWordsTest.setUp(FourLetterWordsTest.java:92)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.zookeeper.test.FourLetterWordsTest.testValidateConsOutput[3]

Error Message:
test timed out after 3 milliseconds

Stack Trace:
org.junit.runners.model.TestTimedOutException: test timed out after 3 
milliseconds
at java.lang.Thread.sleep(Native Method)
at 

Failed: ZOOKEEPER- PreCommit Build #2440

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2440/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 8.80 KB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] /home/jenkins/tools/ant/apache-ant-1.9.9/bin/ant  
-Djavac.args=-Xlint -Xmaxwarns 1000 
-Djava5.home=/home/jenkins/tools/java5/latest/ 
-Dforrest.home=/home/jenkins/tools/forrest/latest/ -DZookeeperPatchProcess= 
clean tar > 
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/patchprocess/trunkJavacWarnings.txt
 2>&1
 [exec] Trunk compilation is broken?
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec]   0 00 00 0  0  0 --:--:-- --:--:-- 
--:--:-- 0curl: (6) Could not resolve host: .diffmv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build@2/build.xml:1974:
 exec returned: 1

Total time: 19 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
ERROR: Step ?Publish JUnit test result report? failed: No test report files 
were found. Configuration error?
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3029
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 0ba918a53d8204bdb5bdf7d5967d3f3382ca4a70 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2440/ and 
message: 'FAILURE
 No test results found.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2440/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
No tests ran.

[GitHub] zookeeper issue #670: DO_NOT_MERGE - MAVEN MIGRATION - Separation of server ...

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/670
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2440/



---


[GitHub] zookeeper pull request #670: DO_NOT_MERGE - MAVEN MIGRATION - Separation of ...

2018-10-15 Thread nkalmar
GitHub user nkalmar opened a pull request:

https://github.com/apache/zookeeper/pull/670

DO_NOT_MERGE - MAVEN MIGRATION - Separation of server and client

This is to show that unlike I thought at the start of maven migration, 
separating java client and server code is too much of a refactor, and even 
introduces package change (like ConfigException needs to be removed from 
QuorumPeerConfig.ConfigException as both client and server related classes 
throws it. Moving QuorumPeerConfig would bring too much file in common.) 

Also, zookeeper-common, zookeeper-client and zookeeper-server would have 
similar packages, sometimes tripling the package names.

Dependency hierarchy wise server would depend on client, there's no way to 
make the two depend only on common. 

And I didn't even start looking at the tests. Most of them depend on 
ZooKeeper.java and other "main" classes.

My suggestion: just leave zookeeper-server, or just zookeeper. 

An email has been sent to the dev list to start the discussion on this.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/nkalmar/zookeeper ZOOKEEPER-3029

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zookeeper/pull/670.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #670


commit dae0114a829d3f33198c76bf732b35961d5c26b7
Author: Norbert Kalmar 
Date:   2018-10-15T13:51:52Z

ZOOKEEPER-3029 - MAVEN MIGRATION - create pom for core modules

commit 9c0e82fe37f27910daaf20248b3253e2aacef129
Author: Norbert Kalmar 
Date:   2018-10-15T19:34:50Z

common-build-works

commit 0ba918a53d8204bdb5bdf7d5967d3f3382ca4a70
Author: Norbert Kalmar 
Date:   2018-10-15T21:12:25Z

client in progress




---


[GitHub] zookeeper issue #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread ivmaykov
Github user ivmaykov commented on the issue:

https://github.com/apache/zookeeper/pull/669
  
@dain take a look at the changes I made to airlift's test ByteBuf 
allocator. With these changes, we (sometimes) get leak details printed to 
stderr if a ByteBuf leaks, before the test crashes. Feel free to incorporate 
the approach into airlift if you want.


---


[jira] [Updated] (ZOOKEEPER-3152) Port ZK netty stack to netty 4

2018-10-15 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated ZOOKEEPER-3152:
--
Labels: pull-request-available  (was: )

> Port ZK netty stack to netty 4
> --
>
> Key: ZOOKEEPER-3152
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3152
> Project: ZooKeeper
>  Issue Type: Improvement
>  Components: java client, server
>Affects Versions: 3.6.0
>Reporter: Ilya Maykov
>Priority: Minor
>  Labels: pull-request-available
>
> Netty 3 is super old. Let's port ZK's netty stack to netty 4. I'm working on 
> a patch that I will put up as a pull request on github once we finish testing 
> it internally at Facebook, just getting the Jira ticket ready ahead of time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper pull request #669: ZOOKEEPER-3152: Port ZK netty stack to netty4

2018-10-15 Thread ivmaykov
GitHub user ivmaykov opened a pull request:

https://github.com/apache/zookeeper/pull/669

ZOOKEEPER-3152: Port ZK netty stack to netty4

Summary: Ported the client connection netty stack from netty3 to netty4. 
This includes both the server side (NettyServerCnxn and friends) and the client 
side (ClientCnxnSocketNetty).

Test Plan: Modified `FourLetterWordsTest` and `NettyServerCnxnTest`, plus 
manual testing on a regional ensemble.

FB Reviewers: nixon

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ivmaykov/zookeeper ZOOKEEPER-3152

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zookeeper/pull/669.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #669


commit 34c3e275d012bd14c243633a638c85f1ca4a36c4
Author: Ilya Maykov 
Date:   2018-08-31T23:26:55Z

port ZK netty stack from netty3 to netty4

Summary:
Ported the client connection netty stack from netty3 to netty4. This 
includes both the server side
(NettyServerCnxn and friends) and the client side (ClientCnxnSocketNetty).

Test Plan: Modified `FourLetterWordsTest` and `NettyServerCnxnTest`, plus 
manual testing on a regional ensemble.

Reviewers: nixon, nwolchko, nedelchev

Subscribers:

Differential Revision: https://phabricator.intern.facebook.com/D9646262

Tasks:

Tags:

Blame Revision:




---


[jira] [Commented] (ZOOKEEPER-3154) Update release process to use the MarkDown solution

2018-10-15 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650640#comment-16650640
 ] 

Hudson commented on ZOOKEEPER-3154:
---

FAILURE: Integrated in Jenkins build ZooKeeper-trunk #233 (See 
[https://builds.apache.org/job/ZooKeeper-trunk/233/])
ZOOKEEPER-3154: Update release process to use the MarkDown solution (andor: rev 
e92fdfefb86df24d9ef6e68be827e21f55b1c971)
* (edit) zookeeper-docs/src/main/resources/markdown/index.md
* (edit) zookeeper-docs/src/main/resources/markdown/recipes.md
* (edit) zookeeper-docs/src/main/resources/markdown/javaExample.md
* (edit) pom.xml
* (add) zookeeper-docs/src/main/resources/markdown/releasenotes.md
* (edit) build.xml
* (edit) zookeeper-docs/pom.xml


> Update release process to use the MarkDown solution
> ---
>
> Key: ZOOKEEPER-3154
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3154
> Project: ZooKeeper
>  Issue Type: Sub-task
>Reporter: Tamas Penzes
>Assignee: Tamas Penzes
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.5.5, 3.4.14
>
>  Time Spent: 5h 20m
>  Remaining Estimate: 0h
>
> We have to update the release process to use the MarkDown solution.
> We have to add the zookeeper-docs/src/main/resources/markdown and the 
> zookeeper-docs/target/html directories and their content to the tarball.
> We also have to remove the old mechanism of adding PDFs and old generated 
> HTML files to the tarball in the same time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


ZooKeeper-trunk - Build # 233 - Failure

2018-10-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/ZooKeeper-trunk/233/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 196.09 KB...]
[junit] Running org.apache.zookeeper.server.quorum.Zab1_0Test in thread 1
[junit] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
37.547 sec, Thread: 1, Class: org.apache.zookeeper.server.quorum.Zab1_0Test
[junit] Running org.apache.zookeeper.server.quorum.auth.MiniKdcTest in 
thread 1
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
1.921 sec, Thread: 1, Class: org.apache.zookeeper.server.quorum.auth.MiniKdcTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumAuthUpgradeTest in thread 1
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
37.071 sec, Thread: 1, Class: 
org.apache.zookeeper.server.quorum.auth.QuorumAuthUpgradeTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumDigestAuthTest in thread 1
[junit] Tests run: 24, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 
262.095 sec, Thread: 3, Class: 
org.apache.zookeeper.server.quorum.QuorumPeerMainTest
[junit] Test org.apache.zookeeper.server.quorum.QuorumPeerMainTest FAILED
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
99.434 sec, Thread: 2, Class: 
org.apache.zookeeper.server.quorum.StandaloneDisabledTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumKerberosAuthTest in thread 3
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumKerberosHostBasedAuthTest in 
thread 2
[junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
7.053 sec, Thread: 3, Class: 
org.apache.zookeeper.server.quorum.auth.QuorumKerberosAuthTest
[junit] Running org.apache.zookeeper.server.util.BitHashSetTest in thread 3
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.12 sec, Thread: 3, Class: org.apache.zookeeper.server.util.BitHashSetTest
[junit] Running org.apache.zookeeper.server.util.BitMapTest in thread 3
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.149 sec, Thread: 3, Class: org.apache.zookeeper.server.util.BitMapTest
[junit] Running org.apache.zookeeper.server.util.ConfigUtilsTest in thread 3
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.167 sec, Thread: 3, Class: org.apache.zookeeper.server.util.ConfigUtilsTest
[junit] Running org.apache.zookeeper.server.util.SerializeUtilsTest in 
thread 3
[junit] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.468 sec, Thread: 3, Class: org.apache.zookeeper.server.util.SerializeUtilsTest
[junit] Running org.apache.zookeeper.server.util.VerifyingFileFactoryTest 
in thread 3
[junit] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.165 sec, Thread: 3, Class: 
org.apache.zookeeper.server.util.VerifyingFileFactoryTest
[junit] Running org.apache.zookeeper.server.watch.WatchManagerTest in 
thread 3
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
21.302 sec, Thread: 1, Class: 
org.apache.zookeeper.server.quorum.auth.QuorumDigestAuthTest
[junit] Running org.apache.zookeeper.server.watch.WatcherCleanerTest in 
thread 1
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
5.119 sec, Thread: 1, Class: 
org.apache.zookeeper.server.watch.WatcherCleanerTest
[junit] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
7.752 sec, Thread: 3, Class: org.apache.zookeeper.server.watch.WatchManagerTest
[junit] Running org.apache.zookeeper.server.watch.WatcherOrBitSetTest in 
thread 1
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.102 sec, Thread: 1, Class: 
org.apache.zookeeper.server.watch.WatcherOrBitSetTest
[junit] Running org.apache.zookeeper.server.watch.WatchesPathReportTest in 
thread 3
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.081 sec, Thread: 3, Class: 
org.apache.zookeeper.server.watch.WatchesPathReportTest
[junit] Running org.apache.zookeeper.server.watch.WatchesReportTest in 
thread 1
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.112 sec, Thread: 1, Class: org.apache.zookeeper.server.watch.WatchesReportTest
[junit] Running org.apache.zookeeper.server.watch.WatchesSummaryTest in 
thread 3
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.079 sec, Thread: 3, Class: 
org.apache.zookeeper.server.watch.WatchesSummaryTest
[junit] Running org.apache.zookeeper.client.ZKClientConfigTest in thread 1
[junit] Running org.apache.jute.BinaryInputArchiveTest in thread 3
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.245 sec, Thread: 1, Class: 

[GitHub] zookeeper issue #662: ZOOKEEPER-3162. Broken lock semantics in C client lock...

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/662
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2437/



---


Success: ZOOKEEPER- PreCommit Build #2437

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2437/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 77.64 MB...]
 [exec] 
==
 [exec] Adding comment to Jira.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD SUCCESSFUL
Total time: 16 minutes 54 seconds
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3162
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 09f7ff4ed14053c50a05168d621b3c3a70a4ef43 to SUCCESS with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2437/ and 
message: 'SUCCESS 
 1760 tests run, 1 skipped, 0 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2437/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Success
Sending email for trigger: Success
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
All tests passed

Failed: ZOOKEEPER- PreCommit Build #2436

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2436/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 40.37 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=02D796F0F4C718482B16220432F687B8.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1966:
 exec returned: 1

Total time: 33 minutes 16 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3154
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of f0c868346a308a60927dca0c1c1fd6382651dbd1 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2436/ and 
message: 'FAILURE
 657 tests run, 3 skipped, 2 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2436/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testLeaderOutOfView

Error Message:
null

Stack Trace:
junit.framework.AssertionFailedError
at 
org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testLeaderOutOfView(QuorumPeerMainTest.java:1321)
at 
org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:55)


FAILED:  
org.apache.zookeeper.test.RestoreCommittedLogTest.testRestoreCommittedLog

Error Message:
log size != 0

Stack Trace:
junit.framework.AssertionFailedError: log size != 0
at 
org.apache.zookeeper.test.RestoreCommittedLogTest.testRestoreCommittedLog(RestoreCommittedLogTest.java:83)
at 
org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:55)

[GitHub] zookeeper issue #540: Branch 3.4

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/540
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2436/



---


[jira] [Assigned] (ZOOKEEPER-3155) Remove Forrest XMLs and their build process from the project

2018-10-15 Thread Tamas Penzes (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tamas Penzes reassigned ZOOKEEPER-3155:
---

Assignee: Tamas Penzes

> Remove Forrest XMLs and their build process from the project
> 
>
> Key: ZOOKEEPER-3155
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3155
> Project: ZooKeeper
>  Issue Type: Sub-task
>Reporter: Tamas Penzes
>Assignee: Tamas Penzes
>Priority: Major
>
> Remove obsoleted Forrest XML files and their build process from the project.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (ZOOKEEPER-3154) Update release process to use the MarkDown solution

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar resolved ZOOKEEPER-3154.
-
   Resolution: Fixed
Fix Version/s: 3.5.5
   3.4.14
   3.6.0

Issue resolved by pull request 663
[https://github.com/apache/zookeeper/pull/663]

> Update release process to use the MarkDown solution
> ---
>
> Key: ZOOKEEPER-3154
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3154
> Project: ZooKeeper
>  Issue Type: Sub-task
>Reporter: Tamas Penzes
>Assignee: Tamas Penzes
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.6.0, 3.4.14, 3.5.5
>
>  Time Spent: 4h 50m
>  Remaining Estimate: 0h
>
> We have to update the release process to use the MarkDown solution.
> We have to add the zookeeper-docs/src/main/resources/markdown and the 
> zookeeper-docs/target/html directories and their content to the tarball.
> We also have to remove the old mechanism of adding PDFs and old generated 
> HTML files to the tarball in the same time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper pull request #664: ZOOKEEPER-3154: Update release process to use t...

2018-10-15 Thread tamaashu
Github user tamaashu closed the pull request at:

https://github.com/apache/zookeeper/pull/664


---


[GitHub] zookeeper pull request #663: ZOOKEEPER-3154: Update release process to use t...

2018-10-15 Thread tamaashu
Github user tamaashu closed the pull request at:

https://github.com/apache/zookeeper/pull/663


---


[GitHub] zookeeper issue #663: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread anmolnar
Github user anmolnar commented on the issue:

https://github.com/apache/zookeeper/pull/663
  
Committed to branch-3.5. Thanks @tamaashu !
Please close this PR.


---


[GitHub] zookeeper issue #664: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread anmolnar
Github user anmolnar commented on the issue:

https://github.com/apache/zookeeper/pull/664
  
Committed to branch-3.4. Thanks @tamaashu !
Please close this PR.


---


[GitHub] zookeeper pull request #661: ZOOKEEPER-3154: Update release process to use t...

2018-10-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zookeeper/pull/661


---


[GitHub] zookeeper issue #661: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread anmolnar
Github user anmolnar commented on the issue:

https://github.com/apache/zookeeper/pull/661
  
Committed to master branch. Thanks @tamaashu !



---


Success: ZOOKEEPER- PreCommit Build #2435

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2435/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 76.20 MB...]
 [exec] 
==
 [exec] Adding comment to Jira.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=3F888C8050E77EA0CD92FA6BF83F7030.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD SUCCESSFUL
Total time: 19 minutes 47 seconds
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3154
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of fce1499b9abcd661b1ff72fd33cba2aa94735a60 to SUCCESS with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2435/ and 
message: 'SUCCESS 
 1720 tests run, 3 skipped, 0 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2435/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Success
Sending email for trigger: Success
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
All tests passed

[GitHub] zookeeper issue #663: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/663
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2435/



---


[GitHub] zookeeper issue #663: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread tamaashu
Github user tamaashu commented on the issue:

https://github.com/apache/zookeeper/pull/663
  
retest this please


---


[GitHub] zookeeper issue #664: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/664
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2432/



---


Success: ZOOKEEPER- PreCommit Build #2432

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2432/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 41.31 MB...]
 [exec] 
==
 [exec] Adding comment to Jira.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=57D735BB0A234C7B1C572F338946F1F2.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD SUCCESSFUL
Total time: 35 minutes 43 seconds
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3154
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 16a078e122a44e3fa1c79eceed36fb728e20779d to SUCCESS with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2432/ and 
message: 'SUCCESS 
 657 tests run, 3 skipped, 0 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2432/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Success
Sending email for trigger: Success
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
All tests passed

[GitHub] zookeeper issue #663: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/663
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2433/



---


Failed: ZOOKEEPER- PreCommit Build #2433

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2433/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 80.85 MB...]
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=7171024D654238D438BC7197C8E63F41.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
‘/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess’
 and 
‘/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess’
 are the same file

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/build.xml:1953:
 exec returned: 1

Total time: 19 minutes 41 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3154
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of fce1499b9abcd661b1ff72fd33cba2aa94735a60 to FAILURE with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2433/ and 
message: 'FAILURE
 1720 tests run, 3 skipped, 1 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2433/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  
org.apache.zookeeper.server.quorum.ReconfigFailureCasesTest.testObserverToParticipantConversionFails

Error Message:
Reconfig should have failed with NewConfigNoQuorum

Stack Trace:
junit.framework.AssertionFailedError: Reconfig should have failed with 
NewConfigNoQuorum
at 
org.apache.zookeeper.server.quorum.ReconfigFailureCasesTest.testObserverToParticipantConversionFails(ReconfigFailureCasesTest.java:264)
at 
org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)

Success: ZOOKEEPER- PreCommit Build #2434

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2434/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 69.47 MB...]
 [exec] 
==
 [exec] Adding comment to Jira.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=C2C83D07A91678AF84CF025457508C17.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD SUCCESSFUL
Total time: 17 minutes 22 seconds
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-3154
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of 43300182d312900c674be9438956574e298ddb20 to SUCCESS with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2434/ and 
message: 'SUCCESS 
 1760 tests run, 1 skipped, 0 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2434/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Success
Sending email for trigger: Success
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
All tests passed

[GitHub] zookeeper issue #661: ZOOKEEPER-3154: Update release process to use the Mark...

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/661
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2434/



---


[jira] [Updated] (ZOOKEEPER-2481) Flaky Test: testZeroWeightQuorum

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2481:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: testZeroWeightQuorum
> 
>
> Key: ZOOKEEPER-2481
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2481
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: server, tests
>Affects Versions: 3.4.8, 3.5.2
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.6.0, 3.5.5
>
>
> See https://builds.apache.org/job/ZooKeeper-trunk-openjdk7/1098/
> {noformat}
> Error Message
> Threads didn't join
> Stacktrace
> junit.framework.AssertionFailedError: Threads didn't join
>   at 
> org.apache.zookeeper.test.FLEZeroWeightTest.testZeroWeightQuorum(FLEZeroWeightTest.java:167)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> Standard Output
> 2016-07-21 04:24:14,065 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-07-21 04:24:14,158 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-07-21 04:24:14,176 [myid:] - INFO  [main:ZKTestCase$1@55] - STARTING 
> testZeroWeightQuorum
> 2016-07-21 04:24:14,180 [myid:] - INFO  
> [main:JUnit4ZKTestRunner$LoggedInvokeMethod@77] - RUNNING TEST METHOD 
> testZeroWeightQuorum
> 2016-07-21 04:24:14,180 [myid:] - INFO  [main:FLEZeroWeightTest@143] - 
> TestZeroWeightQuorum: testZeroWeightQuorum, 9
> 2016-07-21 04:24:14,183 [myid:] - INFO  [main:PortAssignment@157] - Single 
> test process using ports from 11221 - 32767.
> 2016-07-21 04:24:14,187 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11222 from range 11221 - 32767.
> 2016-07-21 04:24:14,189 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11223 from range 11221 - 32767.
> 2016-07-21 04:24:14,189 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11224 from range 11221 - 32767.
> 2016-07-21 04:24:14,218 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11225 from range 11221 - 32767.
> 2016-07-21 04:24:14,218 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11226 from range 11221 - 32767.
> 2016-07-21 04:24:14,219 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11227 from range 11221 - 32767.
> 2016-07-21 04:24:14,219 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11228 from range 11221 - 32767.
> 2016-07-21 04:24:14,220 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11229 from range 11221 - 32767.
> 2016-07-21 04:24:14,220 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11230 from range 11221 - 32767.
> 2016-07-21 04:24:14,221 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11231 from range 11221 - 32767.
> 2016-07-21 04:24:14,224 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11232 from range 11221 - 32767.
> 2016-07-21 04:24:14,224 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11233 from range 11221 - 32767.
> 2016-07-21 04:24:14,225 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11234 from range 11221 - 32767.
> 2016-07-21 04:24:14,225 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11235 from range 11221 - 32767.
> 2016-07-21 04:24:14,225 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11236 from range 11221 - 32767.
> 2016-07-21 04:24:14,226 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11237 from range 11221 - 32767.
> 2016-07-21 04:24:14,226 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11238 from range 11221 - 32767.
> 2016-07-21 04:24:14,227 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11239 from range 11221 - 32767.
> 2016-07-21 04:24:14,227 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11240 from range 11221 - 32767.
> 2016-07-21 04:24:14,228 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11241 from range 11221 - 32767.
> 2016-07-21 04:24:14,228 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11242 from range 11221 - 32767.
> 2016-07-21 04:24:14,229 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11243 from range 11221 - 32767.
> 2016-07-21 04:24:14,229 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11244 from range 11221 - 32767.
> 2016-07-21 04:24:14,229 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11245 from range 11221 - 32767.
> 2016-07-21 04:24:14,230 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11246 from range 11221 - 32767.
> 2016-07-21 04:24:14,230 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 11247 from range 

Re: Decrease number of threads in Jenkins builds to reduce flakyness

2018-10-15 Thread Andor Molnar
+1



On Mon, Oct 15, 2018 at 1:55 PM, Enrico Olivelli 
wrote:

> Il giorno lun 15 ott 2018 alle ore 12:46 Andor Molnar
>  ha scritto:
> >
> > Thank you guys. This is great help.
> >
> > I remember your efforts Bogdan, as far as I remember you observer thread
> starvation in multiple runs on Apache Jenkins. Correct my if I’m wrong.
> >
> > I’ve created an umbrella Jira to capture all flaky test fixing efforts
> here:
> > https://issues.apache.org/jira/browse/ZOOKEEPER-3170 <
> https://issues.apache.org/jira/browse/ZOOKEEPER-3170>
> >
> > All previous flaky-related tickets have been converted to sub-tasks.
> Some of them might not be up-to-date, please consider reviewing them and
> close if possible. Additionally feel free to create new sub-tasks to
> capture your actual work.
> >
> > I’ve already modified Trunk and branch-3.5 builds to run on 4 threads
> for testing initially. It resulted in slightly more stable tests:
>
> +1
>
> I have assigned the umbrella issue to you Andor as you are driving
> this important task. is is ok ?
>
> thank you
>
> Enrico
>
>
> >
> > Trunk (java 8) - failing 1/4 (since #229) - build time increased by
> 40-45%
> > Trunk (java 9) - failing 0/2 (since #993) - ~40%
> > Trunk (java 10) - failing 1/2 (since #280) -
> > branch-3.5 (java 8) - failing 0/4 (since #1153) - ~35-45%
> >
> > However the pattern is not big enough and results are inaccurate, so I
> need more builds. I also need to fix a bug in SSL to get java9/10 builds
> working on 3.5.
> >
> > Please let me know if I should revert the changes. Precommit build is
> still running on 8 threads, but I’d like to change that one too.
> >
> > Regards,
> > Andor
> >
> >
> >
> > > On 2018. Oct 15., at 9:31, Bogdan Kanivets 
> wrote:
> > >
> > > Fangmin,
> > >
> > > Those are good ideas.
> > >
> > > FYI, I've stated running tests continuously in aws m1.xlarge.
> > > https://github.com/lavacat/zookeeper-tests-lab
> > >
> > > So far, I've done ~ 12 runs of trunk. Same common offenders as in Flaky
> > > dash: testManyChildWatchersAutoReset, testPurgeWhenLogRollingInProgr
> ess
> > > I'll do some more runs, then try to come up with report.
> > >
> > > I'm using aws and not Apache Jenkins env because of better
> > > control/observability.
> > >
> > >
> > >
> > >
> > > On Sun, Oct 14, 2018 at 4:58 PM Fangmin Lv 
> wrote:
> > >
> > >> Internally, we also did some works to reduce the flaky, here are the
> main
> > >> things we've done:
> > >>
> > >> * using retry rule to retry in case the zk client lost it's
> connection,
> > >> this could happen if the quorum tests is running on unstable
> environment
> > >> and the leader election happened.
> > >> * using random port instead of sequentially to avoid the port racing
> when
> > >> running tests concurrently
> > >> * changing tests to avoid using the same test path when
> creating/deleting
> > >> nodes
> > >>
> > >> These greatly reduced the flaky internally, we should try those if
> we're
> > >> seeing similar issues in the Jenkins.
> > >>
> > >> Fangmin
> > >>
> > >> On Sat, Oct 13, 2018 at 10:48 AM Bogdan Kanivets  >
> > >> wrote:
> > >>
> > >>> I've looked into flakiness couple months ago (special attention on
> > >>> testManyChildWatchersAutoReset). In my opinion the problem is a)
> and c).
> > >>> Unfortunately I don't have data to back this claim.
> > >>>
> > >>> I don't remember seeing many 'port binding' exceptions. Unless 'port
> > >>> assignment' issue manifested as some other exception.
> > >>>
> > >>> Before decreasing number of threads I think more data should be
> > >>> collected/visualized
> > >>>
> > >>> 1) Flaky dashboard is great, but we should add another report that
> maps
> > >>> 'error causes' to builds/tests
> > >>> 2) Flaky dash can be extended to save more history (for example like
> this
> > >>> https://www.chromium.org/developers/testing/flakiness-dashboard)
> > >>> 3) PreCommit builds should be included in dashboard
> > >>> 4) We should have a common clean benchmark. For example - take
> > >>> AWS t3.xlarge instance with set linux distro, jvm, zk commit sha and
> run
> > >>> tests (current 8 threads) for 8 hours with 1 min cooldown.
> > >>>
> > >>> Due to recent employment change, I got sidetracked, but I really
> want to
> > >>> get to the bottom of this.
> > >>> I'm going to setup 4) and report results to this mailing list. Also
> > >> willing
> > >>> to work on other items.
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> On Sat, Oct 13, 2018 at 4:59 AM Enrico Olivelli  >
> > >>> wrote:
> > >>>
> >  Il ven 12 ott 2018, 23:17 Benjamin Reed  ha
> scritto:
> > 
> > > i think the unique port assignment (d) is more problematic than it
> > > appears. there is a race between finding a free port and actually
> > > grabbing it. i think that contributes to the flakiness.
> > >
> > 
> >  This is very hard to solve for our test cases, because we need to
> build
> >  configs before starting the groups of servers.
> >  For 

ZooKeeper_branch35_jdk8 - Build # 1157 - Failure

2018-10-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/ZooKeeper_branch35_jdk8/1157/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 63.75 KB...]
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
24.422 sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.ReconfigBackupTest
[junit] Running 
org.apache.zookeeper.server.quorum.ReconfigDuringLeaderSyncTest in thread 4
[junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
7.06 sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.ReconfigDuringLeaderSyncTest
[junit] Running org.apache.zookeeper.server.quorum.ReconfigFailureCasesTest 
in thread 4
[junit] Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
93.841 sec, Thread: 3, Class: 
org.apache.zookeeper.server.quorum.QuorumRequestPipelineTest
[junit] Running org.apache.zookeeper.server.quorum.ReconfigLegacyTest in 
thread 3
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
46.659 sec, Thread: 3, Class: 
org.apache.zookeeper.server.quorum.ReconfigLegacyTest
[junit] Running org.apache.zookeeper.server.quorum.ReconfigRecoveryTest in 
thread 3
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
61.365 sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.ReconfigFailureCasesTest
[junit] Running 
org.apache.zookeeper.server.quorum.ReconfigRollingRestartCompatibilityTest in 
thread 4
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
22.117 sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.ReconfigRollingRestartCompatibilityTest
[junit] Running org.apache.zookeeper.server.quorum.RemotePeerBeanTest in 
thread 4
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.388 sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.RemotePeerBeanTest
[junit] Running org.apache.zookeeper.server.quorum.StandaloneDisabledTest 
in thread 4
[junit] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
176.1 sec, Thread: 2, Class: 
org.apache.zookeeper.server.quorum.QuorumPeerMainTest
[junit] Running org.apache.zookeeper.server.quorum.StatCommandTest in 
thread 2
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.424 sec, Thread: 2, Class: org.apache.zookeeper.server.quorum.StatCommandTest
[junit] Running org.apache.zookeeper.server.quorum.StatResetCommandTest in 
thread 2
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.442 sec, Thread: 2, Class: 
org.apache.zookeeper.server.quorum.StatResetCommandTest
[junit] Running org.apache.zookeeper.server.quorum.UnifiedServerSocketTest 
in thread 2
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.748 sec, Thread: 2, Class: 
org.apache.zookeeper.server.quorum.UnifiedServerSocketTest
[junit] Running org.apache.zookeeper.server.quorum.WatchLeakTest in thread 2
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
2.563 sec, Thread: 2, Class: org.apache.zookeeper.server.quorum.WatchLeakTest
[junit] Running org.apache.zookeeper.server.quorum.Zab1_0Test in thread 2
[junit] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
35.036 sec, Thread: 2, Class: org.apache.zookeeper.server.quorum.Zab1_0Test
[junit] Running org.apache.zookeeper.server.quorum.auth.MiniKdcTest in 
thread 2
[junit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
1.66 sec, Thread: 2, Class: org.apache.zookeeper.server.quorum.auth.MiniKdcTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumAuthUpgradeTest in thread 2
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
33.969 sec, Thread: 2, Class: 
org.apache.zookeeper.server.quorum.auth.QuorumAuthUpgradeTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumDigestAuthTest in thread 2
[junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
93.618 sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.StandaloneDisabledTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumKerberosAuthTest in thread 4
[junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.6 
sec, Thread: 4, Class: 
org.apache.zookeeper.server.quorum.auth.QuorumKerberosAuthTest
[junit] Running 
org.apache.zookeeper.server.quorum.auth.QuorumKerberosHostBasedAuthTest in 
thread 4
[junit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
19.75 sec, Thread: 2, Class: 
org.apache.zookeeper.server.quorum.auth.QuorumDigestAuthTest
[junit] Running org.apache.zookeeper.server.util.SerializeUtilsTest in 
thread 2
[junit] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.392 sec, Thread: 2, Class: 

Re: Decrease number of threads in Jenkins builds to reduce flakyness

2018-10-15 Thread Enrico Olivelli
Il giorno lun 15 ott 2018 alle ore 12:46 Andor Molnar
 ha scritto:
>
> Thank you guys. This is great help.
>
> I remember your efforts Bogdan, as far as I remember you observer thread 
> starvation in multiple runs on Apache Jenkins. Correct my if I’m wrong.
>
> I’ve created an umbrella Jira to capture all flaky test fixing efforts here:
> https://issues.apache.org/jira/browse/ZOOKEEPER-3170 
> 
>
> All previous flaky-related tickets have been converted to sub-tasks. Some of 
> them might not be up-to-date, please consider reviewing them and close if 
> possible. Additionally feel free to create new sub-tasks to capture your 
> actual work.
>
> I’ve already modified Trunk and branch-3.5 builds to run on 4 threads for 
> testing initially. It resulted in slightly more stable tests:

+1

I have assigned the umbrella issue to you Andor as you are driving
this important task. is is ok ?

thank you

Enrico


>
> Trunk (java 8) - failing 1/4 (since #229) - build time increased by 40-45%
> Trunk (java 9) - failing 0/2 (since #993) - ~40%
> Trunk (java 10) - failing 1/2 (since #280) -
> branch-3.5 (java 8) - failing 0/4 (since #1153) - ~35-45%
>
> However the pattern is not big enough and results are inaccurate, so I need 
> more builds. I also need to fix a bug in SSL to get java9/10 builds working 
> on 3.5.
>
> Please let me know if I should revert the changes. Precommit build is still 
> running on 8 threads, but I’d like to change that one too.
>
> Regards,
> Andor
>
>
>
> > On 2018. Oct 15., at 9:31, Bogdan Kanivets  wrote:
> >
> > Fangmin,
> >
> > Those are good ideas.
> >
> > FYI, I've stated running tests continuously in aws m1.xlarge.
> > https://github.com/lavacat/zookeeper-tests-lab
> >
> > So far, I've done ~ 12 runs of trunk. Same common offenders as in Flaky
> > dash: testManyChildWatchersAutoReset, testPurgeWhenLogRollingInProgress
> > I'll do some more runs, then try to come up with report.
> >
> > I'm using aws and not Apache Jenkins env because of better
> > control/observability.
> >
> >
> >
> >
> > On Sun, Oct 14, 2018 at 4:58 PM Fangmin Lv  wrote:
> >
> >> Internally, we also did some works to reduce the flaky, here are the main
> >> things we've done:
> >>
> >> * using retry rule to retry in case the zk client lost it's connection,
> >> this could happen if the quorum tests is running on unstable environment
> >> and the leader election happened.
> >> * using random port instead of sequentially to avoid the port racing when
> >> running tests concurrently
> >> * changing tests to avoid using the same test path when creating/deleting
> >> nodes
> >>
> >> These greatly reduced the flaky internally, we should try those if we're
> >> seeing similar issues in the Jenkins.
> >>
> >> Fangmin
> >>
> >> On Sat, Oct 13, 2018 at 10:48 AM Bogdan Kanivets 
> >> wrote:
> >>
> >>> I've looked into flakiness couple months ago (special attention on
> >>> testManyChildWatchersAutoReset). In my opinion the problem is a) and c).
> >>> Unfortunately I don't have data to back this claim.
> >>>
> >>> I don't remember seeing many 'port binding' exceptions. Unless 'port
> >>> assignment' issue manifested as some other exception.
> >>>
> >>> Before decreasing number of threads I think more data should be
> >>> collected/visualized
> >>>
> >>> 1) Flaky dashboard is great, but we should add another report that maps
> >>> 'error causes' to builds/tests
> >>> 2) Flaky dash can be extended to save more history (for example like this
> >>> https://www.chromium.org/developers/testing/flakiness-dashboard)
> >>> 3) PreCommit builds should be included in dashboard
> >>> 4) We should have a common clean benchmark. For example - take
> >>> AWS t3.xlarge instance with set linux distro, jvm, zk commit sha and run
> >>> tests (current 8 threads) for 8 hours with 1 min cooldown.
> >>>
> >>> Due to recent employment change, I got sidetracked, but I really want to
> >>> get to the bottom of this.
> >>> I'm going to setup 4) and report results to this mailing list. Also
> >> willing
> >>> to work on other items.
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> On Sat, Oct 13, 2018 at 4:59 AM Enrico Olivelli 
> >>> wrote:
> >>>
>  Il ven 12 ott 2018, 23:17 Benjamin Reed  ha scritto:
> 
> > i think the unique port assignment (d) is more problematic than it
> > appears. there is a race between finding a free port and actually
> > grabbing it. i think that contributes to the flakiness.
> >
> 
>  This is very hard to solve for our test cases, because we need to build
>  configs before starting the groups of servers.
>  For tests in single server it will be easier, you just have to start
> >> the
>  server on port zero, get the port and the create client configs.
>  I don't know how much it will be worth
> 
>  Enrico
> 
> 
> > ben
> > On Fri, Oct 12, 2018 at 8:50 AM Andor Molnar 
> >> wrote:
> >>
> >> That is a 

[jira] [Assigned] (ZOOKEEPER-3170) Umbrella for eliminating ZooKeeper flaky tests

2018-10-15 Thread Enrico Olivelli (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Enrico Olivelli reassigned ZOOKEEPER-3170:
--

Assignee: Andor Molnar

> Umbrella for eliminating ZooKeeper flaky tests
> --
>
> Key: ZOOKEEPER-3170
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3170
> Project: ZooKeeper
>  Issue Type: Test
>  Components: tests
>Reporter: Andor Molnar
>Assignee: Andor Molnar
>Priority: Major
>
> Umbrella ticket for joint community efforts to reduce number of flaky tests 
> and improve the stability of our Jenkins builds.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (ZOOKEEPER-2807) Flaky test: org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar reassigned ZOOKEEPER-2807:
---

Assignee: Andor Molnar  (was: Abraham Fine)

> Flaky test: 
> org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged
> -
>
> Key: ZOOKEEPER-2807
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2807
> Project: ZooKeeper
>  Issue Type: Sub-task
>Reporter: Abraham Fine
>Assignee: Andor Molnar
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zookeeper issue #300: ZOOKEEPER-2807: Flaky test: org.apache.zookeeper.test....

2018-10-15 Thread asfgit
Github user asfgit commented on the issue:

https://github.com/apache/zookeeper/pull/300
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2431/



---


Success: ZOOKEEPER- PreCommit Build #2431

2018-10-15 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2431/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 78.04 MB...]
 [exec] 
==
 [exec] Adding comment to Jira.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] 
 [exec] Error: No value specified for option "issue"
 [exec] Session logged out. Session was 
JSESSIONID=E6AD7C6E05DDFA4C1FDE68B370D70296.
 [exec] 
 [exec] 
 [exec] 
==
 [exec] 
==
 [exec] Finished build.
 [exec] 
==
 [exec] 
==
 [exec] 
 [exec] 
 [exec] mv: 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 and 
'/home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-github-pr-build/patchprocess'
 are the same file

BUILD SUCCESSFUL
Total time: 17 minutes 19 seconds
Archiving artifacts
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Recording test results
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
[description-setter] Description set: ZOOKEEPER-2807
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Adding one-line test results to commit status...
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting status of fedd1734aae0c6531e9e6a1e6b34e04d3abd0f4f to SUCCESS with url 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2431/ and 
message: 'SUCCESS 
 1760 tests run, 1 skipped, 0 failed.'
Using context: Jenkins

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2431/

Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Email was triggered for: Success
Sending email for trigger: Success
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/
Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8
Setting MAVEN_3_LATEST__HOME=/home/jenkins/tools/maven/latest3/



###
## FAILED TESTS (if any) 
##
All tests passed

[GitHub] zookeeper issue #300: ZOOKEEPER-2807: Flaky test: org.apache.zookeeper.test....

2018-10-15 Thread anmolnar
Github user anmolnar commented on the issue:

https://github.com/apache/zookeeper/pull/300
  
@lavacat @lvfangmin
This is a potential flaky test fix you might want to take a quick look.


---


[jira] [Updated] (ZOOKEEPER-2807) Flaky test: org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged

2018-10-15 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated ZOOKEEPER-2807:
--
Labels: pull-request-available  (was: )

> Flaky test: 
> org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged
> -
>
> Key: ZOOKEEPER-2807
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2807
> Project: ZooKeeper
>  Issue Type: Sub-task
>Reporter: Abraham Fine
>Assignee: Abraham Fine
>Priority: Major
>  Labels: pull-request-available
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Decrease number of threads in Jenkins builds to reduce flakyness

2018-10-15 Thread Andor Molnar
Thank you guys. This is great help.

I remember your efforts Bogdan, as far as I remember you observer thread 
starvation in multiple runs on Apache Jenkins. Correct my if I’m wrong.

I’ve created an umbrella Jira to capture all flaky test fixing efforts here:
https://issues.apache.org/jira/browse/ZOOKEEPER-3170 


All previous flaky-related tickets have been converted to sub-tasks. Some of 
them might not be up-to-date, please consider reviewing them and close if 
possible. Additionally feel free to create new sub-tasks to capture your actual 
work.

I’ve already modified Trunk and branch-3.5 builds to run on 4 threads for 
testing initially. It resulted in slightly more stable tests:

Trunk (java 8) - failing 1/4 (since #229) - build time increased by 40-45%
Trunk (java 9) - failing 0/2 (since #993) - ~40%
Trunk (java 10) - failing 1/2 (since #280) - 
branch-3.5 (java 8) - failing 0/4 (since #1153) - ~35-45%

However the pattern is not big enough and results are inaccurate, so I need 
more builds. I also need to fix a bug in SSL to get java9/10 builds working on 
3.5.

Please let me know if I should revert the changes. Precommit build is still 
running on 8 threads, but I’d like to change that one too.

Regards,
Andor
 


> On 2018. Oct 15., at 9:31, Bogdan Kanivets  wrote:
> 
> Fangmin,
> 
> Those are good ideas.
> 
> FYI, I've stated running tests continuously in aws m1.xlarge.
> https://github.com/lavacat/zookeeper-tests-lab
> 
> So far, I've done ~ 12 runs of trunk. Same common offenders as in Flaky
> dash: testManyChildWatchersAutoReset, testPurgeWhenLogRollingInProgress
> I'll do some more runs, then try to come up with report.
> 
> I'm using aws and not Apache Jenkins env because of better
> control/observability.
> 
> 
> 
> 
> On Sun, Oct 14, 2018 at 4:58 PM Fangmin Lv  wrote:
> 
>> Internally, we also did some works to reduce the flaky, here are the main
>> things we've done:
>> 
>> * using retry rule to retry in case the zk client lost it's connection,
>> this could happen if the quorum tests is running on unstable environment
>> and the leader election happened.
>> * using random port instead of sequentially to avoid the port racing when
>> running tests concurrently
>> * changing tests to avoid using the same test path when creating/deleting
>> nodes
>> 
>> These greatly reduced the flaky internally, we should try those if we're
>> seeing similar issues in the Jenkins.
>> 
>> Fangmin
>> 
>> On Sat, Oct 13, 2018 at 10:48 AM Bogdan Kanivets 
>> wrote:
>> 
>>> I've looked into flakiness couple months ago (special attention on
>>> testManyChildWatchersAutoReset). In my opinion the problem is a) and c).
>>> Unfortunately I don't have data to back this claim.
>>> 
>>> I don't remember seeing many 'port binding' exceptions. Unless 'port
>>> assignment' issue manifested as some other exception.
>>> 
>>> Before decreasing number of threads I think more data should be
>>> collected/visualized
>>> 
>>> 1) Flaky dashboard is great, but we should add another report that maps
>>> 'error causes' to builds/tests
>>> 2) Flaky dash can be extended to save more history (for example like this
>>> https://www.chromium.org/developers/testing/flakiness-dashboard)
>>> 3) PreCommit builds should be included in dashboard
>>> 4) We should have a common clean benchmark. For example - take
>>> AWS t3.xlarge instance with set linux distro, jvm, zk commit sha and run
>>> tests (current 8 threads) for 8 hours with 1 min cooldown.
>>> 
>>> Due to recent employment change, I got sidetracked, but I really want to
>>> get to the bottom of this.
>>> I'm going to setup 4) and report results to this mailing list. Also
>> willing
>>> to work on other items.
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Sat, Oct 13, 2018 at 4:59 AM Enrico Olivelli 
>>> wrote:
>>> 
 Il ven 12 ott 2018, 23:17 Benjamin Reed  ha scritto:
 
> i think the unique port assignment (d) is more problematic than it
> appears. there is a race between finding a free port and actually
> grabbing it. i think that contributes to the flakiness.
> 
 
 This is very hard to solve for our test cases, because we need to build
 configs before starting the groups of servers.
 For tests in single server it will be easier, you just have to start
>> the
 server on port zero, get the port and the create client configs.
 I don't know how much it will be worth
 
 Enrico
 
 
> ben
> On Fri, Oct 12, 2018 at 8:50 AM Andor Molnar 
>> wrote:
>> 
>> That is a completely valid point. I started to investigate flakies
>>> for
> exactly the same reason, if you remember the thread that I started a
 while
> ago. It was later abandoned unfortunately, because I’ve run into a
>> few
> issues:
>> 
>> - We nailed down that in order to release 3.5 stable, we have to
>> make
> sure it’s not worse than 3.4 by comparing the builds: but these
>> 

[jira] [Updated] (ZOOKEEPER-3171) Create pom.xml for recipes and contrib

2018-10-15 Thread Norbert Kalmar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Norbert Kalmar updated ZOOKEEPER-3171:
--
Description: 
After the directory structures has been created, it is time to create the pom 
files for all the modules, and create the build hierarchy. 
At first, ant should remain in place until we are sure maven works fine.

After maven build is stable for jute, server, client and common recipes and 
contrib should be finished as well.

The different modules will get their maven structure:
{noformat}
zookeeper-[something]
| -src
|| -main
||| -java
||| \org...
||\resources
|| -test (unit tests only)
||| -java
|||   \org...
||\ resources
|| - it (integration tests)
|\pom.xml
{noformat}

  was:
After the directory structures has been created, it is time to create the pom 
files for all the modules, and create the build hierarchy. 
At first, ant should remain in place until we are sure maven works fine.

jute, server, client and common should be priority first. docs is handled in a 
different jira, as it is also being migrated. Recipes and contrib will remain 
for last.

The different modules will get their maven structure:
{noformat}
zookeeper-[something]
| -src
|| -main
||| -java
||| \org...
||\resources
|| -test (unit tests only)
||| -java
|||   \org...
||\ resources
|| - it (integration tests)
|\pom.xml
{noformat}


> Create pom.xml for recipes and contrib
> --
>
> Key: ZOOKEEPER-3171
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3171
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: build, scripts
>Affects Versions: 3.6.0
>Reporter: Norbert Kalmar
>Assignee: Norbert Kalmar
>Priority: Major
>
> After the directory structures has been created, it is time to create the pom 
> files for all the modules, and create the build hierarchy. 
> At first, ant should remain in place until we are sure maven works fine.
> After maven build is stable for jute, server, client and common recipes and 
> contrib should be finished as well.
> The different modules will get their maven structure:
> {noformat}
> zookeeper-[something]
> | -src
> || -main
> ||| -java
> ||| \org...
> ||\resources
> || -test (unit tests only)
> ||| -java
> |||   \org...
> ||\ resources
> || - it (integration tests)
> |\pom.xml
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZOOKEEPER-3171) Create pom.xml for recipes and contrib

2018-10-15 Thread Norbert Kalmar (JIRA)
Norbert Kalmar created ZOOKEEPER-3171:
-

 Summary: Create pom.xml for recipes and contrib
 Key: ZOOKEEPER-3171
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3171
 Project: ZooKeeper
  Issue Type: Sub-task
  Components: build, scripts
Affects Versions: 3.6.0
Reporter: Norbert Kalmar
Assignee: Norbert Kalmar


After the directory structures has been created, it is time to create the pom 
files for all the modules, and create the build hierarchy. 
At first, ant should remain in place until we are sure maven works fine.

jute, server, client and common should be priority first. docs is handled in a 
different jira, as it is also being migrated. Recipes and contrib will remain 
for last.

The different modules will get their maven structure:
{noformat}
zookeeper-[something]
| -src
|| -main
||| -java
||| \org...
||\resources
|| -test (unit tests only)
||| -java
|||   \org...
||\ resources
|| - it (integration tests)
|\pom.xml
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3029) Create pom.xml for jute, server, client and common

2018-10-15 Thread Norbert Kalmar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Norbert Kalmar updated ZOOKEEPER-3029:
--
Description: 
After the directory structures has been created, it is time to create the pom 
files for all the modules, and create the build hierarchy. 
At first, ant should remain in place until we are sure maven works fine.

jute, server, client and common should be priority first. docs is handled in a 
different jira, as it is also being migrated. Recipes and contrib will remain 
for last.

The different modules will get their maven structure:
{noformat}
zookeeper-[something]
| -src
|| -main
||| -java
||| \org...
||\resources
|| -test (unit tests only)
||| -java
|||   \org...
||\ resources
|| - it (integration tests)
|\pom.xml
{noformat}

  was:
After the directory structures has been created, it is time to create the pom 
files for all the modules, and create the build hierarchy. 
At first, Ant should remain in place until we are sure maven works fine.

The most straight forward is creating the maven pom.xml for the server, client 
and common parts, as they are fairly easy to build (unlike recipes and contrib)

The different modules will get their maven structure:
{noformat}
zookeeper-[something]
| -src
|| -main
||| -java
||| \org...
||\resources
|| -test (unit tests only)
||| -java
|||   \org...
||\ resources
|| - it (integration tests)
|\pom.xml
{noformat}


> Create pom.xml for jute, server, client and common
> --
>
> Key: ZOOKEEPER-3029
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3029
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: build, scripts
>Affects Versions: 3.6.0
>Reporter: Norbert Kalmar
>Assignee: Norbert Kalmar
>Priority: Major
>
> After the directory structures has been created, it is time to create the pom 
> files for all the modules, and create the build hierarchy. 
> At first, ant should remain in place until we are sure maven works fine.
> jute, server, client and common should be priority first. docs is handled in 
> a different jira, as it is also being migrated. Recipes and contrib will 
> remain for last.
> The different modules will get their maven structure:
> {noformat}
> zookeeper-[something]
> | -src
> || -main
> ||| -java
> ||| \org...
> ||\resources
> || -test (unit tests only)
> ||| -java
> |||   \org...
> ||\ resources
> || - it (integration tests)
> |\pom.xml
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3029) Create pom.xml for jute, server, client and common

2018-10-15 Thread Norbert Kalmar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Norbert Kalmar updated ZOOKEEPER-3029:
--
Summary: Create pom.xml for jute, server, client and common  (was: Create 
pom.xml for server, client and common)

> Create pom.xml for jute, server, client and common
> --
>
> Key: ZOOKEEPER-3029
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3029
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: build, scripts
>Affects Versions: 3.6.0
>Reporter: Norbert Kalmar
>Assignee: Norbert Kalmar
>Priority: Major
>
> After the directory structures has been created, it is time to create the pom 
> files for all the modules, and create the build hierarchy. 
> At first, Ant should remain in place until we are sure maven works fine.
> The most straight forward is creating the maven pom.xml for the server, 
> client and common parts, as they are fairly easy to build (unlike recipes and 
> contrib)
> The different modules will get their maven structure:
> {noformat}
> zookeeper-[something]
> | -src
> || -main
> ||| -java
> ||| \org...
> ||\resources
> || -test (unit tests only)
> ||| -java
> |||   \org...
> ||\ resources
> || - it (integration tests)
> |\pom.xml
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2610) Flaky Test: org.apache.zookeeper.test.ReconfigTest.testQuorumSystemChange

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2610:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: org.apache.zookeeper.test.ReconfigTest.testQuorumSystemChange
> -
>
> Key: ZOOKEEPER-2610
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2610
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: quorum, server, tests
>Affects Versions: 3.5.2
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.6.0
>
>
> {noformat}
> Regression
> org.apache.zookeeper.test.ReconfigTest.testQuorumSystemChange (from 
> org.apache.zookeeper.test.NioNettySuiteTest)
> Failing for the past 1 build (Since Failed#3462 )
> Took 2 min 10 sec.
> Error Message
> Waiting for server up
> Stacktrace
> junit.framework.AssertionFailedError: Waiting for server up
>   at org.apache.zookeeper.test.QuorumUtil.restart(QuorumUtil.java:216)
>   at 
> org.apache.zookeeper.test.ReconfigTest.testQuorumSystemChange(ReconfigTest.java:861)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> Standard Output
> 2016-10-04 01:04:03,140 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,170 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,179 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,182 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,186 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,190 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,200 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,204 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,208 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,276 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,279 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,282 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,284 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,285 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,286 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,286 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,291 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,292 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-10-04 01:04:03,304 [myid:] - INFO  [main:PortAssignment@151] - Test 
> process 3/8 using ports from 16607 - 19299.
> 2016-10-04 01:04:03,308 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 16608 from range 16607 - 19299.
> 2016-10-04 01:04:03,316 [myid:] - INFO  [main:ZKTestCase$1@55] - STARTING 
> testAcls
> 2016-10-04 01:04:03,317 [myid:] - INFO  
> [main:JUnit4ZKTestRunner$LoggedInvokeMethod@77] - RUNNING TEST METHOD testAcls
> 2016-10-04 01:04:03,337 [myid:] - INFO  [main:Environment@109] - Server 
> environment:zookeeper.version=3.6.0-SNAPSHOT--1, built on 10/04/2016 00:56 GMT
> 2016-10-04 01:04:03,337 [myid:] - INFO  [main:Environment@109] - Server 
> environment:host.name=asf905.gq1.ygridcore.net
> 2016-10-04 01:04:03,337 [myid:] - INFO  [main:Environment@109] - Server 
> environment:java.version=1.7.0_80
> 2016-10-04 01:04:03,337 [myid:] - INFO  [main:Environment@109] - Server 
> environment:java.vendor=Oracle Corporation
> 2016-10-04 01:04:03,337 [myid:] - INFO  [main:Environment@109] - Server 
> environment:java.home=/usr/local/asfpackages/java/jdk1.7.0_80/jre
> 2016-10-04 01:04:03,337 [myid:] - INFO  [main:Environment@109] - Server 
> 

[jira] [Updated] (ZOOKEEPER-2538) Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalObserverRun

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2538:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: 
> org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalObserverRun
> ---
>
> Key: ZOOKEEPER-2538
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2538
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: quorum, server, tests
>Affects Versions: 3.5.2
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.6.0, 3.5.5
>
>
> The failure of this test is fairly often. Might relate to ZOOKEEPER-1798.
> {noformat}
> org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalObserverRun
> Failing for the past 1 build (Since Failed#1143 )
> Took 0 ms.
> Error Message
> Timeout occurred. Please note the time in the report does not reflect the 
> time until the timeout.
> Stacktrace
> junit.framework.AssertionFailedError: Timeout occurred. Please note the time 
> in the report does not reflect the time until the timeout.
>   at java.lang.Thread.run(Thread.java:745)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2499) Flaky Test: org.apache.zookeeper.test.SSLTest.testSecureQuorumServer

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2499:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky Test: org.apache.zookeeper.test.SSLTest.testSecureQuorumServer 
> -
>
> Key: ZOOKEEPER-2499
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2499
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.5.2
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.6.0, 3.5.5
>
>
> {noformat}
> Error Message
> waiting for server 0 being up
> Stacktrace
> junit.framework.AssertionFailedError: waiting for server 0 being up
>   at 
> org.apache.zookeeper.test.SSLTest.testSecureQuorumServer(SSLTest.java:100)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> Standard Output
> 2016-08-03 05:33:41,529 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-08-03 05:33:41,594 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-08-03 05:33:41,608 [myid:] - INFO  [main:ZKTestCase$1@55] - STARTING 
> testSecureQuorumServer
> 2016-08-03 05:33:41,611 [myid:] - INFO  
> [main:JUnit4ZKTestRunner$LoggedInvokeMethod@77] - RUNNING TEST METHOD 
> testSecureQuorumServer
> 2016-08-03 05:33:41,614 [myid:] - INFO  [main:PortAssignment@151] - Test 
> process 8/8 using ports from 30072 - 32764.
> 2016-08-03 05:33:41,616 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30073 from range 30072 - 32764.
> 2016-08-03 05:33:41,617 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30074 from range 30072 - 32764.
> 2016-08-03 05:33:41,617 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30075 from range 30072 - 32764.
> 2016-08-03 05:33:41,617 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30076 from range 30072 - 32764.
> 2016-08-03 05:33:41,618 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30077 from range 30072 - 32764.
> 2016-08-03 05:33:41,618 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30078 from range 30072 - 32764.
> 2016-08-03 05:33:41,618 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30079 from range 30072 - 32764.
> 2016-08-03 05:33:41,619 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30080 from range 30072 - 32764.
> 2016-08-03 05:33:41,619 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30081 from range 30072 - 32764.
> 2016-08-03 05:33:41,620 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30082 from range 30072 - 32764.
> 2016-08-03 05:33:41,620 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30083 from range 30072 - 32764.
> 2016-08-03 05:33:41,623 [myid:] - INFO  [main:PortAssignment@85] - Assigned 
> port 30084 from range 30072 - 32764.
> 2016-08-03 05:33:41,641 [myid:] - INFO  
> [main:QuorumPeerTestBase$MainThread@131] - id = 0 tmpDir = 
> /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/trunk/build/test/tmp/test8166855371662584608.junit.dir
>  clientPort = -1 adminServerPort = 8080
> 2016-08-03 05:33:41,647 [myid:] - INFO  
> [main:QuorumPeerTestBase$MainThread@131] - id = 1 tmpDir = 
> /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/trunk/build/test/tmp/test5311610672905591522.junit.dir
>  clientPort = -1 adminServerPort = 8080
> 2016-08-03 05:33:41,648 [myid:] - INFO  
> [main:QuorumPeerTestBase$MainThread@131] - id = 2 tmpDir = 
> /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/trunk/build/test/tmp/test4754133370740902988.junit.dir
>  clientPort = -1 adminServerPort = 8080
> 2016-08-03 05:33:41,651 [myid:] - INFO  [Thread-1:QuorumPeerConfig@116] - 
> Reading configuration from: 
> /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/trunk/build/test/tmp/test5311610672905591522.junit.dir/zoo.cfg
> 2016-08-03 05:33:41,651 [myid:] - INFO  [Thread-0:QuorumPeerConfig@116] - 
> Reading configuration from: 
> /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/trunk/build/test/tmp/test8166855371662584608.junit.dir/zoo.cfg
> 2016-08-03 05:33:41,651 [myid:] - INFO  [Thread-2:QuorumPeerConfig@116] - 
> Reading configuration from: 
> /home/jenkins/jenkins-slave/workspace/PreCommit-ZOOKEEPER-Build/trunk/build/test/tmp/test4754133370740902988.junit.dir/zoo.cfg
> 2016-08-03 05:33:41,651 [myid:] - INFO  [main:FourLetterWordMain@85] - 
> connecting to 127.0.0.1 30073
> 2016-08-03 05:33:41,653 [myid:] - INFO  [Thread-2:QuorumPeerConfig@308] - 
> clientPort is not set
> 2016-08-03 05:33:41,653 [myid:] - INFO  [Thread-1:QuorumPeerConfig@308] - 
> 

[jira] [Updated] (ZOOKEEPER-3089) Flaky test:StaticHostProviderTest.testNextDoesNotSleepForZero

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-3089:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky test:StaticHostProviderTest.testNextDoesNotSleepForZero
> -
>
> Key: ZOOKEEPER-3089
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3089
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.4.12
>Reporter: maoling
>Priority: Minor
>
> Flaky test:
> https://builds.apache.org/job/ZooKeeper_branch34_java9/322/testReport/junit/org.apache.zookeeper.test/StaticHostProviderTest/testNextDoesNotSleepForZero/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2807) Flaky test: org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2807:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky test: 
> org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged
> -
>
> Key: ZOOKEEPER-2807
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2807
> Project: ZooKeeper
>  Issue Type: Sub-task
>Reporter: Abraham Fine
>Assignee: Abraham Fine
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2970) Flaky Test: testNullQuorumAuthServerWithValidQuorumAuthPacket

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2970:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky Test: testNullQuorumAuthServerWithValidQuorumAuthPacket 
> --
>
> Key: ZOOKEEPER-2970
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2970
> Project: ZooKeeper
>  Issue Type: Sub-task
>Affects Versions: 3.4.5
>Reporter: Mark Fenes
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2486) Flaky Test: org.apache.zookeeper.test.QuorumZxidSyncTest.testBehindLeader

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2486:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: org.apache.zookeeper.test.QuorumZxidSyncTest.testBehindLeader
> -
>
> Key: ZOOKEEPER-2486
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2486
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.4.8
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.5.2
>
>
> From https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1156
> {noformat}
> Error Message
> waiting for server up
> Stacktrace
> junit.framework.AssertionFailedError: waiting for server up
>   at 
> org.apache.zookeeper.test.QuorumBase.startServers(QuorumBase.java:183)
>   at 
> org.apache.zookeeper.test.QuorumBase.startServers(QuorumBase.java:113)
>   at 
> org.apache.zookeeper.test.QuorumZxidSyncTest.testBehindLeader(QuorumZxidSyncTest.java:67)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:55)
> Standard Output
> 2016-07-21 08:11:45,722 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11221
> 2016-07-21 08:11:45,729 [myid:] - INFO  [main:ZKTestCase$1@50] - STARTING 
> testBehindLeader
> 2016-07-21 08:11:45,729 [myid:] - INFO  [main:QuorumBase@69] - 
> QuorumBase.setup null
> 2016-07-21 08:11:45,926 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11222
> 2016-07-21 08:11:45,926 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11223
> 2016-07-21 08:11:45,927 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11224
> 2016-07-21 08:11:45,927 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11225
> 2016-07-21 08:11:45,927 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11226
> 2016-07-21 08:11:45,928 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11227
> 2016-07-21 08:11:45,928 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11228
> 2016-07-21 08:11:45,928 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11229
> 2016-07-21 08:11:45,928 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11230
> 2016-07-21 08:11:45,929 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11231
> 2016-07-21 08:11:45,929 [myid:] - INFO  [main:QuorumBase@93] - Ports are: 
> 127.0.0.1:11222,127.0.0.1:11223,127.0.0.1:11224,127.0.0.1:11225,127.0.0.1:11226
> 2016-07-21 08:11:45,946 [myid:] - INFO  [main:QuorumPeer$QuorumServer@149] - 
> Resolved hostname: 127.0.0.1 to address: /127.0.0.1
> 2016-07-21 08:11:45,946 [myid:] - INFO  [main:QuorumPeer$QuorumServer@149] - 
> Resolved hostname: 127.0.0.1 to address: /127.0.0.1
> 2016-07-21 08:11:45,948 [myid:] - INFO  [main:QuorumPeer$QuorumServer@149] - 
> Resolved hostname: 127.0.0.1 to address: /127.0.0.1
> 2016-07-21 08:11:45,948 [myid:] - INFO  [main:QuorumPeer$QuorumServer@149] - 
> Resolved hostname: 127.0.0.1 to address: /127.0.0.1
> 2016-07-21 08:11:45,949 [myid:] - INFO  [main:QuorumPeer$QuorumServer@149] - 
> Resolved hostname: 127.0.0.1 to address: /127.0.0.1
> 2016-07-21 08:11:45,949 [myid:] - INFO  [main:QuorumBase@142] - creating 
> QuorumPeer 1 port 11222
> 2016-07-21 08:11:45,961 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - 
> binding to port 0.0.0.0/0.0.0.0:11222
> 2016-07-21 08:11:45,979 [myid:] - INFO  [main:QuorumBase@145] - creating 
> QuorumPeer 2 port 11223
> 2016-07-21 08:11:45,979 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - 
> binding to port 0.0.0.0/0.0.0.0:11223
> 2016-07-21 08:11:45,980 [myid:] - INFO  [main:QuorumBase@148] - creating 
> QuorumPeer 3 port 11224
> 2016-07-21 08:11:45,980 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - 
> binding to port 0.0.0.0/0.0.0.0:11224
> 2016-07-21 08:11:45,981 [myid:] - INFO  [main:QuorumBase@151] - creating 
> QuorumPeer 4 port 11225
> 2016-07-21 08:11:45,981 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - 
> binding to port 0.0.0.0/0.0.0.0:11225
> 2016-07-21 08:11:45,981 [myid:] - INFO  [main:QuorumBase@154] - creating 
> QuorumPeer 5 port 11226
> 2016-07-21 08:11:45,982 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - 
> binding to port 0.0.0.0/0.0.0.0:11226
> 2016-07-21 08:11:45,982 [myid:] - INFO  [main:QuorumBase@163] - QuorumPeer 1 
> voting view: 
> {1=org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@47628981, 
> 2=org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@163198c4, 
> 3=org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@1224773e, 
> 4=org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@181090c0, 
> 5=org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@678f3997}
> 

[jira] [Updated] (ZOOKEEPER-3023) Flaky test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-3023:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky test: 
> org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff
> ---
>
> Key: ZOOKEEPER-3023
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3023
> Project: ZooKeeper
>  Issue Type: Sub-task
>Affects Versions: 3.6.0
>Reporter: Pravin Dsilva
>Assignee: maoling
>Priority: Major
>
> Getting the following error on master branch:
> Error Message
> {code:java}
> expected:<4294967298> but was:<0>{code}
> Stacktrace
> {code:java}
> junit.framework.AssertionFailedError: expected:<4294967298> but was:<0> at 
> org.apache.zookeeper.server.quorum.Zab1_0Test$5.converseWithFollower(Zab1_0Test.java:876)
>  at 
> org.apache.zookeeper.server.quorum.Zab1_0Test.testFollowerConversation(Zab1_0Test.java:523)
>  at 
> org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff(Zab1_0Test.java:791)
>  at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79){code}
> Flaky 
> test:https://builds.apache.org/job/ZooKeeper-trunk-java10/141/testReport/junit/org.apache.zookeeper.server.quorum/Zab1_0Test/testNormalFollowerRunWithDiff/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2529) Flaky Test: org.apache.zookeeper.test.NonRecoverableErrorTest.testZooKeeperServiceAvailableOnLeader

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2529:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: 
> org.apache.zookeeper.test.NonRecoverableErrorTest.testZooKeeperServiceAvailableOnLeader
> ---
>
> Key: ZOOKEEPER-2529
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2529
> Project: ZooKeeper
>  Issue Type: Sub-task
>Affects Versions: 3.4.9, 3.5.3
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
>
> This flaky is introduced by ZOOKEEPER-2247 recently.
> {noformat}
> Error Message
> IOException is expected due to error injected to transaction log commit
> Stacktrace
> junit.framework.AssertionFailedError: IOException is expected due to error 
> injected to transaction log commit
>   at 
> org.apache.zookeeper.test.NonRecoverableErrorTest.testZooKeeperServiceAvailableOnLeader(NonRecoverableErrorTest.java:115)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>   at java.lang.Thread.run(Thread.java:745)
> Standard Output
> 2016-08-24 19:20:17,000 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-08-24 19:20:17,142 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No 
> test.method specified. using default methods.
> 2016-08-24 19:20:17,215 [myid:] - INFO  [main:ZKTestCase$1@55] - STARTING 
> testZooKeeperServiceAvailableOnLeader
> 2016-08-24 19:20:17,222 [myid:] - INFO  [Time-limited 
> test:JUnit4ZKTestRunner$LoggedInvokeMethod@77] - RUNNING TEST METHOD 
> testZooKeeperServiceAvailableOnLeader
> 2016-08-24 19:20:17,228 [myid:] - INFO  [Time-limited 
> test:PortAssignment@151] - Test process 1/8 using ports from 11221 - 13913.
> 2016-08-24 19:20:17,230 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11222 from range 11221 - 13913.
> 2016-08-24 19:20:17,231 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11223 from range 11221 - 13913.
> 2016-08-24 19:20:17,231 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11224 from range 11221 - 13913.
> 2016-08-24 19:20:17,232 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11225 from range 11221 - 13913.
> 2016-08-24 19:20:17,232 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11226 from range 11221 - 13913.
> 2016-08-24 19:20:17,232 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11227 from range 11221 - 13913.
> 2016-08-24 19:20:17,233 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11228 from range 11221 - 13913.
> 2016-08-24 19:20:17,233 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11229 from range 11221 - 13913.
> 2016-08-24 19:20:17,234 [myid:] - INFO  [Time-limited test:PortAssignment@85] 
> - Assigned port 11230 from range 11221 - 13913.
> 2016-08-24 19:20:17,256 [myid:] - INFO  [Time-limited 
> test:QuorumPeerTestBase$MainThread@131] - id = 0 tmpDir = 
> /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test7330020881446886387.junit.dir
>  clientPort = 11222 adminServerPort = 8080
> 2016-08-24 19:20:17,262 [myid:] - INFO  [Time-limited 
> test:QuorumPeerTestBase$MainThread@131] - id = 1 tmpDir = 
> /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test7260737707555606353.junit.dir
>  clientPort = 11225 adminServerPort = 8080
> 2016-08-24 19:20:17,267 [myid:] - INFO  [Time-limited 
> test:QuorumPeerTestBase$MainThread@131] - id = 2 tmpDir = 
> /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test1038022970424066351.junit.dir
>  clientPort = 11228 adminServerPort = 8080
> 2016-08-24 19:20:17,268 [myid:] - INFO  [Thread-1:QuorumPeerConfig@116] - 
> Reading configuration from: 
> /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test7260737707555606353.junit.dir/zoo.cfg
> 2016-08-24 19:20:17,268 [myid:] - INFO  [Thread-0:QuorumPeerConfig@116] - 
> Reading configuration from: 
> /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test7330020881446886387.junit.dir/zoo.cfg
> 2016-08-24 19:20:17,269 [myid:] - INFO  [Thread-2:QuorumPeerConfig@116] - 
> Reading configuration from: 
> /home/jenkins/jenkins-slave/workspace/ZooKeeper-trunk/trunk/build/test/tmp/test1038022970424066351.junit.dir/zoo.cfg
> 2016-08-24 19:20:17,270 [myid:] - INFO  [Thread-1:QuorumPeerConfig@318] - 
> clientPortAddress is 0.0.0.0/0.0.0.0:11225
> 2016-08-24 19:20:17,270 [myid:] - INFO  

[jira] [Updated] (ZOOKEEPER-2781) Flaky test: testClientAuthAgainstNoAuthServerWithLowerSid

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2781:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky test: testClientAuthAgainstNoAuthServerWithLowerSid
> -
>
> Key: ZOOKEEPER-2781
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2781
> Project: ZooKeeper
>  Issue Type: Sub-task
>Affects Versions: 3.4.10
>Reporter: Abraham Fine
>Assignee: Abraham Fine
>Priority: Major
>
> Here is an example failing job: 
> https://builds.apache.org/job/ZooKeeper_branch34_openjdk7/1489/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3048) Track OutOfMemory failures on Flaky Dashboard

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-3048:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Improvement)

> Track OutOfMemory failures on Flaky Dashboard
> -
>
> Key: ZOOKEEPER-3048
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3048
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: build-infrastructure, tests
>Reporter: Bogdan Kanivets
>Assignee: Bogdan Kanivets
>Priority: Minor
>
> Flaky Tests 
> [Dashboard|https://builds.apache.org/job/ZooKeeper-Find-Flaky-Tests/lastSuccessfulBuild/artifact/report.html]
>  should track which tests failed because of OutOfMemory exception.
> Related issue: 
> [ZOOKEEPER-3044|https://issues.apache.org/jira/browse/ZOOKEEPER-3044]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3046) testManyChildWatchersAutoReset is flaky

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-3046:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> testManyChildWatchersAutoReset is flaky
> ---
>
> Key: ZOOKEEPER-3046
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3046
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.5.3, 3.4.12
>Reporter: Bogdan Kanivets
>Assignee: Bogdan Kanivets
>Priority: Minor
>  Labels: flaky, pull-request-available
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> According to the 
> [dashboard|https://builds.apache.org/job/ZooKeeper-Find-Flaky-Tests/lastSuccessfulBuild/artifact/report.html]
>  testManyChildWatchersAutoReset is flaky in 3.4 and 3.5
> [ZooKeeper_branch34_java10|https://builds.apache.org/job/ZooKeeper_branch34_java10//13]
> [ZooKeeper_branch35_java9|https://builds.apache.org/job/ZooKeeper_branch35_java9/253]
> Test times out and because of that ant doesn't capture any output.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-1802) flaky test testResyncByTxnlogThenDiffAfterFollowerCrashes

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-1802:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> flaky test testResyncByTxnlogThenDiffAfterFollowerCrashes
> -
>
> Key: ZOOKEEPER-1802
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1802
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.5.0
>Reporter: Patrick Hunt
>Assignee: Thawan Kooburat
>Priority: Major
>  Labels: flaky
>
> This test fails intermittently on trunk:
> https://builds.apache.org/view/S-Z/view/ZooKeeper/job/ZooKeeper-trunk-jdk7/691/testReport/junit/org.apache.zookeeper.test/FollowerResyncConcurrencyTest/testResyncByTxnlogThenDiffAfterFollowerCrashes/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2877) Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalRun

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2877:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalRun
> ---
>
> Key: ZOOKEEPER-2877
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2877
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Reporter: Michael Han
>Priority: Major
>
> {noformat}
> Error Message
> expected:<1> but was:<0>
> Stacktrace
> junit.framework.AssertionFailedError: expected:<1> but was:<0>
>   at 
> org.apache.zookeeper.server.quorum.Zab1_0Test$6.converseWithLeader(Zab1_0Test.java:939)
>   at 
> org.apache.zookeeper.server.quorum.Zab1_0Test.testLeaderConversation(Zab1_0Test.java:398)
>   at 
> org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalRun(Zab1_0Test.java:906)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2485) Flaky Test: org.apache.zookeeper.test.FourLetterWordsTest.testFourLetterWords

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2485:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: org.apache.zookeeper.test.FourLetterWordsTest.testFourLetterWords
> -
>
> Key: ZOOKEEPER-2485
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2485
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.4.8
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.6.0, 3.5.5
>
>
> From https://builds.apache.org/job/ZooKeeper_branch34_jdk7/1156/
> {noformat}
> Error Message
> test timed out after 3 milliseconds
> Stacktrace
> java.lang.Exception: test timed out after 3 milliseconds
>   at java.io.FileOutputStream.writeBytes(Native Method)
>   at java.io.FileOutputStream.write(FileOutputStream.java:345)
>   at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
>   at java.io.PrintStream.write(PrintStream.java:480)
>   at java.io.PrintStream.write(PrintStream.java:480)
>   at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
>   at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
>   at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
>   at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
>   at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
>   at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
>   at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
>   at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
>   at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
>   at 
> org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
>   at org.apache.log4j.Category.callAppenders(Category.java:206)
>   at org.apache.log4j.Category.forcedLog(Category.java:391)
>   at org.apache.log4j.Category.log(Category.java:856)
>   at org.slf4j.impl.Log4jLoggerAdapter.info(Log4jLoggerAdapter.java:305)
>   at 
> org.apache.zookeeper.test.FourLetterWordsTest.verify(FourLetterWordsTest.java:121)
>   at 
> org.apache.zookeeper.test.FourLetterWordsTest.testFourLetterWords(FourLetterWordsTest.java:52)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:55)
> Standard Output
> 2016-07-21 08:05:43,150 [myid:] - INFO  [main:PortAssignment@32] - assigning 
> port 11221
> 2016-07-21 08:05:43,156 [myid:] - INFO  [main:ZKTestCase$1@50] - STARTING 
> testDisconnectedAddAuth
> 2016-07-21 08:05:43,157 [myid:] - INFO  
> [main:JUnit4ZKTestRunner$LoggedInvokeMethod@53] - RUNNING TEST METHOD 
> testDisconnectedAddAuth
> 2016-07-21 08:05:43,178 [myid:] - INFO  [main:Environment@100] - Server 
> environment:zookeeper.version=3.4.9-SNAPSHOT-1753645, built on 07/21/2016 
> 07:46 GMT
> 2016-07-21 08:05:43,178 [myid:] - INFO  [main:Environment@100] - Server 
> environment:host.name=asf907.gq1.ygridcore.net
> 2016-07-21 08:05:43,178 [myid:] - INFO  [main:Environment@100] - Server 
> environment:java.version=1.7.0_80
> 2016-07-21 08:05:43,178 [myid:] - INFO  [main:Environment@100] - Server 
> environment:java.vendor=Oracle Corporation
> 2016-07-21 08:05:43,178 [myid:] - INFO  [main:Environment@100] - Server 
> environment:java.home=/home/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.7/jre
> 2016-07-21 08:05:43,179 [myid:] - INFO  [main:Environment@100] - Server 
> 

[jira] [Updated] (ZOOKEEPER-2752) Introduce ZooKeeper flaky test dashboard

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2752:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Introduce ZooKeeper flaky test dashboard
> 
>
> Key: ZOOKEEPER-2752
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2752
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Reporter: Michael Han
>Assignee: Michael Han
>Priority: Major
>  Labels: tools
>
> ZooKeeper flaky test dashboard is a set of tools used to track, analyze, and 
> report flaky tests. It's designed with the goal to automate most of the labor 
> intensive part of work related to tracking, monitoring, analyzing and 
> aggregating unit tests results from various Apache ZooKeeper builds. It also 
> increases the visibility of the tests along with (in long term) the over all 
> quality of the ZooKeeper builds. This work is inspired by similar work done 
> on HBase side, with some the tools borrowed from HBase and customized for 
> ZooKeeper use cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2497) Flaky Test: org.apache.zookeeper.test.QuorumTest.testMultipleWatcherObjs

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2497:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Test)

> Flaky Test: org.apache.zookeeper.test.QuorumTest.testMultipleWatcherObjs
> 
>
> Key: ZOOKEEPER-2497
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2497
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: quorum, tests
>Affects Versions: 3.5.2
>Reporter: Michael Han
>Priority: Major
>  Labels: flaky, flaky-test
> Fix For: 3.6.0, 3.5.5
>
>
> Example:
> https://builds.apache.org/job/ZooKeeper-trunk-jdk8/607/
> https://builds.apache.org/job/ZooKeeper_branch35_jdk8/127/
> Note I haven't found any of the Jenkins JDK7 build fail with same error 
> message, so not sure if this is JDK8 specific.
> {noformat}
> 1 tests failed.
> FAILED:  org.apache.zookeeper.test.QuorumTest.testMultipleWatcherObjs
> Error Message:
> Timeout occurred. Please note the time in the report does not reflect the 
> time until the timeout.
> Stack Trace:
> junit.framework.AssertionFailedError: Timeout occurred. Please note the time 
> in the report does not reflect the time until the timeout.
> at java.lang.Thread.run(Thread.java:745)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3047) flaky test LearnerSnapshotThrottlerTest

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-3047:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> flaky test LearnerSnapshotThrottlerTest
> ---
>
> Key: ZOOKEEPER-3047
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3047
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.5.4, 3.6.0, 3.4.12
>Reporter: Patrick Hunt
>Priority: Major
>  Labels: flaky, newbie
>
> * LearnerSnapshotThrottlerTest is flakey - failed during a clover run
> {noformat}
> 2018-05-19 13:39:24,510 [myid:] - INFO  
> [main:JUnit4ZKTestRunner$LoggedInvokeMethod@98] - TEST METHOD FAILED 
> testHighContentionWithTimeout
> java.lang.AssertionError
>   at org.junit.Assert.fail(Assert.java:86)
>   at org.junit.Assert.assertTrue(Assert.java:41)
>   at org.junit.Assert.assertTrue(Assert.java:52)
>   at 
> org.apache.zookeeper.server.quorum.LearnerSnapshotThrottlerTest.__CLR4_2_1a5fyaprev(LearnerSnapshotThrottlerTest.java:216)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2916) startSingleServerTest may be flaky

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2916:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> startSingleServerTest may be flaky
> --
>
> Key: ZOOKEEPER-2916
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2916
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: tests
>Affects Versions: 3.5.3, 3.6.0
>Reporter: Patrick Hunt
>Assignee: Bogdan Kanivets
>Priority: Major
>  Labels: flaky, newbie
>
> startSingleServerTest seems to be failing intermittently. 10 times in the 
> first few days of this month. Can someone take a look?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-3141) testLeaderElectionWithDisloyalVoter is flaky

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-3141:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> testLeaderElectionWithDisloyalVoter is flaky
> 
>
> Key: ZOOKEEPER-3141
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3141
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: leaderElection, server, tests
>Affects Versions: 3.6.0
>Reporter: Michael Han
>Priority: Major
>
> The unit test added in ZOOKEEPER-3109 turns out to be quite flaky.
> See 
> [https://builds.apache.org/job/zOOkeeper-Find-Flaky-Tests/511/artifact/report.html]
> Recent failure builds:
> [https://builds.apache.org/job/ZooKeeper-trunk//181] 
> [https://builds.apache.org/job/ZooKeeper-trunk//179] 
> [https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/2123/testReport/junit/org.apache.zookeeper.server.quorum/QuorumPeerMainTest/testLeaderElectionWithDisloyalVoter_stillHasMajority/]
>  
>  
> Snapshot of the failure:
> {code:java}
> org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testLeaderElectionWithDisloyalVoter_stillHasMajority
> Error Message
> Server 0 should have joined quorum by now
> Stacktrace
> junit.framework.AssertionFailedError: Server 0 should have joined quorum by 
> now
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testLeaderElection(QuorumPeerMainTest.java:1482)
>   at 
> org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testLeaderElectionWithDisloyalVoter_stillHasMajority(QuorumPeerMainTest.java:1431)
>   at 
> org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ZOOKEEPER-2966) Flaky NullPointerException while closing client connection

2018-10-15 Thread Andor Molnar (JIRA)


 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andor Molnar updated ZOOKEEPER-2966:

Parent: ZOOKEEPER-3170
Issue Type: Sub-task  (was: Bug)

> Flaky NullPointerException while closing client connection
> --
>
> Key: ZOOKEEPER-2966
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2966
> Project: ZooKeeper
>  Issue Type: Sub-task
>  Components: java client
>Affects Versions: 3.5.3
>Reporter: Enrico Olivelli
>Priority: Critical
>
> It is not always reproducible, I get this in system tests of client 
> applications.
> ZK client 3.5.3, stacktrace self-explains
> {code:java}
> java.lang.NullPointerException
>     at 
> org.apache.zookeeper.ClientCnxnSocketNetty.onClosing(ClientCnxnSocketNetty.java:206)
>     at org.apache.zookeeper.ClientCnxn$SendThread.close(ClientCnxn.java:1395)
>     at org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1440)
>     at org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1467)
>     at org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1319){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


  1   2   >