[jira] [Commented] (HADOOP-14949) TestKMS#testACLs fails intermitently
[
https://issues.apache.org/jira/browse/HADOOP-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204437#comment-16204437
]
Hadoop QA commented on HADOOP-14949:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
17s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 32m
24s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 34m
35s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
44s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
4s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
17m 31s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
30s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
41s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 27m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 27m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
17m 8s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
37s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 4m
46s{color} | {color:green} hadoop-kms in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 1m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}146m 9s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:0de40f0 |
| JIRA Issue | HADOOP-14949 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12892181/HADOOP-14949.01.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient findbugs checkstyle |
| uname | Linux c061c34e74df 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11
12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 3fb4718 |
| Default Java | 1.8.0_144 |
| findbugs | v3.1.0-RC1 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/13507/testReport/ |
| modules | C: hadoop-common-project/hadoop-kms U:
hadoop-common-project/hadoop-kms |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/13507/console |
| Powered by | Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> TestKMS#testACLs fails intermitently
>
>
> Key: HADOOP-14949
> URL: https://issues.apache.org/jira/browse/HADOOP-14949
> Project: Hadoop Common
> Issue Type: Bug
> Components
[jira] [Commented] (HADOOP-14949) TestKMS#testACLs fails intermitently
[
https://issues.apache.org/jira/browse/HADOOP-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204434#comment-16204434
]
Xiao Chen commented on HADOOP-14949:
With the fix in patch 1, it passes 100 separate runs.
http://dist-test.cloudera.org/job?job_id=hadoop.xiao.1507937904.2138
Previously the failure rate in our internal infra was ~30%.
> TestKMS#testACLs fails intermitently
>
>
> Key: HADOOP-14949
> URL: https://issues.apache.org/jira/browse/HADOOP-14949
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms, test
>Reporter: Xiao Chen
>Assignee: Xiao Chen
> Attachments: HADOOP-14949.01.patch
>
>
> We have seen some intermittent failures of this test:
> Error Message
> {noformat}
> java.lang.AssertionError
> {noformat}
> Stack Trace
> {noformat}java.lang.AssertionError: Should not have been able to
> reencryptEncryptedKey
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS$11$15.run(TestKMS.java:1616)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS$11$15.run(TestKMS.java:1608)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS.doAs(TestKMS.java:313)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS.access$100(TestKMS.java:97)
> {noformat}
> Standard Output
> {noformat}
> 2017-10-07 09:44:11,112 INFO log - jetty-6.1.26.cloudera.4
> 2017-10-07 09:44:11,131 INFO KMSWebApp -
> -
> 2017-10-07 09:44:11,131 INFO KMSWebApp - Java runtime version :
> 1.7.0_121-b00
> 2017-10-07 09:44:11,131 INFO KMSWebApp - User: slave
> 2017-10-07 09:44:11,131 INFO KMSWebApp - KMS Hadoop Version:
> 2.6.0-cdh5.14.0-SNAPSHOT
> 2017-10-07 09:44:11,131 INFO KMSWebApp -
> -
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'CREATE' ACL 'CREATE,SET_KEY_MATERIAL'
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'DELETE' ACL 'DELETE'
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'ROLLOVER' ACL
> 'ROLLOVER,SET_KEY_MATERIAL'
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'GET' ACL 'GET'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'GET_KEYS' ACL 'GET_KEYS'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'GET_METADATA' ACL 'GET_METADATA'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'SET_KEY_MATERIAL' ACL
> 'SET_KEY_MATERIAL'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'GENERATE_EEK' ACL 'GENERATE_EEK'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'DECRYPT_EEK' ACL 'DECRYPT_EEK'
> 2017-10-07 09:44:11,135 INFO KMSACLs - KEY_NAME 'k0' KEY_OP 'ALL' ACL '*'
> 2017-10-07 09:44:11,135 INFO KMSACLs - KEY_NAME 'k1' KEY_OP 'ALL' ACL '*'
> 2017-10-07 09:44:11,136 INFO KMSAudit - No audit logger configured, using
> default.
> 2017-10-07 09:44:11,137 INFO KMSAudit - Initializing audit logger class
> org.apache.hadoop.crypto.key.kms.server.SimpleKMSAuditLogger
> 2017-10-07 09:44:11,137 INFO KMSWebApp - Initialized KeyProvider
> CachingKeyProvider:
> jceks://file@/tmp/run_tha_testUYG3Cl/hadoop-common-project/hadoop-kms/target/ddbffdf2-e7d8-4e75-982a-debebb227075/kms.keystore
> 2017-10-07 09:44:11,138 INFO KMSWebApp - Initialized
> KeyProviderCryptoExtension EagerKeyGeneratorKeyProviderCryptoExtension:
> KeyProviderCryptoExtension: CachingKeyProvider:
> jceks://file@/tmp/run_tha_testUYG3Cl/hadoop-common-project/hadoop-kms/target/ddbffdf2-e7d8-4e75-982a-debebb227075/kms.keystore
> 2017-10-07 09:44:11,138 INFO KMSWebApp - Default key bitlength is 128
> 2017-10-07 09:44:11,138 INFO KMSWebApp - KMS Started
> 2017-10-07 09:44:11,141 INFO PackagesResourceConfig - Scanning for root
> resource and provider classes in the packages:
> org.apache.hadoop.crypto.key.kms.server
> 2017-10-07 09:44:11,146 INFO ScanningResourceConfig - Root resource classes
> found:
> class org.apache.hadoop.crypto.key.kms.server.KMS
> 2017-10-07 09:44:11,146 INFO ScanningResourceConfig - Provider classes found:
> class org.apache.hadoop.crypto.key.kms.server.KMSJSONWriter
> class org.apache.hadoop.crypto.key.kms.server.KMSExceptionsProvider
> class org.apache.hadoop.crypto.key.kms.server.KMSJSONReader
> 2017-10-07 09:44:11,147 INFO WebApplicationImpl - Initiating Jersey
> application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
> 2017-10-07 09:44:11,224 INFO log - Started SocketConnector@localhost:46764
> Test KMS running at: http://localhost:46764/kms
> 2017-10-07 09:44:11,254 INFO kms-audit - UNAUTHORIZED[op=CREATE_KEY, key=k,
> user=client]
> 2017-10-07 09:44:11,255 WARN KMS - User cli...@example.com (auth:
[jira] [Commented] (HADOOP-14949) TestKMS#testACLs fails intermitently
[
https://issues.apache.org/jira/browse/HADOOP-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204364#comment-16204364
]
Xiao Chen commented on HADOOP-14949:
In the passing runs, the acl reloading is observed:
{noformat}
2017-10-13 16:35:29,055 INFO KMSACLs - 'CREATE' ACL 'foo'
2017-10-13 16:35:29,055 INFO KMSACLs - 'DELETE' ACL '*'
2017-10-13 16:35:29,055 INFO KMSACLs - 'ROLLOVER' ACL '*'
2017-10-13 16:35:29,055 INFO KMSACLs - 'GET' ACL '*'
2017-10-13 16:35:29,055 INFO KMSACLs - 'GET_KEYS' ACL '*'
2017-10-13 16:35:29,055 INFO KMSACLs - 'GET_METADATA' ACL '*'
2017-10-13 16:35:29,055 INFO KMSACLs - 'SET_KEY_MATERIAL' ACL '*'
2017-10-13 16:35:29,055 INFO KMSACLs - 'GENERATE_EEK' ACL 'foo'
2017-10-13 16:35:29,055 INFO KMSACLs - 'DECRYPT_EEK' ACL '*'
{noformat}
This is not seen in the failed runs.
Let's improve the test to not depend on the file mtime and sleep, but be
deterministic.
> TestKMS#testACLs fails intermitently
>
>
> Key: HADOOP-14949
> URL: https://issues.apache.org/jira/browse/HADOOP-14949
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms, test
>Reporter: Xiao Chen
>Assignee: Xiao Chen
> Attachments: HADOOP-14949.01.patch
>
>
> We have seen some intermittent failures of this test:
> Error Message
> {noformat}
> java.lang.AssertionError
> {noformat}
> Stack Trace
> {noformat}java.lang.AssertionError: Should not have been able to
> reencryptEncryptedKey
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS$11$15.run(TestKMS.java:1616)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS$11$15.run(TestKMS.java:1608)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS.doAs(TestKMS.java:313)
> at
> org.apache.hadoop.crypto.key.kms.server.TestKMS.access$100(TestKMS.java:97)
> {noformat}
> Standard Output
> {noformat}
> 2017-10-07 09:44:11,112 INFO log - jetty-6.1.26.cloudera.4
> 2017-10-07 09:44:11,131 INFO KMSWebApp -
> -
> 2017-10-07 09:44:11,131 INFO KMSWebApp - Java runtime version :
> 1.7.0_121-b00
> 2017-10-07 09:44:11,131 INFO KMSWebApp - User: slave
> 2017-10-07 09:44:11,131 INFO KMSWebApp - KMS Hadoop Version:
> 2.6.0-cdh5.14.0-SNAPSHOT
> 2017-10-07 09:44:11,131 INFO KMSWebApp -
> -
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'CREATE' ACL 'CREATE,SET_KEY_MATERIAL'
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'DELETE' ACL 'DELETE'
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'ROLLOVER' ACL
> 'ROLLOVER,SET_KEY_MATERIAL'
> 2017-10-07 09:44:11,134 INFO KMSACLs - 'GET' ACL 'GET'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'GET_KEYS' ACL 'GET_KEYS'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'GET_METADATA' ACL 'GET_METADATA'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'SET_KEY_MATERIAL' ACL
> 'SET_KEY_MATERIAL'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'GENERATE_EEK' ACL 'GENERATE_EEK'
> 2017-10-07 09:44:11,135 INFO KMSACLs - 'DECRYPT_EEK' ACL 'DECRYPT_EEK'
> 2017-10-07 09:44:11,135 INFO KMSACLs - KEY_NAME 'k0' KEY_OP 'ALL' ACL '*'
> 2017-10-07 09:44:11,135 INFO KMSACLs - KEY_NAME 'k1' KEY_OP 'ALL' ACL '*'
> 2017-10-07 09:44:11,136 INFO KMSAudit - No audit logger configured, using
> default.
> 2017-10-07 09:44:11,137 INFO KMSAudit - Initializing audit logger class
> org.apache.hadoop.crypto.key.kms.server.SimpleKMSAuditLogger
> 2017-10-07 09:44:11,137 INFO KMSWebApp - Initialized KeyProvider
> CachingKeyProvider:
> jceks://file@/tmp/run_tha_testUYG3Cl/hadoop-common-project/hadoop-kms/target/ddbffdf2-e7d8-4e75-982a-debebb227075/kms.keystore
> 2017-10-07 09:44:11,138 INFO KMSWebApp - Initialized
> KeyProviderCryptoExtension EagerKeyGeneratorKeyProviderCryptoExtension:
> KeyProviderCryptoExtension: CachingKeyProvider:
> jceks://file@/tmp/run_tha_testUYG3Cl/hadoop-common-project/hadoop-kms/target/ddbffdf2-e7d8-4e75-982a-debebb227075/kms.keystore
> 2017-10-07 09:44:11,138 INFO KMSWebApp - Default key bitlength is 128
> 2017-10-07 09:44:11,138 INFO KMSWebApp - KMS Started
> 2017-10-07 09:44:11,141 INFO PackagesResourceConfig - Scanning for root
> resource and provider classes in the packages:
> org.apache.hadoop.crypto.key.kms.server
> 2017-10-07 09:44:11,146 INFO ScanningResourceConfig - Root resource classes
> found:
> class org.apache.hadoop.crypto.key.kms.server.KMS
> 2017-10-07 09:44:11,146 INFO ScanningResourceConfig - Provider classes found:
> class org.apache.hadoop.crypto.key.kms.server.KMSJSONWr
