I can't reproduce the test failures in Kafka, HBase or Hive. However, I can reproduce the build errors in security-admin. It's caused by this bug in Maven:
https://issues.apache.org/jira/browse/MNG-6298 The solution is to use Apache Maven 3.5.0 instead of 3.5.2. Colm. On Tue, Nov 21, 2017 at 5:19 PM, Nigel Jones <nigel.l.jo...@gmail.com> wrote: > Consistent in failing, but it's unclear how repeatable any specific error > is... I'll try some more - this was the test from just 4 attempts so I > wanted to check I was doing things correct. > > My invocation in each case is > mvn -DskipTests=false clean compile package install assembly:assembly > > Maven versions were > a) 3.5.2 (local mac) > b) 3.5.0 (azure ubuntu 17.10) > c) 3.3.9 (cloudfoundry/openstack ubuntu 16.04) > > We hit funny maven issues in Atlas - jenkins is now at 3.5.0. I proposed a > validation check in ATLAS-2245 to persuade everyone to upgrade. > > I'm assuming lots of people here use macOS. Whilst my OS level is forward > I doubt that's the issue. Is everyone still building with java 1.7? And > what version of maven? Any other dependent components? > > Thanks > Nigel. > > On 2017-11-21 15:48, Colm O hEigeartaigh <cohei...@apache.org> wrote: > > What maven version are you using? Are the test failures consistent or > > sporadic? > > > > Colm. > > > > On Tue, Nov 21, 2017 at 3:09 PM, Nigel Jones <nigel.l.jo...@gmail.com> > > wrote: > > > > > I'm experiencing some issues getting the ranger build to work. > > > a) macOS (10.13.2 b4), oracle 8 *(152) > > > > > > [INFO] HBase Security Plugin .............................. FAILURE > [11:37 > > > min] > > > > > > [INFO] Running org.apache.ranger.authorization.hbase. > > > HBaseRangerAuthorizationTest > > > Formatting using clusterid: testClusterID > > > [ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 0, Time > elapsed: > > > 690.138 s <<< FAILURE! - in org.apache.ranger.authorization.hbase. > > > HBaseRangerAuthorizationTest > > > [ERROR] testTagBasedTablePolicy(org.apache.ranger.authorization.hbase. > HBaseRangerAuthorizationTest) > > > Time elapsed: 612.923 s <<< ERROR! > > > org.apache.hadoop.hbase.exceptions.TimeoutIOException: > > > java.util.concurrent.TimeoutException: The procedure 18 is still > running > > > at org.apache.ranger.authorization.hbase. > > > HBaseRangerAuthorizationTest.testTagBasedTablePolicy( > > > HBaseRangerAuthorizationTest.java:780) > > > Caused by: java.util.concurrent.TimeoutException: The procedure 18 is > > > still running > > > at org.apache.ranger.authorization.hbase. > > > HBaseRangerAuthorizationTest.testTagBasedTablePolicy( > > > HBaseRangerAuthorizationTest.java:780) > > > > > > > > > >> This looks like potentially a timeout, though at 690s maybe in > reality > > > a logical issue > > > > > > b) Ubuntu 17.10, MS Azure, openjdk 8 (151) > > > > > > [INFO] Hive Security Plugin ............................... FAILURE [ > > > 41.084 s] > > > ERROR StatusLogger No log4j2 configuration file found. Using default > > > configuration: logging only errors to the console. > > > [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > > > 30.286 s <<< FAILURE! - in org.apache.ranger.services. > > > hive.HIVERangerAuthorizerTest > > > [ERROR] org.apache.ranger.services.hive.HIVERangerAuthorizerTest Time > > > elapsed: 30.286 s <<< ERROR! > > > java.sql.SQLException: Could not open client transport with JDBC Uri: > > > jdbc:hive2://localhost:36781: java.net.ConnectException: Connection > refused > > > (Connection refused) > > > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest. > setup( > > > HIVERangerAuthorizerTest.java:103) > > > Caused by: org.apache.thrift.transport.TTransportException: > > > java.net.ConnectException: Connection refused (Connection refused) > > > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest. > setup( > > > HIVERangerAuthorizerTest.java:103) > > > Caused by: java.net.ConnectException: Connection refused (Connection > > > refused) > > > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest. > setup( > > > HIVERangerAuthorizerTest.java:103) > > > > > > > > > >> This one is clearly a jdbc connection issue, perhaps hive didn't > start > > > .... > > > > > > c) Ubuntu 16.04, our internal IBM cloudfoundry/openstack environment - > > > open jdk 1.8 (151) > > > > > > [INFO] KAFKA Security Plugin .............................. FAILURE > [18:58 > > > min] > > > > > > [INFO] Running org.apache.ranger.authorization.kafka.authorizer. > > > KafkaRangerAuthorizerGSSTest > > > log4j:WARN No appenders could be found for logger > > > (org.apache.kerby.kerberos.kerb.identity.backend. > AbstractIdentityBackend). > > > log4j:WARN Please initialize the log4j system properly. > > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig > for > > > more info. > > > [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: > > > 1,108.807 s <<< FAILURE! - in org.apache.ranger.authorization.kafka. > > > authorizer.KafkaRangerAuthorizerGSSTest > > > [ERROR] testAuthorizedRead(org.apache.ranger.authorization.kafka. > > > authorizer.KafkaRangerAuthorizerGSSTest) Time elapsed: 1,103.05 s > <<< > > > FAILURE! > > > java.lang.AssertionError > > > at org.apache.ranger.authorization.kafka.authorizer. > > > KafkaRangerAuthorizerGSSTest.testAuthorizedRead( > > > KafkaRangerAuthorizerGSSTest.java:243) > > > > > > d) Same system as a) but a prior run: > > > [INFO] Security Admin Web Application ..................... FAILURE > [01:20 > > > min] > > > > > > [ERROR] Failed to execute goal com.webcohesion.enunciate: > > > enunciate-maven-plugin:2.8.0:docs (default) on project > > > security-admin-web: freemarker.core._TemplateModelException: An error > has > > > occurred when reading existing sub-variable "securityRoles"; see cause > > > exception! The type of the containing value was: extended_hash+string > > > (com.webcohesion.enunciate.modules.jaxrs.api.impl.MethodImpl wrapped > into > > > f.e.b.StringModel) > > > [ERROR] > > > [ERROR] ---- > > > [ERROR] FTL stack trace ("~" means nesting-related): > > > [ERROR] - Failed at: #assign securityRoles = method.securi... > [in > > > template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/ > > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/ > > > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro > > > "processResourceGroup" at line 556, column 11] > > > [ERROR] ~ Reached through: #nested [in template > > > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/ > > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/ > > > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro > "boilerplate" > > > at line 141, column 9] > > > [ERROR] ~ Reached through: @boilerplate title=(title + ": " + > > > re... [in template "jar:file:/Users/jonesn/.m2/ > > > repository/com/webcohesion/enunciate/enunciate-docs/2.8. > > > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/ > modules/docs/docs.fmt" > > > in macro "processResourceGroup" at line 518, column 5] > > > [ERROR] - Reached through: @file name=(resourceGroup.slug + > > > ".ht... [in template "jar:file:/Users/jonesn/.m2/ > > > repository/com/webcohesion/enunciate/enunciate-docs/2.8. > > > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/ > modules/docs/docs.fmt" > > > in macro "processResourceGroup" at line 517, column 3] > > > [ERROR] - Reached through: @processResourceGroup > > > resourceGroup=r... [in template "jar:file:/Users/jonesn/.m2/ > > > repository/com/webcohesion/enunciate/enunciate-docs/2.8. > > > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/ > modules/docs/docs.fmt" > > > at line 238, column 11] > > > [ERROR] ~ Reached through: #nested [in template > > > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/ > > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/ > > > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro > "boilerplate" > > > at line 141, column 9] > > > [ERROR] ~ Reached through: @boilerplate pagenav=pagenav [in > > > template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/ > > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/ > > > com/webcohesion/enunciate/modules/docs/docs.fmt" at line 192, column > 3] > > > [ERROR] - Reached through: @file name=indexPageName [in > template > > > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/ > > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/ > > > com/webcohesion/enunciate/modules/docs/docs.fmt" at line 181, column > 1] > > > [ERROR] ----: InvocationTargetException: javax/annotation/security/ > RolesAllowed: > > > javax.annotation.security.RolesAllowed > > > [ERROR] -> [Help 1] > > > [ERROR] > > > [ERROR] To see the full stack trace of the errors, re-run Maven with > the > > > -e switch. > > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > > [ERROR] > > > [ERROR] For more information about the errors and possible solutions, > > > please read the following articles: > > > [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ > > > MojoExecutionException > > > [ERROR] > > > [ERROR] After correcting the problems, you can resume the build with > the > > > command > > > [ERROR] mvn <goals> -rf :security-admin-web > > > > > > > > > >> --- > > > > > > So that's 4 attempts, 4 different results. I could open JIRAs, but I'm > > > concerned at the lack of consistency. What do I need to check in my dev > > > environments? Are there additional prereqs not checked for in maven? > > > > > > My Atlas builds are more consistent (occasional timeout, but generally > > > sharing results with others) > > > > > > Many thanks > > > Nigel Jones > > > nigel.l.jo...@gmail.com > > > > > > > > > > > -- > > Colm O hEigeartaigh > > > > Talend Community Coder > > http://coders.talend.com > > > -- Colm O hEigeartaigh Talend Community Coder http://coders.talend.com
