Hi Michael, Thank you very much for your reply.
I'm working with the current release downloaded from https://metron.apache.org/documentation/#releases 0.7.1 At this point, our objective is just to get Metron running in AWS so we can try it out. If there is a faster/better/more reliable way to do so, I'm open to suggestions :) Thanks, Eric On Thu, 12 Sep 2019 at 16:39, Michael Miklavcic <[email protected]> wrote: > > I think it's been quite some time since this has been tested (that I'm aware > of, anyhow). YMMV. I don't see any errors in the stacktrace you copied - > those are all warnings. Near the bottom, the Maven output references > "metron-profiler-spark", which is the part of the output we'd want to see. > Are you deploying a specific release of Metron or just the latest master? > > On Thu, Sep 12, 2019 at 2:27 PM Eric Jacksch <[email protected]> wrote: >> >> Greetings, >> >> I've been trying to deploy in AWS to ec2 instances using the playbook. >> >> The VPC is created, instances spun up, etc, but I get hundreds (or >> thousands) of lines of errors during the build. >> >> Can anyone help? >> >> I'm running the playbook on another EC2 instance, so it is certainly >> possible that I am missing a dependency, etc... >> >> Thanks! >> >> >> >> TASK [metron-builder : Build Metron] >> ********************************************************************************************** >> failed: [ec2-35-183-121-120.ca-central-1.compute.amazonaws.com -> >> localhost] (item=mvn package -DskipTests -T 2C -P HDP-2.5.0.0,mpack) >> => {"changed": true, "cmd": "mvn package -DskipTests -T 2C -P >> HDP-2.5.0.0,mpack", "delta": "0:01:12.526650", "end": "2019-09-12 >> 19:58:48.231138", "failed": true, "item": "mvn package -DskipTests -T >> 2C -P HDP-2.5.0.0,mpack", "msg": "non-zero return code", "rc": 1, >> "start": "2019-09-12 19:57:35.704488", "stderr": "warning: No >> SupportedSourceVersion annotation found on >> org.adrianwalker.multilinestring.MultilineProcessor, returning >> RELEASE_6.\nwarning: Supported source version 'RELEASE_6' from >> annotation processor >> 'org.adrianwalker.multilinestring.MultilineProcessor' less than >> -source '1.8'\n2 warnings\nwarning: No SupportedSourceVersion >> annotation found on >> org.adrianwalker.multilinestring.MultilineProcessor, returning >> RELEASE_6.\nwarning: Supported source version 'RELEASE_6' from >> annotation processor >> 'org.adrianwalker.multilinestring.MultilineProcessor' less than >> -source >> '1.8'\n/home/ec2-user/metron/metron-platform/metron-test-utilities/src/main/java/org/apache/metron/test/bolt/BaseBoltTest.java:87: >> warning: [unchecked] unchecked method invocation: method copyOf in >> class ImmutableSet is applied to given types\n ImmutableSet keys = >> ImmutableSet.copyOf(message.keySet());\n >> ^\n required: Collection<? extends E>\n found: Set\n >> where E is a type-variable:\n E extends Object declared in method >> <E>copyOf(Collection<? extends >> E>)\n/home/ec2-user/metron/metron-platform/metron-test-utilities/src/main/java/org/apache/metron/test/bolt/BaseBoltTest.java:87: >> warning: [unchecked] unchecked conversion\n ImmutableSet keys = >> ImmutableSet.copyOf(message.keySet());\n >> ^\n required: Collection<? extends E>\n >> found: Set\n where E is a type-variable:\n E extends Object >> declared in method <E>copyOf(Collection<? extends >> E>)\n/home/ec2-user/metron/metron-platform/metron-test-utilities/src/main/java/org/apache/metron/test/utils/KafkaLoader.java:67: >> warning: [unchecked] unchecked call to send(ProducerRecord<K,V>) as a >> member of the raw type KafkaProducer\n kafkaProducer.send(new >> ProducerRecord<String, String>(topic, line));\n >> ^\n where K,V are type-variables:\n K extends Object declared >> in class KafkaProducer\n V extends Object declared in class >> KafkaProducer\n5 >> warnings\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:174: >> warning: [unchecked] unchecked conversion\n functionRestConfig >> = getArg(1, Map.class, args);\n ^\n >> required: Map<String,Object>\n found: >> Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:176: >> warning: [unchecked] unchecked conversion\n queryParameters = >> getArg(2, Map.class, args);\n ^\n >> required: Map<String,Object>\n found: >> Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:181: >> warning: [unchecked] unchecked cast\n Map<String, Object> >> globalRestConfig = (Map<String, Object>) >> getGlobalConfig(context).get(STELLAR_REST_SETTINGS);\n >> >> ^\n required: Map<String,Object>\n found: >> Object\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:182: >> warning: [unchecked] unchecked cast\n Map<String, Object> >> getRestConfig = (Map<String, Object>) >> getGlobalConfig(context).get(STELLAR_REST_GET_SETTINGS);\n >> >> ^\n required: Map<String,Object>\n found: >> Object\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:183: >> warning: [unchecked] unchecked generic array creation for varargs >> parameter of type Map<String,Object>[]\n RestConfig restConfig = >> buildRestConfig(globalRestConfig, getRestConfig, >> functionRestConfig);\n >> ^\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:254: >> warning: [unchecked] unchecked conversion\n functionRestConfig >> = getArg(2, Map.class, args);\n ^\n >> required: Map<String,Object>\n found: >> Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:256: >> warning: [unchecked] unchecked conversion\n queryParameters = >> getArg(3, Map.class, args);\n ^\n >> required: Map<String,Object>\n found: >> Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:261: >> warning: [unchecked] unchecked cast\n Map<String, Object> >> globalRestConfig = (Map<String, Object>) >> getGlobalConfig(context).get(STELLAR_REST_SETTINGS);\n >> >> ^\n required: Map<String,Object>\n found: >> Object\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:262: >> warning: [unchecked] unchecked cast\n Map<String, Object> >> postRestConfig = (Map<String, Object>) >> getGlobalConfig(context).get(STELLAR_REST_POST_SETTINGS);\n >> >> ^\n required: Map<String,Object>\n found: >> Object\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:263: >> warning: [unchecked] unchecked generic array creation for varargs >> parameter of type Map<String,Object>[]\n RestConfig restConfig = >> buildRestConfig(globalRestConfig, postRestConfig, >> functionRestConfig);\n >> ^\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/dsl/functions/RestFunctions.java:347: >> warning: [unchecked] unchecked generic array creation for varargs >> parameter of type Map<String,Object>[]\n RestConfig restConfig = >> buildRestConfig(getGlobalConfig(context));\n >> >> ^\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/common/generated/StellarParser.java:3045: >> warning: [MissingOverride] sempred overrides method in Recognizer; >> expected @Override\n\tpublic boolean sempred(RuleContext _localctx, >> int ruleIndex, int predIndex) {\n\t ^\n (see >> http://errorprone.info/bugpattern/MissingOverride)\n Did you mean >> '@Override public boolean sempred(RuleContext _localctx, int >> ruleIndex, int predIndex) >> {'?\n/home/ec2-user/metron/metron-stellar/stellar-common/src/main/java/org/apache/metron/stellar/common/utils/SerDeUtils.java:136: >> warning: [unchecked] newInstantiatorOf(Class) in >> DefaultInstantiatorStrategy implements <T>newInstantiatorOf(Class<T>) >> in InstantiatorStrategy\n public ObjectInstantiator >> newInstantiatorOf(final Class type) {\n >> ^\n return type requires unchecked conversion from ObjectInstantiator >> to ObjectInstantiator<T>\n where T is a type-variable:\n T extends >> Object declared in method <T>newInstantiatorOf(Class<T>)\n13 >> warnings\nwarning: No SupportedSourceVersion annotation found on >> org.adrianwalker.multilinestring.MultilineProcessor, returning >> RELEASE_6.\nwarning: Supported source version 'RELEASE_6' from >> annotation processor >> 'org.adrianwalker.multilinestring.MultilineProcessor' less than >> -source >> '1.8'\n/home/ec2-user/metron/metron-stellar/stellar-common/src/test/java/org/apache/metron/stellar/dsl/functions/BasicStellarTest.java:654: >> warning: [unchecked] unchecked method invocation: method run in class >> StellarProcessorUtils is applied to given types\n >> assertThat(run(query, vars), instanceOf(Map.class));\n >> ^\n required: String,Map<String,Object>\n found: >> String,Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/test/java/org/apache/metron/stellar/dsl/functions/BasicStellarTest.java:654: >> warning: [unchecked] unchecked conversion\n assertThat(run(query, >> vars), instanceOf(Map.class));\n ^\n >> required: Map<String,Object>\n found: >> Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/test/java/org/apache/metron/stellar/dsl/functions/BasicStellarTest.java:656: >> warning: [unchecked] unchecked method invocation: method run in class >> StellarProcessorUtils is applied to given types\n >> assertThat(run(query, vars), equalTo(\"bar\"));\n ^\n >> required: String,Map<String,Object>\n found: >> String,Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/test/java/org/apache/metron/stellar/dsl/functions/BasicStellarTest.java:656: >> warning: [unchecked] unchecked conversion\n assertThat(run(query, >> vars), equalTo(\"bar\"));\n ^\n required: >> Map<String,Object>\n found: >> Map\n/home/ec2-user/metron/metron-stellar/stellar-common/src/test/java/org/apache/metron/stellar/dsl/functions/BasicStellarTest.java:662: >> warning: [unchecked] unchecked call to put(K,V) as a member of the raw >> type HashMap\n put(\"mymap\", null);\n ^\n where K,V are >> type-variables:\n K extends Object declared in class HashMap\n V >> extends Object declared in class >> HashMap\n/home/ec2-user/metron/metron-stellar/stellar-common/src/test/java/org/apache/metron/stellar/dsl/fu >> >> <snip...many, many, many lines omitted> >> >> (Wall Clock)", "[INFO] Finished at: 2019-09-12T19:58:47Z", "[INFO] >> Final Memory: 738M/2811M", "[INFO] >> ------------------------------------------------------------------------", >> "[ERROR] Failed to execute goal >> org.apache.maven.plugins:maven-compiler-plugin:3.5.1:compile >> (default-compile) on project metron-profiler-spark: Compilation >> failure -> [Help 1]", "[ERROR] ", "[ERROR] To see the full stack trace >> of the errors, re-run Maven with the -e switch.", "[ERROR] Re-run >> Maven using the -X switch to enable full debug logging.", "[ERROR] ", >> "[ERROR] For more information about the errors and possible solutions, >> please read the following articles:", "[ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException";, >> "[ERROR] ", "[ERROR] After correcting the problems, you can resume the >> build with the command", "[ERROR] mvn <goals> -rf >> :metron-profiler-spark", "[INFO] ", "[INFO] --- >> maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ >> metron-data-management ---"]} >> >> NO MORE HOSTS LEFT >> **************************************************************************************************************** >> to retry, use: --limit >> @/home/ec2-user/metron/metron-deployment/amazon-ec2/playbook.retry >> >> PLAY RECAP >> ************************************************************************************************************************ >> ec2-15-222-1-43.ca-central-1.compute.amazonaws.com : ok=14 changed=8 >> unreachable=0 failed=0 >> ec2-15-222-9-90.ca-central-1.compute.amazonaws.com : ok=14 changed=8 >> unreachable=0 failed=0 >> ec2-35-182-158-204.ca-central-1.compute.amazonaws.com : ok=14 >> changed=8 unreachable=0 failed=0 >> ec2-35-183-110-49.ca-central-1.compute.amazonaws.com : ok=14 >> changed=8 unreachable=0 failed=0 >> ec2-35-183-121-120.ca-central-1.compute.amazonaws.com : ok=15 >> changed=9 unreachable=0 failed=1 >> ec2-35-183-121-202.ca-central-1.compute.amazonaws.com : ok=14 >> changed=8 unreachable=0 failed=0 >> ec2-35-183-210-180.ca-central-1.compute.amazonaws.com : ok=14 >> changed=8 unreachable=0 failed=0 >> ec2-99-79-193-27.ca-central-1.compute.amazonaws.com : ok=14 >> changed=8 unreachable=0 failed=0 >> ec2-99-79-52-74.ca-central-1.compute.amazonaws.com : ok=14 changed=8 >> unreachable=0 failed=0 >> ec2-99-79-60-74.ca-central-1.compute.amazonaws.com : ok=14 changed=8 >> unreachable=0 failed=0 >> localhost : ok=20 changed=15 unreachable=0 failed=0 -- Eric Jacksch, CPP, CISM, CISSP [email protected] Twitter: @EricJacksch https://SecurityShelf.com
