Nick Allen created METRON-872: --------------------------------- Summary: "Metron Enrichment Start" Fails in Quick Dev Key: METRON-872 URL: https://issues.apache.org/jira/browse/METRON-872 Project: Metron Issue Type: Bug Reporter: Nick Allen
h3. Problem The "Quick Dev" deployment fails to complete deployment successfully for me. Ambari fails to launch the Enrichment topology with this error. {code} resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash: /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory {code} This is confusing to me because we should be on 0.4.0, so why is it referencing 0.3.1? h3. Steps to Reproduce First, I had to `install` the Metron libs (which I don't remember being a requirement before.) Then I was able to `vagrant up`. {code} cd incubator-metron mvn clean install -DskipTests -T 1C cd metron-deployment/vagrant/quick-dev-platform vagrant up {code} h3. Additional Clues When I login to the "Quick Dev" VM, I see that there are some 0.4.0 libs and some 0.3.1 libs. {code} [root@node1 metron]# ls -l /usr/metron/0.3.1/lib/ total 167800 -rw-r--r--. 1 root root 85332259 Apr 3 21:05 metron-api-0.3.1.jar -rw-r--r--. 1 root root 86490682 Mar 30 13:09 metron-pcap-backend-0.3.1.jar [root@node1 metron]# ls -l /usr/metron/0.4.0/lib/ total 463428 -rw-r--r--. 1 root root 48425098 Apr 21 13:45 metron-common-0.4.0.jar -rw-r--r--. 1 root root 124020704 Apr 21 13:50 metron-data-management-0.4.0.jar -rw-r--r--. 1 root root 114754821 Apr 21 13:50 metron-elasticsearch-0.4.0-uber.jar -rw-r--r--. 1 root root 93280994 Apr 21 13:48 metron-enrichment-0.4.0-uber.jar -rw-r--r--. 1 root root 94059479 Apr 21 13:50 metron-parsers-0.4.0-uber.jar {code} Where did those 0.3.1 libs come from? When I look in my local Maven repository on my build machine, I don't see any 0.3.1 libs at all, only 0.4.0 {code} $ find ~/.m2/repository/org/apache/metron/ -name "0.3.1" $ find ~/.m2/repository/org/apache/metron/ -name "0.4.0" /Users/nallen/.m2/repository/org/apache/metron//elasticsearch-shaded/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//Metron/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-analytics/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-api/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-common/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-config/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-data-management/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-deployment/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-docker/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-elasticsearch/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-enrichment/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-hbase/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-indexing/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-integration-test/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-interface/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-maas-common/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-maas-service/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-management/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-parsers/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-pcap/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-pcap-backend/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-platform/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-profiler/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-profiler-client/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-profiler-common/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-rest/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-rest-client/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-solr/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-statistics/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-storm-kafka/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-test-utilities/0.4.0 /Users/nallen/.m2/repository/org/apache/metron//metron-writer/0.4.0 {code} I seem to have the latest "Quick Dev" box image. {code} $ vagrant box update Running with ansible-tags: ["quick_dev", "report"] ==> node1: Checking for updates to 'metron/quick_dev' node1: Latest installed version: 0.2.0 node1: Version constraints: node1: Provider: virtualbox ==> node1: Box 'metron/quick_dev' (v0.2.0) is running the latest version. {code} And for good measure, here is what my environment looks-like. {code} $ ./metron-deployment/scripts/platform-info.sh Metron 0.4.0 -- * master -- commit 41b5b1050cf29e5dcb5d0c36b5a9dbd1cafa745e Author: justinjleet <justinjl...@gmail.com> Date: Mon Apr 17 15:16:49 2017 -0400 The MPack should function in a kerberized cluster (justinleet) closes apache/incubator-metron#518 -- -- ansible 2.0.0.2 config file = configured module search path = Default w/o overrides -- Vagrant 1.8.1 -- Python 2.7.13 -- Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T11:41:47-05:00) Maven home: /usr/local/Cellar/maven/3.3.9/libexec Java version: 1.8.0_66, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.12.4", arch: "x86_64", family: "mac" -- Darwin HW12402.local 16.5.0 Darwin Kernel Version 16.5.0: Fri Mar 3 16:52:33 PST 2017; root:xnu-3789.51.2~3/RELEASE_X86_64 x86_64 -- Total System Memory = 16384 MB Processor Model: Intel(R) Core(TM) i7-4870HQ CPU Processor Speed: 2.50GHz Total Physical Processors: 4 Total cores: 4 Disk information: /dev/disk1 465Gi 319Gi 145Gi 69% 2694524 4292272755 0% / {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)