Nick Allen created METRON-872:
---------------------------------
Summary: "Metron Enrichment Start" Fails in Quick Dev
Key: METRON-872
URL: https://issues.apache.org/jira/browse/METRON-872
Project: Metron
Issue Type: Bug
Reporter: Nick Allen
h3. Problem
The "Quick Dev" deployment fails to complete deployment successfully for me.
Ambari fails to launch the Enrichment topology with this error.
{code}
resource_management.core.exceptions.ExecutionFailed: Execution of
'/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i
/usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash:
/usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
{code}
This is confusing to me because we should be on 0.4.0, so why is it referencing
0.3.1?
h3. Steps to Reproduce
First, I had to `install` the Metron libs (which I don't remember being a
requirement before.) Then I was able to `vagrant up`.
{code}
cd incubator-metron
mvn clean install -DskipTests -T 1C
cd metron-deployment/vagrant/quick-dev-platform
vagrant up
{code}
h3. Additional Clues
When I login to the "Quick Dev" VM, I see that there are some 0.4.0 libs and
some 0.3.1 libs.
{code}
[root@node1 metron]# ls -l /usr/metron/0.3.1/lib/
total 167800
-rw-r--r--. 1 root root 85332259 Apr 3 21:05 metron-api-0.3.1.jar
-rw-r--r--. 1 root root 86490682 Mar 30 13:09 metron-pcap-backend-0.3.1.jar
[root@node1 metron]# ls -l /usr/metron/0.4.0/lib/
total 463428
-rw-r--r--. 1 root root 48425098 Apr 21 13:45 metron-common-0.4.0.jar
-rw-r--r--. 1 root root 124020704 Apr 21 13:50 metron-data-management-0.4.0.jar
-rw-r--r--. 1 root root 114754821 Apr 21 13:50
metron-elasticsearch-0.4.0-uber.jar
-rw-r--r--. 1 root root 93280994 Apr 21 13:48 metron-enrichment-0.4.0-uber.jar
-rw-r--r--. 1 root root 94059479 Apr 21 13:50 metron-parsers-0.4.0-uber.jar
{code}
Where did those 0.3.1 libs come from? When I look in my local Maven repository
on my build machine, I don't see any 0.3.1 libs at all, only 0.4.0
{code}
$ find ~/.m2/repository/org/apache/metron/ -name "0.3.1"
$ find ~/.m2/repository/org/apache/metron/ -name "0.4.0"
/Users/nallen/.m2/repository/org/apache/metron//elasticsearch-shaded/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//Metron/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-analytics/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-api/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-common/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-config/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-data-management/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-deployment/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-docker/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-elasticsearch/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-enrichment/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-hbase/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-indexing/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-integration-test/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-interface/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-maas-common/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-maas-service/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-management/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-parsers/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-pcap/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-pcap-backend/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-platform/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-profiler/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-profiler-client/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-profiler-common/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-rest/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-rest-client/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-solr/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-statistics/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-storm-kafka/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-test-utilities/0.4.0
/Users/nallen/.m2/repository/org/apache/metron//metron-writer/0.4.0
{code}
I seem to have the latest "Quick Dev" box image.
{code}
$ vagrant box update
Running with ansible-tags: ["quick_dev", "report"]
==> node1: Checking for updates to 'metron/quick_dev'
node1: Latest installed version: 0.2.0
node1: Version constraints:
node1: Provider: virtualbox
==> node1: Box 'metron/quick_dev' (v0.2.0) is running the latest version.
{code}
And for good measure, here is what my environment looks-like.
{code}
$ ./metron-deployment/scripts/platform-info.sh
Metron 0.4.0
--
* master
--
commit 41b5b1050cf29e5dcb5d0c36b5a9dbd1cafa745e
Author: justinjleet <justinjl...@gmail.com>
Date: Mon Apr 17 15:16:49 2017 -0400
The MPack should function in a kerberized cluster (justinleet) closes
apache/incubator-metron#518
--
--
ansible 2.0.0.2
config file =
configured module search path = Default w/o overrides
--
Vagrant 1.8.1
--
Python 2.7.13
--
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5;
2015-11-10T11:41:47-05:00)
Maven home: /usr/local/Cellar/maven/3.3.9/libexec
Java version: 1.8.0_66, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.12.4", arch: "x86_64", family: "mac"
--
Darwin HW12402.local 16.5.0 Darwin Kernel Version 16.5.0: Fri Mar 3 16:52:33
PST 2017; root:xnu-3789.51.2~3/RELEASE_X86_64 x86_64
--
Total System Memory = 16384 MB
Processor Model: Intel(R) Core(TM) i7-4870HQ CPU
Processor Speed: 2.50GHz
Total Physical Processors: 4
Total cores: 4
Disk information:
/dev/disk1 465Gi 319Gi 145Gi 69% 2694524 4292272755 0% /
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
