[metron] branch feature/METRON-2088-support-hdp-3.1 updated (69163fa -> 92034de)

2019-11-13 Thread mmiklavcic
This is an automated email from the ASF dual-hosted git repository.

mmiklavcic pushed a change to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git.


from 69163fa  Merge remote-tracking branch 'upstream/master' into 
feature/METRON-2088-support-hdp-3.1
 add fca9ebf  METRON-2239 Metron Automated backup and restore (mmiklavc) 
closes apache/metron#1546
 new 92034de  Merge branch 'master' into feature/METRON-2088-support-hdp-3.1

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 Upgrade_steps.md   |  40 +++
 .../packaging/docker/rpm-docker/SPECS/metron.spec  |   1 +
 metron-platform/metron-common/README.md|  30 ++
 .../src/main/scripts/upgrade_helper.sh | 120 +
 4 files changed, 191 insertions(+)
 create mode 100644 Upgrade_steps.md
 create mode 100755 
metron-platform/metron-common/src/main/scripts/upgrade_helper.sh



[metron] 01/01: Merge branch 'master' into feature/METRON-2088-support-hdp-3.1

2019-11-13 Thread mmiklavcic
This is an automated email from the ASF dual-hosted git repository.

mmiklavcic pushed a commit to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git

commit 92034de2f6fc5657c43a996ac4784fbe4717a010
Merge: 69163fa fca9ebf
Author: Michael Miklavcic 
AuthorDate: Wed Nov 13 11:37:03 2019 -0700

Merge branch 'master' into feature/METRON-2088-support-hdp-3.1

 Upgrade_steps.md   |  40 +++
 .../packaging/docker/rpm-docker/SPECS/metron.spec  |   1 +
 metron-platform/metron-common/README.md|  30 ++
 .../src/main/scripts/upgrade_helper.sh | 120 +
 4 files changed, 191 insertions(+)



[metron] 01/01: Merge remote-tracking branch 'upstream/master' into feature/METRON-2088-support-hdp-3.1

2019-11-13 Thread nickallen
This is an automated email from the ASF dual-hosted git repository.

nickallen pushed a commit to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git

commit 69163fab7cf5a14754c96e7115492f0ce9e1ebca
Merge: 78a6f38 12e16df
Author: nickallen 
AuthorDate: Wed Nov 13 12:22:35 2019 -0500

Merge remote-tracking branch 'upstream/master' into 
feature/METRON-2088-support-hdp-3.1

 metron-analytics/metron-maas-service/README.md | 209 -
 metron-analytics/metron-profiler-common/README.md  |  10 +-
 .../metron/profiler/spark/BatchProfiler.java   |   4 +-
 .../spark/BatchProfilerIntegrationTest.java|  29 ++-
 .../alerts/alerts-list/alerts-list.component.ts|   1 +
 .../auto-polling/auto-polling.service.spec.ts  |  12 +-
 .../auto-polling/auto-polling.service.ts   |   9 +-
 .../metron-elasticsearch-storm/pom.xml |  11 ++
 .../metron-indexing/metron-indexing-storm/pom.xml  |  23 +--
 .../metron-solr/metron-solr-storm/pom.xml  |   6 +
 10 files changed, 269 insertions(+), 45 deletions(-)




[metron] branch feature/METRON-2088-support-hdp-3.1 updated: METRON-2223 Reconcile Versions in Root POM with HDP 3.1 (nickwallen) closes apache/metron#1551

2019-11-13 Thread nickallen
This is an automated email from the ASF dual-hosted git repository.

nickallen pushed a commit to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git


The following commit(s) were added to 
refs/heads/feature/METRON-2088-support-hdp-3.1 by this push:
 new 78a6f38  METRON-2223 Reconcile Versions in Root POM with HDP 3.1 
(nickwallen) closes apache/metron#1551
78a6f38 is described below

commit 78a6f38daa1ff4602e32d1c11a2d5d726d9975e4
Author: nickwallen 
AuthorDate: Wed Nov 13 12:19:35 2019 -0500

METRON-2223 Reconcile Versions in Root POM with HDP 3.1 (nickwallen) closes 
apache/metron#1551
---
 README.md  |   2 +-
 .../ambari_config/tasks/dependencies-CentOS-6.yml  |  26 
 .../ambari_slave/tasks/install-agent-CentOS-6.yml  |  19 ---
 .../tasks/install-service-CentOS-6.yml |  22 
 .../manual-install/Manual_Install_CentOS6.md   |  18 +--
 metron-platform/metron-storm-kafka/pom.xml |   2 +-
 pom.xml| 137 +
 7 files changed, 68 insertions(+), 158 deletions(-)

diff --git a/README.md b/README.md
index a3bc14e..f7977a5 100644
--- a/README.md
+++ b/README.md
@@ -99,7 +99,7 @@ $ mvn clean install -DskipTests
 
 Build with the HDP profile:
 ```
-$ mvn clean install -PHDP-2.5.0.0
+$ mvn clean install -PHDP-3.1
 ```
 
 You can swap "install" for "package" in the commands above if you don't want 
to deploy the artifacts to your local .m2 repo.
diff --git 
a/metron-deployment/ansible/roles/ambari_config/tasks/dependencies-CentOS-6.yml 
b/metron-deployment/ansible/roles/ambari_config/tasks/dependencies-CentOS-6.yml
deleted file mode 100644
index 72a96d4..000
--- 
a/metron-deployment/ansible/roles/ambari_config/tasks/dependencies-CentOS-6.yml
+++ /dev/null
@@ -1,26 +0,0 @@
-#
-#  Licensed to the Apache Software Foundation (ASF) under one or more
-#  contributor license agreements.  See the NOTICE file distributed with
-#  this work for additional information regarding copyright ownership.
-#  The ASF licenses this file to You under the Apache License, Version 2.0
-#  (the "License"); you may not use this file except in compliance with
-#  the License.  You may obtain a copy of the License at
-#
-#  http://www.apache.org/licenses/LICENSE-2.0
-#
-#  Unless required by applicable law or agreed to in writing, software
-#  distributed under the License is distributed on an "AS IS" BASIS,
-#  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-#  See the License for the specific language governing permissions and
-#  limitations under the License.
-#

-- name: Install urllib3 with pip
-  pip:
-name: urllib3
-version: 1.10.2
-
-- name: Install requests with pip
-  pip:
-name: requests
-version: 2.6.1
diff --git 
a/metron-deployment/ansible/roles/ambari_slave/tasks/install-agent-CentOS-6.yml 
b/metron-deployment/ansible/roles/ambari_slave/tasks/install-agent-CentOS-6.yml
deleted file mode 100644
index 8f16b92..000
--- 
a/metron-deployment/ansible/roles/ambari_slave/tasks/install-agent-CentOS-6.yml
+++ /dev/null
@@ -1,19 +0,0 @@
-#
-#  Licensed to the Apache Software Foundation (ASF) under one or more
-#  contributor license agreements.  See the NOTICE file distributed with
-#  this work for additional information regarding copyright ownership.
-#  The ASF licenses this file to You under the Apache License, Version 2.0
-#  (the "License"); you may not use this file except in compliance with
-#  the License.  You may obtain a copy of the License at
-#
-#  http://www.apache.org/licenses/LICENSE-2.0
-#
-#  Unless required by applicable law or agreed to in writing, software
-#  distributed under the License is distributed on an "AS IS" BASIS,
-#  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-#  See the License for the specific language governing permissions and
-#  limitations under the License.
-#

-- name: Install ambari-agent on CentOS 6
-  yum: name=ambari-agent
diff --git 
a/metron-deployment/ansible/roles/sensor-stubs/tasks/install-service-CentOS-6.yml
 
b/metron-deployment/ansible/roles/sensor-stubs/tasks/install-service-CentOS-6.yml
deleted file mode 100644
index 022e49f..000
--- 
a/metron-deployment/ansible/roles/sensor-stubs/tasks/install-service-CentOS-6.yml
+++ /dev/null
@@ -1,22 +0,0 @@
-#
-#  Licensed to the Apache Software Foundation (ASF) under one or more
-#  contributor license agreements.  See the NOTICE file distributed with
-#  this work for additional information regarding copyright ownership.
-#  The ASF licenses this file to You under the Apache License, Version 2.0
-#  (the "License"); you may not use this file except in compliance with
-#  the License.  You may obtain a copy of the License at
-#
-#  http://www.apache.org/licenses/LICENSE-2.0
-#
-#  Unless required by applicable law or agreed to in writing, software
-# 

[metron] branch master updated: METRON-2308 Fix 'Degrees' Example Profile (nickwallen) closes apache/metron#1555

2019-11-13 Thread nickallen
This is an automated email from the ASF dual-hosted git repository.

nickallen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/metron.git


The following commit(s) were added to refs/heads/master by this push:
 new 12e16df  METRON-2308 Fix 'Degrees' Example Profile (nickwallen) closes 
apache/metron#1555
12e16df is described below

commit 12e16df4c340be169ff0d0190c732948fdcd2e44
Author: nickwallen 
AuthorDate: Wed Nov 13 10:06:30 2019 -0500

METRON-2308 Fix 'Degrees' Example Profile (nickwallen) closes 
apache/metron#1555
---
 metron-analytics/metron-profiler-common/README.md | 10 ++
 1 file changed, 6 insertions(+), 4 deletions(-)

diff --git a/metron-analytics/metron-profiler-common/README.md 
b/metron-analytics/metron-profiler-common/README.md
index fe4c2ed..5841efc 100644
--- a/metron-analytics/metron-profiler-common/README.md
+++ b/metron-analytics/metron-profiler-common/README.md
@@ -363,15 +363,17 @@ This profile captures the vertex degree of a host. If you 
view network communica
   "profile": "in-degrees",
   "onlyif": "source.type == 'yaf'",
   "foreach": "ip_dst_addr",
-  "update": { "in": "HLLP_ADD(in, ip_src_addr)" },
-  "result": "HLLP_CARDINALITY(in)"
+  "init": { "estimator": "HLLP_INIT()" },
+  "update": { "estimator": "HLLP_ADD(estimator, ip_src_addr)" },
+  "result": "HLLP_CARDINALITY(estimator)"
 },
 {
   "profile": "out-degrees",
   "onlyif": "source.type == 'yaf'",
   "foreach": "ip_src_addr",
-  "update": { "out": "HLLP_ADD(out, ip_dst_addr)" },
-  "result": "HLLP_CARDINALITY(out)"
+  "init": { "estimator": "HLLP_INIT()" },
+  "update": { "estimator": "HLLP_ADD(estimator, ip_dst_addr)" },
+  "result": "HLLP_CARDINALITY(estimator)"
 }
   ]
 }