[metron] branch feature/METRON-2088-support-hdp-3.1 updated (0a619e0 -> 275a6d8)

2019-10-23 Thread mmiklavcic
This is an automated email from the ASF dual-hosted git repository.

mmiklavcic pushed a change to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git.


from 0a619e0  METRON-2297 Enrichment Topology Unable to Load Geo IP Data 
from HDFS (nickwallen) closes apache/metron#1539
 add 50b5c50  METRON-2278 Metron on CentOS 6 Documentation is 
outdated (subhashjha35 via sardell) closes apache/metron#1530
 add bb9a244  METRON-2259 [UI] Hide Resolved and Hide Dismissed toggles not 
works when filtering is in manual mode (tiborm via sardell) closes 
apache/metron#1532
 add 67b4d0b  METRON-2280 PCAP queries no longer work (mmiklavc) closes 
apache/metron#1537
 new 275a6d8  Merge branch 'master' into feature/METRON-2088-support-hdp-3.1

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 metron-deployment/development/centos6/README.md|  8 +++---
 .../show-hide-alert-entries.component.spec.ts  | 32 --
 .../show-hide/show-hide-alert-entries.component.ts | 16 +--
 .../show-hide/show-hide.service.spec.ts| 12 +++-
 .../configure-rows/show-hide/show-hide.service.ts  |  6 +++-
 .../src/app/shared/switch/switch.component.html|  4 +--
 .../src/app/shared/switch/switch.component.scss|  9 ++
 .../src/app/shared/switch/switch.component.ts  |  1 +
 metron-interface/metron-rest/pom.xml   |  3 +-
 metron-platform/metron-pcap-backend/pom.xml|  3 +-
 10 files changed, 78 insertions(+), 16 deletions(-)



[metron] branch master updated: METRON-2280 PCAP queries no longer work (mmiklavc) closes apache/metron#1537

2019-10-23 Thread mmiklavcic
This is an automated email from the ASF dual-hosted git repository.

mmiklavcic pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/metron.git


The following commit(s) were added to refs/heads/master by this push:
 new 67b4d0b  METRON-2280 PCAP queries no longer work (mmiklavc) closes 
apache/metron#1537
67b4d0b is described below

commit 67b4d0b2c84f7f370890c1caf639459a4c40b37a
Author: mmiklavc 
AuthorDate: Wed Oct 23 15:12:47 2019 -0600

METRON-2280 PCAP queries no longer work (mmiklavc) closes apache/metron#1537
---
 metron-interface/metron-rest/pom.xml| 3 ++-
 metron-platform/metron-pcap-backend/pom.xml | 3 ++-
 2 files changed, 4 insertions(+), 2 deletions(-)

diff --git a/metron-interface/metron-rest/pom.xml 
b/metron-interface/metron-rest/pom.xml
index 66dd99e..b4ca507 100644
--- a/metron-interface/metron-rest/pom.xml
+++ b/metron-interface/metron-rest/pom.xml
@@ -192,10 +192,11 @@
 
 
 
+
 org.apache.metron
 stellar-common
 ${project.parent.version}
-provided
 
   
 org.apache.hadoop
diff --git a/metron-platform/metron-pcap-backend/pom.xml 
b/metron-platform/metron-pcap-backend/pom.xml
index 5042b70..719292c 100644
--- a/metron-platform/metron-pcap-backend/pom.xml
+++ b/metron-platform/metron-pcap-backend/pom.xml
@@ -58,10 +58,11 @@
 
 
 
+
 org.apache.metron
 stellar-common
 ${project.parent.version}
-provided
 
 
 junit



[metron] branch feature/METRON-2088-support-hdp-3.1 updated: METRON-2297 Enrichment Topology Unable to Load Geo IP Data from HDFS (nickwallen) closes apache/metron#1539

2019-10-23 Thread nickallen
This is an automated email from the ASF dual-hosted git repository.

nickallen pushed a commit to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git


The following commit(s) were added to 
refs/heads/feature/METRON-2088-support-hdp-3.1 by this push:
 new 0a619e0  METRON-2297 Enrichment Topology Unable to Load Geo IP Data 
from HDFS (nickwallen) closes apache/metron#1539
0a619e0 is described below

commit 0a619e082f34d65269f03ed4c6e16ba8bb5a0dbb
Author: nickwallen 
AuthorDate: Wed Oct 23 15:39:19 2019 -0400

METRON-2297 Enrichment Topology Unable to Load Geo IP Data from HDFS 
(nickwallen) closes apache/metron#1539
---
 metron-analytics/metron-profiler-storm/pom.xml |   5 +
 .../CURRENT/configuration/metron-security-env.xml  |  10 +-
 .../CURRENT/package/scripts/params/params_linux.py |   7 +-
 .../storm/security/auth/kerberos/AutoTGT.java  | 254 +
 .../metron-elasticsearch-storm/pom.xml |   5 +
 .../metron-enrichment-storm/pom.xml|   5 +
 .../metron-indexing/metron-indexing-storm/pom.xml  |   5 +
 metron-platform/metron-pcap-backend/pom.xml|   5 +
 .../metron-solr/metron-solr-storm/pom.xml  |   5 +
 9 files changed, 299 insertions(+), 2 deletions(-)

diff --git a/metron-analytics/metron-profiler-storm/pom.xml 
b/metron-analytics/metron-profiler-storm/pom.xml
index 84c0631..da049ac 100644
--- a/metron-analytics/metron-profiler-storm/pom.xml
+++ b/metron-analytics/metron-profiler-storm/pom.xml
@@ -148,6 +148,11 @@
 
 
 org.apache.metron
+metron-common-storm
+${project.parent.version}
+
+
+org.apache.metron
 metron-writer-storm
 ${project.parent.version}
 
diff --git 
a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml
 
b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml
index beb0451..fc91a4a 100644
--- 
a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml
+++ 
b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml
@@ -159,7 +159,6 @@
 
 
   
-
   
 metron.ldap.ssl.truststore
 LDAP Truststore
@@ -240,4 +239,13 @@
 Name of the role at the authentication provider that provides 
administrative access to Metron.
 
   
+  
+topology_auto_credentials
+Topology Auto Credentials
+The value of Storm's `topology.auto-credentials`. A list of 
plugins used to unpack credentials on the Storm worker. This value is only used 
when Kerberos has been enabled.
+['org.apache.metron.storm.security.auth.kerberos.AutoTGT']
+
+  true
+
+  
 
\ No newline at end of file
diff --git 
a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py
 
b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py
index b7fbcf4..d0026dd 100755
--- 
a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py
+++ 
b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py
@@ -258,7 +258,12 @@ profiler_topology_worker_childopts = client_jaas_arg if 
security_enabled else ''
 indexing_topology_worker_childopts = client_jaas_arg if security_enabled else 
''
 pcap_topology_worker_childopts = client_jaas_arg if security_enabled else ''
 metron_jvm_flags += (' ' + client_jaas_arg) if security_enabled else ''
-topology_auto_credentials = 
config['configurations']['storm-site'].get('nimbus.credential.renewers.classes',
 [])
+
+# the user-defined `topology.auto-credentials` are only used if security is 
enabled
+topology_auto_credentials = []
+if security_enabled:
+topology_auto_credentials = 
config['configurations']['metron-security-env'].get('topology_auto_credentials',
 [])
+
 # Needed for storm.config, because it needs Java String
 topology_auto_credentials_double_quotes = 
str(topology_auto_credentials).replace("'", '"')
 
diff --git 
a/metron-platform/metron-common-streaming/metron-common-storm/src/main/java/org/apache/metron/storm/security/auth/kerberos/AutoTGT.java
 
b/metron-platform/metron-common-streaming/metron-common-storm/src/main/java/org/apache/metron/storm/security/auth/kerberos/AutoTGT.java
new file mode 100644
index 000..adf0327
--- /dev/null
+++ 
b/metron-platform/metron-common-streaming/metron-common-storm/src/main/java/org/apache/metron/storm/security/auth/kerberos/AutoTGT.java
@@ 

[metron] branch feature/METRON-2088-support-hdp-3.1 updated: METRON-2298 'User Base DN' Missing from Security Configuration (nickwallen) closes apache/metron#1538

2019-10-23 Thread nickallen
This is an automated email from the ASF dual-hosted git repository.

nickallen pushed a commit to branch feature/METRON-2088-support-hdp-3.1
in repository https://gitbox.apache.org/repos/asf/metron.git


The following commit(s) were added to 
refs/heads/feature/METRON-2088-support-hdp-3.1 by this push:
 new 0b6cd7d  METRON-2298 'User Base DN' Missing from Security 
Configuration (nickwallen) closes apache/metron#1538
0b6cd7d is described below

commit 0b6cd7da29795dee0ae90b09eb2afac2b460de9f
Author: nickwallen 
AuthorDate: Wed Oct 23 15:23:07 2019 -0400

METRON-2298 'User Base DN' Missing from Security Configuration (nickwallen) 
closes apache/metron#1538
---
 .../common-services/METRON/CURRENT/themes/metron_theme.json| 10 ++
 1 file changed, 10 insertions(+)

diff --git 
a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json
 
b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json
index f6285c7..06c9013 100644
--- 
a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json
+++ 
b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json
@@ -897,6 +897,10 @@
   "subsection-name": "subsection-security-ldap"
 },
 {
+  "config": "metron-security-env/metron.ldap.user.basedn",
+  "subsection-name": "subsection-security-ldap"
+},
+{
   "config": "metron-security-env/metron.ldap.user.dnpattern",
   "subsection-name": "subsection-security-ldap"
 },
@@ -1688,6 +1692,12 @@
 }
   },
   {
+"config": "metron-security-env/metron.ldap.user.basedn",
+"widget": {
+  "type": "text-field"
+}
+  },
+  {
 "config": "metron-security-env/metron.ldap.user.dnpattern",
 "widget": {
   "type": "text-field"