[metron] branch feature/METRON-2088-support-hdp-3.1 updated (0a619e0 -> 275a6d8)
This is an automated email from the ASF dual-hosted git repository. mmiklavcic pushed a change to branch feature/METRON-2088-support-hdp-3.1 in repository https://gitbox.apache.org/repos/asf/metron.git. from 0a619e0 METRON-2297 Enrichment Topology Unable to Load Geo IP Data from HDFS (nickwallen) closes apache/metron#1539 add 50b5c50 METRON-2278 Metron on CentOS 6 Documentation is outdated (subhashjha35 via sardell) closes apache/metron#1530 add bb9a244 METRON-2259 [UI] Hide Resolved and Hide Dismissed toggles not works when filtering is in manual mode (tiborm via sardell) closes apache/metron#1532 add 67b4d0b METRON-2280 PCAP queries no longer work (mmiklavc) closes apache/metron#1537 new 275a6d8 Merge branch 'master' into feature/METRON-2088-support-hdp-3.1 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: metron-deployment/development/centos6/README.md| 8 +++--- .../show-hide-alert-entries.component.spec.ts | 32 -- .../show-hide/show-hide-alert-entries.component.ts | 16 +-- .../show-hide/show-hide.service.spec.ts| 12 +++- .../configure-rows/show-hide/show-hide.service.ts | 6 +++- .../src/app/shared/switch/switch.component.html| 4 +-- .../src/app/shared/switch/switch.component.scss| 9 ++ .../src/app/shared/switch/switch.component.ts | 1 + metron-interface/metron-rest/pom.xml | 3 +- metron-platform/metron-pcap-backend/pom.xml| 3 +- 10 files changed, 78 insertions(+), 16 deletions(-)
[metron] branch master updated: METRON-2280 PCAP queries no longer work (mmiklavc) closes apache/metron#1537
This is an automated email from the ASF dual-hosted git repository. mmiklavcic pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/metron.git The following commit(s) were added to refs/heads/master by this push: new 67b4d0b METRON-2280 PCAP queries no longer work (mmiklavc) closes apache/metron#1537 67b4d0b is described below commit 67b4d0b2c84f7f370890c1caf639459a4c40b37a Author: mmiklavc AuthorDate: Wed Oct 23 15:12:47 2019 -0600 METRON-2280 PCAP queries no longer work (mmiklavc) closes apache/metron#1537 --- metron-interface/metron-rest/pom.xml| 3 ++- metron-platform/metron-pcap-backend/pom.xml | 3 ++- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/metron-interface/metron-rest/pom.xml b/metron-interface/metron-rest/pom.xml index 66dd99e..b4ca507 100644 --- a/metron-interface/metron-rest/pom.xml +++ b/metron-interface/metron-rest/pom.xml @@ -192,10 +192,11 @@ + org.apache.metron stellar-common ${project.parent.version} -provided org.apache.hadoop diff --git a/metron-platform/metron-pcap-backend/pom.xml b/metron-platform/metron-pcap-backend/pom.xml index 5042b70..719292c 100644 --- a/metron-platform/metron-pcap-backend/pom.xml +++ b/metron-platform/metron-pcap-backend/pom.xml @@ -58,10 +58,11 @@ + org.apache.metron stellar-common ${project.parent.version} -provided junit
[metron] branch feature/METRON-2088-support-hdp-3.1 updated: METRON-2297 Enrichment Topology Unable to Load Geo IP Data from HDFS (nickwallen) closes apache/metron#1539
This is an automated email from the ASF dual-hosted git repository. nickallen pushed a commit to branch feature/METRON-2088-support-hdp-3.1 in repository https://gitbox.apache.org/repos/asf/metron.git The following commit(s) were added to refs/heads/feature/METRON-2088-support-hdp-3.1 by this push: new 0a619e0 METRON-2297 Enrichment Topology Unable to Load Geo IP Data from HDFS (nickwallen) closes apache/metron#1539 0a619e0 is described below commit 0a619e082f34d65269f03ed4c6e16ba8bb5a0dbb Author: nickwallen AuthorDate: Wed Oct 23 15:39:19 2019 -0400 METRON-2297 Enrichment Topology Unable to Load Geo IP Data from HDFS (nickwallen) closes apache/metron#1539 --- metron-analytics/metron-profiler-storm/pom.xml | 5 + .../CURRENT/configuration/metron-security-env.xml | 10 +- .../CURRENT/package/scripts/params/params_linux.py | 7 +- .../storm/security/auth/kerberos/AutoTGT.java | 254 + .../metron-elasticsearch-storm/pom.xml | 5 + .../metron-enrichment-storm/pom.xml| 5 + .../metron-indexing/metron-indexing-storm/pom.xml | 5 + metron-platform/metron-pcap-backend/pom.xml| 5 + .../metron-solr/metron-solr-storm/pom.xml | 5 + 9 files changed, 299 insertions(+), 2 deletions(-) diff --git a/metron-analytics/metron-profiler-storm/pom.xml b/metron-analytics/metron-profiler-storm/pom.xml index 84c0631..da049ac 100644 --- a/metron-analytics/metron-profiler-storm/pom.xml +++ b/metron-analytics/metron-profiler-storm/pom.xml @@ -148,6 +148,11 @@ org.apache.metron +metron-common-storm +${project.parent.version} + + +org.apache.metron metron-writer-storm ${project.parent.version} diff --git a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml index beb0451..fc91a4a 100644 --- a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml +++ b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/configuration/metron-security-env.xml @@ -159,7 +159,6 @@ - metron.ldap.ssl.truststore LDAP Truststore @@ -240,4 +239,13 @@ Name of the role at the authentication provider that provides administrative access to Metron. + +topology_auto_credentials +Topology Auto Credentials +The value of Storm's `topology.auto-credentials`. A list of plugins used to unpack credentials on the Storm worker. This value is only used when Kerberos has been enabled. +['org.apache.metron.storm.security.auth.kerberos.AutoTGT'] + + true + + \ No newline at end of file diff --git a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py index b7fbcf4..d0026dd 100755 --- a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py +++ b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/package/scripts/params/params_linux.py @@ -258,7 +258,12 @@ profiler_topology_worker_childopts = client_jaas_arg if security_enabled else '' indexing_topology_worker_childopts = client_jaas_arg if security_enabled else '' pcap_topology_worker_childopts = client_jaas_arg if security_enabled else '' metron_jvm_flags += (' ' + client_jaas_arg) if security_enabled else '' -topology_auto_credentials = config['configurations']['storm-site'].get('nimbus.credential.renewers.classes', []) + +# the user-defined `topology.auto-credentials` are only used if security is enabled +topology_auto_credentials = [] +if security_enabled: +topology_auto_credentials = config['configurations']['metron-security-env'].get('topology_auto_credentials', []) + # Needed for storm.config, because it needs Java String topology_auto_credentials_double_quotes = str(topology_auto_credentials).replace("'", '"') diff --git a/metron-platform/metron-common-streaming/metron-common-storm/src/main/java/org/apache/metron/storm/security/auth/kerberos/AutoTGT.java b/metron-platform/metron-common-streaming/metron-common-storm/src/main/java/org/apache/metron/storm/security/auth/kerberos/AutoTGT.java new file mode 100644 index 000..adf0327 --- /dev/null +++ b/metron-platform/metron-common-streaming/metron-common-storm/src/main/java/org/apache/metron/storm/security/auth/kerberos/AutoTGT.java @@
[metron] branch feature/METRON-2088-support-hdp-3.1 updated: METRON-2298 'User Base DN' Missing from Security Configuration (nickwallen) closes apache/metron#1538
This is an automated email from the ASF dual-hosted git repository. nickallen pushed a commit to branch feature/METRON-2088-support-hdp-3.1 in repository https://gitbox.apache.org/repos/asf/metron.git The following commit(s) were added to refs/heads/feature/METRON-2088-support-hdp-3.1 by this push: new 0b6cd7d METRON-2298 'User Base DN' Missing from Security Configuration (nickwallen) closes apache/metron#1538 0b6cd7d is described below commit 0b6cd7da29795dee0ae90b09eb2afac2b460de9f Author: nickwallen AuthorDate: Wed Oct 23 15:23:07 2019 -0400 METRON-2298 'User Base DN' Missing from Security Configuration (nickwallen) closes apache/metron#1538 --- .../common-services/METRON/CURRENT/themes/metron_theme.json| 10 ++ 1 file changed, 10 insertions(+) diff --git a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json index f6285c7..06c9013 100644 --- a/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json +++ b/metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/CURRENT/themes/metron_theme.json @@ -897,6 +897,10 @@ "subsection-name": "subsection-security-ldap" }, { + "config": "metron-security-env/metron.ldap.user.basedn", + "subsection-name": "subsection-security-ldap" +}, +{ "config": "metron-security-env/metron.ldap.user.dnpattern", "subsection-name": "subsection-security-ldap" }, @@ -1688,6 +1692,12 @@ } }, { +"config": "metron-security-env/metron.ldap.user.basedn", +"widget": { + "type": "text-field" +} + }, + { "config": "metron-security-env/metron.ldap.user.dnpattern", "widget": { "type": "text-field"