GitHub user cestella opened a pull request:
https://github.com/apache/incubator-metron/pull/108
METRON-141: The ability to do threat triage
We have the ability to mark messages as part of the enrichment topology as
threat alerts, but we have no ability to prioritize those alerts.
We should allow for the prioritization of messages that have some threat
intelligence alert via a scoring mechanism.
The general idea is for each message from each sensor:
1. Map threat conditions as defined by a lightweight query language to
threat levels (a number).
2. More than one condition may match a given message, so allow for the
choice of aggregation functions.
3. If the aggregated score is positive, then add a field
(`threat.triage.level`) with the level to the JSON message.
The above configuration is done at the per-sensor level.
As part of this PR, the following were added out of necessity:
* A query language DSL which is used in defining the conditions which map
to threat levels. Docs at
[here](https://github.com/cestella/incubator-metron/tree/METRON-141/metron-platform/metron-common#query-language)
* The addition of a `triageConfig` section to the sensor enrichment config.
Description at
[here](https://github.com/cestella/incubator-metron/tree/METRON-141/metron-platform/metron-common#the-threatintel-configuration)
* Actual documentation of our enrichment configuration. Documentation at
[here](https://github.com/cestella/incubator-metron/tree/METRON-141/metron-platform/metron-common#enrichment-configuration)
* A rewrite of the `zk_load_configs.sh` utility to support both pushing and
pulling configs (the threat triage rules are part of the configs and until we
have a UI, we need to add them). Docs at
[here](https://github.com/cestella/incubator-metron/tree/METRON-141/metron-platform/metron-common#management-utility)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cestella/incubator-metron METRON-141
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/108.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #108
----
commit cfdffd48d6a5ea7c228c4b66f23c16cc55691f79
Author: cstella <[email protected]>
Date: 2016-05-06T22:46:02Z
METRON-141: The ability to do threat triage
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---