Github user JonZeolla commented on the issue: https://github.com/apache/incubator-metron/pull/453 I'm sorry if this was already covered and I missed it, I'm writing this from my phone. How does this handle errors during indexing itself? For instance, if the failure is due to the content of a specific field and that is placed in rawMessage/raw_message, wouldn't we have a failure loop? I was under the assumption that rawMessage/raw_message was not going to be included because of this sort of cyclical concern. Just wanted to double check on that because I've definitely seen those sort of failures in my environment. This also may be mitigated by the outcome of the ongoing dev list conversation "[DISCUSS] Management of Elastic and other index schemas" because we could attempt to fix those known sort of issues in the abstraction, but it still leaves us open to unknown issues.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---