>From what I can tell, the data pruner isn't documented anywhere, so I'm
curious if anybody is using this, and if so, how are you using it?

   -
   
https://github.com/apache/metron/blob/master/metron-platform/metron-data-management/README.md
   -
   
https://github.com/apache/metron/blob/master/metron-platform/metron-data-management/src/main/java/org/apache/metron/dataloads/bulk/ElasticsearchDataPrunerRunner.java
   -
   
https://github.com/apache/metron/blob/master/metron-platform/metron-data-management/src/main/java/org/apache/metron/dataloads/bulk/DataPruner.java

It looks to me that it allows you to specify the start date and a number of
days for lookback from the start date to purge along with a regex pattern
to match the index name. It also does not look like it has any built-in
scheduling semantics, so I assume this was a cron job. I think that about
covers it. Anything I've missed?

I'm adding a quick doc write-up to METRON-939 (
https://github.com/apache/metron/pull/840) for using Curator to prune
indices from Elasticsearch. It is desirable to make sure I've covered
existing use cases.

Best,
Mike

Reply via email to