As soon as the property is changed in global config, it should initiate a reload in the enrichment topology - https://github.com/apache/metron/tree/master/metron-platform/metron-enrichment/metron-enrichment-common#geohdfsfile. I don't recall us writing code that checks a file sha-1 or anything like that, so I believe you need to update the filename stored in HDFS. A good option would be to append the timestamp of the day the DB was downloaded to the filename. Then simply update the filename in global config and push it back up to Zookeeper. That should be all you need.
Best, Mike On Thu, Jan 30, 2020 at 6:10 AM Vladimir Mikhailov < [email protected]> wrote: > In light of recent changes in the policy for downloading Maxmind GeoIP > data files, we have configured to update files in HDFS using an external > tool. And we decided to figure out when does the Metron start using the new > Maxmind GeoIP data after updating. > > After studying the source code, we came to the conclusion that it is > necessary to restart the enrichment topology so that updated data files > begin to be used. > > Is it so? > > Thanks. >
