Matt Burgess created NIFI-8093:
----------------------------------

             Summary: Possible race condition when deleting oldest provenance 
file
                 Key: NIFI-8093
                 URL: https://issues.apache.org/jira/browse/NIFI-8093
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
            Reporter: Matt Burgess


Saw this in some recent NiFi logs:

2020-12-14 11:42:53,770 WARN [Provenance Repository Maintenance-2-thread-1] 
o.a.n.p.store.WriteAheadStorePartition Provenance Event Store 
Partition[directory=./provenance_repository] Failed to delete oldest event file 
./provenance_repository/37169.prov. This file should be cleaned up manually.
2020-12-14 11:42:53,796 INFO [Provenance Repository Maintenance-2-thread-1] 
o.a.n.p.store.WriteAheadStorePartition Provenance Event Store 
Partition[directory=./provenance_repository] Deleted 
./provenance_repository/37169.prov.gz event file (120.69 MB) due to storage 
limits

It appears there may be a race condition where NiFi is attempting to delete the 
oldest provenance file while it is being compressed. After compression 
completes, the .gz file does get successfully deleted (so no manual 
intervention is required).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to