Hey Daren, Herald, Thanks for the note. I have seen this once before but couldn’t figure out what caused it. Restarting addressed the issue.
I think I may understand the problem, now, though, after looking at it again. In nifi.properties, there are a couple of property named “nifi.provenance.repository.max.storage.time” that defaults to “24 hours" Is it possible that you went 24 hours (or whatever value is set for that property) without generating any Provenance events? If so, then I think that would understand why it deleted the data. It’s trying to age off old data but unfortunately it doesn’t perform a check to first determine whether or not the “old file” that it’s about to delete is also the “active file”. Can you confirm whether or not you would expect to see 24 hours pass without any provenance data? Thanks -Mark On Apr 9, 2020, at 4:32 AM, Dobbernack, Harald (Key-Work) <harald.dobbern...@key-work.de<mailto:harald.dobbern...@key-work.de>> wrote: What I noticed is that as long as provenance is working there will be *.prov files in the directory. When Provenance isn’t working these files are not to be seen. Maybe some Cleaning Process deletes those files prematurely or the process building them doesn’t work any more? Von: Dobbernack, Harald (Key-Work) <harald.dobbern...@key-work.de<mailto:harald.dobbern...@key-work.de>> Gesendet: Donnerstag, 9. April 2020 10:27 An: users@nifi.apache.org<mailto:users@nifi.apache.org> Betreff: AW: Not Seeing Provenance data This is something I experience too from time to time. My quick and dirty workaround is stop nifi, delete everything in the provenance directory, restart…. Then Provenance is usable again (of course only with data since the delete) . I’m hoping very much there is a better way, someone can show us better settings or a potential bug can be discovered… Von: Darren Govoni <dar...@ontrenet.com<mailto:dar...@ontrenet.com>> Gesendet: Mittwoch, 8. April 2020 20:31 An: users@nifi.apache.org<mailto:users@nifi.apache.org> Betreff: Not Seeing Provenance data Hi, When I go to "View data provenance" in Nifi, I never see any logs for my flow. Am I missing some configuration setting somewhere? thanks, Darren Harald Dobbernack Key-Work Consulting GmbH | Kriegsstr. 100 | 76133 | Karlsruhe | Germany | https://www.key-work.de<x-msg://13/www.key-work.de> | Datenschutz<https://www.key-work.de/de/footer/datenschutz.html> Fon: +49-721-78203-264 | E-Mail: harald.dobbern...@key-work.de<mailto:harald.dobbern...@key-work.de> | Fax: +49-721-78203-10 Key-Work Consulting GmbH, Karlsruhe, HRB 108695, HRG Mannheim Geschäftsführer: Andreas Stappert, Tobin Wotring
