Hi Mark,
Thanks for the help! We set the rollover period to 10 minutes so it is easy
for us to hit this. In addition to increasing the rollover time period
we're going to include a lone GenerateFlowFile processor which runs every
hour just to ensure that provenance events are in the log.
Thanks,
Eric,
Looks like you’re running into NIFI-7856 [1]. Should be addressed in the next
release. In the interim, there’s a work around that you can employ by updating
the settings in your nifi.properties file.
The issue occurs when the Provenance Event file rolls over after the configured
amount
Leon and I did some more digging and found this in both of our logs when we
were experiencing the lack of provenance. I think the missing ".prov" file
could be why those events are not visible.
We also grepped for the filename and component ID we were using in the
provenance query and both
I am also trying out a simple example. I connected a Generate Flowfile
processor to a LogAttribute processor and even though I could see flowfiles
moving through I didn't see any events for either of the component ids nor
did I see any events in the overall view of all provenance events.
I did
Hello,
This is the first time I’ve emailed here so please bear with me.
We are using nifi-1.12.1-RC2 and for one of our tests, we are seeing missing
data provenance in NiFi despite the DB showing the flow being processed.
A simplified explanation of how the system works is NiFi ingests a text
