[ https://issues.apache.org/jira/browse/NIFI-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124465#comment-16124465 ]
ASF subversion and git services commented on NIFI-4077: ------------------------------------------------------- Commit 84935d4f7840fe9b22aa929afb403718c073e627 in nifi's branch refs/heads/master from [~markap14] [ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=84935d4 ] NIFI-4023, NIFI-4077 This closes #2075. Addressed issue where repository was aging off the wrong index. When it should age off Index 1, it was removing Index 2. As a result, the earliest index is never aged off, and the newest index could potentially be aged off before it is ready to be. Also addressed issue where a query that attempts to read an event that has aged off throws FileNotFoundException (NIFI-4077) instead of skipping over the event. The JavaDocs indicate that the EventIterator should skip records that it cannot find, but SelectiveRecordReaderEventIterator throw FileNotFoundException instead Signed-off-by: joewitt <joew...@apache.org> > o.a.n.p.index.lucene.LuceneEventIndex Failed to retrieve Provenance Events > from store > ------------------------------------------------------------------------------------- > > Key: NIFI-4077 > URL: https://issues.apache.org/jira/browse/NIFI-4077 > Project: Apache NiFi > Issue Type: Bug > Affects Versions: 1.3.0 > Reporter: Joseph Gresock > Assignee: Mark Payne > Fix For: 1.4.0 > > > I get this error when trying to display Data Provenance on a 4-node cluster: > 2017-06-15 18:28:23,945 ERROR [Provenance Query-2] > o.a.n.p.index.lucene.LuceneEventIndex Failed to retrieve Provenance Events > from store > java.io.FileNotFoundException: Unable to locate file > /data/nifi/provenance_repository/85309321.prov > at > org.apache.nifi.provenance.serialization.RecordReaders.newRecordReader(RecordReaders.java:119) > at > org.apache.nifi.provenance.WriteAheadProvenanceRepository.lambda$initialize$46(WriteAheadProvenanceRepository.java:125) > at > org.apache.nifi.provenance.store.iterator.SelectiveRecordReaderEventIterator.nextEvent(SelectiveRecordReaderEventIterator.java:137) > at > org.apache.nifi.provenance.store.iterator.AuthorizingEventIterator.nextEvent(AuthorizingEventIterator.java:47) > at > org.apache.nifi.provenance.store.PartitionedEventStore.getEvents(PartitionedEventStore.java:192) > at > org.apache.nifi.provenance.store.PartitionedEventStore.getEvents(PartitionedEventStore.java:167) > at > org.apache.nifi.provenance.index.lucene.LuceneEventIndex.lambda$submitQuery$58(LuceneEventIndex.java:442) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) > I don't know if this is related, but I also see this error in the same logs: > 2017-06-15 18:28:42,923 ERROR [Compress Provenance Logs-1-thread-1] > o.a.n.p.s.EventFileCompressor Failed to read TOC File > /data/nifi/provenance_repository/toc/87247412.toc > java.io.EOFException: null > at > org.apache.nifi.provenance.toc.StandardTocReader.<init>(StandardTocReader.java:48) > at > org.apache.nifi.provenance.serialization.EventFileCompressor.run(EventFileCompressor.java:93) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) -- This message was sent by Atlassian JIRA (v6.4.14#64029)