[
https://issues.apache.org/jira/browse/NIFI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377096#comment-15377096
]
ASF GitHub Bot commented on NIFI-2087:
--------------------------------------
GitHub user markap14 opened a pull request:
https://github.com/apache/nifi/pull/652
NIFI-2087: Do not update the lucene index to delete expired events...
Instead, just wait for the entire index to expire and remove the files for
that index. This is much more efficient.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/markap14/nifi NIFI-2087
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/nifi/pull/652.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #652
----
commit 4e62ba28797cd58d2b4ab116908c4d2b53c0916b
Author: Mark Payne <[email protected]>
Date: 2016-06-30T20:06:24Z
NIFI-2087: Do not update the lucene index to delete expired events.
Instead, just wait for the entire index to expire and remove the files for that
index. This is much more efficient.
----
> Provenance Repository still removing events from Lucene Index
> -------------------------------------------------------------
>
> Key: NIFI-2087
> URL: https://issues.apache.org/jira/browse/NIFI-2087
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Reporter: Mark Payne
> Assignee: Mark Payne
> Fix For: 1.0.0
>
>
> NIFI-756 was implemented in NiFi 0.3.0 to change the way in which we remove
> events from the Lucene Indexes. It appears, though, that we still are using
> the DeleteIndexAction to remove events from the Lucene Index, in addition to
> the code that was added. As a result, we are removing events from the lucene
> index, in addition to the newer mechanism of just deleting the index files
> when they are no longer relevant.
> We should be able to simply stop using the DeleteIndexAction in
> PersistentProvenanceRepository and then test by starting NiFi with a small
> index shard size (say 25 MB), create a lot of data, such that some of the
> data ages off. We should then be able to verify that queries no longer show
> the data and be able to look in the provenance repository directory to verify
> that the old index-* directories are getting deleted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
