Re: Update Problem 1.9.2 to 1.10.0 (Lost provenance)

2020-01-08 Thread alec_osborne
Hi Mark,

in our test environment, the repository is only 1 GB. We waited for about an
hour. During this time we could not access the old entries. However, new
entries have been added. We always tested this via the global (hamburger)
menu -> Provenance.

Thanks

Alec



--
Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/


Re: Update Problem 1.9.2 to 1.10.0 (Lost provenance)

2020-01-06 Thread Mark Payne
Alec,

How large is your provenance Repository? How long did you wait before 
attempting to query the repo? How powerful is the machine that you're running 
on?

You are correct that NiFi must rebuild the Lucene indices before they can be 
queried. This can take quite a while for a large repository. So this happens in 
the background, not upon restart. So if you had a 1 TB repository, for 
instance, you wouldn't be able to query it immediately after startup. It may 
take a while. Conversely, if you had a 10 GB repository and waited hours before 
attempting to query, then perhaps something has gone awry. Also, did you 
attempt to query it by going to the "Provenance" menu item from the global 
(hamburger) menu, or by right-clicking on a processor and choosing Provenance 
Events from there?

Thanks
-Mark


> On Jan 6, 2020, at 3:24 PM, alec_osborne  wrote:
> 
> Hi 
> 
> we use the WriteAheadProvenanceRepository implementation.
> 
> nifi.provenance.repository.implementation=org.apache.nifi.provenance.WriteAheadProvenanceRepository
> 
> Thanks,
> 
> Alec
> 
> 
> 
> --
> Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/



Re: Update Problem 1.9.2 to 1.10.0 (Lost provenance)

2020-01-06 Thread alec_osborne
Hi 

we use the WriteAheadProvenanceRepository implementation.

nifi.provenance.repository.implementation=org.apache.nifi.provenance.WriteAheadProvenanceRepository

Thanks,

Alec



--
Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/


Re: Update Problem 1.9.2 to 1.10.0 (Lost provenance)

2019-12-27 Thread Pierre Villard
Hi,

What is your provenance repository configuration? what is the
implementation you chose?

Thanks,
Pierre

Le lun. 23 déc. 2019 à 11:11, alec_osborne  a écrit :

> Hi,
> we wanted to migrate our Nifi version from 1.9.2 to 1.10.0. We did not
> succeed. It was not possible for us after the update to access the old
> provenance events. We have not changed anything in our configuration. I
> read
> that after the update the index is rebuilt. Can that be a reason or do I
> have to consider something special? After I changed back to version 1.9.2,
> my old provenance events were immediately available again.
>
> Do you have any tips on what I can check?
>
> Many thanks
> With kind regards
>
>
>
> --
> Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/
>


Update Problem 1.9.2 to 1.10.0 (Lost provenance)

2019-12-23 Thread alec_osborne
Hi,
we wanted to migrate our Nifi version from 1.9.2 to 1.10.0. We did not
succeed. It was not possible for us after the update to access the old
provenance events. We have not changed anything in our configuration. I read
that after the update the index is rebuilt. Can that be a reason or do I
have to consider something special? After I changed back to version 1.9.2,
my old provenance events were immediately available again.

Do you have any tips on what I can check?

Many thanks
With kind regards



--
Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/