Re: Upgrading NiFi Registry
t; deleted from NiFi Registry by accident, for instance. > > > > If your team/users are using NiFi Registry and have feedback, > positive or > > otherwise, let us know as it would be great to factor that in to the > > existing backlog for what to target in future releases. > > > > Best, > > Kevin > > > > If your team runs into any trouble with this, do let us know as I'm > not > > sure the deployment footprint > > > > On 6/28/18, 13:31, "Mike Thomsen" wrote: > > > > Kevin, > > > > The problem with our situation is that it's all inside Docker so > I > > don't > > think I can just stop the registry and proceed. That's why I was > > asking if > > it sounded feasible to just say "hands off for 5 minutes while > we copy > > the > > data." > > > > Also, what is the maturity level of the GitFlow option at this > point? > > That > > was particularly attractive as a storage solution because it > should > > make it > > much easier to export everything from our dev team to our end > users. > > > > Thanks, > > > > Mike > > > > On Thu, Jun 28, 2018 at 1:28 PM Kevin Doran > wrote: > > > > > Mike, > > > > > > I don't know the extent of H2's capabilities, but for NiFi > Registry > > > changing the location of those files will require restarting > the > > server to > > > pick up the new database location from > nifi-registry.properties, > > correct? > > > So if I follow correctly what the objective is, my > recommendation > > would be > > > the following steps: > > > > > > 1. Stop NiFi Registry > > > 2. Move/copy the H2 database files to the Docker volume > location > > (should > > > be safe to do when Registry is stopped) > > > 3. Change nifi-registry.properties to point the database config > > props to > > > the new location > > > 4. Start NiFi Registry > > > > > > If the goal is actually just to copy a snapshot of the H2 > database > > to the > > > docker volume and not re-point NiFi Registry, which you want > to keep > > > running, I suppose you could do that. It should be fine to > copy it if > > > nothing is being written, but of course no guarantees and > YMMV, so > > at the > > > least I'd try to verify that it is a validate db file after > copying > > it, > > > using something like [1]. > > > > > > [1] > > > > > > https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption > > > > > > Hope this helps, > > > Kevin > > > > > > On 6/28/18, 12:34, "Mike Thomsen" > wrote: > > > > > > Kevin/Bryan, > > > > > > We have a bunch of users that are using Docker and might > not > > have set > > > things up to point to a docker volume for the H2 database > > location. Do > > > either of you know if H2 will allow you to copy the files > over > > to the > > > Docker volume while everything's running? > > > > > > Thanks, > > > > > > Mike > > > > > > On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende < > bbe...@gmail.com> > > wrote: > > > > > > > Ah good point Mark... yes the old db properties are only > need > > this > > > > first time so that it can auto-migrate the old DB to the > new > > one, >
Re: Upgrading NiFi Registry
yment footprint > > > > On 6/28/18, 13:31, "Mike Thomsen" wrote: > > > > Kevin, > > > > The problem with our situation is that it's all inside Docker so > I > > don't > > think I can just stop the registry and proceed. That's why I was > > asking if > > it sounded feasible to just say "hands off for 5 minutes while > we copy > > the > > data." > > > > Also, what is the maturity level of the GitFlow option at this > point? > > That > > was particularly attractive as a storage solution because it > should > > make it > > much easier to export everything from our dev team to our end > users. > > > > Thanks, > > > > Mike > > > > On Thu, Jun 28, 2018 at 1:28 PM Kevin Doran > wrote: > > > > > Mike, > > > > > > I don't know the extent of H2's capabilities, but for NiFi > Registry > > > changing the location of those files will require restarting > the > > server to > > > pick up the new database location from > nifi-registry.properties, > > correct? > > > So if I follow correctly what the objective is, my > recommendation > > would be > > > the following steps: > > > > > > 1. Stop NiFi Registry > > > 2. Move/copy the H2 database files to the Docker volume > location > > (should > > > be safe to do when Registry is stopped) > > > 3. Change nifi-registry.properties to point the database config > > props to > > > the new location > > > 4. Start NiFi Registry > > > > > > If the goal is actually just to copy a snapshot of the H2 > database > > to the > > > docker volume and not re-point NiFi Registry, which you want > to keep > > > running, I suppose you could do that. It should be fine to > copy it if > > > nothing is being written, but of course no guarantees and > YMMV, so > > at the > > > least I'd try to verify that it is a validate db file after > copying > > it, > > > using something like [1]. > > > > > > [1] > > > > > > https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption > > > > > > Hope this helps, > > > Kevin > > > > > > On 6/28/18, 12:34, "Mike Thomsen" > wrote: > > > > > > Kevin/Bryan, > > > > > > We have a bunch of users that are using Docker and might > not > > have set > > > things up to point to a docker volume for the H2 database > > location. Do > > > either of you know if H2 will allow you to copy the files > over > > to the > > > Docker volume while everything's running? > > > > > > Thanks, > > > > > > Mike > > > > > > On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende < > bbe...@gmail.com> > > wrote: > > > > > > > Ah good point Mark... yes the old db properties are only > need > > this > > > > first time so that it can auto-migrate the old DB to the > new > > one, > > > > after that you don't need the old properties anymore. > > > > > > > > Thanks Kevin! > > > > > > > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran < > > kdo...@apache.org> > > > wrote: > > > > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 > -> 0.2 > > > migration > > > > guide to include these steps as part of updating the > site with > > news > > > of the > > > > new release. > > > > > > > > > > Thanks, > > > > > Kevin > > > > > > > > > > > > > > > From: Mark Bean >
Re: Upgrading NiFi Registry
> server to > > pick up the new database location from nifi-registry.properties, > correct? > > So if I follow correctly what the objective is, my recommendation > would be > > the following steps: > > > > 1. Stop NiFi Registry > > 2. Move/copy the H2 database files to the Docker volume location > (should > > be safe to do when Registry is stopped) > > 3. Change nifi-registry.properties to point the database config > props to > > the new location > > 4. Start NiFi Registry > > > > If the goal is actually just to copy a snapshot of the H2 database > to the > > docker volume and not re-point NiFi Registry, which you want to keep > > running, I suppose you could do that. It should be fine to copy it if > > nothing is being written, but of course no guarantees and YMMV, so > at the > > least I'd try to verify that it is a validate db file after copying > it, > > using something like [1]. > > > > [1] > > > https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption > > > > Hope this helps, > > Kevin > > > > On 6/28/18, 12:34, "Mike Thomsen" wrote: > > > > Kevin/Bryan, > > > > We have a bunch of users that are using Docker and might not > have set > > things up to point to a docker volume for the H2 database > location. Do > > either of you know if H2 will allow you to copy the files over > to the > > Docker volume while everything's running? > > > > Thanks, > > > > Mike > > > > On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende > wrote: > > > > > Ah good point Mark... yes the old db properties are only need > this > > > first time so that it can auto-migrate the old DB to the new > one, > > > after that you don't need the old properties anymore. > > > > > > Thanks Kevin! > > > > > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran < > kdo...@apache.org> > > wrote: > > > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 > > migration > > > guide to include these steps as part of updating the site with > news > > of the > > > new release. > > > > > > > > Thanks, > > > > Kevin > > > > > > > > > > > > From: Mark Bean > > > > Sent: Wednesday, June 20, 2018 8:53:39 AM > > > > To: dev@nifi.apache.org > > > > Subject: Re: Upgrading NiFi Registry > > > > > > > > Thanks Bryan. There is actually another step not explicitly > > mentioned. At > > > > least for 0.1.0 -> 0.2.0, I needed to modify the > > nifi-registry.properties > > > > file as well. The 0.2.0 version has new properties/values > not in > > the > > > 0.1.0. > > > > And, I had to set the following for the database (using > values from > > > 0.1.0). > > > > This was only required on the first startup; these > properties can > > be > > > empty > > > > values on subsequent startups. > > > > nifi.registry.db.directory= > > > > nifi.registry.db.url.append= > > > > > > > > In the future, if using a database location that is external > to the > > > > installation directory, is nifi.registry.db.url the only > property > > that > > > > needs to be modified? > > > > > > > > > > > > On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende < > bbe...@gmail.com> > > wrote: > > > > > > > >> Mark, > > > >>
Re: Upgrading NiFi Registry
no guarantees and YMMV, so > at the > > least I'd try to verify that it is a validate db file after copying > it, > > using something like [1]. > > > > [1] > > > https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption > > > > Hope this helps, > > Kevin > > > > On 6/28/18, 12:34, "Mike Thomsen" wrote: > > > > Kevin/Bryan, > > > > We have a bunch of users that are using Docker and might not > have set > > things up to point to a docker volume for the H2 database > location. Do > > either of you know if H2 will allow you to copy the files over > to the > > Docker volume while everything's running? > > > > Thanks, > > > > Mike > > > > On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende > wrote: > > > > > Ah good point Mark... yes the old db properties are only need > this > > > first time so that it can auto-migrate the old DB to the new > one, > > > after that you don't need the old properties anymore. > > > > > > Thanks Kevin! > > > > > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran < > kdo...@apache.org> > > wrote: > > > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 > > migration > > > guide to include these steps as part of updating the site with > news > > of the > > > new release. > > > > > > > > Thanks, > > > > Kevin > > > > > > > > > > > > From: Mark Bean > > > > Sent: Wednesday, June 20, 2018 8:53:39 AM > > > > To: dev@nifi.apache.org > > > > Subject: Re: Upgrading NiFi Registry > > > > > > > > Thanks Bryan. There is actually another step not explicitly > > mentioned. At > > > > least for 0.1.0 -> 0.2.0, I needed to modify the > > nifi-registry.properties > > > > file as well. The 0.2.0 version has new properties/values > not in > > the > > > 0.1.0. > > > > And, I had to set the following for the database (using > values from > > > 0.1.0). > > > > This was only required on the first startup; these > properties can > > be > > > empty > > > > values on subsequent startups. > > > > nifi.registry.db.directory= > > > > nifi.registry.db.url.append= > > > > > > > > In the future, if using a database location that is external > to the > > > > installation directory, is nifi.registry.db.url the only > property > > that > > > > needs to be modified? > > > > > > > > > > > > On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende < > bbe...@gmail.com> > > wrote: > > > > > > > >> Mark, > > > >> > > > >> The database directory and flow storage directory are where > all > > the > > > >> data are. By default these are created in the root of NiFi > > Registry, > > > >> so depending how you want to set it up you could move those > > > >> directories to the new install, or you could set them up to > be > > > >> external locations so you don't have to move them every > time, or > > you > > > >> could upgrade the lib directory of your current install and > leave > > > >> everything in place. > > > >> > > > >> The policies are the same as NiFi... stored in users.xml and > > > >> authorizations.xml the conf directory, depending how you > > configured > > > >> everything. So just copying those two files over to the new > > install. > > > >> > > > >> -Bryan > > > >> > > > >> > > > >> On Wed, Jun 20, 2018 at 11:13 AM, Mark Bean < > > mark.o.b...@gmail.com> > > > wrote: > > > >> > How does one upgrade the NiFi Registry? > > > >> > > > > >> > After unpacking the .tar.gz file, how does one get all > the flows > > > >> registered > > > >> > in a previous version of NiFi Registry into the newly > installed > > > version? > > > >> > And, how does one ensure all the policies transfer as > well? > > > >> > > > > >> > Thanks, > > > >> > Mark > > > >> > > > > > > > > > > > > > > >
Re: Upgrading NiFi Registry
Oh right. My mistake. Not sure if there is a way to stop the nifi registry process without stopping the container. Other's more knowledgeable of Docker might know... In that case I'd say it's worth a shot as that DB file should be valid so long as nothing is being written to it. The adoption of the git persistence provider stuff is probably still small given how new it is, but anecdotally, I've been using it for about a week now, syncing to a github repo as a remote, and I've not run into any issues with it nor have I heard of anyone else having a problem with it. It seems pretty solid to me. One of the nice things about the git option is that the format saved to git in the snapshots is compatible with a tool like NiFi CLI, so (while some custom scripting still required), you should be in a pretty good position to do disaster recovery to recreate a NiFi Registry instance with your bucket/flow/flow-snapshot data just from the contents of your git repository should you need to for whatever reason (again, would need to script the right NiFi CLI commands to crawl the git directory tree, but it's pretty straightforward as it's just a matter of parsing json and yml files). One really nice feature is that deletes (a flow or bucket for instance) happen as a new commit so you can even recover objects that were deleted from NiFi Registry by accident, for instance. If your team/users are using NiFi Registry and have feedback, positive or otherwise, let us know as it would be great to factor that in to the existing backlog for what to target in future releases. Best, Kevin If your team runs into any trouble with this, do let us know as I'm not sure the deployment footprint On 6/28/18, 13:31, "Mike Thomsen" wrote: Kevin, The problem with our situation is that it's all inside Docker so I don't think I can just stop the registry and proceed. That's why I was asking if it sounded feasible to just say "hands off for 5 minutes while we copy the data." Also, what is the maturity level of the GitFlow option at this point? That was particularly attractive as a storage solution because it should make it much easier to export everything from our dev team to our end users. Thanks, Mike On Thu, Jun 28, 2018 at 1:28 PM Kevin Doran wrote: > Mike, > > I don't know the extent of H2's capabilities, but for NiFi Registry > changing the location of those files will require restarting the server to > pick up the new database location from nifi-registry.properties, correct? > So if I follow correctly what the objective is, my recommendation would be > the following steps: > > 1. Stop NiFi Registry > 2. Move/copy the H2 database files to the Docker volume location (should > be safe to do when Registry is stopped) > 3. Change nifi-registry.properties to point the database config props to > the new location > 4. Start NiFi Registry > > If the goal is actually just to copy a snapshot of the H2 database to the > docker volume and not re-point NiFi Registry, which you want to keep > running, I suppose you could do that. It should be fine to copy it if > nothing is being written, but of course no guarantees and YMMV, so at the > least I'd try to verify that it is a validate db file after copying it, > using something like [1]. > > [1] > https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption > > Hope this helps, > Kevin > > On 6/28/18, 12:34, "Mike Thomsen" wrote: > > Kevin/Bryan, > > We have a bunch of users that are using Docker and might not have set > things up to point to a docker volume for the H2 database location. Do > either of you know if H2 will allow you to copy the files over to the > Docker volume while everything's running? > > Thanks, > > Mike > > On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende wrote: > > > Ah good point Mark... yes the old db properties are only need this > > first time so that it can auto-migrate the old DB to the new one, > > after that you don't need the old properties anymore. > > > > Thanks Kevin! > > > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran > wrote: > > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 > migration > > guide to include these steps as part of updating the site with news > of the > > new release. > > > > > > Thanks, > > > Kevin > >
Re: Upgrading NiFi Registry
Kevin, The problem with our situation is that it's all inside Docker so I don't think I can just stop the registry and proceed. That's why I was asking if it sounded feasible to just say "hands off for 5 minutes while we copy the data." Also, what is the maturity level of the GitFlow option at this point? That was particularly attractive as a storage solution because it should make it much easier to export everything from our dev team to our end users. Thanks, Mike On Thu, Jun 28, 2018 at 1:28 PM Kevin Doran wrote: > Mike, > > I don't know the extent of H2's capabilities, but for NiFi Registry > changing the location of those files will require restarting the server to > pick up the new database location from nifi-registry.properties, correct? > So if I follow correctly what the objective is, my recommendation would be > the following steps: > > 1. Stop NiFi Registry > 2. Move/copy the H2 database files to the Docker volume location (should > be safe to do when Registry is stopped) > 3. Change nifi-registry.properties to point the database config props to > the new location > 4. Start NiFi Registry > > If the goal is actually just to copy a snapshot of the H2 database to the > docker volume and not re-point NiFi Registry, which you want to keep > running, I suppose you could do that. It should be fine to copy it if > nothing is being written, but of course no guarantees and YMMV, so at the > least I'd try to verify that it is a validate db file after copying it, > using something like [1]. > > [1] > https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption > > Hope this helps, > Kevin > > On 6/28/18, 12:34, "Mike Thomsen" wrote: > > Kevin/Bryan, > > We have a bunch of users that are using Docker and might not have set > things up to point to a docker volume for the H2 database location. Do > either of you know if H2 will allow you to copy the files over to the > Docker volume while everything's running? > > Thanks, > > Mike > > On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende wrote: > > > Ah good point Mark... yes the old db properties are only need this > > first time so that it can auto-migrate the old DB to the new one, > > after that you don't need the old properties anymore. > > > > Thanks Kevin! > > > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran > wrote: > > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 > migration > > guide to include these steps as part of updating the site with news > of the > > new release. > > > > > > Thanks, > > > Kevin > > > > > > > > > From: Mark Bean > > > Sent: Wednesday, June 20, 2018 8:53:39 AM > > > To: dev@nifi.apache.org > > > Subject: Re: Upgrading NiFi Registry > > > > > > Thanks Bryan. There is actually another step not explicitly > mentioned. At > > > least for 0.1.0 -> 0.2.0, I needed to modify the > nifi-registry.properties > > > file as well. The 0.2.0 version has new properties/values not in > the > > 0.1.0. > > > And, I had to set the following for the database (using values from > > 0.1.0). > > > This was only required on the first startup; these properties can > be > > empty > > > values on subsequent startups. > > > nifi.registry.db.directory= > > > nifi.registry.db.url.append= > > > > > > In the future, if using a database location that is external to the > > > installation directory, is nifi.registry.db.url the only property > that > > > needs to be modified? > > > > > > > > > On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende > wrote: > > > > > >> Mark, > > >> > > >> The database directory and flow storage directory are where all > the > > >> data are. By default these are created in the root of NiFi > Registry, > > >> so depending how you want to set it up you could move those > > >> directories to the new install, or you could set them up to be > > >> external locations so you don't have to move them every time, or > you > > >> could upgrade the lib directory of your current install and leave > > >> everything in place. > > >> > > >> The policies are the same as NiFi... stored in users.xml and >
Re: Upgrading NiFi Registry
Mike, I don't know the extent of H2's capabilities, but for NiFi Registry changing the location of those files will require restarting the server to pick up the new database location from nifi-registry.properties, correct? So if I follow correctly what the objective is, my recommendation would be the following steps: 1. Stop NiFi Registry 2. Move/copy the H2 database files to the Docker volume location (should be safe to do when Registry is stopped) 3. Change nifi-registry.properties to point the database config props to the new location 4. Start NiFi Registry If the goal is actually just to copy a snapshot of the H2 database to the docker volume and not re-point NiFi Registry, which you want to keep running, I suppose you could do that. It should be fine to copy it if nothing is being written, but of course no guarantees and YMMV, so at the least I'd try to verify that it is a validate db file after copying it, using something like [1]. [1] https://stackoverflow.com/questions/32727588/how-to-check-h2-database-health-and-corruption Hope this helps, Kevin On 6/28/18, 12:34, "Mike Thomsen" wrote: Kevin/Bryan, We have a bunch of users that are using Docker and might not have set things up to point to a docker volume for the H2 database location. Do either of you know if H2 will allow you to copy the files over to the Docker volume while everything's running? Thanks, Mike On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende wrote: > Ah good point Mark... yes the old db properties are only need this > first time so that it can auto-migrate the old DB to the new one, > after that you don't need the old properties anymore. > > Thanks Kevin! > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran wrote: > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 migration > guide to include these steps as part of updating the site with news of the > new release. > > > > Thanks, > > Kevin > > > > > > From: Mark Bean > > Sent: Wednesday, June 20, 2018 8:53:39 AM > > To: dev@nifi.apache.org > > Subject: Re: Upgrading NiFi Registry > > > > Thanks Bryan. There is actually another step not explicitly mentioned. At > > least for 0.1.0 -> 0.2.0, I needed to modify the nifi-registry.properties > > file as well. The 0.2.0 version has new properties/values not in the > 0.1.0. > > And, I had to set the following for the database (using values from > 0.1.0). > > This was only required on the first startup; these properties can be > empty > > values on subsequent startups. > > nifi.registry.db.directory= > > nifi.registry.db.url.append= > > > > In the future, if using a database location that is external to the > > installation directory, is nifi.registry.db.url the only property that > > needs to be modified? > > > > > > On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende wrote: > > > >> Mark, > >> > >> The database directory and flow storage directory are where all the > >> data are. By default these are created in the root of NiFi Registry, > >> so depending how you want to set it up you could move those > >> directories to the new install, or you could set them up to be > >> external locations so you don't have to move them every time, or you > >> could upgrade the lib directory of your current install and leave > >> everything in place. > >> > >> The policies are the same as NiFi... stored in users.xml and > >> authorizations.xml the conf directory, depending how you configured > >> everything. So just copying those two files over to the new install. > >> > >> -Bryan > >> > >> > >> On Wed, Jun 20, 2018 at 11:13 AM, Mark Bean > wrote: > >> > How does one upgrade the NiFi Registry? > >> > > >> > After unpacking the .tar.gz file, how does one get all the flows > >> registered > >> > in a previous version of NiFi Registry into the newly installed > version? > >> > And, how does one ensure all the policies transfer as well? > >> > > >> > Thanks, > >> > Mark > >> >
Re: Upgrading NiFi Registry
Kevin/Bryan, We have a bunch of users that are using Docker and might not have set things up to point to a docker volume for the H2 database location. Do either of you know if H2 will allow you to copy the files over to the Docker volume while everything's running? Thanks, Mike On Wed, Jun 20, 2018 at 11:58 AM Bryan Bende wrote: > Ah good point Mark... yes the old db properties are only need this > first time so that it can auto-migrate the old DB to the new one, > after that you don't need the old properties anymore. > > Thanks Kevin! > > On Wed, Jun 20, 2018 at 11:57 AM, Kevin Doran wrote: > > Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 migration > guide to include these steps as part of updating the site with news of the > new release. > > > > Thanks, > > Kevin > > > > > > From: Mark Bean > > Sent: Wednesday, June 20, 2018 8:53:39 AM > > To: dev@nifi.apache.org > > Subject: Re: Upgrading NiFi Registry > > > > Thanks Bryan. There is actually another step not explicitly mentioned. At > > least for 0.1.0 -> 0.2.0, I needed to modify the nifi-registry.properties > > file as well. The 0.2.0 version has new properties/values not in the > 0.1.0. > > And, I had to set the following for the database (using values from > 0.1.0). > > This was only required on the first startup; these properties can be > empty > > values on subsequent startups. > > nifi.registry.db.directory= > > nifi.registry.db.url.append= > > > > In the future, if using a database location that is external to the > > installation directory, is nifi.registry.db.url the only property that > > needs to be modified? > > > > > > On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende wrote: > > > >> Mark, > >> > >> The database directory and flow storage directory are where all the > >> data are. By default these are created in the root of NiFi Registry, > >> so depending how you want to set it up you could move those > >> directories to the new install, or you could set them up to be > >> external locations so you don't have to move them every time, or you > >> could upgrade the lib directory of your current install and leave > >> everything in place. > >> > >> The policies are the same as NiFi... stored in users.xml and > >> authorizations.xml the conf directory, depending how you configured > >> everything. So just copying those two files over to the new install. > >> > >> -Bryan > >> > >> > >> On Wed, Jun 20, 2018 at 11:13 AM, Mark Bean > wrote: > >> > How does one upgrade the NiFi Registry? > >> > > >> > After unpacking the .tar.gz file, how does one get all the flows > >> registered > >> > in a previous version of NiFi Registry into the newly installed > version? > >> > And, how does one ensure all the policies transfer as well? > >> > > >> > Thanks, > >> > Mark > >> >
Re: Upgrading NiFi Registry
Thanks Mark and Bryan. I will add a NiFi Registry 0.1 -> 0.2 migration guide to include these steps as part of updating the site with news of the new release. Thanks, Kevin From: Mark Bean Sent: Wednesday, June 20, 2018 8:53:39 AM To: dev@nifi.apache.org Subject: Re: Upgrading NiFi Registry Thanks Bryan. There is actually another step not explicitly mentioned. At least for 0.1.0 -> 0.2.0, I needed to modify the nifi-registry.properties file as well. The 0.2.0 version has new properties/values not in the 0.1.0. And, I had to set the following for the database (using values from 0.1.0). This was only required on the first startup; these properties can be empty values on subsequent startups. nifi.registry.db.directory= nifi.registry.db.url.append= In the future, if using a database location that is external to the installation directory, is nifi.registry.db.url the only property that needs to be modified? On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende wrote: > Mark, > > The database directory and flow storage directory are where all the > data are. By default these are created in the root of NiFi Registry, > so depending how you want to set it up you could move those > directories to the new install, or you could set them up to be > external locations so you don't have to move them every time, or you > could upgrade the lib directory of your current install and leave > everything in place. > > The policies are the same as NiFi... stored in users.xml and > authorizations.xml the conf directory, depending how you configured > everything. So just copying those two files over to the new install. > > -Bryan > > > On Wed, Jun 20, 2018 at 11:13 AM, Mark Bean wrote: > > How does one upgrade the NiFi Registry? > > > > After unpacking the .tar.gz file, how does one get all the flows > registered > > in a previous version of NiFi Registry into the newly installed version? > > And, how does one ensure all the policies transfer as well? > > > > Thanks, > > Mark >
Re: Upgrading NiFi Registry
Thanks Bryan. There is actually another step not explicitly mentioned. At least for 0.1.0 -> 0.2.0, I needed to modify the nifi-registry.properties file as well. The 0.2.0 version has new properties/values not in the 0.1.0. And, I had to set the following for the database (using values from 0.1.0). This was only required on the first startup; these properties can be empty values on subsequent startups. nifi.registry.db.directory= nifi.registry.db.url.append= In the future, if using a database location that is external to the installation directory, is nifi.registry.db.url the only property that needs to be modified? On Wed, Jun 20, 2018 at 11:18 AM Bryan Bende wrote: > Mark, > > The database directory and flow storage directory are where all the > data are. By default these are created in the root of NiFi Registry, > so depending how you want to set it up you could move those > directories to the new install, or you could set them up to be > external locations so you don't have to move them every time, or you > could upgrade the lib directory of your current install and leave > everything in place. > > The policies are the same as NiFi... stored in users.xml and > authorizations.xml the conf directory, depending how you configured > everything. So just copying those two files over to the new install. > > -Bryan > > > On Wed, Jun 20, 2018 at 11:13 AM, Mark Bean wrote: > > How does one upgrade the NiFi Registry? > > > > After unpacking the .tar.gz file, how does one get all the flows > registered > > in a previous version of NiFi Registry into the newly installed version? > > And, how does one ensure all the policies transfer as well? > > > > Thanks, > > Mark >