Re: Registry H2 to PostgreSQL migration

2018-06-23 Thread Jagrut Sharma
Thanks! My confluence username is jagrutsharma. -- Jagrut On Sat, Jun 23, 2018 at 4:29 PM, Bryan Bende wrote: > Sure, that would be good. I think you may need permissions to edit the wiki > page, but if you let us know your confluence account we can get you added. > I’m not at a computer right

Re: Registry H2 to PostgreSQL migration

2018-06-23 Thread Bryan Bende
Sure, that would be good. I think you may need permissions to edit the wiki page, but if you let us know your confluence account we can get you added. I’m not at a computer right now, but can take care of it tomorrow if no one else gets to it first. Thanks, Bryan On Sat, Jun 23, 2018 at 6:56 PM

Re: Registry H2 to PostgreSQL migration

2018-06-23 Thread Jagrut Sharma
Thanks Bryan. Your explanation makes sense. Would it be ok if I add a short section to this guide https://cwiki.apache.org/confluence/display/NIFIREG/Migration+Guidance with steps to switch 0.2.0 (H2) to 0.2.0 (PostgreSQL)? Thanks. -- Jagrut On Sat, Jun 23, 2018 at 2:52 PM, Bryan Bende wrote: >

Re: [VOTE] Release Apache NiFi 1.7.0

2018-06-23 Thread Andy LoPresto
Thanks everyone. I’m traveling right now and don’t have the template for the vote close email, but things look good. Will follow up shortly. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 23, 2018, at 10

Re: Registry H2 to PostgreSQL migration

2018-06-23 Thread Jagrut Sharma
Hi Kevin - I set the below in nifi-registry.properties file to make the switch. Kept the H2 properties commented for reference as they came out of the box. : : # legacy database properties, used to migrate data from original DB to new DB below # NOTE: Users upgrading from 0.1.0 should leave these

Re: Registry H2 to PostgreSQL migration

2018-06-23 Thread Bryan Bende
Hello, This is actually expected behavior... The migration is only setup to migrate the database from 0.1.0 which was named nifi-registry.mv.db. If you have an H2 DB named nifi-registry-primary.mv.db this is the name of the new H2 DB in 0.2.0, so it’s not looking for this because the idea was yo

Re: Registry H2 to PostgreSQL migration

2018-06-23 Thread Kevin Doran
Hi Jagrut, I think this is configurable. How did you configure you nifi-registry.properties file? Thanks, Kevin From: Jagrut Sharma Sent: Saturday, June 23, 2018 2:43:33 PM To: dev@nifi.apache.org Subject: Registry H2 to PostgreSQL migration Hi - I performed m

Registry H2 to PostgreSQL migration

2018-06-23 Thread Jagrut Sharma
Hi - I performed migration from H2 to PostgreSQL, and ran into a potential bug. After switching the database config, registry started up fine. But the tables were all empty. On digging a bit deeper, I found that the default H2 database file is named nifi-registry-primary.mv.db. The migration code

Re: How would we handle this?

2018-06-23 Thread Mike Thomsen
I am going to send them a pull request since it looks like the only contributors are Confluent employees. If they don't respond to that, I'll go that route. On Sat, Jun 23, 2018 at 2:16 PM Aldrin Piri wrote: > Mike, > > That sounds fair and should be straightforward. Just be sure to update the

Re: How would we handle this?

2018-06-23 Thread Aldrin Piri
Mike, That sounds fair and should be straightforward. Just be sure to update the LICENSE with the appropriate reference to the source as a derived work. On Sat, Jun 23, 2018 at 1:46 PM Mike Thomsen wrote: > Aldrin, > > Ticket 5084 calls for a GenerateRecord processor, and this avro generator >

Re: How would we handle this?

2018-06-23 Thread Mike Thomsen
Aldrin, Ticket 5084 calls for a GenerateRecord processor, and this avro generator does a really good job of handling that. As far as I can tell, the only GPL issue there it uses one annotation from findbugs. I am thinking I can resolve this by importing the one source file we need (the Generator.j

Re: How would we handle this?

2018-06-23 Thread Aldrin Piri
Hi Mike, Be careful of the findbugs annotations. While there are other projects that are indeed ALv2, it appears the canonical repo has this as LGPL [2]. Not sure if this is needed, but could be complicating in terms of the binary assemblies we would create. There is a cleanroom implementation [

Re: How would we handle this?

2018-06-23 Thread Mike Thomsen
Disregard... There are apparently multiple projects out there that have the same name and I found one that was GPL. The one this project uses **appears** to be ASL 2.0, so I think we're good. On Sat, Jun 23, 2018 at 1:04 PM Mike Thomsen wrote: > I found that Confluent has an Avro data generator

Re: [VOTE] Release Apache NiFi 1.7.0

2018-06-23 Thread Joe Witt
+1 (binding) We'll definitely want to fix that funky directory maven creates after building now but all the L&N, testing, sigs/hashes look good. Awesome progress in this release! Thanks On Fri, Jun 22, 2018 at 9:06 PM, James Wing wrote: > +1 (binding). Ran through the release helper, tested t

How would we handle this?

2018-06-23 Thread Mike Thomsen
I found that Confluent has an Avro data generator project. Their code is ASL 2.0 with the caveat that it has a GPL dependency and they reference a GPL'd class in it. Can I bring this ASL 2.0 code into our code base or do I have to treat it as GPL-tainted even if I remove the references to the one a

Re: NIFI Multiple Kerberos configuration

2018-06-23 Thread Jeff
I'll have to set up a test this week and see if I can reproduce this. If you'd like, you can file a JIRA [1] with sanitized details of your krb5.conf and an example flow. [1] https://issues.apache.org/jira/projects/NIFI/issues On Sat, Jun 23, 2018 at 3:48 AM Hiroaki Miyanaga wrote: > I tried a

Re: NIFI Multiple Kerberos configuration

2018-06-23 Thread Hiroaki Miyanaga
I tried a similar case last week and it could not access to both cluster at the same time. Try to connect kafka and hadoop managed by their own KDCs. I set both KDCs in realms section of krb5.conf. But NiFi looks using default realms in krb5.conf. I find a similar ticket. https://community.horton