Re: MODERATE for annou...@apache.org
Hi Bryan, Thanks for taking care of this. I've approved the announcement. Regards, Craig > On May 23, 2019, at 2:07 PM, Bryan Bende wrote: > > Hi Craig, > > I updated the KEYS link, do I need to re-send the announcement? > > -Bryan > > On Thu, May 23, 2019 at 3:01 PM Private List Moderation > wrote: >> >> Hi, >> >> This announcement is ok except for the download page >> https://nifi.apache.org/registry.html >> >> The KEYS link should be https://apache.org//dist/nifi/KEYS >> >> If you can correct this, please let us know and we can approve the release >> announcement. >> >> Regards, >> >> Craig >> >>> Begin forwarded message: >>> >>> From: announce-reject-1558618900.41479.goiokbocdnegaihbb...@apache.org >>> Subject: MODERATE for annou...@apache.org >>> Date: May 23, 2019 at 6:41:40 AM PDT >>> To: Recipient list not shown: ; >>> Cc: >>> announce-allow-tc.1558618900.dcploigljccibckoedom-bbende=apache@apache.org >>> Reply-To: announce-accept-1558618900.41479.goiokbocdnegaihbb...@apache.org >>> >>> >>> To approve: >>> announce-accept-1558618900.41479.goiokbocdnegaihbb...@apache.org >>> To reject: >>> announce-reject-1558618900.41479.goiokbocdnegaihbb...@apache.org >>> To give a reason to reject: >>> %%% Start comment >>> %%% End comment >>> >>> >>> From: Bryan Bende >>> Subject: [ANNOUNCE] Apache NiFi Registry 0.4.0 Release >>> Date: May 23, 2019 at 6:41:28 AM PDT >>> To: annou...@apache.org >>> Reply-To: dev@nifi.apache.org >>> >>> >>> Hello >>> >>> The Apache NiFi team would like to announce the release of Apache NiFi >>> Registry 0.4.0. >>> >>> Apache NiFi is an easy to use, powerful, and reliable system to >>> process and distribute data. Apache NiFi was made for dataflow. It >>> supports highly configurable directed graphsof data routing, >>> transformation, and system mediation logic. >>> >>> Registry, a subproject of Apache NiFi, is a complementary application >>> that provides a central location for storage and management of shared >>> resources across one or more instances of NiFi or MiNiFi. >>> >>> More details on Apache NiFi Registry, along with release artifacts, >>> can be found here: >>> https://nifi.apache.org/registry.html >>> >>> Maven artifacts have been made available and mirrored as per normal >>> ASF artifact processes. >>> >>> Issues closed/resolved for this list can be found here: >>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320920&version=12344183 >>> >>> Release note highlights can be found here: >>> https://cwiki.apache.org/confluence/display/NIFIREG/Release+Notes#ReleaseNotes-NiFiRegistry0.4.0 >>> >>> Thank you >>> The Apache NiFi team >>> >>> >>> >> >> Craig L Russell >> c...@apache.org >> Craig L Russell c...@apache.org
Re: Adding schema inference
I think tabling that feature for this processor is probably the right way to go for now. It really should be part of a larger upgrade to the Record API because just jamming in new fields without warning here could be very unwelcomed by some users such as my current project team (we have very hard controls on schemas compared to most of my other engagements). (FWIW, we're actually using this processor on real data) Thanks, Mike On Thu, May 23, 2019 at 6:25 PM Matt Burgess wrote: > I think it'd be great to create one-field records for each level that > doesn't exist, for things like LookupRecord and/or UpdateRecord (from > the aforementioned Jira) I had envisioned the same thing. It would > make it easier for other such processors to enrich/enlarge a > newly-existing record level, basically an Upsert pattern (or mkdir -p > :) > > Regards, > Matt > > On Tue, May 21, 2019 at 2:32 PM Mike Thomsen > wrote: > > > > All things considered, it doesn't seem like that much work. My main > concern > > is how to handle it if a user does something like nest the data deep into > > multiple schema levels that don't exist. How should that be handled? An > > exception or generating empty record declarations that have one field? > > > > On Tue, May 21, 2019 at 2:07 PM Matt Burgess > wrote: > > > > > Mike, > > > > > > Check AbstractRouteRecord, it uses the read-first-get-schema-read-rest > > > pattern. However for that snippet, it is the RecordReader that is > > > possibly updating the schema (currently the only thing that does this > > > is schema inference), then the RecordSetWriter is created using the > > > (possibly updated) schema. For your PR, you might need to update the > > > schema manually and then pass that into the > > > RecordSetWriterFactory.getSchema() call. > > > > > > Now that I think of it, you might be the first to do this > > > automatic-schema-update-on-write thing (if you choose to do so). I > > > thought NIFI-5524 [1] had been implemented but apparently not. > > > > > > Regards, > > > Matt > > > > > > [1] https://issues.apache.org/jira/browse/NIFI-5524 > > > > > > > > > On Tue, May 21, 2019 at 10:08 AM Mike Thomsen > > > wrote: > > > > > > > > Matt left this suggestion: > > > > > > > > https://github.com/apache/nifi/pull/3231#discussion_r285693972 > > > > > > > > What would be a good example of that pattern if I wanted to update > that > > > PR > > > > and document the process for others? > > > > > > > > Thanks, > > > > > > > > Mike > > > >
Re: Adding schema inference
I think it'd be great to create one-field records for each level that doesn't exist, for things like LookupRecord and/or UpdateRecord (from the aforementioned Jira) I had envisioned the same thing. It would make it easier for other such processors to enrich/enlarge a newly-existing record level, basically an Upsert pattern (or mkdir -p :) Regards, Matt On Tue, May 21, 2019 at 2:32 PM Mike Thomsen wrote: > > All things considered, it doesn't seem like that much work. My main concern > is how to handle it if a user does something like nest the data deep into > multiple schema levels that don't exist. How should that be handled? An > exception or generating empty record declarations that have one field? > > On Tue, May 21, 2019 at 2:07 PM Matt Burgess wrote: > > > Mike, > > > > Check AbstractRouteRecord, it uses the read-first-get-schema-read-rest > > pattern. However for that snippet, it is the RecordReader that is > > possibly updating the schema (currently the only thing that does this > > is schema inference), then the RecordSetWriter is created using the > > (possibly updated) schema. For your PR, you might need to update the > > schema manually and then pass that into the > > RecordSetWriterFactory.getSchema() call. > > > > Now that I think of it, you might be the first to do this > > automatic-schema-update-on-write thing (if you choose to do so). I > > thought NIFI-5524 [1] had been implemented but apparently not. > > > > Regards, > > Matt > > > > [1] https://issues.apache.org/jira/browse/NIFI-5524 > > > > > > On Tue, May 21, 2019 at 10:08 AM Mike Thomsen > > wrote: > > > > > > Matt left this suggestion: > > > > > > https://github.com/apache/nifi/pull/3231#discussion_r285693972 > > > > > > What would be a good example of that pattern if I wanted to update that > > PR > > > and document the process for others? > > > > > > Thanks, > > > > > > Mike > >
Re: MODERATE for annou...@apache.org
Hi Craig, I updated the KEYS link, do I need to re-send the announcement? -Bryan On Thu, May 23, 2019 at 3:01 PM Private List Moderation wrote: > > Hi, > > This announcement is ok except for the download page > https://nifi.apache.org/registry.html > > The KEYS link should be https://apache.org//dist/nifi/KEYS > > If you can correct this, please let us know and we can approve the release > announcement. > > Regards, > > Craig > > > Begin forwarded message: > > > > From: announce-reject-1558618900.41479.goiokbocdnegaihbb...@apache.org > > Subject: MODERATE for annou...@apache.org > > Date: May 23, 2019 at 6:41:40 AM PDT > > To: Recipient list not shown: ; > > Cc: > > announce-allow-tc.1558618900.dcploigljccibckoedom-bbende=apache@apache.org > > Reply-To: announce-accept-1558618900.41479.goiokbocdnegaihbb...@apache.org > > > > > > To approve: > > announce-accept-1558618900.41479.goiokbocdnegaihbb...@apache.org > > To reject: > > announce-reject-1558618900.41479.goiokbocdnegaihbb...@apache.org > > To give a reason to reject: > > %%% Start comment > > %%% End comment > > > > > > From: Bryan Bende > > Subject: [ANNOUNCE] Apache NiFi Registry 0.4.0 Release > > Date: May 23, 2019 at 6:41:28 AM PDT > > To: annou...@apache.org > > Reply-To: dev@nifi.apache.org > > > > > > Hello > > > > The Apache NiFi team would like to announce the release of Apache NiFi > > Registry 0.4.0. > > > > Apache NiFi is an easy to use, powerful, and reliable system to > > process and distribute data. Apache NiFi was made for dataflow. It > > supports highly configurable directed graphsof data routing, > > transformation, and system mediation logic. > > > > Registry, a subproject of Apache NiFi, is a complementary application > > that provides a central location for storage and management of shared > > resources across one or more instances of NiFi or MiNiFi. > > > > More details on Apache NiFi Registry, along with release artifacts, > > can be found here: > > https://nifi.apache.org/registry.html > > > > Maven artifacts have been made available and mirrored as per normal > > ASF artifact processes. > > > > Issues closed/resolved for this list can be found here: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320920&version=12344183 > > > > Release note highlights can be found here: > > https://cwiki.apache.org/confluence/display/NIFIREG/Release+Notes#ReleaseNotes-NiFiRegistry0.4.0 > > > > Thank you > > The Apache NiFi team > > > > > > > > Craig L Russell > c...@apache.org >
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congrats Arpad! > On May 23, 2019, at 9:23 AM, Aldrin Piri wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Arpad > has accepted the PMC's invitation to become a committer on the Apache > NiFi project. > We greatly appreciate all of Arpad's hard work and generous contributions > to the project. We look forward to his continued involvement in the project. > > Arpad has been highly involved in the MiNiFi C++ codebase providing > contributions covering everything from code cleanup, tests, and new > features. Arpad has been an active reviewer, contributor to JIRAs and > aided in verification of releases across the NiFi project. Thank you for > all your efforts! > > Welcome and congratulations! > > --aldrin
Fwd: MODERATE for annou...@apache.org
Hi, This announcement is ok except for the download page https://nifi.apache.org/registry.html The KEYS link should be https://apache.org//dist/nifi/KEYS If you can correct this, please let us know and we can approve the release announcement. Regards, Craig > Begin forwarded message: > > From: announce-reject-1558618900.41479.goiokbocdnegaihbb...@apache.org > Subject: MODERATE for annou...@apache.org > Date: May 23, 2019 at 6:41:40 AM PDT > To: Recipient list not shown: ; > Cc: > announce-allow-tc.1558618900.dcploigljccibckoedom-bbende=apache@apache.org > Reply-To: announce-accept-1558618900.41479.goiokbocdnegaihbb...@apache.org > > > To approve: > announce-accept-1558618900.41479.goiokbocdnegaihbb...@apache.org > To reject: > announce-reject-1558618900.41479.goiokbocdnegaihbb...@apache.org > To give a reason to reject: > %%% Start comment > %%% End comment > > > From: Bryan Bende > Subject: [ANNOUNCE] Apache NiFi Registry 0.4.0 Release > Date: May 23, 2019 at 6:41:28 AM PDT > To: annou...@apache.org > Reply-To: dev@nifi.apache.org > > > Hello > > The Apache NiFi team would like to announce the release of Apache NiFi > Registry 0.4.0. > > Apache NiFi is an easy to use, powerful, and reliable system to > process and distribute data. Apache NiFi was made for dataflow. It > supports highly configurable directed graphsof data routing, > transformation, and system mediation logic. > > Registry, a subproject of Apache NiFi, is a complementary application > that provides a central location for storage and management of shared > resources across one or more instances of NiFi or MiNiFi. > > More details on Apache NiFi Registry, along with release artifacts, > can be found here: > https://nifi.apache.org/registry.html > > Maven artifacts have been made available and mirrored as per normal > ASF artifact processes. > > Issues closed/resolved for this list can be found here: > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320920&version=12344183 > > Release note highlights can be found here: > https://cwiki.apache.org/confluence/display/NIFIREG/Release+Notes#ReleaseNotes-NiFiRegistry0.4.0 > > Thank you > The Apache NiFi team > > > Craig L Russell c...@apache.org
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congratulations! On Thu, May 23, 2019 at 9:23 AM Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Arpad > has accepted the PMC's invitation to become a committer on the Apache > NiFi project. > We greatly appreciate all of Arpad's hard work and generous contributions > to the project. We look forward to his continued involvement in the > project. > > Arpad has been highly involved in the MiNiFi C++ codebase providing > contributions covering everything from code cleanup, tests, and new > features. Arpad has been an active reviewer, contributor to JIRAs and > aided in verification of releases across the NiFi project. Thank you for > all your efforts! > > Welcome and congratulations! > > --aldrin >
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congrats Arpad! On Thu, May 23, 2019 at 3:23 PM Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Arpad > has accepted the PMC's invitation to become a committer on the Apache > NiFi project. > We greatly appreciate all of Arpad's hard work and generous contributions > to the project. We look forward to his continued involvement in the > project. > > Arpad has been highly involved in the MiNiFi C++ codebase providing > contributions covering everything from code cleanup, tests, and new > features. Arpad has been an active reviewer, contributor to JIRAs and > aided in verification of releases across the NiFi project. Thank you for > all your efforts! > > Welcome and congratulations! > > --aldrin >
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congratulations Arpad, looking forward to your continued contribution. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 23, 2019, at 8:12 AM, Pierre Villard > wrote: > > Congrats Arpad! > > Le jeu. 23 mai 2019 à 16:19, Joe Witt a écrit : > >> Thanks for all the efforts Arpad across both nifi and minifi! >> >> Thanks >> Joe >> >> On Thu, May 23, 2019 at 10:14 AM Mike Thomsen >> wrote: >> >>> Congratulations! >>> >>> On Thu, May 23, 2019 at 9:37 AM Otto Fowler >>> wrote: >>> Congratulations! On May 23, 2019 at 09:23:46, Aldrin Piri (ald...@apache.org) wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that >>> Arpad has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Arpad's hard work and generous >> contributions to the project. We look forward to his continued involvement in the project. Arpad has been highly involved in the MiNiFi C++ codebase providing contributions covering everything from code cleanup, tests, and new features. Arpad has been an active reviewer, contributor to JIRAs and aided in verification of releases across the NiFi project. Thank you >> for all your efforts! Welcome and congratulations! --aldrin >>> >>
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congrats Arpad! Le jeu. 23 mai 2019 à 16:19, Joe Witt a écrit : > Thanks for all the efforts Arpad across both nifi and minifi! > > Thanks > Joe > > On Thu, May 23, 2019 at 10:14 AM Mike Thomsen > wrote: > > > Congratulations! > > > > On Thu, May 23, 2019 at 9:37 AM Otto Fowler > > wrote: > > > > > Congratulations! > > > > > > > > > On May 23, 2019 at 09:23:46, Aldrin Piri (ald...@apache.org) wrote: > > > > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > > Arpad > > > has accepted the PMC's invitation to become a committer on the Apache > > > NiFi project. > > > We greatly appreciate all of Arpad's hard work and generous > contributions > > > to the project. We look forward to his continued involvement in the > > > project. > > > > > > Arpad has been highly involved in the MiNiFi C++ codebase providing > > > contributions covering everything from code cleanup, tests, and new > > > features. Arpad has been an active reviewer, contributor to JIRAs and > > > aided in verification of releases across the NiFi project. Thank you > for > > > all your efforts! > > > > > > Welcome and congratulations! > > > > > > --aldrin > > > > > >
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Thanks for all the efforts Arpad across both nifi and minifi! Thanks Joe On Thu, May 23, 2019 at 10:14 AM Mike Thomsen wrote: > Congratulations! > > On Thu, May 23, 2019 at 9:37 AM Otto Fowler > wrote: > > > Congratulations! > > > > > > On May 23, 2019 at 09:23:46, Aldrin Piri (ald...@apache.org) wrote: > > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Arpad > > has accepted the PMC's invitation to become a committer on the Apache > > NiFi project. > > We greatly appreciate all of Arpad's hard work and generous contributions > > to the project. We look forward to his continued involvement in the > > project. > > > > Arpad has been highly involved in the MiNiFi C++ codebase providing > > contributions covering everything from code cleanup, tests, and new > > features. Arpad has been an active reviewer, contributor to JIRAs and > > aided in verification of releases across the NiFi project. Thank you for > > all your efforts! > > > > Welcome and congratulations! > > > > --aldrin > > >
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congratulations! On Thu, May 23, 2019 at 9:37 AM Otto Fowler wrote: > Congratulations! > > > On May 23, 2019 at 09:23:46, Aldrin Piri (ald...@apache.org) wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Arpad > has accepted the PMC's invitation to become a committer on the Apache > NiFi project. > We greatly appreciate all of Arpad's hard work and generous contributions > to the project. We look forward to his continued involvement in the > project. > > Arpad has been highly involved in the MiNiFi C++ codebase providing > contributions covering everything from code cleanup, tests, and new > features. Arpad has been an active reviewer, contributor to JIRAs and > aided in verification of releases across the NiFi project. Thank you for > all your efforts! > > Welcome and congratulations! > > --aldrin >
Re: [ANNOUNCE] New Apache NiFi Committer Arpad Boda
Congratulations! On May 23, 2019 at 09:23:46, Aldrin Piri (ald...@apache.org) wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that Arpad has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Arpad's hard work and generous contributions to the project. We look forward to his continued involvement in the project. Arpad has been highly involved in the MiNiFi C++ codebase providing contributions covering everything from code cleanup, tests, and new features. Arpad has been an active reviewer, contributor to JIRAs and aided in verification of releases across the NiFi project. Thank you for all your efforts! Welcome and congratulations! --aldrin
[ANNOUNCE] New Apache NiFi Committer Arpad Boda
On behalf of the Apache NiFI PMC, I am very pleased to announce that Arpad has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Arpad's hard work and generous contributions to the project. We look forward to his continued involvement in the project. Arpad has been highly involved in the MiNiFi C++ codebase providing contributions covering everything from code cleanup, tests, and new features. Arpad has been an active reviewer, contributor to JIRAs and aided in verification of releases across the NiFi project. Thank you for all your efforts! Welcome and congratulations! --aldrin
