Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats! Le 14 nov. 2017 04:16, "Jeff"a écrit : > Congrats, Andy! > > On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran > wrote: > > > Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! > > > > On 11/13/17, 19:39, "Tony Kurc" wrote: > > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > > Andy > > has accepted the PMC's invitation to become a committer on the Apache > > NiFi > > project. We greatly appreciate all of Andy's hard work and generous > > contributions to the project. We look forward to his continued > > involvement > > in the project. > > > > In addition to contributing significant code to MiNiFi CPP, Andy has > > been > > leading discussions and been the focal point for several major > > improvements. His engagement with the community has been top notch, > and > > we're excited he accepted the PMC's invitation. > > > > Andy, Welcome and congratulations! > > Tony > > > > > > > > >
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats, Andy! On Mon, Nov 13, 2017 at 9:44 PM Kevin Doranwrote: > Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! > > On 11/13/17, 19:39, "Tony Kurc" wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Andy > has accepted the PMC's invitation to become a committer on the Apache > NiFi > project. We greatly appreciate all of Andy's hard work and generous > contributions to the project. We look forward to his continued > involvement > in the project. > > In addition to contributing significant code to MiNiFi CPP, Andy has > been > leading discussions and been the focal point for several major > improvements. His engagement with the community has been top notch, and > we're excited he accepted the PMC's invitation. > > Andy, Welcome and congratulations! > Tony > > > >
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! On 11/13/17, 19:39, "Tony Kurc"wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Andy's hard work and generous contributions to the project. We look forward to his continued involvement in the project. In addition to contributing significant code to MiNiFi CPP, Andy has been leading discussions and been the focal point for several major improvements. His engagement with the community has been top notch, and we're excited he accepted the PMC's invitation. Andy, Welcome and congratulations! Tony
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats, Andy! On Mon, Nov 13, 2017 at 20:36 Joe Wittwrote: > andy. congrats. exciting stuff with minifi! > > On Nov 13, 2017 7:53 PM, "Matt Burgess" wrote: > > > Congrats and welcome aboard Andy! > > > > On Mon, Nov 13, 2017 at 7:39 PM, Tony Kurc wrote: > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Andy > > > has accepted the PMC's invitation to become a committer on the Apache > > NiFi > > > project. We greatly appreciate all of Andy's hard work and generous > > > contributions to the project. We look forward to his continued > > involvement > > > in the project. > > > > > > In addition to contributing significant code to MiNiFi CPP, Andy has > been > > > leading discussions and been the focal point for several major > > > improvements. His engagement with the community has been top notch, and > > > we're excited he accepted the PMC's invitation. > > > > > > Andy, Welcome and congratulations! > > > Tony > > >
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
andy. congrats. exciting stuff with minifi! On Nov 13, 2017 7:53 PM, "Matt Burgess"wrote: > Congrats and welcome aboard Andy! > > On Mon, Nov 13, 2017 at 7:39 PM, Tony Kurc wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy > > has accepted the PMC's invitation to become a committer on the Apache > NiFi > > project. We greatly appreciate all of Andy's hard work and generous > > contributions to the project. We look forward to his continued > involvement > > in the project. > > > > In addition to contributing significant code to MiNiFi CPP, Andy has been > > leading discussions and been the focal point for several major > > improvements. His engagement with the community has been top notch, and > > we're excited he accepted the PMC's invitation. > > > > Andy, Welcome and congratulations! > > Tony >
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats and welcome aboard Andy! On Mon, Nov 13, 2017 at 7:39 PM, Tony Kurcwrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy > has accepted the PMC's invitation to become a committer on the Apache NiFi > project. We greatly appreciate all of Andy's hard work and generous > contributions to the project. We look forward to his continued involvement > in the project. > > In addition to contributing significant code to MiNiFi CPP, Andy has been > leading discussions and been the focal point for several major > improvements. His engagement with the community has been top notch, and > we're excited he accepted the PMC's invitation. > > Andy, Welcome and congratulations! > Tony
[ANNOUNCE] New Apache NiFi Committer Andy Christianson
On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Andy's hard work and generous contributions to the project. We look forward to his continued involvement in the project. In addition to contributing significant code to MiNiFi CPP, Andy has been leading discussions and been the focal point for several major improvements. His engagement with the community has been top notch, and we're excited he accepted the PMC's invitation. Andy, Welcome and congratulations! Tony
Anyone else getting this error when building?
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project nifi-standard-processors: Error resolving project artifact: Could not transfer artifact com.martiansoftware:macnificent:pom:0.2.0 from/to central ( https://repo1.maven.org/maven2): Host name 'repo1.maven.org' does not match the certificate subject provided by the peer (CN=repo.maven.apache.org, O="Sonatype, Inc", L=Fulton, ST=MD, C=US) for project com.martiansoftware:macnificent:jar:0.2.0
Re: Custom properties file for environmental promotion
In general that approach should work, there were a few community efforts that did something like this in the past [1][2]. For the RPG, you may need to substitute another value as well, because I believe the template also contains the UUID of the ports it is connected to, which will be different depending on the target URI, but I don't remember exactly how this part works, maybe others can chime in. Thanks, Bryan [1] https://github.com/aperepel/nifi-api-deploy [2] https://github.com/hermannpencole/nifi-config On Mon, Nov 13, 2017 at 1:47 PM, wildowrote: > If you guys would please entertain one more question: > > Unfortunately the site is currently limited to Nifi 1.2, and this > effectively renders the custom properties file useless as it relates to the > PutHDFS kerberos principal/keytab. I was thinking about this as I exported > the template in order to put into source control. > > Is there any reason that I couldn't modify the xml template to replace these > values before uploading the template into the new environment? > > > Kerberos Principal > d...@mydomain.com > > > > Kerberos Keytab > /my/path/to/keytabs/dev.keytab > > > > Similarly, when it comes to the remote process group, is there any reason > that I can't just modify these uris before uploading the template to the new > environment? > > https://dev001.mydomain.com:1234/nifi > https://dev001.mydomain.com:1234/nifi,https://dev002.mydomain.com:1234/nifi > > > It would be quite simple to write a script that does a simple substitution > on these values. But is there any reason that that wouldn't work? I imagine > I'm hardly the first to think about editing the template xml itself... > > > > -- > Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: Custom properties file for environmental promotion
If you guys would please entertain one more question: Unfortunately the site is currently limited to Nifi 1.2, and this effectively renders the custom properties file useless as it relates to the PutHDFS kerberos principal/keytab. I was thinking about this as I exported the template in order to put into source control. Is there any reason that I couldn't modify the xml template to replace these values before uploading the template into the new environment? Kerberos Principal d...@mydomain.com Kerberos Keytab /my/path/to/keytabs/dev.keytab Similarly, when it comes to the remote process group, is there any reason that I can't just modify these uris before uploading the template to the new environment? https://dev001.mydomain.com:1234/nifi https://dev001.mydomain.com:1234/nifi,https://dev002.mydomain.com:1234/nifi It would be quite simple to write a script that does a simple substitution on these values. But is there any reason that that wouldn't work? I imagine I'm hardly the first to think about editing the template xml itself... -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: Nifi ExecuteScript slow performance
Vyshali, Another trick you can do that works very well if you have a lot of flowfiles to process is use session.get(int) to grab a batch. Obviously, keep the volume you grab tuned to reasonable memory limits and all that, but you can use that to make the script do a lot more work in one single run. I have a flow that ends up processing millions of JSON files, and grabbing 500 of them at once and merging them into a JSON array to create a record batch really helps. On Mon, Nov 13, 2017 at 12:23 PM, Vyshaliwrote: > Thank you so much Matt. > I will try the solutions provided and come back in case of questions. > > Thanks, > Vyshali > > > > -- > Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/ >
Re: Nifi ExecuteScript slow performance
Thank you so much Matt. I will try the solutions provided and come back in case of questions. Thanks, Vyshali -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: Custom properties file for environmental promotion
Thanks Matt! I was just coming back to update. I found the 1.4 docs that indicated that it was available there. We are currently using 1.2. I should have researched better... Thanks again! -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: Custom properties file for environmental promotion
It looks like the HDFS ones were added in NiFi 1.4.0 [1] [2], and the ListenTCP EL support for Port has an open Jira [3]. Regards, Matt [1] https://issues.apache.org/jira/browse/NIFI-2923 [2] https://issues.apache.org/jira/browse/NIFI-4010 [3] https://issues.apache.org/jira/browse/NIFI-4458 On Mon, Nov 13, 2017 at 11:08 AM, wildowrote: > Oh no! I just realized that the Kerberos Principle and Keytab fields in > PutHDFS do *not* support expression language. Oy. This is a nonstarter... > > Bryan- is there some way to submit an enhancement request for EL support on > these fields? Same goes for the port number on ListenTCP- no EL support. > Sorry- I'm not aware of the protocol for submitting such an enhancement. > > > > -- > Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: Custom properties file for environmental promotion
Oh no! I just realized that the Kerberos Principle and Keytab fields in PutHDFS do *not* support expression language. Oy. This is a nonstarter... Bryan- is there some way to submit an enhancement request for EL support on these fields? Same goes for the port number on ListenTCP- no EL support. Sorry- I'm not aware of the protocol for submitting such an enhancement. -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: Problems running Minifi with an SSL Context
Hi David, Sorry for your troubles, this is a bug I am addressing in MINIFI-408 [1]. I am finishing up some testing and refactoring but hope to have a PR up in the next couple hours. There are some additional details on the ticket. [1] https://issues.apache.org/jira/browse/MINIFI-408 On Mon, Nov 13, 2017 at 9:20 AM, DAVID SMITHwrote: > Hi > In my work dev environment I have a VM that is running NiFi v1.3, I am > using this to create a flow template for a Minifi (v0.2.0 Java ) instance > (initially on the same VM). > My flow has a listenHttp which I am listening on port 1 using an > sslContext which I have set up in NiFi, I zip the file and then use a > postHttp to post the file to another NiFi (on a second VM) on port 4726 > also using the same sslContext. > In Nifi everything is fine and my flow works, I have taken a template of > the flow, and used the Minifi toolkit to create the config.yml. I have > edited the yaml file to ensure the keystore variables are set in the > controller service section. > When I start Minifi I get the following error message: > [error] o.apache.nifi.controller.FlowController Unable to start > ListenHTTP [id=1234.] due to java.lang.IllegalStateException: > Processor ListenHttp is not in a valid state due to [ 'SSL Context Service' > validated against '968df5a-dfd5-39ad--000' is invalid because > StandardSSLContextService - 0.2.0 from org.apache.nifi.minifi - > minifi-ssl-context-service-nar is not compatible with SSLContextService - > unversioned from default - system] > Can anyone give me a pointer as to what may be wrong here please? > Many thanksDave