Re: Removing JRuby?

2023-11-06 Thread Edward Armes
While I do like the ExecuteScript processors as they are great at digging you out of a hole. The performance of them isn't that great. That being said I would ve careful about dropping Lua support as there is a growing list of software that supports end user/administrator extensions via Lua for th

Re: Use of attribute uuid and other "native" attributes

2023-07-18 Thread Edward Armes
Hmm, I've seen this come up a few times now I wonder is there need for a rename of the uuid field and a creation of an external id field? Edward On Tue, 18 Jul 2023, 20:53 Lucas Ottersbach, wrote: > Hey Matt, > > you wrote that both `Session.create` and `Session.clone` set a new FlowFile > UUI

Re: [VOTE] Adopt NiFi 2.0 Proposed Release Goals

2022-12-14 Thread Edward Armes
-1 (non-binding) Im not sure if this is covered by 8 and 5 , but I would like to suggest that as part of 2.0 focus on removing places were concrete implementations are used over interfaces, and update the way the website docs are generated to ensure that NARs that not included in the standard dist

Re: Need some feedback on how upgrading Avro might cause problems

2022-04-07 Thread Edward Armes
I've had a quick look in JIRA and it looks like this might have happened as a side effect of AVRO-1544. I think it is worth upgrading especially given that it looks like few of the changes refer to updating against newer bundled dependencies some of which seem to have CVE's against them. Dependi

Re: Data Provenance

2021-09-04 Thread Edward Armes
Hi Anupam, to the best of my knowledge it is not possible to read the provenance records directly. You can however read the provenance records from either the API directly or use the site to site provenance reporting reporting task to ship the provance records to the same Nifi instance (not recom

Re: Running nifi as non-root user

2021-08-09 Thread Edward Armes
You should also be aware, that you might have some issues listening or using protected/privileged ports (1 - 1023 inclusive) Regards Edward On Mon, 9 Aug 2021, 08:58 Jens M. Kofoed, wrote: > No. But the user need rwx rights to all the folders which is configured > for NiFi. And read+write to

Re: [DISCUSS] NiFi 2.0 Release Goals

2021-07-26 Thread Edward Armes
Given the major version number shift and the spliting up of processors into multiple NAR's. I'd like to suggest that we start individually versioning individual NARs/ bundles. I can see this bringing a large number of benifits including making Nifi more deployable with things RPM, but also potenti

Re: Removing documentation from deployment

2021-03-17 Thread Edward Armes
Just had a thought given that the UI links through in the docs are there any tests or build conditions that break around the UI packaging if this was to be done? Edward On Tue, Mar 16, 2021 at 10:38 PM Matt Burgess wrote: > I haven't tried it, but I would think you could add a profile > (disabl

Re: Username/Password authentication

2021-02-12 Thread Edward Armes
Hi Sumant, The best way to do this would be using an approach known as Basic Authentication. information you need to enable this can be found in Administration guide which can be found here: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html Regards Edward On Fri, Feb 12, 20

Re: Enabling Cross Origin Requests

2020-10-31 Thread Edward Armes
Hi Terry, Just want to check I understand what your asking. Are asking, if the Nifi REST API can be setup such that it can accept an additional set of client certificates, that has been issued by an issuer outside of the trust chain of the certificate that is used by Nifi itself? Edward On Sat,

Re: Maximum load

2020-09-21 Thread Edward Armes
Hi Phil, A few things that might be of help here. It's been a while since I looked at the call chain for a processor but... I believe what happens is that when a processor is set to have a number of concurrent processors set what happens is that per nifi node the locks around the onTrigger m

Re: Info required for service upgrade

2020-08-14 Thread Edward Armes
Hi Ganesh, The most up to date instructions for upgrading Nifi can be found here: https://cwiki.apache.org/confluence/display/NIFI/Upgrading+NiFi To answer your specific questions: Yes - It is required to suspend all activity on the entire Nifi cluster before upgrading, and ensure that there is n

Re: [DISCUSS] rename master branch, look through code for other related issues

2020-06-18 Thread Edward Armes
t;>> can take these actions as a community to improve the experience for > >> others, > >>> I am in favor of that. > >>> > >>>> - One final point (and potentially controversial), A good chunk of the > >>>> wording that is proposed to be changed.

Re: [DISCUSS] rename master branch, look through code for other related issues

2020-06-17 Thread Edward Armes
This is a difficult issue and causes no small amount of friction every time. I'm personally against this for the following reassons: - Some of the terms proposed are not industry standard and may potentially cause significant issue for non-english speakers. - For each change that is made can we g

Re: [DISCUSS] Assembly size for 1.10

2019-08-22 Thread Edward Armes
Could we potentially look at removing the embedded external dependences for the nars and have them resolve on first start up using an embed manger like what spark jobs and some of the OSGI frameworks do? Edward On Thu, 22 Aug 2019, 04:48 Bryan Bende, wrote: > I would vote for doing the reorgani

Re: Duplicate flow files *without* their content

2019-07-31 Thread Edward Armes
HI Lars, In short. depending on the how a FlowFile is duplicated, the content shouldn't be duplicated as well. In general, content is only duplicated when it has been deemed to have been changed (copy-on-write semantics). For the most part (unless a FlowFIle has a large number of attributes) a Fl

Re: [DISCUSS] Streaming or "lazy" mode for `CompressContent`

2019-07-30 Thread Edward Armes
t sure we > can avoid having a specific solution. Some compression types can be > concatted together and some cannot. Some record types would be > tolerant/still valid and some would not. > > Thanks > Joe > > On Tue, Jul 30, 2019 at 12:34 PM Edward Armes > wrote: > >

Re: [DISCUSS] Streaming or "lazy" mode for `CompressContent`

2019-07-30 Thread Edward Armes
So while I agree with in principle and it is a good idea on paper. My concern is that this starts to add a bolt-on bloat problem. The Nifi processors as they stand in general do follow the Unix Philosophy (Do one thing, and do it well). My concern is while it could just be a case with just adding

Re: Not able to start apche-nifi in aks

2019-07-22 Thread Edward Armes
Hi Hitesh, >From what you've said I believe that this is actually a Kubernetes issue and not a problem with the Nifi docker container. As such I've responded to your Stack Overflow post and hopefully someone with a bit more experience with Kubernetes will then also be able help a bit more from the

Re: Java 12 Compatibility

2019-07-17 Thread Edward Armes
So the warning here isn't something you need to worry about and you'll find it's quite a common one, on a lot of Java applications and its down to changes made in Java 9, The short reason for this, is that in Java 9 a new type of package was created a Module. A module is essentially a package of p

Re: [EXT] [discuss] Splitting NiFi framework and extension repos and releases

2019-07-12 Thread Edward Armes
I think Nifi would really benefit from this. One thing I think that, should be looked into is something I noticed while trying to get to grips with the Nifi source, At the start of the year I did a small exercise to track how a call from the API to start and stop a processor translates to a process