Re: Nifi - how to achieve a concurrent development and CI/CD

2020-05-14 Thread Eric Secules
Hi Ami, I'm testing our NiFi application using a blackbox approach. We have a test harness that stages input files and waits for the corresponding outputs, then validates the content of the output. NiFi runs in a docker container (see https://hub.docker.com/r/apache/nifi/) and you can automate

Re: Nifi - how to achieve a concurrent development and CI/CD

2020-05-14 Thread Jorge Machado
I think we could improve Nifi by hooking up to GitHub somehow. So that we don’t need the registry… > On 14. May 2020, at 18:49, Ami Goldenberg wrote: > > Hi Eric, > Would love to know, what kind of tests do you write/run for NiFi? We were > just researching this topic. > > On Thu, May 14,

Re: Nifi - how to achieve a concurrent development and CI/CD

2020-05-14 Thread Ami Goldenberg
Hi Eric, Would love to know, what kind of tests do you write/run for NiFi? We were just researching this topic. On Thu, May 14, 2020 at 6:38 PM Eric Secules wrote: > Hi Michal, > > I'm also using a single registry for development and production. It > doesn't help with collaborating on the same

Re: Nifi - how to achieve a concurrent development and CI/CD

2020-05-14 Thread Eric Secules
Hi Michal, I'm also using a single registry for development and production. It doesn't help with collaborating on the same process group as there is way for it to reconcile merge conflicts. Instead, the registry will earn you that you're about to overwrite someone else's changes. Another pain of

Re: Nifi - how to achieve a concurrent development and CI/CD

2020-05-14 Thread Jorge Machado
Hi, Managing xml is always hard I think. Last time I need to do something similar we used https://nifi.apache.org/registry.html Works pretty well It was already 2 Years ago. Maybe now there is something better > On 14. May 2020, at 15:57, Michal Slama

Nifi - how to achieve a concurrent development and CI/CD

2020-05-14 Thread Michal Slama (DHL IT Services), external
Hello, may I ask you for recommendations for development and CI/CD in NiFi? Pls let me describe our situation...I am a developer from DHL currently working on project including NiFi. It is part of our core and it is responsible for handling incoming data streams, data transormation and put

Re: Inquiry about Azure blob processors

2020-05-14 Thread Paul Riddle
That is exactly what I am looking for. Thanks! Paul On Wed, May 13, 2020 at 12:29 PM Muazma Zahid wrote: > There is a PR open about this issue: > https://github.com/apache/nifi/pull/4265. Please review and provide any > feedback. > Thanks, > Muazma > > On Wed, May 13, 2020 at 9:19 AM Paul