Ryan Hendrickson created NIFI-9028:
--------------------------------------

             Summary: Large Canvas Management
                 Key: NIFI-9028
                 URL: https://issues.apache.org/jira/browse/NIFI-9028
             Project: Apache NiFi
          Issue Type: New Feature
            Reporter: Ryan Hendrickson


Beginning with a NiFi flow that consists of ~15 stand-alone NiFis and 2 NiFi 
clusters, each canvas is managed individually.  To see the entire canvas, 
systems engineering diagrams need to be kept up-to-date identifying all the 
input/output ports.  To move processors from server to server often requires 
the verification of the existence of scripts, configuration files, NiFi custom 
nars, and using the templating or Registry to migrate portions of the dataflow.
 
Our current design pattern to accomplish some of these tasks include using 
Ansible, Jenkins, and Nexus to verify script & configuration files are up to 
date.  We use Confluence's Gliffy to document the NiFi communication paths 
between the servers.
 
Ideally, we'd be able to see an overall management view of the Canvases 
together in a single place - it would indicate which server the portions of the 
canvas are deployed on and tie together where the Remote Process Group ports 
are connected.  Additionally, NiFi would allow the user to move Processors and 
Process Groups seamlessly from one server to another server to help manually 
distribute and balance data flow processing cycles.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to