Ferenc Gerlits created NIFI-13997:
-------------------------------------

             Summary: When loading a Python processor, do not load other 
processor code
                 Key: NIFI-13997
                 URL: https://issues.apache.org/jira/browse/NIFI-13997
             Project: Apache NiFi
          Issue Type: Improvement
            Reporter: Ferenc Gerlits
            Assignee: Ferenc Gerlits


When NiFi loads the code for a Python processor contained in a package, it 
loads all Python files in that package (directory). This means that the 
dependencies of all processors in the package must be identical.

In some cases, the user may want to have the ProcA and ProcB processors in the 
same package to have some common dependencies dep_common (listed in the 
{{requirements.txt}} file) plus each processor to have some extra dependencies, 
say dep_a and dep_b (listed in {{ProcessorDetails.dependencies}} in each 
processor module). When loading ProcA, we currently only install the dep_common 
+ dep_a dependencies, but then try to load both ProcA and ProcB, which will 
fail due to the missing dep_b dependencies.

To solve this problem, when we load a processor from a package, we should not 
load any other processors in the same package. We should load all non-processor 
helper files plus the single processor requested by the user.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to