[jira] [Created] (MINIFICPP-2778) Move llama.cpp model management, init/deinit to controller service

[Adam Debreceni (Jira)]

Adam Debreceni created MINIFICPP-2778:
-----------------------------------------

             Summary: Move llama.cpp model management, init/deinit to 
controller service
                 Key: MINIFICPP-2778
                 URL: https://issues.apache.org/jira/browse/MINIFICPP-2778
             Project: Apache NiFi MiNiFi C++
          Issue Type: Improvement
            Reporter: Adam Debreceni


Currently all instances of llama processors initialize a new model instance, 
which is wasteful when they could use the same model.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)