Arafat Khan created HDDS-14817:
----------------------------------
Summary: Multi-LLM Provider Support with Intelligent Routing
Key: HDDS-14817
URL: https://issues.apache.org/jira/browse/HDDS-14817
Project: Apache Ozone
Issue Type: Sub-task
Reporter: Arafat Khan
Customers differ in which AI services they are contracted to use some run on
Azure OpenAI, others on Anthropic, and others still on Google Cloud. This JIRA
ensures the Recon AI Assistant is not tied to a single vendor by building out a
pluggable provider model and adding native support for OpenAI and Anthropic
alongside Gemini. It introduces a smart routing layer that automatically
determines which AI provider to use based on the model the user selects so if a
user picks a GPT model, it routes to OpenAI; if they pick Claude, it routes to
Anthropic. Administrators can also set a cluster-wide default provider. The
result is a flexible, provider-agnostic assistant that works within whatever AI
ecosystem an organization already has in place.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
