Baoyuantop commented on issue #13213: URL: https://github.com/apache/apisix/issues/13213#issuecomment-4242015018
The ai-proxy-multi plugin is currently designed only to proxy LLM chat/completion, embeddings, and responses APIs; it does not support the rerank protocol. We recommend using a standard reverse proxy: do not use ai-proxy-multi, but instead configure upstream + route directly, and use the proxy-rewrite plugin to proxy rerank requests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
