Re: [I] help request: about ai-multi-proxy, rewrite the endpoint [apisix]
jiqq closed issue #13213: help request: about ai-multi-proxy, rewrite the endpoint URL: https://github.com/apache/apisix/issues/13213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] help request: about ai-multi-proxy, rewrite the endpoint [apisix]
jiqq commented on issue #13213: URL: https://github.com/apache/apisix/issues/13213#issuecomment-4242110401 ok,ths -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] help request: about ai-multi-proxy, rewrite the endpoint [apisix]
Baoyuantop commented on issue #13213: URL: https://github.com/apache/apisix/issues/13213#issuecomment-4242015018 The ai-proxy-multi plugin is currently designed only to proxy LLM chat/completion, embeddings, and responses APIs; it does not support the rerank protocol. We recommend using a standard reverse proxy: do not use ai-proxy-multi, but instead configure upstream + route directly, and use the proxy-rewrite plugin to proxy rerank requests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
