chryancclee-boop opened a new issue, #13453:
URL: https://github.com/apache/apisix/issues/13453

   ### Description
   
   When using the ai-proxy plugin with the openai-compatible provider and 
configuring an override.endpoint, the endpoint must be a full URL including the 
path (http://127.0.0.1:8080/v1/chat/completions). because when I do not 
configure the URL in the endpoint of ai-proxy, the forwarding fails.
   
   This creates a problem when you want to proxy multiple endpoints (e.g., 
/v1/chat/completions, /v1/embeddings, /v1/completions) from the same model 
service — you forced to:
   
   1. Create multiple separate routes in APISIX, each with a different 
override.endpoint configuration, OR
   2. Use ai-proxy-multi with multiple instances (which is designed for load 
balancing/fallback, not path-based routing)
   
   ### Environment
   
   - APISIX version (run `apisix version`): 3.16.0
   - Operating system (run `uname -a`): Linux 49e6a76a70b2 6.8.0-110-generic 
#110-Ubuntu SMP PREEMPT_DYNAMIC Thu Mar 19 15:09:20 UTC 2026 x86_64 x86_64 
x86_64 GNU/Linux
    
   - OpenResty / Nginx version (run `openresty -V` or `nginx -V`):nginx 
version: openresty/1.27.1.2
   built by gcc 13.3.0 (Ubuntu 13.3.0-6ubuntu2~24.04.1) 
   built with OpenSSL 3.4.1 11 Feb 2025
   - etcd version, if relevant (run `curl 
http://127.0.0.1:9090/v1/server_info`):
   - APISIX Dashboard version, if relevant:
   - Plugin runner version, for issues related to plugin runners:
   - LuaRocks version, for installation issues (run `luarocks --version`):
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to