sihyeonn commented on PR #12857:
URL: https://github.com/apache/apisix/pull/12857#issuecomment-3708662674
Hi @Baoyuantop ,
I'm running an LLM gateway. Many models expose multiple endpoints from the
same base URL:
- `/v1/chat/completions`
- `/v1/responses`
- `/v1/embeddings`
- `/v1/moderations`
Currently, I must create separate routes for each endpoint because
`override.endpoint` replaces the entire URI:
```yaml
# Example Current: 4 routes per model
routes:
- uri: /v1/chat/completions
plugins:
ai-proxy:
override:
endpoint: https://api.example.com/models/gpt-4/v1/chat/completions
- uri: /v1/responses
plugins:
ai-proxy:
override:
endpoint: https://api.example.com/models/gpt-4/v1/responses
# ... 2 more routes
```
This creates unnecessary duplication:
- 4+ routes per model
- Same base URL repeated across routes
- Duplicate plugin configs (healthcheck, auth, timeout)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
