kayx23 commented on code in PR #12950:
URL: https://github.com/apache/apisix/pull/12950#discussion_r2740270133
##########
docs/en/latest/plugins/ai-proxy-multi.md:
##########
@@ -59,11 +59,18 @@ In addition, the Plugin also supports logging LLM request
information in the acc
| instances | array[object] | True |
| | LLM instance configurations. |
| instances.name | string | True |
| | Name of the LLM service instance. |
| instances.provider | string | True |
| [openai, deepseek, azure-openai, aimlapi, anthropic,
openrouter, gemini, vertex-ai, openai-compatible] | LLM service provider. When
set to `openai`, the Plugin will proxy the request to `api.openai.com`. When
set to `deepseek`, the Plugin will proxy the request to `api.deepseek.com`.
When set to `aimlapi`, the Plugin uses the OpenAI-compatible driver and proxies
the request to `api.aimlapi.com` by default. When set to `anthropic`, the
Plugin will proxy the request to `api.anthropic.com` by default. When set to
`openrouter`, the Plugin uses the OpenAI-compatible driver and proxies the
request to `openrouter.ai` by default. When set to `gemini`, the Plugin uses
the OpenAI-compatible driver and proxies the request to
`generativelanguage.googleapis.com` by default. When set to `vertex-ai`, the
Plugin will proxy the request to `aiplatform.googleapis.com` by default and
requires `provide
r_conf` or `override`. When set to `openai-compatible`, the Plugin will proxy
the request to the custom endpoint configured in `override`. |
+| instances.provider_conf | object | False |
| | Configuration for the specific
provider. Required when `provider` is set to `vertex-ai` and `override` is not
configured. |
+| instances.provider_conf.project_id | string | True |
| | Google Cloud Project ID. Required when
`provider` is set to `vertex-ai`. |
+| instances.provider_conf.region | string | True |
| | Google Cloud Region. Required when
`provider` is set to `vertex-ai`. |
| instances.priority | integer | False | 0
| | Priority of the LLM instance in load
balancing. `priority` takes precedence over `weight`. |
| instances.weight | string | True | 0
| greater or equal to 0 | Weight of the LLM instance in
load balancing. |
| instances.auth | object | True |
| | Authentication configurations. |
| instances.auth.header | object | False |
| | Authentication headers. At least one of
the `header` and `query` should be configured. |
| instances.auth.query | object | False |
| | Authentication query parameters. At
least one of the `header` and `query` should be configured. |
+| instances.auth.gcp | object | False |
| | Configuration for Google Cloud Platform
(GCP) authentication. |
+| instances.auth.gcp.service_account_json | string | False |
| | Content of the GCP service account JSON
file. |
Review Comment:
```suggestion
| instances.auth.gcp.service_account_json | string | False |
| | Content of the GCP service account
JSON file. This can also be configured by setting the `GCP_SERVICE_ACCOUNT`
environment variable. |
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
