juzhiyuan commented on code in PR #13659:
URL: https://github.com/apache/apisix/pull/13659#discussion_r3524356850
##########
docs/en/latest/plugins/prometheus.md:
##########
@@ -249,6 +249,63 @@ The `type` label distinguishes the kind of latency,
similar to `apisix_http_late
| request_type | traditional_http / ai_chat / ai_stream
|
| llm_model | For non-traditional_http requests, name of the llm_model
|
+### Labels for `apisix_ai_cache_hits_total`
+
+`apisix_ai_cache_hits_total` counts requests served from the
[`ai-cache`](./ai-cache.md) Plugin's cache, per serving layer.
+
+| Name | Description
|
+| ---------- |
-----------------------------------------------------------------------------------------------------------------------------
|
+| layer | Cache layer that served the hit: `exact` or `semantic`.
|
+| route_id | ID of the Route that the metric corresponds to. Default to
an empty string if a request does not match any Route. |
+| service_id | ID of the Service that the matched Route belongs to. Default
to an empty string if the matched Route does not belong to any Service. |
+| consumer | Name of the Consumer associated with a request. Default to an
empty string if no Consumer is associated with the request.
|
+| node | IP address of the upstream node. Empty for requests served from
the cache, which never reach the upstream.
|
+| request_type | traditional_http / ai_chat / ai_stream
|
+| request_llm_model | Model name requested by the client.
|
+| llm_model | Model name reported by the LLM response. Empty for
requests served from the cache, which never reach the upstream.
|
+
+### Labels for `apisix_ai_cache_misses_total`
+
+`apisix_ai_cache_misses_total` counts requests the [`ai-cache`](./ai-cache.md)
Plugin looked up but could not serve from the cache.
+
+| Name | Description
|
+| ---------- |
-----------------------------------------------------------------------------------------------------------------------------
|
+| route_id | ID of the Route that the metric corresponds to. Default to
an empty string if a request does not match any Route. |
+| service_id | ID of the Service that the matched Route belongs to. Default
to an empty string if the matched Route does not belong to any Service. |
+| consumer | Name of the Consumer associated with a request. Default to an
empty string if no Consumer is associated with the request.
|
+| node | IP address of the upstream node. Empty for requests served from
the cache, which never reach the upstream.
|
+| request_type | traditional_http / ai_chat / ai_stream
|
+| request_llm_model | Model name requested by the client.
|
+| llm_model | Model name reported by the LLM response. Empty for
requests served from the cache, which never reach the upstream.
|
Review Comment:
How to understand "Empty for requests served from the cache, which never
reach the upstream.
"?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
