Yilialinn commented on code in PR #2120:
URL: https://github.com/apache/apisix-website/pull/2120#discussion_r4002990577
##########
next/src/components/MainPages/AiGatewayPage.astro:
##########
@@ -11,55 +11,119 @@ const features = [
title: t(locale, 'Multi-LLM load balancing', '多 LLM 负载均衡'),
description: t(
locale,
- 'Route across OpenAI, DeepSeek, Claude, Mistral, Gemini, and other
providers with health checks and weighted balancing.',
- '通过健康检查和权重负载均衡，在 OpenAI、DeepSeek、Claude、Mistral、Gemini 等模型提供商之间路由。',
+ 'Use weighted round robin or consistent hashing, or configure semantic
routing from prompt similarity to per-instance examples.',
+ '使用加权轮询或一致性哈希，或根据提示词与各实例示例的相似度配置语义路由。',
),
icon: '/img/ai-gateway/load-balancing.svg',
+ href: '/docs/apisix/plugins/ai-proxy-multi/',
},
{
title: t(locale, 'Token rate limiting', 'Token 限流'),
description: t(
locale,
- 'Control token consumption by Route, Service, Consumer, Consumer Group,
or custom attributes in standalone and cluster deployments.',
- '按 Route、Service、Consumer、Consumer Group 或自定义属性控制 token 消耗，支持单机与集群部署。',
+ 'Apply token-based limits with local or Redis-backed counters to control
usage before requests reach an LLM provider.',
+ '使用本地或 Redis 计数器实施基于 token 的限制，在请求到达 LLM 提供商之前控制用量。',
),
icon: '/img/ai-gateway/token-rate-limiting.svg',
+ href: '/docs/apisix/plugins/ai-rate-limiting/',
},
{
title: 'AI RAG',
description: t(
locale,
- 'Connect enterprise knowledge to model requests at the gateway layer for
grounded, context-aware responses.',
- '在网关层为模型请求连接企业知识库，生成有依据、具备上下文的响应。',
+ 'Augment requests with context retrieved through the plugin\'s
documented Azure OpenAI and Azure AI Search integration.',
+ '通过插件当前支持的 Azure OpenAI 与 Azure AI Search 集成，为请求补充检索到的上下文。',
),
icon: '/img/ai-gateway/ai-rag.svg',
+ href: '/docs/apisix/plugins/ai-rag/',
},
{
title: t(locale, 'Token observability', 'Token 可观测性'),
description: t(
locale,
- 'Track token usage through access logs and existing observability tools
to control abuse and unexpected cost.',
- '通过访问日志和现有可观测工具追踪 token 使用，控制滥用和意外成本。',
+ 'Record model, latency, token usage, and time-to-first-token summaries
when AI proxy logging is enabled.',
+ '启用 AI 代理日志后，记录模型、延迟、token 用量和首 token 响应时间等摘要。',
),
icon: '/img/ai-gateway/observability.svg',
+ href: '/docs/apisix/plugins/ai-proxy/',
},
{
title: t(locale, 'Retry and fallback', '重试与回退'),
description: t(
locale,
- 'Use health checks, automatic retries, and fallback providers to keep AI
applications available when an upstream model fails.',
- '通过健康检查、自动重试和备用模型提供商，在上游模型故障时保持 AI 应用可用。',
+ 'Configure bounded retries and fallback strategies for selected upstream
failures without changing application endpoints.',
+ '针对指定的上游故障配置有限次数的重试和回退策略，无需更改应用访问端点。',
),
icon: '/img/ai-gateway/retry-fallback.svg',
+ href: '/docs/apisix/plugins/ai-proxy-multi/',
},
{
- title: t(locale, 'Prompt security', '提示词安全'),
+ title: t(locale, 'Prompt and content controls', '提示词与内容控制'),
description: t(
locale,
- 'Apply prompt guards, decorators, templates, content moderation,
logging, and auditing before traffic reaches a model.',
- '在流量到达模型之前应用提示词防护、装饰、模板、内容审核、日志和审计。',
+ 'Apply allow and deny patterns with Prompt Guard, and compose separate
plugins for templates, decoration, or moderation.',
+ '使用 Prompt Guard 配置允许与拒绝规则，并按需组合模板、装饰或内容审核插件。',
),
icon: '/img/ai-gateway/security.svg',
+ href: '/docs/apisix/plugins/ai-prompt-guard/',
+ },
+ {
+ title: t(locale, 'AI response caching', 'AI 响应缓存'),
+ description: t(
+ locale,
+ 'With AI Proxy, cache completed LLM responses using Redis-backed exact
matching and optional semantic matching.',
Review Comment:
Fixed in 54291bea2. Both the AI response caching and Lakera Guard feature
cards now explicitly name ai-proxy and ai-proxy-multi, matching the capability
table and plugin documentation. The cache card also now uses a dedicated cache
icon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
