wjchan89 opened a new issue, #12249:
URL: https://github.com/apache/apisix/issues/12249

   ### Current Behavior
   
   unable to get local issuer certificate
   
   ### Expected Behavior
   
   how to use them together?
   
   ### Error Logs
   
   2025/05/23 16:08:42 [warn] 1083891#1083891: *2991 [lua] base.lua:49: 
phase_func(): failed to send request to AI service: failed to connect to LLM 
server: 20: unable to get local issuer certificate, client: 127.0.0.1, server: 
_, request: "POST /tds HTTP/1.1", host: "127.0.0.1:9080"
   2025/05/23 16:08:42 [warn] 1083891#1083891: *2991 [lua] plugin.lua:1210: 
common_phase(): ai-proxy exits with http status code 500, client: 127.0.0.1, 
server: _, request: "POST /tds HTTP/1.1", host: "127.0.0.1:9080"
   
   ### Steps to Reproduce
   
   1. etcd mTLS Setup
   issued a custom CA certificate using cfssl and added the following 
configuration in config.yaml:
   apisix:
     ssl:
       ssl_trusted_certificate: /path/to/certs/ca-certificates.crt
   
   2. configured a Route with the ai-proxy plugin like this:
   curl "http://127.0.0.1:9080/apisix/admin/routes/testdeepseek"; -X PUT \
     -H "X-API-KEY: xxx" \
     -d '{
       "uri": "/tds",
       "plugins": {
         "ai-proxy": {
           "provider": "deepseek",
           "auth": {
             "header": {
               "Authorization": "Bearer {api key}"
             }
           },
           "options": {
             "model": "deepseek-chat",
             "max_tokens": 512,
             "temperature": 1.0
           }
         }
       }
     }'
   
   
   3. Request:
   curl http://127.0.0.1:9080/tds -i -XPOST  -H 'Content-Type: 
application/json' -d '{
           "messages": [
               { "role": "system", "content": "You are a mathematician" },
               { "role": "user", "content": "What is 1+1?" }
           ]
       }'
   
   ### Environment
   
   - APISIX version (run `apisix version`):3.12.0
   - Operating system (run `uname -a`):Linux x86_64
   - OpenResty / Nginx version (run `openresty -V` or `nginx -V`):1.27.1.1
   - etcd version, if relevant (run `curl 
http://127.0.0.1:9090/v1/server_info`):3.5.4
   - APISIX Dashboard version, if relevant:
   - Plugin runner version, for issues related to plugin runners:
   - LuaRocks version, for installation issues (run `luarocks --version`):
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@apisix.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to