Revolyssup opened a new pull request, #12042: URL: https://github.com/apache/apisix/pull/12042
### Description <!-- Please include a summary of the change and which issue is fixed. --> <!-- Please also include relevant motivation and context. --> Fixes # (issue) After the traffic passes through the AI Gateway (also known as APISIX), users hope to: be able to record more variables required for AI proxy scenarios in the access log of AI requests and responses. Some metadata explicitly mentioned by the user, and corresponding explanations: - Token: The token usage for each request and response phase needs to be recorded separately. - Latency: The waiting time for the first response after the request is sent to the AI Instance through the AI Gateway proxy. - Time to first byte. ```bash 127.0.0.1 - - [12/Mar/2025:16:24:57 +0530] 127.0.0.1:9080 "POST /anything HTTP/1.1" 429 349 1.088 "-" "curl/8.9.1" - - - "https://somerandom.com "ai_token_usage={\x22prompt_tokens\x22:0,\x22completion_tokens\x22:0,\x22total_tokens\x22:0}" "ai_time_to_first_byte(in seconds)=1.0880000591278"" ``` ### Checklist - [ ] I have explained the need for this PR and the problem it solves - [ ] I have explained the changes or the new features added to this PR - [ ] I have added tests corresponding to this change - [ ] I have updated the documentation to reflect this change - [ ] I have verified that this change is backward compatible (If not, please discuss on the [APISIX mailing list](https://github.com/apache/apisix/tree/master#community) first) <!-- Note 1. Mark the PR as draft until it's ready to be reviewed. 2. Always add/update tests for any changes unless you have a good reason. 3. Always update the documentation to reflect the changes made in the PR. 4. Make a new commit to resolve conversations instead of `push -f`. 5. To resolve merge conflicts, merge master instead of rebasing. 6. Use "request review" to notify the reviewer after making changes. 7. Only a reviewer can mark a conversation as resolved. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@apisix.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
