tqchen commented on PR #18203: URL: https://github.com/apache/tvm/pull/18203#issuecomment-3179134116
Thanks, we are integrating GQA from flashinfer integration and not sure if we need it for standard attention interface, and if the current form is the best form, given GQA may also have group size config -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
