jlaupa opened a new pull request, #13707: URL: https://github.com/apache/apisix/pull/13707
…(N) full rebuild per change _M.plugin() rebuilt the entire consumer plugin tree via core.lrucache.global on every consumers.conf_version change, which is O(N) on the request path. With a large consumer base and steady consumer churn, rebuilds take seconds and stack up: request latency collapses and CPU saturates. Replace the full rebuild with an incremental one: a pending-set fed by the etcd filter callback applies only changed consumers on conf_version change; a full rebuild happens only on bootstrap (first request); a lightweight 30s background consistency check (count compare + id scan) triggers a full rebuild only if it detects a discrepancy (covers the simultaneous create+delete edge). No config or API changes; consumers_count_for_lrucache is unchanged. ### Description <!-- Please include a summary of the change and which issue is fixed. --> <!-- Please also include relevant motivation and context. --> #### Which issue(s) this PR fixes: <!-- *Automatically closes linked issue when PR is merged. Usage: `Fixes #<issue number>`, or `Fixes (paste link of issue)`. --> Fixes # ### Checklist - [ ] I have explained the need for this PR and the problem it solves - [ ] I have explained the changes or the new features added to this PR - [ ] I have added tests corresponding to this change - [ ] I have updated the documentation to reflect this change - [ ] I have verified that this change is backward compatible (If not, please discuss on the [APISIX mailing list](https://github.com/apache/apisix/tree/master#community) first) <!-- Note 1. Mark the PR as draft until it's ready to be reviewed. 2. Always add/update tests for any changes unless you have a good reason. 3. Always update the documentation to reflect the changes made in the PR. 4. Make a new commit to resolve conversations instead of `push -f`. 5. To resolve merge conflicts, merge master instead of rebasing. 6. Use "request review" to notify the reviewer after making changes. 7. Only a reviewer can mark a conversation as resolved. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
