[GitHub] [kafka] showuon opened a new pull request #10552: KAFKA-12675: improve the sticky general assignor scalability and performance

[GitBox]

showuon opened a new pull request #10552:
URL: https://github.com/apache/kafka/pull/10552


   I did code refactor, keep the same algorithm in this PR.
   I've achieved:
   1. Originally, With this setting:
   ```
   topicCount = 50;
   partitionCount = 800;
   consumerCount = 800;
   ```
   We complete in 10 seconds, after my code refactor, the time down to 200 ms
   
   2. With the 1 million partitions setting:
   ```
   topicCount = 500;
   partitionCount = 2000;
   consumerCount = 2000;
   ```
   No OutOfMemory will be thrown anymore. The time will take 5 seconds.
   
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org