GitHub user enothereska opened a pull request:
https://github.com/apache/kafka/pull/2643
KAFKA-4843: More efficient round-robin scheduler
- Improves streams efficiency by more than 200K requests/second (small 100
byte requests)
- Gets streams efficiency very close to pure consumer (see results in
https://jenkins.confluent.io/job/system-test-kafka-branch-builder/746/console)
- Maintains same fairness across tasks
- Schedules all records in the queue in-between poll() calls, not just one
per task.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/enothereska/kafka minor-schedule-round-robin
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2643.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2643
----
commit c3f9a1756e7b7f0e2869853bde2e249fb3f1f6d9
Author: Eno Thereska <[email protected]>
Date: 2017-03-05T08:09:51Z
More efficient round robin
commit 138a491f743d5ed7017c415c9f50f974f16c8567
Author: Eno Thereska <[email protected]>
Date: 2017-03-05T10:05:38Z
Tighter loop
commit caba483760eb47304e50589f66d396a2afdf0f4e
Author: Eno Thereska <[email protected]>
Date: 2017-03-05T14:16:33Z
Increased records further
commit aaa14d1c95bfea0f7681f1b5686e0bc6736b13ee
Author: Eno Thereska <[email protected]>
Date: 2017-03-05T15:00:06Z
Temporary reduce number of tests for quick branch builder turnaround
commit 6c616addbc86f23e9f7311f6ac1cc2e5c92152ee
Author: Eno Thereska <[email protected]>
Date: 2017-03-05T15:24:29Z
Re-enable full tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
