GitHub user mimaison opened a pull request:
https://github.com/apache/kafka/pull/3684
KIP-81: KAFKA-4133: Bound memory usage of the Consumer
This is in-progress but there should be enough to start the reviews.
Although the KIP doesn't mention metrics, I think we should expose the
memory pool usage metrics like in KIP-72. Also this need more tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mimaison/kafka KAFKA-4133
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/3684.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3684
----
commit c5bebf8df80e90f920a82a7d7a1ae8fe31ca4d84
Author: Mickael Maison <[email protected]>
Date: 2017-07-26T20:27:37Z
KIP-81: KAFKA-4133: Bound Consumer memory usage
The Consumer can now use a MemoryPool to bound its memory usage
commit c9a110b2310fc2872ca8e63c150249733bf496b0
Author: Mickael Maison <[email protected]>
Date: 2017-08-17T10:03:48Z
Minor fixes following Vahid's review
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---