GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/2486
KAFKA-4724: Clean up of state directories can possibly remove stores that
are about to be used by another thread
Delay the cleanup of state directories that are not locked and not owned by
the current thread such that we only remove the directory if its last modified
is < now - cleanupDelayMs.
This also helps to avoid a race between threads on the same instance, where
during rebalance, one thread releases the lock on the state directory, and
before another thread can take the lock, the cleanup runs and removes the data.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka KAFKA-4724
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2486.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2486
----
commit 229471706dec638361777f00de195e7538a54c29
Author: Damian Guy <[email protected]>
Date: 2017-02-02T12:58:07Z
delay cleanup of state directories
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
