[
https://issues.apache.org/jira/browse/KAFKA-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Greg Fodor updated KAFKA-3619:
------------------------------
Description:
The .lock files in the state store directories do not seem to be having their
file handles freed (despite the locks being freed), so on a complex job the
number of file handles in use goes up rapidly as the locks are taken for the
cleanup routine at the end of the thread run loop. Running lsof shows the
number of open filehandles on the .lock file increasing rapidly over time. In a
separate test project, I reproduced the issue and determined that in order for
the filehandle to be relinquished the FileChannel instance must be properly
closed.
PR:
https://github.com/apache/kafka/pull/1267
was:
The .lock files in the state store directories do not seem to be having their
file handles freed (despite the locks being freed), so on a complex job the
number of file handles in use goes up rapidly as the locks are taken
for the cleanup routine at the end of the thread run loop. Running lsof shows
the number of open filehandles on the .lock file increasing rapidly over time.
In a separate test project, I reproduced the issue and determined that in order
for the filehandle to be relinquished the FileChannel instance must be properly
closed.
PR:
https://github.com/apache/kafka/pull/1267
> State lock file handle leaks
> ----------------------------
>
> Key: KAFKA-3619
> URL: https://issues.apache.org/jira/browse/KAFKA-3619
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 0.10.0.0
> Reporter: Greg Fodor
> Assignee: Guozhang Wang
> Priority: Critical
>
> The .lock files in the state store directories do not seem to be having their
> file handles freed (despite the locks being freed), so on a complex job the
> number of file handles in use goes up rapidly as the locks are taken for the
> cleanup routine at the end of the thread run loop. Running lsof shows the
> number of open filehandles on the .lock file increasing rapidly over time. In
> a separate test project, I reproduced the issue and determined that in order
> for the filehandle to be relinquished the FileChannel instance must be
> properly closed.
> PR:
> https://github.com/apache/kafka/pull/1267
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
