Chesnay Schepler created FLINK-13245:
----------------------------------------
Summary: Network stack is leaking files
Key: FLINK-13245
URL: https://issues.apache.org/jira/browse/FLINK-13245
Project: Flink
Issue Type: Bug
Components: Runtime / Network
Affects Versions: 1.9.0
Reporter: Chesnay Schepler
Assignee: Chesnay Schepler
Fix For: 1.9.0
There's file leak in the network stack / shuffle service.
When running the {{SlotCountExceedingParallelismTest}} on Windows a large
number of {{.channel}} files continue to reside in a
{{flink-netty-shuffle-XXX}} directory.
>From what I've gathered so far these files are still being used by a
>{{BoundedBlockingSubpartition}}. The cleanup logic in this class uses
>ref-counting to ensure we don't release data while a reader is still present.
>However, at the end of the job this count has not reached 0, and thus nothing
>is being released.
The same issue is also present on the {{ResultPartition}} level; the
{{ReleaseOnConsumptionResultPartition}} also are being released while the
ref-count is greater than 0.
Overall it appears like there's some issue with the notifications for
partitions being consumed.
It is feasible that this issue has recently caused issues on Travis where the
build were failing due to a lack of disk space.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
