[ https://issues.apache.org/jira/browse/BEAM-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amit Sela resolved BEAM-1392. ----------------------------- Resolution: Fixed Fix Version/s: 0.6.0 > DoFn teardown not called on empty partitions > -------------------------------------------- > > Key: BEAM-1392 > URL: https://issues.apache.org/jira/browse/BEAM-1392 > Project: Beam > Issue Type: Bug > Components: runner-spark > Reporter: Aviem Zur > Assignee: Aviem Zur > Fix For: 0.6.0 > > > DoFn teardown is not called on empty partitions. > Discovered in a long running Kafka pipeline (read from Kafka -> write to > Kafka) where some partitions did not have data and Kafka producers where > being created but not closed, eventually resulting in {{Too many open files}} > exception. -- This message was sent by Atlassian JIRA (v6.3.15#6346)