Raghu Angadi created BEAM-3689: ---------------------------------- Summary: Direct runner leak a reader for every 10 input records Key: BEAM-3689 URL: https://issues.apache.org/jira/browse/BEAM-3689 Project: Beam Issue Type: Improvement Components: runner-direct Reporter: Raghu Angadi Assignee: Thomas Groh
Direct runner reads 10 records at a time from a reader. I think the intention is to reuse the reader, but it reuses only if the reader is idle initially, not when the source has messages available. When I was testing KafkaIO with direct runner it kept opening new reader for every 10 records and soon ran out of file descriptors. -- This message was sent by Atlassian JIRA (v7.6.3#76005)