Swapnil Ghike created KAFKA-515: ----------------------------------- Summary: Log cleanup can close a file channel opnened by Log.read before the transfer completes Key: KAFKA-515 URL: https://issues.apache.org/jira/browse/KAFKA-515 Project: Kafka Issue Type: Bug Affects Versions: 0.8 Reporter: Swapnil Ghike Fix For: 0.8
If consumers are lagging behind, then log cleanup activities can close a file channel opened by Log.read 1. before the transfer the starts (broker will probably throw an exception in this case) OR 2. during the transfer (possibility of half baked corrupted data being sent to consumer?) We probably haven't hit this race condition in practice because the consumers consume data well before the logs are cleaned up. To avoid this issue, we could avoid cleaning up the file until the transfer is complete. Reference counting? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira