Guozhang Wang created KAFKA-5151: ------------------------------------ Summary: Refactor TransactionCoordinator in-memory structure and error handling logic Key: KAFKA-5151 URL: https://issues.apache.org/jira/browse/KAFKA-5151 Project: Kafka Issue Type: Sub-task Reporter: Guozhang Wang Assignee: Guozhang Wang
Current status: 1. we are having two types of threads: request handling thread for any client requests as well as controller requests for `immigration` and `emigration`, and the marker sender thread for draining queued marker entries and handle responses. They maintain different in-memory cache structures like the `txnMetadataCache`, and the `pendingTxnMap` which are storing the same info, and they access some of the shared structures concurrently, like the markers queue and the markerPurgatory. 2. we are having one queue per broker today, and due to the emigration purpose we probably are having one queue per brokerId + TxnLogPartitionId + DataPartitionId, which would result in a lot of queues to handle. This ticket is for collapsing some of these structures and simplify the access of them from concurrent threads. -- This message was sent by Atlassian JIRA (v6.3.15#6346)