keith-turner commented on PR #3262: URL: https://github.com/apache/accumulo/pull/3262#issuecomment-1828943330
Was anything done re upgrade in this PR? If not I think we need to open a follow in issue for that. This would be a follow on issue, thinking we an distribute the compaction coordinator by having it hash parition queue names. among manager processes. TGW could make an RPC to add a job to a remote queue. Compaction coordinators could hash the name to find the manager process to ask for work. In this PR it seems like the TGW is adding compaction jobs to a local queue in the process. What do compactors do to find jobs? We may need to make the EventCoordinator use the same partitioning as the TGW and send events to other manager processes via a new async RPC. Need to analyze the EventCoordinator, may make sense to pull it in to the TGW conceptually. Every manager uses it local TGW instance to signal events and internally the TGW code knows how to route that in the cluster to other TGW instances. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
