dlmarion commented on PR #3801: URL: https://github.com/apache/accumulo/pull/3801#issuecomment-1743468002
There is still more work to be done here, but wanted to get some feedback on: 1. The Thrift messaging / RPC changes 2. The changes to Compactor (which needs to be renamed to TaskWorker) around the TASK_RUNNER_WORKER_TYPE property. The basic gist of the design here is: 1. A TaskWorker process (currently known as Compactor) is started with the property TASK_RUNNER_WORKER_TYPE, which has values COMPACTION, LOG_SORTING, SPLIT_POINT_CALCULATION. That instance of the TaskWorker only perform jobs of the configured type. 2. The TaskWorker gets the next job from the TaskManager (currently known as the CompactionCoordinator) by making a call via the Tasks Thrift API to the Manager. 3. The TaskManager returns the next highest priority task of the given type (COMPACTION, LOG_SORTING, SPLIT_CALCULATION). 4. The TaskWorker executes the Task and reports status back the TaskManager. If I had to guess, I'm probably about 80-85% done at this point. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@accumulo.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
