Yuukadesu commented on PR #3795: URL: https://github.com/apache/streampipes/pull/3795#issuecomment-3455174775
This PR already achieve this discussion https://github.com/apache/streampipes/discussions/2552. In this PR,I add LoadBalancer to do load balance for StreamPipes. Specifically: Firstly, the pipeline was segmented, and then three allocation algorithms were used: weighted random algorithm, minimum resource allocation rate algorithm, and weight first allocation algorithm to achieve pipeline allocation. After allocation, various separation algorithms such as threshold migration, overload migration, and unified load migration will be used to perform pipeline separation and migration operations during program runtime, ensuring load balancing for all extended services. In addition, I added metrics to monitor the load balancer, which allows me to observe the number of adapters and pipelines for each service, as well as the time taken for each migration operation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
