Hi folks, I have implemented the support to Async Job Submission with the callback workflows on top of the proposed task execution framework. This supports to both Async Job Submission in remote compute resources using Agents and event driven job monitoring. Using this approach, I'm going to address following issues that we are facing today
1. Resolve fault DoS attack detection in compute resources when doing multiple ssh command executions in a short period of time. 2. Optimize resource utilization and robustness of Airavata Task Execution Framework when executing long running jobs Design and implementation details can be found from [1]. Sources for the main components can be found from [2], [3], [4] Please share your comments and suggestions [1] https://docs.google.com/document/d/1DIjrkjxZZWo9XiwkKWq9WZiOX-uRD5WO-eB6TLxagAg/edit?usp=sharing [2] https://github.com/DImuthuUpe/airavata-sandbox/tree/master/airavata-kubernetes/modules/microservices/async-event-listener [3] https://github.com/DImuthuUpe/airavata-sandbox/tree/master/airavata-kubernetes/modules/microservices/tasks/async-command-monitor [4] https://github.com/DImuthuUpe/airavata-sandbox/tree/master/airavata-kubernetes/modules/microservices/tasks/async-command-task Thanks Dimuthu
