Dimuthu Upeksha created AIRAVATA-3000: -----------------------------------------
Summary: [GSoC] Refactor parser framework into a generic workflow framework Key: AIRAVATA-3000 URL: https://issues.apache.org/jira/browse/AIRAVATA-3000 Project: Airavata Issue Type: New Feature Reporter: Dimuthu Upeksha This an extension of the work we have done in GSoC 2018. Yasas has worked on developing a workflow framework for Airavata and his mail list discussions and medium post can be found from [1] [2]. Based on his research and the another GSoC project which was done in integrating a parser framework for Airavata, we have developed a new parser framework [3] [4] [5] [6] which utilized Apache Helix task framework [7] as the task execution engine. Even though this framework was specifically developed for parsers, we feel that this implementation shares a lot of common features of the workflow design which Yasas has worked on. So in this project we need to generalize parser framework into a generic workflow framework where we can create and launch workflows with any application registered in Airavata Student should be good at Java and distributed system concepts Key Expectations # Refactor/ improve parser data models into workflow data models # Refactor/ improve parser tables into workflow database tables # Implement new helix tasks to support workflow operations mentioned in [2] # Refactor/ improve parser API into a workflow level API [5] # Demonstrate that we can still preserve parser workflows in newly created generic workflow engine (This will be final demo). [1] [https://medium.com/@yasgun/gsoc-2018-with-apache-airavata-user-defined-airavata-workflows-39f0e79234ee] [2] [http://mail-archives.apache.org/mod_mbox/airavata-dev/201806.mbox/browser] [3] [https://github.com/apache/airavata/tree/develop/modules/airavata-helix/helix-spectator/src/main/java/org/apache/airavata/helix/impl/task/parsing] [4] [https://github.com/apache/airavata/blob/develop/modules/airavata-helix/helix-spectator/src/main/java/org/apache/airavata/helix/impl/workflow/ParserWorkflowManager.java] [5] [https://github.com/apache/airavata/blob/develop/thrift-interface-descriptions/airavata-apis/airavata_api.thrift#L3505] [6] https://github.com/apache/airavata/blob/develop/thrift-interface-descriptions/data-models/app-catalog-models/parser_model.thrift [7] [https://helix.apache.org/0.8.4-docs/tutorial_task_framework.html] -- This message was sent by Atlassian JIRA (v7.6.3#76005)