Dear All,


I wanted to update on my mid-term report of Google Summer of Code with
Airavata-Apache.



*Original Proposal Summary*:



Apache Airavata MFT is a distributed high-performance, multi-protocol data
transfer engine to orchestrate data movement and operations across most
cloud and on-premises storages. Agent is the core of this distributed
system which does the heavy lifting of transfer jobs. Right now, agents
have to be manually deployed and configured to start the transfer. This is
a problem for researchers and people who need to transfer data without
having much technical skills or time. The proposed solution is to automate
the process of deploying and lifecycle management of the agents when a
transfer job is submitted from an edge machine.



Upon requirements evaluation, along with my mentor I came up with an
updated proposal including the cybershuttle agent to MFT agent.



*Updated Proposal Summary*:



Updated proposal includes creating a desktop application and cybershuttle
server to communicate with each other. Next step is to guide cybershuttle
agent and MFT agent from cybershuttle server to perform execution of jobs
and data transfer, this would also maintain the lifecycle of cybershuttle
agent and mft agents.



*Progress made till now*:



I have explored and finalized on the desktop tech stack as electronJS,
Vuejs, grpc protocol. Development of desktop application and cybershuttle
backend is done along with unit testing. Which concludes the important UI
phase of the project. I have finalized the architecture for cybershuttle
agent which will be using nomad and consul. Implementation of cybershuttle
agent is in progress.



*Pull requests made till now*:



Desktop application –

·      Electron vue setup:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/1

·      gRPC added:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/2

·      gRPC-web update:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/3

·      Login/signup:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/4

·      Persistent storage and dynamic navbar:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/5

·      Cybershuttle services:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/6

·       App items views:
https://github.com/cyber-shuttle/cybershuttle-agent/pull/7



Cybershuttle app server:

·      Appserver setup:
https://github.com/cyber-shuttle/cybershuttle-server/pull/1

·      Login/signup backend:
https://github.com/cyber-shuttle/cybershuttle-server/pull/2

·      Cybershuttle services backend:
https://github.com/cyber-shuttle/cybershuttle-server/pull/3





*Plans going forward*:

·      Develop cybershuttle orchestration agent using nomad

·      Setup consul as the message broker between cybershuttle server and
orchestration agent in local

·      Deploy cybershuttle agent and mft agent along with cybershuttle
application

·      Unit test and integration testing of the whole software



Thank you for your continuous support in the whole process and I truly
enjoy building groundbreaking solutions with the team.



Best Regards,

Praneeth Chityala

Reply via email to