Hi Dimuthu and Suresh, Thanks for getting back to us. We went ahead and made a work in progress pull request<https://github.com/apache/airavata/pull/263> for our changes we have created so far. We also took a look at the job-monitor section and will work towards creating additions to support HTCondor.
Do any of you have any suggestions on what the best way is to test submissions to HTCondor? We looked into using the Airavata API and the Django portal and are curious what you would recommend, and how to do it using your recommendation. Thanks! - Daniel Shchur From: DImuthu Upeksha<mailto:[email protected]> Sent: Friday, October 2, 2020 5:22 PM To: Airavata Dev<mailto:[email protected]> Cc: [email protected]<mailto:[email protected]>; Evan Palmer<mailto:[email protected]> Subject: Re: HTCondor Extension Help Hi Daniel, This is great progress. I think you are on the right track. Did you manage to set up the ide integration for the development of Airavata. If you have already done that, you can test these features. However I recommend you to send pull requests to a separate branch (htcondor?) and then I can provide you feedback on the next steps. Thanks Dimuthu On Thu, Oct 1, 2020 at 4:57 PM Suresh Marru <[email protected]<mailto:[email protected]>> wrote: Hi Daniel, Thanks for this nice summary for keeping the dev list apprised of your progress. One additional item is to discuss and plan on job monitoring approaches, you can look at current references here - https://github.com/apache/airavata/tree/master/modules/job-monitor<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_airavata_tree_master_modules_job-2Dmonitor&d=DwMFaQ&c=Cu5g146wZdoqVuKpTNsYHeFX_rg6kWhlkLF8Eft-wwo&r=SfMtyOx08LDuEVnPLH5bLf0tBX7T0FnnGw0oDSWu8Es&m=lmrRGQ0q0u8q8eCyoDDHtDCxKniLMvrktlVw7qnV3Fo&s=zpJDdIRgv9hm0QkGZuHhDOYvc1_zMhUmH9TF7mx9A-0&e=> Suresh On Oct 1, 2020, at 4:52 PM, Daniel Shchur <[email protected]<mailto:[email protected]>> wrote: Hi all, We are working on the HTCondor extension for Airavata. We have gone through the code and started to implement additions based on the other job workflow systems such as SLURM. We forked<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_docquantum_airavata_tree_htcondor&d=DwMFaQ&c=Cu5g146wZdoqVuKpTNsYHeFX_rg6kWhlkLF8Eft-wwo&r=SfMtyOx08LDuEVnPLH5bLf0tBX7T0FnnGw0oDSWu8Es&m=lmrRGQ0q0u8q8eCyoDDHtDCxKniLMvrktlVw7qnV3Fo&s=14ShokmbcQHBZlmV67fTrNoK8ARktUQERu6wRQQTlWc&e=> the project and created a new branch (htcondor) to host our changes. We will make a pull request into the main Airavata repository for it once we have finished the implementation. A relevant issue has also been created here<https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_AIRAVATA-2D3377&d=DwMFaQ&c=Cu5g146wZdoqVuKpTNsYHeFX_rg6kWhlkLF8Eft-wwo&r=SfMtyOx08LDuEVnPLH5bLf0tBX7T0FnnGw0oDSWu8Es&m=lmrRGQ0q0u8q8eCyoDDHtDCxKniLMvrktlVw7qnV3Fo&s=ZjE4skBTqEHdJqLBat2-uLoS1w6_Ksh_c5d4VPKjnS8&e=>. We would like help to know exactly where additions need to be made in case we missed a few spots. At this point, we know that: * A groovy template needs to be made (finished) * A job configuration class needs to be made (WIP) * A job parser class needs to be made (WIP) * And enums need to be modified throughout the project so that systems know of HTCondor as an option. (finished) If any of you could direct us to the right places, that would be greatly appreciated. Also, if there’s more documentation or information about the code, such as how the command map should work or should be implemented (configuration class?), that would be appreciated. Thank you! - Daniel Shchur
