Re: [GSoC] Status Update

Hi Nadeem, I tested these changes and worked as you describe below. The ability to execute without the I/O nodes should make quick start tutorials easier. Nice work in figuring out the nitty gritty details of XBaya UI. Suresh On Aug 19, 2014, at 5:38 PM, Nadeem Anjum wrote: > Hi Suresh, >

Re: [GSoC] Status Update

Hi Suresh, I have added a new menu for launching applications, restoring the previous functionality of "Run on Interpreter Server" menu option for workflows. I have also made creation of workflows optional for launching single applications i.e. user can just drag drop the application and execute i

RE: GSOC status update

This Friday would be a possibility, if that's convenient. -Original Message- From: Pierce, Marlon Sent: Tuesday, August 19, 2014 8:49 AM To: dev@airavata.apache.org Subject: Re: GSOC status update Thanks, Scott. When is a good time for a meeting/hangout? Marlon On 8/

Re: GSOC status update

Thanks, Scott. When is a good time for a meeting/hangout? Marlon On 8/18/14, 7:03 PM, Scott McCaulay wrote: The code for my meta-scheduler prototype is here: https://github.com/smccaula/airavata-sandbox I'd love to meet in person to provide an overvi

Re: GSOC status update

Hi Scott, I now committed the code to the sandbox and also added a maven build. Can you please also document briefly on the logic of throttling, so it will help understanding how to integrate with airavata? Suresh On Aug 18, 2014, at 7:03 PM, Scott McCaulay wrote: > > The c

GSOC status update

The code for my meta-scheduler prototype is here: https://github.com/smccaula/airavata-sandbox I'd love to meet in person to provide an overview, and open up the discussion of how we can keep this going and incorporate this into Airavata in production.

Re: [GSoC] Status Update

Hi Nadeem, Good job with getting this wrapped into XBaya in a simple way. As I commented on the PR, we need to preserve workflow executions and then add simple applications. Can you please add a new menu to facilitate this? Also, it will be great if we can by pass workflow creation (even if its

[GSoC] Status Update

Hello Devs, I have updated xbaya, so that we can execute a single application through the thrift api. I have created a pull request for the same [1]. I have tested the code with echo application on gw111.iu.xsede.org. Follow the following steps to test: 1. Setup Xbaya Registry. 2. Drag drop an ap

Re: [GSoC] Status Update

I have added a wiki article on GenApp-Airavata Integration [1] , including an architecture diagram Thanks, Nadeem. [1]: https://cwiki.apache.org/confluence/display/AIRAVATA/GenApp On Sun, Aug 10, 2014 at 7:50 PM, Suresh Marru wrote: > Hi Nadeem, > > This is very good. Can you please summarize

[GSoC] Status Update

I am nearly done with the MetaScheduling/Job Throttling prototype. I may be able to add more tomorrow, and will work on comments and documentation. I could demo it in person at the CIB if that's convenient, Tuesday or later. Code is here: https://github.com/sm

Re: [GSoC] Status Update

Hi Nadeem, This is very good. Can you please summarize your progress on a wiki article so we can refer in future? You can reference Emre’s paper http://dl.acm.org/citation.cfm?id=2616560&dl=ACM&coll=DL&CFID=401118053&CFTOKEN=68450637 and draw an architecture diagram on how you extended it to i

[GSoC] Status Update

Hello Devs, I have integrated the Qt3 interface of GenApp with Airavata. The code is available on github [1]. I have updated the readme to include steps for testing qt3 integration. With this, all available genapp interfaces are now integrated with airavata. I have also added a configuration optio

Re: [GSoC] Status Update

As per the update provided by Emre, the java interface of genapp has not been worked on yet. So I will integrate genapp's java interface with airavata in the future when its released, using the java client samples I have written for airavata. Thanks, Nadeem. --- Sen

[GSoC] Status Update

Hello Devs, I have written java cli client samples for Airavata, which can be used for integrating GenApp's java interface (and in general any other application's java interface) with Airavata for job submission. The client samples can be viewed at [1]. I have also created a pull request for the s

[GSoC] Status Update

Hello Devs, I have been playing around with GenApp's C++/Qt4 interface. Since I had not used Qt before, I went through Qt tutorials, understood the internal working of GenApp's C++/Qt4 interface and figured out a method to integrate it with airavata. I have used the airavata c++ client samples [1]

Re: [GSOC] Status update

This is a good solution from Jcloud side to use Futures for monitoring since in EC2 jobs we don't monitor the progress of jobs but we just want to know when the job is done. Good work Nipun ! Regards Lahiru On Tue, Jul 22, 2014 at 10:49 AM, Nipun Udara wrote: > Hi lahiru, > > Thanks for the f

Re: [GSOC] Status update

Hi lahiru, Thanks for the feedback. Each time a job is submited Jclouds return ListenableFuture. we can add a listner to the ListenableFuture which will call the Listener once the job is done. Then the listener will invoke the JcloudsOutHandler or handle according to the jobstate in ExecResponse .

Re: [GSOC] Status update

Hi Nipun, Thanks for the status update, can you bit explain how you have done this ? As part of the final conclusion can you provide an article type of a thing, which describe how to use this feature with airavata with some steps. And Please provide another document which explains developer guide

[GSOC] Status update

Hi all I have added JCloudsMonitor and Monitoringhandler so that job submission to ec2 host can be done asyncrounously. The changes are [1] [1] - https://github.com/nipun123/gfac-jclouds/tree/master/src/main/java/org/apache/airavata/gfac/jclouds/Monitoring Regards Nipun Udara

[GSOC] Status update

Hi all I have added Ec2Credential.java and Ec2CredentialWriter.java to credentialStore. the patch file for the changes to airavata [1]. and change for gfac-jclouds [2] [1] - add_ec2_credentials_to_credential_store.patch [2] - https://github.com/nipun123/gfac-jclouds/blob/master/src/main/java/org/

Re: [GSoC] Status Update

Hello. I have updated the ini file, removed backup files and binaries and created a pull request [1] [1]: https://github.com/apache/airavata/pull/1 Thanks, Nadeem. On Thu, Jul 10, 2014 at 8:23 PM, Suresh Marru wrote: > Hi Nadeem, > > Can you follow these instructions and contribute the chang

Re: [GSoC] Status Update

Hi Nadeem, Can you follow these instructions and contribute the changes: http://airavata.apache.org/community/how-to-contribute-code.html Suresh On Jul 10, 2014, at 12:33 PM, Marlon Pierce wrote: > Great, Nadeem. You should take a look at the PHP config file in > airavata/airavata-api/airav

Re: [GSoC] Status Update

Great, Nadeem. You should take a look at the PHP config file in airavata/airavata-api/airavata-client-sdks/airavata-php-sdk/src/main/resources/conf as the application catalog is no longer running on a separate port. We've also switched to using 9930 as the main port on the test server. A litt

[GSoC] Status Update

Hello Devs, I have written cpp command line client samples for airavata cpp api. These client samples will be used for integration of Airavata with GenApp's C++ Interface (and any other application's C++ interface in general) for job submission to Airavata. The client samples can be viewed at [1]

Re: [GSOC] Status update

Hi Nipun, Can you attach the code patches too to JIRA’s very frequently too? Suresh On Jul 6, 2014, at 12:18 PM, Nipun Udara wrote: > Hi all > > In this week > > I write 2 testcases to validate the ec2 job Submission using new framework > implement monitoring using jclouds cloudwatch > > I

[GSOC] Status update

Hi all In this week I write 2 testcases to validate the ec2 job Submission using new framework implement monitoring using jclouds cloudwatch I am currently working on integration of gfac-jclouds with the credential store Regards Nipun Udara

Re: [GSoC] Status Update

rea...@iu.edu>> wrote: >> OK, thanks. When do you expect a public deployment? >> >> From: Supun Nakandala [mailto:supun.nakand...@gmail.com> supun.nakand...@gmail.com>] >> >> Sent: Wednesday, July 02, 2014 1:14 PM >> To: dev@airavata.apache.org<mailto:

Re: [GSoC] Status Update

@airavata.apache.org Subject: Re: [GSoC] Status Update There is a requirement of incorporating roles and permissions functionality to the user API. Currently I am working on it. But until then if we want we can go for a deployment of the current version of the server and get the PHP Reference Gateway

RE: [GSoC] Status Update

[mailto:supun.nakand...@gmail.com] Sent: Wednesday, July 02, 2014 2:09 PM To: dev@airavata.apache.org Subject: Re: [GSoC] Status Update There is a requirement of incorporating roles and permissions functionality to the user API. Currently I am working on it. But until then if we want we can go for a deployment of

Re: [GSoC] Status Update

:14 PM > *To:* dev@airavata.apache.org > > *Subject:* Re: [GSoC] Status Update > > > > Hi Dave, > > > > You cannot use the API because it is not deployed publicly yet. You can > get the code from [1] and run the server locally and test the API. I have > not yet adde

RE: [GSoC] Status Update

OK, thanks. When do you expect a public deployment? From: Supun Nakandala [mailto:supun.nakand...@gmail.com] Sent: Wednesday, July 02, 2014 1:14 PM To: dev@airavata.apache.org Subject: Re: [GSoC] Status Update Hi Dave, You cannot use the API because it is not deployed publicly yet. You can get

Re: [GSoC] Status Update

being passed an > empty array as input. What should the values in that input array be, and > where should they be defined in a config file somewhere? > > > > > > Thanks, > > Dave > > > > > > > > *From:* Amila Jayasekara [mailto:thejaka.am...@gmail.c

RE: [GSoC] Status Update

? Thanks, Dave From: Amila Jayasekara [mailto:thejaka.am...@gmail.com] Sent: Monday, June 30, 2014 3:38 AM To: dev Subject: Re: [GSoC] Status Update Hi Supun, Very good progress. Please see some inline comments. On Sun, Jun 29, 2014 at 2:01 PM, Supun Nakandala mailto:supun.nakand...@gmail.com

Re: [GSoC] Status Update

Hi Supun, Very good progress. Please see some inline comments. On Sun, Jun 29, 2014 at 2:01 PM, Supun Nakandala wrote: > Hi all, > > Based on the feedback received I extended the proxy user API. The thrift > descriptors can be found at [1]. Also I incorporated the proxy API with PHP > Referenc

[GSoC] Status Update

Hi All, I have created a service for automatic registration of all GenApp modules on Airavata. This registration will work for all genapp language interfaces, including php, c++ and more to come in the future. The registration service needs to be called only once, preferably after running genapp.p

[GSOC] Status update

Hi all this is the git repo of gfac-jclouds [1] [1]- http://github.com/nipun123/gfac-jclouds Regards Nipun Udara

Re: [GSoC] Status Update

rs who are using the gateway. > > What do you think? + 1. I was in the middle of typing the same reply. I think the notion of user roles and the API to query for them seems to be a good way to handle these use cases. Suresh > > > Dave > > > > From: Supun Nak

Re: [GSoC] Status Update

the gateway and use different roles such gateway_admin, privileged_user, restricted_user for all other users who are using the gateway. What do you think? > > > Dave > > > > *From:* Supun Nakandala [mailto:supun.nakand...@gmail.com] > *Sent:* Friday, June 20, 2014 1:20

RE: [GSoC] Status Update

: [GSoC] Status Update Hi Dave, I was planning to have a separate tenant for each gateway. For example PHP-Reference-Gateway has a separate tenant in the WSO2 IS. Each of these have a tenant admin (can have more than one). And gateways has to use the tenant admin credentials to use the UserAPI

Re: [GSoC] Status Update

ind a user a person is? > > > > Thanks, > > Dave > > > > *From:* Amila Jayasekara [mailto:thejaka.am...@gmail.com] > *Sent:* Friday, June 20, 2014 9:31 AM > *To:* dev > *Subject:* Re: [GSoC] Status Update > > > > Nice ! > > > > Thanks > > A

RE: [GSoC] Status Update

[mailto:thejaka.am...@gmail.com] Sent: Friday, June 20, 2014 9:31 AM To: dev Subject: Re: [GSoC] Status Update Nice ! Thanks Amila On Fri, Jun 20, 2014 at 7:16 AM, Supun Nakandala mailto:supun.nakand...@gmail.com>> wrote: Hi All, I have added some php client sample code to the repository [1]. Tha

Re: [GSoC] Status Update

Nice ! Thanks Amila On Fri, Jun 20, 2014 at 7:16 AM, Supun Nakandala wrote: > Hi All, > > I have added some php client sample code to the repository [1]. > > Thank you > Supun > > [1] - > https://github.com/scnakandala/airavata-userapi/tree/master/clients/php-client > > > On Wed, Jun 18, 2014

Re: [GSoC] Status Update

Hi All, I have added some php client sample code to the repository [1]. Thank you Supun [1] - https://github.com/scnakandala/airavata-userapi/tree/master/clients/php-client On Wed, Jun 18, 2014 at 10:05 PM, Supun Nakandala wrote: > Hi All, > > During the last week I drafted a basic user api

Re: [GSoC] Status Update

Thanks Nadeem. I will look at your patch code. On Wed, Jun 18, 2014 at 12:26 PM, Nadeem Anjum wrote: > I have submitted a patch for the changes made to airavata codebase, which > can be seen in the related issue [1] > > The base.php file of the GenApp codebase can be viewed at [2]. I wil > subm

[GSoC] Status Update

Hi All, During the last week I drafted a basic user api description for Airavata user management. You can find the thrift descriptor files at [1]. I have also implemented the server side code and hosted in the same github repository. I did not tried to come up with a complete list of user manageme

Re: [GSoC] Status Update

I have submitted a patch for the changes made to airavata codebase, which can be seen in the related issue [1] The base.php file of the GenApp codebase can be viewed at [2]. I wil submit a patch for genapp codebase when I have added a configuration option which enables one to or not to use airavat

Re: [GSoC] Status Update

Hi Nadeem-- Preferably there is a Jira task describing this. If you are ready to submit a patch, you should create one (see recent email about how to do that with git) and upload to the associated Jira. This is what we would prefer. If you are not ready to submit a patch but you want peopl

Re: [GSoC] Status Update

Code we can't see doesn't exist. Marlon On 6/18/14, 7:43 AM, Saminda Wijeratne wrote: Good work Nadeem. Is there any place that I can see your code? On Wed, Jun 18, 2014 at 5:34 AM, Nadeem Anjum wrote: Hello All, I have been able to successfully extend genapp codebase for job submission t

Re: [GSoC] Status Update

Good work Nadeem. Is there any place that I can see your code? On Wed, Jun 18, 2014 at 5:34 AM, Nadeem Anjum wrote: > Hello All, > > I have been able to successfully extend genapp codebase for job submission > to airavata. > > For application registration, I have added a function createCustomDo

[GSoC] Status Update

Hello All, I have been able to successfully extend genapp codebase for job submission to airavata. For application registration, I have added a function createCustomDocs in DocumentCreator.java file of Airavata [1] which allows one to register any required application with the required configurat

Re: [GSOC] Status update

Hi Supun, Amila, I started a hangout on air for the demo starting in 10 mins - https://plus.google.com/hangouts/_/hoaevent/AP36tYc256HUgu1kp2P_tAz5Zs2_Ku7eKzPEduKX-T1lB_v5Rqjb_w?authuser=0&hl=en Suresh On Jun 16, 2014, at 9:17 AM, Supun Nakandala wrote: > Hi Suresh, > I will be available at t

Re: [GSOC] Status update

+1, keeping code on your laptop and not using an online code repo like GitHub is a terrible practice. More generally, you should be submitting patches to Airavata with your work as it moves along. We do not want 1 big patch at the end of the GSOC. Break your project up into ~2 week chunks an

Re: [GSOC] Status update

Never keep code in your laptop, if your laptop crash at last minute you will fail the GSOC project. On Mon, Jun 16, 2014 at 2:09 PM, Nipun Udara wrote: > Hi lahiru > > Thanks for the advice. still in my machine.i will keep it on git hub and > send a mail > > Regards > Nipun > > > On Mon, Jun 16

Re: [GSOC] Status update

Hi lahiru Thanks for the advice. still in my machine.i will keep it on git hub and send a mail Regards Nipun On Mon, Jun 16, 2014 at 11:17 PM, Lahiru Gunathilake wrote: > Hi Nipun, > > Thanks for the update and I can see a progress in your work. > Where are you keeping the code ? I suggest yo

Re: [GSOC] Status update

Hi Nipun, Thanks for the update and I can see a progress in your work. Where are you keeping the code ? I suggest you to keep it in your own git hub and please write some readme how to setup your handlers in airavata or atleast how to test your code by running a test case and send an email to the

[GSOC] Status update

Hi all So far i have write handlers and provider to run jobs on ec2 with string type and S3type input and looking to add URI type Regards Nipun Udara

Re: [GSOC] Status update

Hi Suresh, I will be available at that time On Mon, Jun 16, 2014 at 6:28 PM, Suresh Marru wrote: > Hi Supun, Amila, > > How is tomorrow (Tuesday 06/17) 11 am eastern 8.30pm srilankan time work > for a google hangout? > > Suresh > > On Jun 15, 2014, at 2:19 PM, Amila Jayasekara > wrote: > > > M

Re: [GSOC] Status update

Hi Supun, Amila, How is tomorrow (Tuesday 06/17) 11 am eastern 8.30pm srilankan time work for a google hangout? Suresh On Jun 15, 2014, at 2:19 PM, Amila Jayasekara wrote: > Marlon/Suresh, > > Could you please schedule a time for the demo ? I will be mostly available > except Wednesdays and

Re: [GSOC] Status update

Marlon/Suresh, Could you please schedule a time for the demo ? I will be mostly available except Wednesdays and Thursdays. Thanks Amila On Sun, Jun 15, 2014 at 12:59 PM, Supun Nakandala wrote: > Yes Amila. What time is convenient for you? > > > On Sun, Jun 15, 2014 at 10:27 PM, Amila Jayaseka

Re: [GSOC] Status update

Yes Amila. What time is convenient for you? On Sun, Jun 15, 2014 at 10:27 PM, Amila Jayasekara wrote: > > > > On Fri, Jun 13, 2014 at 8:47 AM, Marlon Pierce wrote: > >> Thanks, Supun. We may need your additional help with the WS02 identity >> server as well. More on that later. >> >> Marlon

Re: [GSOC] Status update

On Fri, Jun 13, 2014 at 8:47 AM, Marlon Pierce wrote: > Thanks, Supun. We may need your additional help with the WS02 identity > server as well. More on that later. > > Marlon > > On 6/13/14, 12:49 AM, Supun Nakandala wrote: > > Hi All, > > > > So far I have incorporated a php client library to

Re: [GSOC] Status update

Thanks, Supun. We may need your additional help with the WS02 identity server as well. More on that later. Marlon On 6/13/14, 12:49 AM, Supun Nakandala wrote: > Hi All, > > So far I have incorporated a php client library to WSO2 IS in > PHP-Reference-Gateway to do the basic user management func

Re: [GSoC] Status Update

Nadeem Anjum wrote: Hello Everyone, I have almost been able to complete the implementation to enable GenApp submit jobs to Airavata, while assuming that the modules are already registered (i.e. by doing the registration manually). I am currently stuck at an issue (hence "almost") related to p

[GSoC] Status Update

Hello Everyone, I have almost been able to complete the implementation to enable GenApp submit jobs to Airavata, while assuming that the modules are already registered (i.e. by doing the registration manually). I am currently stuck at an issue (hence "almost") related to passing json input to the

[GSoC] Status Update

Hi all, I'm currently working on the Application Catalog and I sent a designed ER diagram to the dev list. There was a issue on how we are going to tackle the current workflow approach to match the new Application catalog design. For now I've decided to keep the discussion on that going and I'm c

[GSOC] Status update

Hi All, So far I have incorporated a php client library to WSO2 IS in PHP-Reference-Gateway to do the basic user management functionalities. My Next goal is to implement a Thrift based proxy API for Airavata to do the basic user management tasks. Currently I am in the process of defining the thri

RE: [GSoC] Status Update and Queries

com] Sent: Thursday, May 29, 2014 6:15 PM To: dev@airavata.apache.org Subject: Re: [GSoC] Status Update and Queries Thanks David. Additionally, could you tell me where does one specify the experiment which is to be run? Thanks, Nadeem. On Fri, May 30, 2014 at 3:24 AM, Reagan, David Michael mai

[GSOC] Status update from Nipun Udara

In the previous week i have done fallowing write testcases for input handler and output handler write Keypair builder this will generate new ssh keypair update initializeCloudEnvironment method to run a post boot script to install s3-cmd tool so that remote host can do filetransfer with s3 imp

Re: [GSoC] Status Update and Queries

> *From:* Nadeem Anjum [nadeem.cs@gmail.com] > *Sent:* Wednesday, May 28, 2014 8:06 AM > *To:* dev@airavata.apache.org > *Subject:* [GSoC] Status Update and Queries > > Hi Everyone, > > I am currently working on integrating GenApp's PHP interface with > A

RE: [GSoC] Status Update and Queries

jum [nadeem.cs@gmail.com] Sent: Wednesday, May 28, 2014 8:06 AM To: dev@airavata.apache.org Subject: [GSoC] Status Update and Queries Hi Everyone, I am currently working on integrating GenApp's PHP interface with Airavata Starus: I have explored and played around with GenApp codebase. I

[GSoC] Status Update and Queries

Hi Everyone, I am currently working on integrating GenApp's PHP interface with Airavata *Starus:* I have explored and played around with GenApp codebase. I have identified the parts of the code that needs to be executed on Airavata. To start with integrating the PHP interface of GenApp, I have ex

Re: [GSOC] Status update from Nipun Udara

hi lahiru and marlon thank you for the comments. I will look into test GFAC plugin tutorial and create a jira with the sub task list. regards On Tue, May 27, 2014 at 6:46 PM, Marlon Pierce wrote: > Why would starting the server on Ubuntu be a problem? > > Nipun, when you have these problems,

Re: [GSOC] Status update from Nipun Udara

Why would starting the server on Ubuntu be a problem? Nipun, when you have these problems, please contact the dev list and complain. Lahiru is your primary GSOC mentor but you need to get into the habit of engaging the entire Airavata developer community, so please direct most communications to

Re: [GSOC] Status update from Nipun Udara

Hi Marlon, I think he did test but since he is running ubuntu on a vm and he is getting some error and he cannot even start the server. Regards Lahiru On Tue, May 27, 2014 at 9:04 AM, Marlon Pierce wrote: > Also, your help testing the GFAC plugin tutorial would be good. We need > to move that

Re: [GSOC] Status update from Nipun Udara

Also, your help testing the GFAC plugin tutorial would be good. We need to move that to the Apache wiki. Marlon On 5/27/14 9:01 AM, Lahiru Gunathilake wrote: > Hi Nipun, > > Thank You for the status update. Can you please create a big jira (epic) > and add sub tasks to that jira and update each t

Re: [GSOC] Status update from Nipun Udara

Hi Nipun, Thank You for the status update. Can you please create a big jira (epic) and add sub tasks to that jira and update each task. When you send the next email please add those jira numbers (sub tasks) in the email. Please number your status update emails too. Please make sure you write test

[GSOC] Status update from Nipun Udara

Hi all Within this week i have implement fallowing JCloudProvider initEnvironment method this method will validate and check whether the instance is running if not start a new instance writeInputData method in InHandler this method will put the inputfiles to the storage prior to t

[GSOC] - Status update from Nipun Udara

Hi all I have created GridPushMonitorHandler and attached the patch file for the changes with the jira [1]. [1] - https://issues.apache.org/jira/browse/AIRAVATA-1265 Regards Nipun Udara

[GSOC] - Status update from Nipun Udara

Hi all, I have separated gfac LocalProvider implementation and related dependencies into gfac-local module and HadoopProvider related implementation and related dependencies into gfac-hadoop module out of gfac-core. I have attached the patch file for the changes with the jira [1]. I am planning t